01/05/2026
Expert item review is a valuable part of instrument development, particularly in examining face validity and content validity. It helps determine whether items are clear, relevant, representative, and aligned with the intended construct. However, validation should not end with a simple Retain, Remove, Revise checklist.
The concept of construct validity, formally developed by Cronbach and Meehl in the mid-1950s, was built on the premise that psychological constructs cannot be validated through item review alone. In psychological assessment, validity refers to the degree to which evidence and theory support the intended interpretation and use of test scores for a specific purpose, population, and context.
A sound validation process draws from multiple sources of evidence, including test content, response processes, internal structure, relationships with other variables, and the consequences of test use. Ultimately, the goal is not only to refine individual items, but to build a coherent validity argument that supports the meaningful and appropriate use of test scores. This is especially critical when instruments are used for high-stakes decisions, where weak validity evidence is not just a psychometric concern, but an ethical one.
