Measuring the Mind: Conceptual Issues in Contemporary Psychometrics is a book by Dutch academic Denny Borsboom. The book discusses the extent to which psychology can measure mental attributes such as intelligence and examines the philosophical issues that arise from such attempts.
The book examines three major models within psychometrics; classical test theory/true scores, latent variables/item response theory and representational measurement theory. Each theory is examined against three perspectives or “stances”:
The book also examines the relationship between the three models and finally ends with a discussion on the concept of validity.
Classical test theory was either one of the best ideas in twentieth-century psychology, or one of the worst mistakes. The theory is mathematically elegant and conceptually simple, and in terms of its acceptance by psychologists, it is a psychometric success story. However, as is typical of popular statistical procedures, classical test theory is prone to misinterpretation. One reason for this is the terminology used: if a competition for the misnomer of the century existed, the term 'true score' would be a serious contestant. The infelicitous use of the adjective 'true' invites the mistaken idea that the true score on a test must somehow be identical to the 'real','valid', or 'construct' score. This cahpetr has hopefully proved the inadequacy of this view beyond reasonable doubt.
If the ability to construct a homomorphic representation were to be a necessary condition for measurement, this entails that we should be able to gather data that fit the measurement model perfectly. This is because, strictly speaking, models like the conjoint model are refuted by a single violation of the axioms...Since we can safely assume that we will not succeed in error-free data – certainly not in psychology – we must choose two conclusions: either measurement is impossible, or it is not necessary to create a perfect homomorphic representation. If we accept the former, we may just as well stop the discussion right now. If we accept the latter, then we have to invent a way to deal with error.
"The six chapters of the book reflect an impressive interplay between philosophy of science, measurement, and mathematics. Consequently, readers who enjoy probing the why behind how we think about true scores, latent variables, scales, relations between models, and ultimately validity will, I think, relish the contents of the book."
"Overall, this is a well-written and well-argued book and theoretically minded psychometricians will find it of interest. While reading the book, I often found myself arguing with the author and, at the end I came away with more questions than answers. For me, these are the hallmarks of a good book."
"Psychometrics is an important sub-discipline. It not only sustains a significant psycho-technology, it also leads social science on its Pythagorean quest. It is therefore strange that, unlike behaviourism or psychoanalysis, it has eluded critical, conceptual scrutiny. Perhaps its foundations seemed secure. This book scuttles that illusion and deftly exposes its soft underbelly."