Pargent, Florian and Hilbert, Sven and Eichhorn, Kathryn and Buehner, Markus (2019) Can't Make it Better nor Worse An Empirical Study About the Effectiveness of General Rules of Item Construction on Psychometric Properties. EUROPEAN JOURNAL OF PSYCHOLOGICAL ASSESSMENT, 35 (6). pp. 891-899. ISSN 1015-5759, 2151-2426
Full text not available from this repository. (Request a copy)Abstract
Some of the most popular psychological questionnaires violate general rules of item construction: precise, positively keyed items without negations, multiple aspects of content, absolute statements, or vague quantifiers. To investigate if following these rules results in more desirable psychometric properties, 1,733 participants completed online either the original NEO Five-Factor Inventory, an "improved" version whose items follow the rules of item construction, or a "deteriorated" version whose items strongly violate these rules. We compared reliability estimates, item-total correlations, Confirmatory Factor Analysis (CFA) model fit, and fit to the partial credit model between the three versions. Neither of the manipulations resulted in considerable or consistent effects on any of the psychometric indices. Our results question the ability of standard analyses in test construction to distinguish good items from bad ones, as well as the effectiveness of general rules of item construction. To increase the reproducibility of psychological science, more focus should be laid on improving psychological measures.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | FIT INDEXES; PERSONALITY; MODEL; QUESTIONS; VALIDITY; SCALE; ALPHA; psychometrics; item wording; psychological measurement; Five-Factor Model of personality; replication crisis |
| Subjects: | 300 Social sciences > 370 Education |
| Divisions: | Psychology and Pedagogy > Institut für Pädagogik |
| Depositing User: | Dr. Gernot Deinzer |
| Date Deposited: | 24 Mar 2020 13:15 |
| Last Modified: | 24 Mar 2020 13:15 |
| URI: | https://pred.uni-regensburg.de/id/eprint/25896 |
Actions (login required)
 |
View Item |
