Hilbert, Sven and Pargent, Florian and Kraus, Elisabeth and Naumann, Felix and Eichhorn, Kathryn and Ungar, Patrizia and Buehner, Markus (2020) What's the measure? An empirical investigation of self-ratings on response scales. INTERNATIONAL JOURNAL OF SOCIAL RESEARCH METHODOLOGY. ISSN 1364-5579, 1464-5300
Full text not available from this repository. (Request a copy)Abstract
Two studies were conducted to investigate how self-ratings on questionnaire items reflect the underlying real-scores. Participants gave numerical information about personal attributes (the real-scores), such as age, height, and weight, and subsequently rated themselves regarding these attributes. In Study 1, they rated themselves on a five-point Likert-type scale from three different perspectives, a personal, a general, and an outsiders', inducing three different frames of reference. By regressing these ratings on the real-scores, it was shown that information about means of and differences between the real-scores were not readily reflected by the response scales. The outsiders' perspective resulted in the most adequate representation of the real-score differences, indicated by the intervals between the categories estimated by the ordinal regression models. In Study 2, neutral item wording with a five-point Likert-type scale and a four-point Likert-type scale was used to rule out the effect of positive wording. This increased the adequacy of the representations just slightly. The findings indicate that, even on average, the investigated rating scales and items reflect the numeric real-scores only limitedly and that self-ratings depend on the item phrasing instead of simply representing a coarse measure of the real-scores. All data and analysis scripts are available at .
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | INCREMENTAL VALIDITY; FRAME; SCORES; DISSATISFACTION; MODEL; Response format; level of measurement; scale; psychometrics; validity |
| Subjects: | 100 Philosophy & psychology > 150 Psychology 300 Social sciences > 360 Social services; association |
| Divisions: | Human Sciences > Institut für Bildungswissenschaft > Professur für Methoden der empirischen Bildungsforschung - Prof. Dr. Sven Hilbert |
| Depositing User: | Petra Gürster |
| Date Deposited: | 21 Apr 2021 09:10 |
| Last Modified: | 21 Apr 2021 09:10 |
| URI: | https://pred.uni-regensburg.de/id/eprint/43320 |
Actions (login required)
 |
View Item |
