Strong Words or Moderate Words: A Comparison of the Reliability and Validity of Responses on Attitude Scales
- 1
- 2
Abstract
A common assumption in attitude measurement is that items should be composed of strongly worded statements. The presumed benefit of strongly worded statements is that they produce more reliable and valid scores than statements with moderate or weak wording. This study tested this assumption using commonly accepted criteria for reliability and validity. Two forms of attitude scales were created - a strongly worded form and a moderately worded form - measuring two attitude objects - attitude towards animal experimentation and attitude towards going to the movies. Different formats were randomly administered to samples of graduate students. There was no superiority found for strongly worded statements over moderately worded statements. The only statistically significant difference was found between one pair of validity coefficients (r = 0.69; r = 0.15; Z = 2.60, p ≤ 0.01) and that was in the direction opposite from expected, favoring moderately worded items over strongly worded items (total scores correlated with a general behavioral item).
- Andrich, D. (1996). A hyperbolic cosine latent trait model for unfolding polytomous responses: Reconciling Thurstone and Likert methodologies. British Journal of Mathematical and Statistical Psychology, 49, 347-365.
- Andrich, D., & Styles, I. (1998). The structural relationship between attitudes and behavior statements from the unfolding perspective. Psychological Methods, 3, 454-469. doi:10.1037/1082-989X.3.4.454
- Barnette, J. J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems. Educational and Psychological Measurement, 60, 361-370. doi:10.1177/00131640021970592
- Best, J. W., & Kahn, J. V. (1989). Research in education (6th Edition). Englewoods Cliffs, N.J.: Prentice-Hall.
- Bourque, L. B., & Fielder, E. P. (1995). How to conduct self-administered and mail surveys. London: Sage.
- Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
- Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Harcourt Brace Jovanovich.
- Feldt, L. S., Woodruff, D. J., & Slaih, F. A. (1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11, 93- 103. doi:10.1177/014662168701100107
- Ferguson, L. (1941). A study of the Likert technique of attitude scale construction. Journal of Social Psychology, 13, 51-57. doi:10.1080/00224545.1941.9714060
- Fink, A. (1995). The Survey Handbook. London: Sage.
- Fowler, F. J. Jr. (1995). Improving Survey Questions. London: Sage.
- Henerson, M. E. Morris, L. L., & Fitz-Gibbon, C. T. (1987). How to measure attitudes. London: Sage.
- Herche, J., & Engelland, B. (1996). Reversed-polarity items and scale unidimensionality. Journal of the Academy of Marketing Science, 24, 366-374. doi:10.1177/0092070396244007
- Leedy, P. D. (1997). Practical research: Planning and design (6th Edition). New Jersey: Prentice-Hall.
- Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 140.
- Mangione, T. W. (1995). Mail surveys: Improving the quality. London: Sage.