A Psychometric Study of Cognitive Self-Regulation: Are Self-Report Questionnaires and Behavioural Tasks Measuring a Similar Construct? — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
A Psychometric Study of Cognitive Self-Regulation: Are Self-Report Questionnaires and Behavioural Tasks Measuring a Similar Construct?
Department of Management, Faculty of Applied Economics, University of Antwerp, Antwerp, Belgium
,
Department of Management, Faculty of Applied Economics, University of Antwerp, Antwerp, Belgium
,
Department of Management, Faculty of Applied Economics, University of Antwerp, Antwerp, Belgium
1 Department of Management, Faculty of Applied Economics, University of Antwerp, Antwerp, Belgium
2 Department of Management, Faculty of Applied Economics, University of Antwerp, Antwerp, Belgium
3 Department of Management, Faculty of Applied Economics, University of Antwerp, Antwerp, Belgium
Assessing individual differences in cognitive self-regulation, an effortful process that relies heavily on executive functions, has proven difficult in non-psychiatric populations. We report the results of a psychometric and a behavioural study that investigate convergent, discriminant, and predictive validity of three self-report measures of self-regulation (Adult Temperament Questionnaire, Temperament and Character Inventory, and locus of control (LOC) scale) and two behavioural tasks assessing impulse control and cognitive flexibility respectively. Factor analysis in study 1 (n = 492 college students) indicates that effortful control, persistence and self-directedness measure a similar cognitive self-regulatory construct. Harm avoidance and novelty seeking correlate negatively with cognitive self-regulation while intelligence is independent of cognitive self-regulatory capacity. In study 2 (n = 78 college students), we replicate this factor and test for correlations with behavioural tasks. Only internal LOC correlates positively with impulse control behaviour. We conclude that construct validity of self-reported cognitive self-regulation is robust but that predictive validity is lacking.
KeywordsCognitive Self-RegulationATQTCILocus of ControlTime DiscountingProbabilistic Reversal LearningPsychometrics
Althoff, R. R., Ayer, L. A., Crehan, E. T., Rettew, D. C., Baer, J. R., & Hudziak, J. J. (2012). Temperamental Profiles of Dysregulated Children. Child Psychiatry & Human Development, 43, 511-522. http://dx.doi.org/10.1007/s10578-012-0280-7
Armbruster, D. J. N., Ueltzhoffer, K., Basten, U., & Fiebach, C. J. (2012). Prefrontal Cortical Mechanisms Underlying Individual Differences in Cognitive Flexibility and Stability. Journal of Cognitive Neuroscience, 24, 2385-2399. http://dx.doi.org/10.1162/jocn_a_00286
Baumeister, R. F., Vohs, K. D., & Tice, D. M. (2007). The Strength Model of Self-Control. Current Directions in Psychological Science, 16, 351-355. http://dx.doi.org/10.1111/j.1467-8721.2007.00534.x
Berger, A., Kofman, O., Livneh, U., & Henik, A. (2007). Multidisciplinary Perspectives on Attention and the, Development of Self-Regulation. Progress in Neurobiology, 82, 256-286. http://dx.doi.org/10.1016/j.pneurobio.2007.06.004
Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Gatchalian, K. M., & McClure, S. M. (2012). Are Executive Function and Impulsivity Antipodes? A Conceptual Reconstruction with Special Reference to Addiction. Psychopharmacology, 221, 361-387. http://dx.doi.org/10.1007/s00213-012-2689-x
Black, D. W., Shaw, M., McCormick, B., Bayless, J. D., & Allen, J. (2012). Neuropsychological Performance, Impulsivity, ADHD Symptoms, and Novelty Seeking in Compulsive Buying Disorder. Psychiatry Research, 200, 581-587. http://dx.doi.org/10.1016/j.psychres.2012.06.003
Boone, C., & De Brabander, B. (1993). Generalized vs Specific-Locus of Control Expectancies of Chief Executive Officers. Strategic Management Journal, 14, 619-625. http://dx.doi.org/10.1002/smj.4250140805
Boone, C., De Brabander, B., Carree, M., de Jong, G., van Olffen, W., & van Witteloostuijn, A. (2002). Locus of Control and Learning to Cooperate in a Prisoner’s Dilemma Game. Personality and Individual Differences, 32, 929-946. http://dx.doi.org/10.1016/S0191-8869(01)00100-3
Camchong, J., MacDonald, A. W., Nelson, B., Bell, C., Mueller, B. A., Specker, S., & Lim, K. O. (2011). Frontal Hyperconnectivity Related to Discounting and Reversal Learning in Cocaine Subjects. Biological Psychiatry, 69, 1117-1123. http://dx.doi.org/10.1016/j.biopsych.2011.01.008
Casey, B. J., Somerville, L. H., Gotlib, I. H., Ayduk, O., Franklin, N. T., Askren, M. K., Shoda, Y. et al. (2011). Behavioral and Neural Correlates of Delay of Gratification 40 Years Later. Proceedings of the National Academy of Sciences of the United States of America, 108, 14998-15003. http://dx.doi.org/10.1073/pnas.1108561108
Christakou, A., Brammer, M., & Rubia, K. (2011). Maturation of Limbic Corticostriatal Activation and Connectivity Associated with Developmental Changes in Temporal Discounting. Neuroimage, 54, 1344-1354. http://dx.doi.org/10.1016/j.neuroimage.2010.08.067
Cloninger, C. R., Svrakic, D. M., & Przybeck, T. R. (1993). A Psychobiological Model of Temperament and Character. Archives of General Psychiatry, 50, 975-990. http://dx.doi.org/10.1001/archpsyc.1993.01820240059008
Cools, R., Barker, R. A., Sahakian, B. J., & Robbins, T. W. (2001). Enhanced or Impaired Cognitive Function in Parkinson’s Disease as a Function of Dopaminergic Medication and Task Demands. Cerebral Cortex, 11, 1136-1143. http://dx.doi.org/10.1093/cercor/11.12.1136
Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002). Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging. Journal of Neuroscience, 22, 4563-4567.
Cools, R., Lewis, S. J. G., Clark, L., Barker, R. A., & Robbins, T. W. (2007). L-dopa Disrupts Activity in the Nucleus Accumbens during Reversal Learning in Parkinson’s Disease. Neuropsychopharmacology, 32, 180-189. http://dx.doi.org/10.1038/sj.npp.1301153
Crean, J. P., de Wit, H., & Richards, J. B. (2000). Reward Discounting as a Measure of Impulsive Behavior in a Psychiatric Outpatient Population. Experimental and Clinical Psychopharmacology, 8, 155-162. http://dx.doi.org/10.1037/1064-1297.8.2.155
Dalley, J. W., & Roiser, J. P. (2012). Dopamine, Serotonin and Impulsivity. Neuroscience, 215, 42-58. http://dx.doi.org/10.1016/j.neuroscience.2012.03.065
de Winter, R. F. P., Wolterbeek, R., Spinhoven, P., Zitman, F. G., & Goekoop, J. G. (2007). Character and Temperament in Major Depressive Disorder and a Highly Anxious-Retarded Subtype Derived from Melancholia. Comprehensive Psychiatry, 48, 426-435. http://dx.doi.org/10.1016/j.comppsych.2007.04.002
Declerck, C. H., Boone, C., & De Brabander, B. (2006). On Feeling in Control: A Biological Theory for Individual Differences in Control Perception. Brain and Cognition, 62, 143-176. http://dx.doi.org/10.1016/j.bandc.2006.04.004
Diehl, M., Semegon, A. B., & Schwarzer, R. (2006). Assessing Attention Control in Goal Pursuit: A Component of Dispositional Self-Regulation. Journal of Personality Assessment, 86, 306-317. http://dx.doi.org/10.1207/s15327752jpa8603_06
Diekhof, E. K., Nerenberg, L., Falkai, P., Dechent, P., Baudewig, J., & Gruber, O. (2012). Impulsive Personality and the Ability to Resist Immediate Reward: An fMRI Study Examining Interindividual Differences in the Neural Mechanisms Underlying Self-Control. Human Brain Mapping, 33, 2768-2784. http://dx.doi.org/10.1002/hbm.21398
Dodds, C. M., Mueller, U., Clark, L., van Loon, A., Cools, R., & Robbins, T. W. (2008). Methylphenidate Has Differential Effects on Blood Oxygenation Level-Dependent Signal Related to Cognitive Subprocesses of Reversal Learning. Journal of Neuroscience, 28, 5976-5982. http://dx.doi.org/10.1523/JNEUROSCI.1153-08.2008
Dom, G., De Wilde, B., Hulstijn, W., & Sabbe, B. (2007). Dimensions of Impulsive Behaviour in Abstinent Alcoholics. Personality and Individual Differences, 42, 465-476. http://dx.doi.org/10.1016/j.paid.2006.08.007
Duckworth, A. L., & Kern, M. L. (2011). A Meta-Analysis of the Convergent Validity of Self-Control Measures. Journal of Research in Personality, 45, 259-268. http://dx.doi.org/10.1016/j.jrp.2011.02.004
Duijsens, S. P., Goekoop, J. G., Spermon, T., & Eurelings-Bontekoe, E. H. M. (2000). The Dutch Temperament and Character Inventory (TCI): Dimensional Structure, Reliability and Validity in a Normal and Psychiatric Outpatient Sample. Personality and Individual Differences, 28, 487-499. http://dx.doi.org/10.1016/S0191-8869(99)00114-2
Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. (1999). Working Memory, Short-Term Memory, and General Fluid Intelligence: A Latent-Variable Approach. Journal of Experimental Psychology-General, 128, 309-331. http://dx.doi.org/10.1037/0096-3445.128.3.309
Ersche, K. D., Barnes, A., Jones, P. S., Morein-Zamir, S., Robbins, T. W., & Bullmore, E. T. (2011). Abnormal Structure of Frontostriatal Brain Systems Is Associated with Aspects of Impulsivity and Compulsivity in Cocaine Dependence. Brain, 134, 2013-2024. http://dx.doi.org/10.1093/brain/awr138
Evans, D. E., & Rothbart, M. K. (2007). Developing a Model for Adult Temperament. Journal of Research in Personality, 41, 868-888. http://dx.doi.org/10.1016/j.jrp.2006.11.002
Field, A. (2009). Discovering Statistics Using Spss (3rd ed.). London: Sage.
Freyer, T., Valerius, G., Kuelz, A. K., Speck, O., Glauche, V., Hull, M., & Voderholzer, U. (2009). Test-Retest Reliability of Event-Related Functional MRI in a Probabilistic Reversal Learning Task. Psychiatry Research-Neuroimaging, 174, 40-46. http://dx.doi.org/10.1016/j.pscychresns.2009.03.003
Heatherton, T. F., & Wagner, D. D. (2011). Cognitive Neuroscience of Self-Regulation Failure. Trends in Cognitive Sciences, 15, 132-139. http://dx.doi.org/10.1016/j.tics.2010.12.005
Hofmann, W., Schmeichel, B. J., & Baddeley, A. D. (2012). Executive Functions and Self-Regulation. Trends in Cognitive Sciences, 16, 174-180. http://dx.doi.org/10.1016/j.tics.2012.01.006
Hurst, R. M., Kepley, H. O., McCalla, M. K., & Livermore, M. K. (2011). Internal Consistency and Discriminant Validity of a Delay-Discounting Task with an Adult Self-Reported ADHD Sample. Journal of Attention Disorders, 15, 412-422. http://dx.doi.org/10.1177/1087054710365993
Joireman, J., Balliet, D., Sprott, D., Spangenberg, E., & Schultz, J. (2008). Consideration of Future Consequences, Ego-Depletion, and Self-Control: Support for Distinguishing Between CFC-Immediate and CFC-Future Sub-Scales. Personality and Individual Differences, 45, 15-21. http://dx.doi.org/10.1016/j.paid.2008.02.011
Judge, T. A. (2009). Core Self-Evaluations and Work Success. Current Directions in Psychological Science, 18, 58-62. http://dx.doi.org/10.1111/j.1467-8721.2009.01606.x
Kehagia, A. A., Murray, G. K., & Robbins, T. W. (2010). Learning and Cognitive Flexibility: Frontostriatal Function and Monoaminergic Modulation. Current Opinion in Neurobiology, 20, 199-204. http://dx.doi.org/10.1016/j.conb.2010.01.007
Kirby, K. N. (2009). One-Year Temporal Stability of Delay-Discount Rates. Psychonomic Bulletin & Review, 16, 457-462. http://dx.doi.org/10.3758/PBR.16.3.457
Kline, T. J., Sulsky, L. M., & Rever-Moriyama, S. D. (2000). Common Method Variance and Specification Errors: A Practical Approach to Detection. Journal of Psychology, 134, 401-421. http://dx.doi.org/10.1080/00223980009598225
Lewis, M. D., & Todd, R. M. (2007). The Self-Regulating Brain: Cortical-Subcortical Feedback and the Development of Intelligent Action. Cognitive Development, 22, 406-430. http://dx.doi.org/10.1016/j.cogdev.2007.08.004
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate Neural Systems Value Immediate and Delayed Monetary Rewards. Science, 306, 503-507. http://dx.doi.org/10.1126/science.1100907
Mischel, W., Ayduk, O., Berman, M. G., Casey, B. J., Gotlib, I. H., Jonides, J., & Shoda, Y. (2011). “Willpower” over the Life Span: Decomposing Self-Regulation. Social Cognitive and Affective Neuroscience, 6, 252-256. http://dx.doi.org/10.1093/scan/nsq081
Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989). Delay of Gratification in Children. Science, 244, 933-938. http://dx.doi.org/10.1126/science.2658056
Moeller, F. G., Dougherty, D. M., Barratt, E. S., Oderinde, V., Mathias, C. W., Harper, R. A., & Swann, A. C. (2002). Increased Impulsivity in Cocaine Dependent Subjects Independent of Antisocial Personality Disorder and Aggression. Drug and Alcohol Dependence, 68, 105-111. http://dx.doi.org/10.1016/S0376-8716(02)00106-0
Moreira, P. A., Oliveira, J. T., Cloninger, K. M., Azevedo, C., Sousa, A., Castro, J., & Cloninger, C. R. (2012). The Psychometrics and Validity of the Junior Temperament and Character Inventory in Portuguese Adolescents. Comprehensive Psychiatry, 53, 1227-1236. http://dx.doi.org/10.1016/j.comppsych.2012.04.014
Muraven, M., & Baumeister, R. F. (2000). Self-Regulation and Depletion of Limited Resources: Does Self-Control Resemble a Muscle? Psychological Bulletin, 126, 247-259. http://dx.doi.org/10.1037/0033-2909.126.2.247
Muraven, M., Tice, D. M., & Baumeister, R. F. (1998). Self-Control as Limited Resource: Regulatory Depletion Patterns. Journal of Personality and Social Psychology, 74, 774-789. http://dx.doi.org/10.1037/0022-3514.74.3.774
Nagano-Saito, A., Leyton, M., Monchi, O., Goldberg, Y. K., He, Y., & Dagher, A. (2008). Dopamine Depletion Impairs Frontostriatal Functional Connectivity during a Set-Shifting Task. Journal of Neuroscience, 28, 3697-3706. http://dx.doi.org/10.1523/JNEUROSCI.3921-07.2008
O’Connor, P. J., & Jackson, C. J. (2010). Applying a Psychobiological Model of Personality to the Study of Leadership. Journal of Individual Differences, 31, 185-197. http://dx.doi.org/10.1027/1614-0001/a000027
Posner, M. I., & Rothbart, M. K. (2009). Toward a Physical Basis of Attention and Self-Regulation. Physics of Life Reviews, 6, 103-120. http://dx.doi.org/10.1016/j.plrev.2009.02.001
Previc, F. H. (2009). The Dopaminergic Mind in Human Evolution and History. Cambridge: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511581366
Reynolds, B., Ortengren, A., Richards, J. B., & de Wit, H. (2006). Dimensions of Impulsive Behavior: Personality and Behavioral Measures. Personality and Individual Differences, 40, 305-315. http://dx.doi.org/10.1016/j.paid.2005.03.024
Rothbart, M. K., Ahadi, S. A., & Evans, D. E. (2000). Temperament and Personality: Origins and Outcomes. Journal of Personality and Social Psychology, 78, 122-135. http://dx.doi.org/10.1037//0022-3514.78.1.122
Rotter, J. B. (1966). Generalized Expectancies for Internal versus External Control of Reinforcement. Psychological Monographs, 80, 1-28. http://dx.doi.org/10.1037/h0092976
Sizoo, B., van den Brink, W., van Eenige, M. G., & van der Gaag, R. J. (2009). Personality Characteristics of Adults with Autism Spectrum Disorders or Attention Deficit Hyperactivity Disorder with and without Substance Use Disorders. Journal of Nervous and Mental Disease, 197, 450-454. http://dx.doi.org/10.1097/NMD.0b013e3181a61dd0
Smillie, L. D., Cooper, A. J., Tharp, I. J., & Pelling, E. L. (2009). Individual Differences in Cognitive Control: The Role of Psychoticism and Working Memory in Set-Shifting. British Journal of Psychology, 100, 629-643. http://dx.doi.org/10.1348/000712608X382094
Sripada, C. S., Gonzalez, R., Phan, K. L., & Liberzon, I. (2011). The Neural Correlates of Intertemporal Decision-Making: Contributions of Subjective Value, Stimulus Type, and Trait Impulsivity. Human Brain Mapping, 32, 1637-1648. http://dx.doi.org/10.1002/hbm.21136
Stuss, D. T., & Levine, B. (2002). Adult Clinical Neuropsychology: Lessons from Studies of the Frontal Lobes. Annual Review of Psychology, 53, 401-433. http://dx.doi.org/10.1146/annurev.psych.53.100901.135220
Vervaet, M., van Heeringen, C., & Audenaert, K. (2004a). Is Drive for Thinness in Anorectic Patients Associated with Personality Characteristics? European Eating Disorders Review, 12, 375-379. http://dx.doi.org/10.1002/erv.586
Vervaet, M., van Heeringen, C., & Audenaert, K. (2004b). Personality-Related Characteristics in Restricting versus Binging and Purging Eating Disordered Patients. Comprehensive Psychiatry, 45, 37-43. http://dx.doi.org/10.1016/j.comppsych.2003.09.008
Wechsler, D. (1997). Wechsler Adult Intelligence Scale: Technical and Interpretive Manual (3rd ed.). San Antonio, TX: The Psychological Corporation.
Zhu, J. J., Weiss, L. G., Prifitera, A., & Coalson, D. (2003). The Wechsler Intelligence Scales for Children and Adults. In S. N. Haynes, E. M. Heiby, & M. Hersen (Eds.), Comprehensive Handbook of Psychological Assessment (pp. 51-75). Hoboken, NJ: John Wiley & Sons, Inc.