The NADINE Soft Skills Tests for Migrants, Refugees and Asylum Seekers: Cultural Adaptation and Preliminary Testing of Their Psychometric Properties
- 1 Ison Psychometrica, Athens, Greece
- 2 Ison Psychometrica, Athens, Greece
- 3 European University Cyprus, Nicosia, Cyprus
- 4 Ison Psychometrica, Athens, Greece
Abstract
The present paper aims at assessing the linguistic and cultural adaptation and equivalency of the French, Farsi, Arabic and English versions of the NADINE1 Soft Skill Tests, which include four scales: interpersonal skills, organizational skills, personal skills, and entrepreneurial skills. The translation process included forward and backward translations. Three studies took place. In Study 1, both the source (English) and target versions of the tests were administered to 117 bilingual subjects. There were very few differences observed between the two versions of the tests, in all language versions, resulting in only a few items being revised. Study 2 aimed at determining the degree to which the items, the response scale and the instructions are comprehensible and culturally relevant to the target population. Three focus groups were formed, with 9, 9 and 7 participants respectively, who rated all items in terms of clarity and cultural relevance. The review resulted in minor changes in the instructions. In study 3, the Farsi, Arabic and French versions of the tests were administered to 120 migrants/refugees/asylum seekers. We calculated the discriminative power of each item and its contribution to the scale’s and subscale’s internal reliability coefficient. Moreover, we calculated Tucker’s congruence coefficient for each subscale to ensure cross-cultural equivalency. Items with poor discriminative power and items which reduced the reliability coefficients were eliminated. The remaining items had discriminative power between 0.20 and 0.80, while all reliability coefficients were above 0.70 (the vast majority being above 0.80). All Tucker’s phi coefficients were above the 0.90 cut-off point, with the exception of the Farsi-French and the Arabic-French comparison of one component. However, Tucker’s phi was above 0.80 which shows similarity. Results of all 3 studies support the case of linguistic and cultural equivalence between the different language versions of the tests. Therefore, all test versions are valid and reliable instruments that can be used by career practitioners to assess the level of soft skills of migrants, refugees and asylum seekers.
- American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). The Standards for Educational and Psychological Testing. Washington DC: AERA Publications.
- CEDEFOP’s Skills Panorama Glossary (2020). https://skillspanorama.cedefop.europa.eu/en/glossary
- Coolican, H. (2014). Research Methods and Statistics in Psychology (6th ed.). New York: Psychology Press. https://doi.org/10.4324/9780203769669
- DeMaio, T., & Landreth, A. (2004). Do Different Cognitive Interview Techniques Produce Different Results? In S. Presser et al. (Eds.), Methods for Testing and Evaluating Survey Questionnaires (pp. 891-08). Hoboken, NJ: John Wiley and Sons. https://doi.org/10.1002/0471654728.ch5
- European Commission (2018). Council Recommendation of 22 May 2018 on Key Competences for Lifelong Learning (Text with EEA Relevance) (pp. 1-13). ST/9009/ 2018/INIT OJ C 189, 4.6.2018, (BG, ES, CS, DA, DE, ET, EL, EN, FR, HR, IT, LV, LT, HU, MT, NL, PL, PT, RO, SK, SL, FI, SV). https://eur-lex.europa.eu/legal-content/EN/TXT/ ?uri=uriserv%3AOJ.C_.2018.189.01.0001.01.ENG
- Furr, R. M. (2011). Scale Construction and Psychometrics for Social and Personality Psychology. New Delhi: Sage Publications. https://doi.org/10.4135/9781446287866
- Hambleton, R. K. (2005). Issues, Designs, and Technical Guidelines for Adapting Tests into Multiple Languages and Cultures. In K. Hambleton, P. Merenda, & C. Spielberger (Eds.), Adapting Educational and Psychological Tests for Cross-Cultural Assessment (pp. 3-38). Mahwah, NJ: Lawrence Erlbaum. https://doi.org/10.4324/9781410611758
- Harkness, J., Pennell, B. E., & Schoua-Glusberg, A. (2004). Survey Questionnaire Translation and Assessment. In S. Presser et al. (Eds.), Methods for Testing and Evaluating Survey Questionnaires (pp. 546, 453-473). Hoboken, NJ: John Wiley & Sons, Inc. https://doi.org/10.1002/0471654728.ch22
- ILO International Labour Organization (2008). Conclusions on Skills for Improved Productivity, Employment Growth and Development. In International Labour Conference. Geneva: International Labour Office ILO. https://www.ilo.org/wcmsp5/groups/public/---ed_emp/---ifp_skills /documents/publication/wcms_103457.pdf
- ILO International Labour Organization (2015). Labour Migration and Skills Matching. Labour Migration Highlights No. 6. Geneva: Labour Migration Branch and Skills and Employability Branch International Labour Office.