Psychometric Innovation in Counseling: Rasch Validation of the ID-CQS among School Counselors
DOI:
https://doi.org/10.56294/saludcyt20262442Keywords:
cultural intelligence, methodological advancement, psychometric innovation, rasch model, school counselorsAbstract
Introduction: This study advances psychometric innovation in counseling by validating the Indonesian Cultural Intelligence Scale (ID-CQS) for school counselors using the Rasch measurement model. As cultural competence becomes increasingly essential in multicultural education and counseling, there is an urgent need for culturally adaptive and methodologically innovative assessment tools that can enhance the accuracy of psychological measurement.
Method: A total of 663 school counselors from various regions of Indonesia participated in the survey. The adaptation process of the ID-CQS followed international standards, including forward–backward translation, expert judgment, and pretesting to ensure semantic and cultural equivalence. Rasch analysis was applied as a modern psychometric approach to assess item functioning, dimensionality, and construct validity.
Results: The results demonstrated strong psychometric properties, with a person reliability of 0.92 and an item reliability of 0.99, indicating a stable and precise measurement structure. The separation indices and Wright map confirmed the instrument’s capacity to distinguish among varying levels of cultural intelligence (CQ), supporting its construct validity and internal consistency.
Conclusions: The findings provide evidence that the ID-CQS is a reliable and valid outcome of psychometric innovation for assessing cultural intelligence among school counselors. This advancement contributes to the development of evidence-based and culturally responsive counseling practices, enhancing the quality and efficiency of educational and psychological services. Future studies are recommended to conduct cross-cultural validation to expand its global applicability.
References
1. Alamsyah MN, Muslihati M, Peng Y. Exploration of multicultural counseling services to support adolescents’ cultural awareness in schools. ProGCouns: Journal of Professionals in Guidance and Counseling. 2024;5(2). DOI: https://doi.org/10.21831/progcouns.v5i2.77508
2. Sofyan A, Hidayah N, Ramli M, Aminah S, Folastri S. Profiling Preferences of the Counseling Paradigm by School Counselors in Indonesia. KONSELOR. 2023;12(3):211–21. DOI: https://doi.org/10.24036/0202312349-0-86
3. Setiyowati AJ, Indreswari H, Simon IM. Cultural Diversity Profile and the Values of Bhinneka (Diversity) in Multicultural Education of Elementary School. In: Proceedings of the 2nd International Conference on Learning Innovation (ICLI 2018). 2019. p. 84–9. DOI: https://doi.org/10.5220/0008408100840089
4. Wijaksono A. Ethnic and Religious Tolerance in Indonesia. Journal of Developing Economies. 2023;8(2):316–25. DOI: https://doi.org/10.20473/jde.v8i2.46417
5. Peed TA, Stevens H. The culturally connected school counselor: Best Practices and considerations. In: Implementing culturally responsive practices in education. IGI Global; 2020. p. 96–116. DOI: https://doi.org/10.4018/978-1-7998-3331-4.ch006
6. Ramli M, Saputra NMA, Muhayani U. Cultural Intelligence Profile of Junior High School Counsellors and Its Implication on Multicultural Counseling. Jurnal Kajian Bimbingan dan Konseling. 2024;9(1):47–54. DOI: https://doi.org/10.17977/um001v9i12024p47-54
7. Wing Sue D, Sue D. Counseling the culturally diverse: Theory and practice. John Wiley & Sons, Inc.; 2008.
8. Dameron ML, Camp A, Friedmann B, Parikh‐Foxx S. Multicultural Education and Perceived Multicultural Competency of School Counselors. J Multicult Couns Devel. 2020;48(3):176–90. DOI: https://doi.org/10.1002/jmcd.12176
9. Bathje GJ, Pillersdorf D, Eddir H. Multicultural Competence as a Common Factor in the Process and Outcome of Counseling. J Humanist Psychol. 2022; DOI: https://doi.org/10.1177/00221678221099679
10. Akalın MB, Koç Z. The Mediator Role of Cognitive Flexibility Levels in the Relationship Between Authenticity Levels and Multicultural Counseling Competence Perceptions of Psychological Counselors. Türk Psikolojik Danışma ve Rehberlik Dergisi. 2024;14(74):327–38. DOI: https://doi.org/10.17066/tpdrd.1382076_3
11. Alifuddin M, Widodo W. How Is Cultural Intelligence Related to Human Behavior? J Intell [Internet]. 2022;10(1). Available from: https://api.elsevier.com/content/abstract/scopus_id/85123791551 DOI: https://doi.org/10.3390/jintelligence10010003
12. Ang S, Van Dyne L. Handbook of Cultural Intelligence: Theory, Measurement, and Applications. Handbook of Cultural Intelligence: Theory, Measurement, and Applications. Routledge; 2015. 1–414 p. DOI: https://doi.org/10.4324/9781315703855
13. Kistyanto A, Rahman MFW, Wisandiko FA, Setyawati EEP. Cultural intelligence increase student’s innovative behavior in higher education: the mediating role of interpersonal trust. International Journal of Educational Management. 2021; DOI: https://doi.org/10.1108/IJEM-11-2020-0510
14. Sendayu FS, Muslihati, Mappiare A, Atmoko A. Level Cultural Intelligence for Counselor Candidates and Its Implications for Education. Pegem Egitim ve Ogretim Dergisi. 2022;12(2):71–6. DOI: https://doi.org/10.47750/pegegog.12.02.06
15. Soejanto LT, Bariyyah K, Ifdil I, Andrianie S, Setyorini S, Ariyanto RD, et al. Exploring cultural intelligence in educational studies: a bibliometric perspective on global literature. COUNS-EDU: The International Journal of Counseling and Education. 2024;9(1):37–46. DOI: https://doi.org/10.23916/0020240948410
16. Watkins M, Noble G. Thinking beyond recognition: Multiculturalism, cultural intelligence, and the professional capacities of teachers. Review of Education, Pedagogy, and Cultural Studies [Internet]. 2016;38(1):42–57. Available from: https://www.tandfonline.com/doi/abs/10.1080/10714413.2016.1119642 DOI: https://doi.org/10.1080/10714413.2016.1119642
17. Goh M, Koch JM, Sanger S. Cultural intelligence in counseling psychology: Applications for multicultural counseling competence. In: Handbook of cultural intelligence. Routledge; 2015. p. 275–88.
18. Katıtaş S, Coşkun B, Karadaş H. The relationship between teachers’ cultural intelligence and multicultural education attitude: The mediating role of intercultural sensitivity. Int J Educ Res. 2024;127:102443. DOI: https://doi.org/10.1016/j.ijer.2024.102443
19. Buyruk Genç A, Yüksel Şahin F. The mediating role of cultural intelligence and cognitive flexibility in the relation between effective counsellor characteristics and multicultural counselling competencies of counsellors in Turkey. Br J Guid Counc. 2023;51(5):675–89. DOI: https://doi.org/10.1080/03069885.2022.2110216
20. Şahin F, Gurbuz S, Köksal O. Cultural intelligence (CQ) in action: The effects of personality and international assignment on the development of CQ. International Journal of Intercultural Relations. 2014;39:152–63. DOI: https://doi.org/10.1016/j.ijintrel.2013.11.002
21. Min H, Lee PC, Park J. Open to Diversity! Investigating the Impact of Cultural Intelligence on Students’ Preference for Group Work. Journal of Hospitality and Tourism Education [Internet]. 2020;32(1):14–24. Available from: https://api.elsevier.com/content/abstract/scopus_id/85071368720 DOI: https://doi.org/10.1080/10963758.2019.1654892
22. Özerk M, Özerk K. Multicultural settings and school psychological services—a Norwegian experience with developing competency in multicultural counseling. Contemp Sch Psychol. 2020;24(4):349–61. DOI: https://doi.org/10.1007/s40688-019-00242-3
23. Pratiwi M, Iswari RD, Nesvita MD, Khairiyah US. Growth Mindset and Grit: Examining the Academic Buoyancy of College Students Implementing Online Lectures. Jurnal Sains Psikologi [Internet]. 2023; Available from: https://consensus.app/papers/growth-mindset-and-grit-examining-the-academic-buoyancy-of-pratiwi-iswari/33891f3d637d553a9b0fe6005fd725d6/
24. Shah KM, Khan A, Jayus R. Enhancing Training for Multicultural Counseling Efficiency According to the School Counselors Perspective Toward Clients Psychological Health. Indian J Public Health Res Dev. 2019;10(9). DOI: https://doi.org/10.5958/0976-5506.2019.02717.7
25. Latif S, Aswar A, Amirullah M, Harum A. Cultural Intelligence Profiles of Guidance and Counseling Teachers. Konseling Edukasi: Journal Of Guidance and Counseling. 2023;7(1):73–93. DOI: https://doi.org/10.21043/konseling.v7i1.22247
26. Van Dyne L, Ang S, Koh C. Development and validation of the CQS: The cultural intelligence scale. In: Handbook of cultural intelligence. Routledge; 2015. p. 34–56.
27. Darwis A, Bafadal I, Wiyono BB, Malik AR. Designing an Assessment Tool for Teacher Leadership Competencies in Aspiring Elementary School Principals in Indonesia. Sustainable Futures. 2025;100803. DOI: https://doi.org/10.1016/j.sftr.2025.100803
28. Blanchard EG, Mohammed P. On Cultural Intelligence in LLM-Based Chatbots: Implications for Artificial Intelligence in Education. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) [Internet]. 2024;14829 LNAI:439–53. Available from: https://link.springer.com/chapter/10.1007/978-3-031-64302-6_31 DOI: https://doi.org/10.1007/978-3-031-64302-6_31
29. Vinco M, Supriatna N, Mulyana A. The Development of 21st Century Cultural Intelligence through Discovery Learning and First-Person Historical Presentation [Internet]. Paramita: Historical Studies …. scholar.archive.org; 2019. Available from: https://scholar.archive.org/work/dgnfjxwtdfc3jmoopjuyl2htni/access/wayback/https://journal.unnes.ac.id/nju/index.php/paramita/article/download/16216/pdf
30. Ramli M, Hidayah N, Eva N, Saputra NMA, Hanafi H. Identification of Cybercounseling Services for Improving High School Students’ Cultural Intelligence in Social Media. In: Proceedings - International Conference on Education and Technology, ICET. IEEE; 2022. p. 137–41. DOI: https://doi.org/10.1109/ICET56879.2022.9990630
31. Rikumahu MCE, Rahayu MNM. Indonesian Adaptation of the Cultural Intelligence Scale (CQS). Journal of Educational, Health and Community Psychology. 2025;1–24. DOI: https://doi.org/10.12928/jehcp.vi.28955
32. Ariyanto RD, Hidayah N, Hambali IM, Indreswari H, Muhayani U, Jesa BI. Indonesian version of Runco Ideational Behaviour Scale via Rasch analysis. In: Pacific-Rim Objective Measurement Symposium (PROMS 2023). Atlantis Press; 2024. p. 285–98. DOI: https://doi.org/10.2991/978-94-6463-494-5_18
33. Bond TG, Fox CM. Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press; 2013.
34. Rangka IB, Hidayah N, Hanurawan F, Eva N. A rasch-based validation of the Indonesian version of the food neophobia scale. Food Qual Prefer. 2023;109:104891. DOI: https://doi.org/10.1016/j.foodqual.2023.104891
35. Jackson T. Should we measure cultural intelligence? International Journal of Cross Cultural Management. 2022;22(2):209–12. DOI: https://doi.org/10.1177/14705958221115785
36. Semenov A V, Randrianasolo A. An extended conceptualization of cultural intelligence. International Journal of Cross Cultural Management. 2024;24(3):563–86. DOI: https://doi.org/10.1177/14705958241268289
37. Rockstuhl T, Van Dyne L. A bi-factor theory of the four-factor model of cultural intelligence: Meta-analysis and theoretical extensions. Organ Behav Hum Decis Process. 2018;148:124–44. DOI: https://doi.org/10.1016/j.obhdp.2018.07.005
38. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186–91. DOI: https://doi.org/10.1097/00007632-200012150-00014
39. Alizamar A, Ifdil I, Taufik T, Syahniar S, Afdal A, Hariko R, et al. Measuring internet addiction: adaptation and validation of the Chen Internet Addiction Scale (CIAS) on Indonesian version. In: Journal of Physics: Conference Series. IOP Publishing; 2018. p. 12057. DOI: https://doi.org/10.1088/1742-6596/1114/1/012057
40. Andrianie S, Bariyyah K, Ifdil I, Soejanto LT, Setyorini S, Ariyanto RD, et al. Rasch model-based grit exploration in university of indonesia students: a descriptive study using the grit-o scale. COUNS-EDU: The International Journal of Counseling and Education. 2024;9(2):20–9. DOI: https://doi.org/10.23916/0020240948520
41. Boone WJ. Rasch Analysis for Instrument Development: Why, When, and How? CBE—Life Sciences Education. 2016;15(4):rm4–rm4. DOI: https://doi.org/10.1187/cbe.16-04-0148
42. Linacre JM, Wright BD. Winsteps. URL: http://www winsteps com/index htm [accessed 2013-06-27][WebCite Cache]. 2000;
43. Bond TG, Fox CM. Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press; 2013.
44. Medvedev ON, Krägeloh CU. Rasch measurement model. In: Handbook of assessment in mindfulness research. Springer; 2022. p. 1–18. DOI: https://doi.org/10.1007/978-3-030-77644-2_4-1
45. Septiana NZ, Atmoko A, Muslihati, Dewanti SR. The Indonesian Version of Triangular Hate Scale: A Validation and Current Mapping on Young Adults via Rasch Analysis. In 2024. p. 269–84. DOI: https://doi.org/10.2991/978-94-6463-494-5_17
46. Thakur T. Rasch measurement theory: A complete course. Educohack Press; 2025.
47. Sari RP, Faradina NH, Ramadhan NNK, Rahman DH, Affandi AJ. Development and validation of the academic stress inventory. Proceedings Series of Educational Studies. 2024;515–21.
48. Stefana A, Damiani S, Granziol U, Provenzani U, Solmi M, Youngstrom EA, et al. Psychological, psychiatric, and behavioral sciences measurement scales: best practice guidelines for their development and validation. Front Psychol. 2025;15:1494261. DOI: https://doi.org/10.3389/fpsyg.2024.1494261
49. Zitzmann S, Orona GA. Why We Might Still be Concerned About Low Cronbach’s Alphas in Domain-specific Knowledge Tests. Educ Psychol Rev. 2025;37(2):37. DOI: https://doi.org/10.1007/s10648-025-10015-5
50. Boone WJ, Staver JR. Advances in Rasch analyses in the human sciences. Springer; 2020. DOI: https://doi.org/10.1007/978-3-030-43420-5
51. Liu X, Boone WJ. Advances in applications of Rasch measurement in science education. Springer; 2023. DOI: https://doi.org/10.1007/978-3-031-28776-3
52. Sumintono B. Rasch model measurements as tools in assesment for learning. In: 1st International Conference on Education Innovation (ICEI 2017). Atlantis Press; 2018. p. 38–42. DOI: https://doi.org/10.2991/icei-17.2018.11
53. Sumintono B, Law MY, Sitasari NW. Self-handicapping scale: evaluation of psychometric properties among Malaysian and Indonesian university students using Rasch rating scale model analysis. Journal of Applied Research in Higher Education. 2025; DOI: https://doi.org/10.1108/JARHE-08-2024-0429
54. Ariyanto RD, Hidayah N, Hambali IM, Indreswari H, Hoi‐yung L. Exploring Gender‐Based Differences in Creative Ideation Among Indonesian Students Through Rasch Model Analysis. Psychol Sch. 2025;62(7):2070–82. DOI: https://doi.org/10.1002/pits.23454
55. Colledani D, Anselmi P, Robusto E. Rasch Models in the Analysis of Repgrid Data. J Constr Psychol. 2022;35(2):605–25. DOI: https://doi.org/10.1080/10720537.2020.1852461
56. Tesio L, Caronni A, Kumbhare D, Scarano S. Interpreting results from Rasch analysis 1. The “most likely” measures coming from the model. Disabil Rehabil. 2024;46(3):591–603. DOI: https://doi.org/10.1080/09638288.2023.2169771
57. Aminah S, Hidayah N, Hanurawan F, Indreswari H. Tailoring of the career adaptabilities scale for Indonesian youth. Child Youth Serv Rev. 2024;166:107914. DOI: https://doi.org/10.1016/j.childyouth.2024.107914
58. Sofyan A, Hidayah N, Wiyono BB, Ramli M, Tsong Y. Validation of the Supervision Outcome Scale in Counselor Professional Education in Indonesia: A Rasch Model Approach. In: Pacific-Rim Objective Measurement Symposium (PROMS 2023). Atlantis Press; 2024. p. 231–41. DOI: https://doi.org/10.2991/978-94-6463-494-5_14
59. Sue DW, Sue D, Neville HA, Smith L. Counseling the culturally diverse: Theory and practice. John Wiley & Sons; 2022.
60. Apgrianto YY, Pali M, Handarini DM, Muslihati M, Jatiperwira SY. Exploring the Mediating Role of Attitudes in Enhancing Cultural Awareness Through Knowledge Among Students. Jurnal Aplikasi Manajemen. 2024 Sep 1;22(3):615–25. DOI: https://doi.org/10.21776/ub.jam.2024.022.03.02
61. Zamroni E, Hanurawan F, Muslihati, Hambali Im, Hidayah N. Trends and Research Implications of Guidance and Counseling Services in Indonesia From 2010 to 2020: A Bibliometric Analysis. Sage Open. 2022 Apr 22;12(2). DOI: https://doi.org/10.1177/21582440221091261
62. Haas J, Walsh DD, Marroquin M. Enhancing cultural competence in counselor education through sociolinguistic awareness. Teaching And Supervision In Counseling. 2024;6(3):4. DOI: https://doi.org/10.7290/tsc06vevm
63. Peeters MJ, Augustine JM. Using Rasch measurement for instrument rating scale refinement. Curr Pharm Teach Learn. 2023 Jan;15(1):110–8. DOI: https://doi.org/10.1016/j.cptl.2023.02.015
64. Saputra R, Hambali I, Muslihati M, Setiyowati AJ, Lidyawati Y, Ramadhani E, et al. Islamic Value-Based Student Employability Scale: Validation with Rasch Model. Islamic Guidance and Counseling Journal. 2025;8(2). DOI: https://doi.org/10.25217/0020258659600
65. RAMADHANI E, SETIYOSARI P, INDRESWARI H, SETIYOWATI AJ, PUTRI RD. MEASURING THESIS PROCRASTINATION: VALIDATION OF AN INDONESIAN STUDENT SCALE WITH THE RASCH MODEL. TPM–Testing, Psychometrics, Methodology in Applied Psychology. 2025;32(2-June):10–22.
66. Daga M, Mohanty P, Priya S, Krishna R. Statistical Validation in Cultural Adaptations of Cognitive Tests: A Multi-Regional Systematic Review.
67. Lee SY, Hong AJ. Psychometric Investigation of the Cultural Intelligence Scale Using the Rasch Measurement Model in South Korea. Sustainability. 2021 Mar 12;13(6):3139. DOI: https://doi.org/10.3390/su13063139
68. Gleeson J, Cutler B, Rickinson M, Walsh L, Ehrich J, Cirkony C, et al. School educators’ engagement with research: an Australian Rasch validation study. Educ Assess Eval Account. 2023 May 24;35(2):281–307. DOI: https://doi.org/10.1007/s11092-023-09404-7
69. Avinç E, Doğan F. Digital literacy scale: Validity and reliability study with the rasch model. Educ Inf Technol (Dordr). 2024 Dec 18;29(17):22895–941. DOI: https://doi.org/10.1007/s10639-024-12662-7
70. Zhu P, Luke MM, Liu Y, Wang Q. Cultural humility and cultural competence in counseling: An exploratory mixed methods investigation. Journal of Counseling & Development. 2023;101(3):264–76. DOI: https://doi.org/10.1002/jcad.12469
71. Diniyah U, Hidayah N, Hotifah Y. Adaptation of the Student Engagement Questionnaire (SEQ) into Indonesian Version for Secondary School Students. Indonesian Journal of Counseling and Development. 2025;160–73.
72. Alsubheen SA, Oliveira A, Habash R, Goldstein R, Brooks D. Systematic review of psychometric properties and cross-cultural adaptation of the University of California and Los Angeles loneliness scale in adults. Current Psychology. 2023 May 1;42(14):11819–33. DOI: https://doi.org/10.1007/s12144-021-02494-w
73. Andrianie S, Wiyono BB, Atmoko A, Setiyowati AJ, Hidayah N, Ramli M, et al. Grit scale development and validation using rasch model: cross-cultural adaptation. Retos. 2025 Sep 21;73:104–15. DOI: https://doi.org/10.47197/retos.v73.112440
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Laily Tiarani Soejanto, Adi Atmoko , Bambang Budi Wiyono, Muslihati, Khairul Bariyyah, Abu Yazid Abu Bakar, Santy Andrianie (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The article is distributed under the Creative Commons Attribution 4.0 License. Unless otherwise stated, associated published material is distributed under the same licence.
