Pilot Testing the Internal Structure of the Multicultural Competency Scale for Prospective Teachers
DOI:
https://doi.org/10.58706/jipp.v4n2.p228-239Keywords:
Multicultural Competency, Confirmatory Factor Analysis, Pilot Study, Prospective TeacherAbstract
Assessing pre-service teachers’ multicultural competence is fundamental to actualizing inclusive education, yet doing so requires robust psychometric tools. This study evaluates the construct validity of a Multicultural Competence Scale using Confirmatory Factor Analysis (CFA). Following rigorous preliminary diagnostics to ensure data suitability, the structural model was evaluated for overall fit, validity, and reliability. While the overarching measurement model demonstrated a robust structural foundation, localized vulnerabilities emerged within the awareness dimension. Specifically, items A1 and A6 failed to reach the necessary factorial thresholds (loadings < 0.30), signaling contextual and linguistic misalignments that require targeted revision. Ultimately, these findings underscore a critical methodological tension: the need to balance comprehensive construct representation with item efficiency. This research establishes an empirical baseline for optimizing the instrument’s cultural sensitivity and structural integrity prior to large-scale application.
References
Afifuddin, A., Amri, M., Latif, A., Rosmini, R., and Bin Tahir, S. Z. (2025). Negotiating multicultural values within centralized education systems: A case study of Indonesia. Frontiers in Education, 10, 1620685. DOI: https://doi.org/10.3389/feduc.2025.1620685.
Amarullah, R.Q., Ruslandi, R, Fadilah, R.M.Y., Ruswandi, U., and Erihadiana, M. (2024). Effective multicultural education strategies to enhance tolerance in Indonesian schools. Atthulab: Islamic Religion Teaching and Learning Journal, 9(1), 142-151. DOI: https://doi.org/10.15575/ath.v9i1.28123.
Avinç, E. and Doğan, F. (2024). Digital literacy scale: Validity and reliability study with the rasch model. Education and Information Technologies, 29(17), 22895–22941. DOI: https://doi.org/10.1007/s10639-024-12662-7.
Beaton, D.E., Bombardier, C., Guillemin, F., and Ferraz, M.B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. DOI: https://doi.org/10.1097/00007632-200012150-00014.
Cain, M. K., Zhang, Z., and Yuan, K.-H. (2017). Univariate and multivariate skewness and kurtosis for measuring nonnormality: Prevalence, influence and estimation. Behavior Research Methods, 49(5), 1716–1735. DOI: https://doi.org/10.3758/s13428-016-0814-1.
Erdem, D. (2020). Multicultural competence scale for prospective teachers: Development, validation and measurement invariance. Eurasian Journal of Educational Research, 20(87), 1–28. Retrieved from: https://ejer.com.tr/multicultural-competence-scale-for-prospective-teachers-development-validation-and-measurement-invariance/.
Fatmawati, L., Dewi, K.P., and Wuryandani, W. (2023). Multicultural competence of elementary teacher education students. International Journal of Elementary Education, 7(4), 721–730. DOI: https://doi.org/10.23887/ijee.v7i4.62880.
Fornell, C. and Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. DOI: https://doi.org/10.1177/002224378101800104.
Gaskin, J.E., Lowry, P.B., Rosengren, W., and Fife, P.T. (2025). Essential validation criteria for rigorous covariance-based structural equation modelling. Information Systems Journal, 35(6), 1630–1661. DOI: https://doi.org/10.1111/isj.12598.
Ghasemi, A. and Zahediasl, S. (2011). Normality tests for statistical analysis: A guide for non-statisticians. International Journal of Endocrinology and Metabolism, 10(2), 486-489. DOI: https://doi.org/10.5812/ijem.3505.
Goretzko, D., Siemund, K., and Sterner, P. (2023). Evaluating model fit of measurement models in confirmatory factor analysis. Educational and Psychological Measurement, 84(1), 123–144. DOI: https://doi.org/10.1177/00131644231163813.
Güneşer, R., Kirimlioğlu, N., and Kalaycioğlu, O. (2025). Validity and reliability of the Turkish version of the Ethical sensitivity scale. Ethics and Behavior, 1–14. DOI: https://doi.org/10.1080/10508422.2025.2534938.
Hair, J.F. (2019). Multivariate data analysis (Eighth edition). Boston: Cengage.
Hair, J.F., Black, W.C., Babin, B.J., and Anderson, R.E. (2019). Multivariate data analysis (Eighth edition). Boston: Cengage.
Harbison, L. and Simmons, K. (2024). Fundamentals of descriptive statistics. American Dental Hygienists’ Association, 98(5), 51–54. Retrieved from: https://pubmed.ncbi.nlm.nih.gov/39406491/.
Henseler, J., Ringle, C.M., and Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. DOI: https://doi.org/10.1007/s11747-014-0403-8.
Iacobucci, D., Román, S., Moon, S., and Rouziès, D. (2025). A tutorial on what to do with skewness, kurtosis, and outliers: New insights to help scholars conduct and defend their research. Psychology and Marketing, 42(5), 1398–1414. DOI: https://doi.org/10.1002/mar.22187.
Indu, P.V., Vidhukumar, K., Chacko, D., Menon, V., Grover, S., and Gupta, S. (2025). Criterion validity, construct validity, and factor analysis: An introductory overview. Indian Journal of Psychiatry, 67, 916-921. DOI: https://doi.org/10.4103/indianjpsychiatry_911_25.
Jackson, D.L., Gillaspy, J.A., and Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6–23. DOI: https://doi.org/10.1037/a0014694.
Kaiser, H.F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. DOI: https://doi.org/10.1007/BF02291575.
Kamath, A., Poojari, S., and Varsha, K. (2025). Assessing the robustness of normality tests under varying skewness and kurtosis: a practical checklist for public health researchers. BMC Medical Research Methodology, 25(1), 206. DOI: https://doi.org/10.1186/s12874-025-02641-y.
Khalim, A.D.N. and Parut, W. (2025). Paradigma and programs multicultural education in inclusive madrasah. Journal of Contemporary Islamic Education, 5(1), 28–44. DOI: https://doi.org/10.25217/jcie.v5i1.5115.
Kline, R.B. (2016). Principles and practice of structural equation modeling (4th ed.). New York: The Guilford Press.
Korkmaz, S., Goksuluk, D., and Zararsiz, G. (2014). MVN: An R package for assessing multivariate normality. The R Journal, 6(2), 151-162. DOI: https://doi.org/10.32614/RJ-2014-031.
Mariyono, D. (2024). Indonesian mosaic: The essential need for multicultural education. Quality Education for All, 1(1), 301–325. DOI: https://doi.org/10.1108/QEA-05-2024-0042.
Mcneish, D. and Wolf, M.G. (2023). Dynamic fit index cutoffs for confirmatory factor analysis models. Psychological Methods, 28(1), 61–88. DOI: https://doi.org/10.1037/met0000425.
Nagy, T., Hergert, J., and Elsherif, M.M. (2025). Bestiary of questionable research practices in psychology. Advances in Methods and Practices in Psychological Science, 8(3), 25152459251348431. DOI: https://doi.org/10.1177/25152459251348431.
Ningtyas, D.W. (2024). Peran guru dalam pendidikan multikultural untuk membentuk karakter peserta didik di era society 5.0. Jurnal MIPA dan Pembelajarannya, 4(3), 3. Retrieved from: https://journal3.um.ac.id/index.php/mipa/article/view/5306.
Papini, N., Kang, M., Ryu, S., Griese, E., Wingert, T., and Herrmann, S. (2020). Rasch calibration of the 25-item Connor-Davidson Resilience Scale. Journal of Health Psychology, 26(11), 1976–1987. DOI: https://doi.org/10.1177/1359105320904769.
Pratama, R., Sumantri, S.H., and Widodo, P. (2023). The role of teachers in implementing multicultural education at Taruna Nusantara High School to enhance social resilience. International Journal of Humanities Education and Social Sciences (IJHESS), 3(1), 167-176. DOI: https://doi.org/10.55227/ijhess.v3i1.580.
Pratiwi, H., Dwiningrum, S.I.A., Riwanda, A., and Minasyan, S. (2024). Insights into multicultural competence of early childhood teacher candidates in Indonesian Islamic Higher Education. EDUKASI: Jurnal Penelitian Pendidikan Agama dan Keagamaan, 22(1), 79–96. DOI: https://doi.org/10.32729/edukasi.v22i1.1813.
Quast, J., Rubach, C., and Porsch, R. (2023). Professional digital competence beliefs of student teachers, pre-service teachers and teachers: Validating an instrument based on the DigCompEdu framework. European Journal of Teacher Education, 48(4), 698–721. DOI: https://doi.org/10.1080/02619768.2023.2251663.
Schamberger, T., Schuberth, F., and Henseler, J. (2022). Confirmatory composite analysis in human development research. International Journal of Behavioral Development, 47(1), 89–100. DOI: https://doi.org/10.1177/01650254221117506.
Soto-Sanfiel, M.T., Angulo-Brunet, A. and Lutz, C. (2025). The scale of artificial intelligence literacy for all (SAIL4ALL): Assessing knowledge of artificial intelligence in all adult populations. Humanities and Social Sciences Communications, 12, 1618. DOI: https://doi.org/10.1057/s41599-025-05978-3.
Sovey, S., Osman, K., and Mohd-Matore, M.E.E. (2022). Exploratory and confirmatory factor analysis for disposition levels of computational thinking instrument among secondary school students. European Journal of Educational Research, 11(2), 639–652. DOI: https://doi.org/10.12973/eu-jer.11.2.639.
Spanierman, L.B., Oh, E., Heppner, P.P., Neville, H.A., Mobley, M., Wright, C.V., Dillon, F.R., and Navarro, R. (2011). The multicultural teaching competency scale: development and initial validation. Urban Education, 46(3), 440–464. DOI: https://doi.org/10.1177/0042085910377442.
Tesio, L., Caronni, A., Simone, A., Kumbhare, D., and Scarano, S. (2023). Interpreting results from Rasch analysis 2. Advanced model applications and the data-model fit assessment. Disability and Rehabilitation, 46(3), 604–617. DOI: https://doi.org/10.1080/09638288.2023.2169772.
Umar, J. and Nisa, Y.F. (2020). Uji validitas konstruk dengan CFA dan pelaporannya. Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I), 9(2), 1–11. DOI: https://doi.org/10.15408/jp3i.v9i2.16964.
Villar-Guevara, M., Livia-Segovia, J.H., García-Salirrosas, E.E., and Fernández-Mallma, I. (2024). Student Evaluation of Teachers’ Effectiveness (SETE) scale: Translation, cross-cultural adaptation and psychometric properties in a Latin American sample. Frontiers in Education, 9, 1401718. DOI: https://doi.org/10.3389/feduc.2024.1401718.
Widodo, W. and Chotimah, C. (2023). Adaptasi dan analisis psikometri skala kompetensi multikultural calon guru menggunakan pemodelan Rasch. Jurnal Pendidikan dan Kebudayaan, 8(2), 153–172. DOI: https://doi.org/10.24832/jpnk.v8i2.4228.
Yang, Y. and Liang, X. (2013). Confirmatory factor analysis under violations of distributional and structural assumptions. International Journal of Quantitative Research in Education, 1(1), 61–84. DOI: https://doi.org/10.1504/IJQRE.2013.055642.
Youssef, N., Saleeb, M., Gebreal, A., and Ghazy, R.M. (2023). The internal reliability and construct validity of the Evidence-Based Practice Questionnaire (EBPQ): Evidence from healthcare professionals in the eastern mediterranean region. Healthcare, 11(15), 2168. DOI: https://doi.org/10.3390/healthcare11152168.
Downloads
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Wahyu Widodo, Sugiantoro Sugiantoro
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
