Contribution to knowledge in Educational Research through scale validation studies: a critical review on the work of M. Tourón et al. (2023) and the methodological analysis by Martínez-García (2024)
Article Sidebar
Main Article Content
Abstract
In the scientific literature, there is a considerable volume of research proposing the design and validation of measurement scales in the field of educational sciences. This work presents, from the perspective of applied educational research, a critical analysis of the validation of the detection scale for high-ability students (GRS 2) for parents published by M. Tourón et al. (2023) in Revista de Educación, taking into account the methodological critique made by Martínez-García (2024) of said validation. The present proposal aims to contribute to this dialogue by analyzing both publications and formulating improvement issues, focusing especially on the theoretical foundation of the models, the formulation of reflective and formative compounds, and the adequacy of using alternative goodness-of-fit indicators to Chi Square in the confirmatory factor analysis model. Certain procedures deeply established in psychometric validation studies within educational research are observed, which, besides not promoting the understanding of the theoretical foundations underlying the scale, hinder its subsequent appropriate use by applied researchers in diagnostic or experimental studies. Thus, the analyzed arguments highlight the need to reconsider, in our view, some of the common practices in this type of studies that diminish their relevance and the implications of the results obtained for the development of educational theory and practice.
Keywords: scales validation, explanatory factor analysis, confirmatory factor analysis, structural equations modelling, formative models.
Article Details
References
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (Second edition). Guilford Publications.
Chin, W. W. (1998). Commentary: Issues and opinion on structural equation modeling. MIS Quarterly, 22(1), vii–xvi.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2.a ed.). Routledge. https://doi.org/10.4324/9780203771587
Curran, P. J., West, S. G, & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16-29.
Educación XX1 (2024). Normas para la presentación de originales. https://revistas.uned.es/index.php/educacionXX1/libraryFiles/downloadPublic/170
Fumero, A., & Miguel, A. de. (2023). Validación de la versión española del NEO-FFI-30. Análisis y Modificación de Conducta, 49(179), Article 179. https://doi.org/10.33776/amc.v49i179.7325
Grissom, R. J., & Kim, J. J. (2011). Effect sizes for research: Univariate and multivariate applications. Routledge Academic.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) (3ª Ed.). Sage.
Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–152. https://doi.org/10.2753/MTP1069-6679190202
Hayduk, L. A. (2014). Shame for disrespecting evidence: The personal consequences of insufficient respect for structural equation model testing. BMC: Medical Research Methodology, 14(124). https://doi.org/10.1186/1471-2288-14-124
Hernández Ramos, J. P., Martínez Abad, F., García Peñalvo, F. J., Herrera García, M. E., & Rodríguez Conde, M. J. (2014). Teachers’ attitude regarding the use of ICT. A factor reliability and validity study. Computers in Human Behavior, 31, 509-516. https://doi.org/10.1016/j.chb.2013.04.039
Hu, L., Bentler, P.M., & Kano, Y. (1992). Can test statistics in covariance structure analysis be trusted? Psychological Bulletin, 112(2), 351-362.
MacCallum, R. C., Roznowski, M., & Necowitz, L. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111(3), 490-504. https://doi.org/10.1037/0033-2909.111.3.490
Martínez-García, J. A., & Martínez-Caro, L. (2009). El análisis factorial confirmatorio y la validez de escalas en modelos causales. Anales de Psicología, 25(2), Article 2.
Martínez-García, J.A. (2024, en prensa). Crítica del análisis de la validez de constructo de la Escala de Detección de alumnos con Altas Capacidades para Padres (GRS 2); réplica a Tourón et al. (2023). Revista de Educación.
Norman, I., & Griffiths, P. (2008). Duplicate publication and «salami slicing»: Ethical issues and practical solutions. International Journal of Nursing Studies, 45(9), 1257-1260. https://doi.org/10.1016/j.ijnurstu.2008.07.003
Quijada, A., Ruiz, M. A., Huertas, J. A., & Alonso-Tapia, J. (2020). Desarrollo y validación del Cuestionario de Clima Escolar para Profesores de Secundaria y Bachillerato (CES-PSB). Anales de Psicología, 36(1), 155-165. https://doi.org/10.6018/analesps.36.1.341001
Rodríguez Conde, M. J., Olmos Migueláñez, S., & Martínez Abad, F. (2012). Propiedades métricas y estructura dimensional de la adaptación española de una escala de evaluación de competencia informacional autopercibida (IL-HUMASS). Revista de investigación educativa, 30(2), 347-365.
Sánchez-Prieto, J. C., Hernández-García, Á., García-Peñalvo, F. J., Chaparro-Peláez, J., & Olmos-Migueláñez, S. (2019). Break the walls! Second-Order barriers and the acceptance of mLearning by first-year pre-service teachers. Computers in Human Behavior, 95, 158–167. https://doi.org/10.1016/j.chb.2019.01.019
Schmitt, T. A., Sass, D. A., Chappelle, W., & Thompson, W. (2018). Selecting the “Best” Factor Structure and Moving Measurement Validation Forward: An Illustration. Journal of Personality Assessment, 100(4), 345-362. https://doi.org/10.1080/00223891.2018.1449116
Šupak Smolčić, V. (2013). Salami publication: Definitions and examples. Biochemia Medica, 23(3), 237-241. https://doi.org/10.11613/BM.2013.030
Thomas, H. J., Scott, J. G., Coates, J. M., & Connor, J. P. (2019). Development and validation of the Bullying and Cyberbullying Scale for Adolescents: A multi-dimensional measurement model. British Journal of Educational Psychology, 89(1), 75-94. https://doi.org/10.1111/bjep.12223
Tourón, J., Martín, D., Navarro-Asencio, E., Pradas, S., & Iñigo, V. (2018). Validación de constructo de un instrumento para medir la competencia digital docente de los profesores (CDD). Revista española de pedagogía, 76(269), 25-54. https://doi.org/10.22550/REP76-1-2018-02
Tourón, M., Tourón, J., & Navarro-Asencio, E. (2023). Validez de Constructo de la Escala de Detección de Alumnado con Altas Capacidades para Profesores de Educación Infantil, Gifted Rating Scales (GRS2-P), en una muestra española. RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa, 29(2), Article 2. https://doi.org/10.30827/relieve.v29i2.27787
Tourón, M., Tourón, J., & Navarro-Asencio, E. (2024). Validación española de la Escala de Detección de altas capacidades, «Gifted Rating Scales 2 (GRS 2-S) School Form», para profesores. Estudios sobre Educación, 46, 33-55. https://doi.org/10.15581/004.46.002