Psychometric Properties and measurement invariance by gender of the Teacher Competency Evaluation Scale for Physical Education in the Mexican Context
DOI:
https://doi.org/10.47197/retos.v46.93958Abstract
This is a study to obtain evidence of validity, whose purpose was to analyze the psychometric properties and the measurement invariance by gender of the Teacher Competency Evaluation Scale for Physical Education (EECD-EF, by it acronym in Spanish) for secondary schools in the Mexican context. Participants were 748 high school students with a mean age of 13.99 years, of whom 374 were female. The results from the Confirmatory Factor Analysis (CFA) support the unifactorial model. The EECD-EF meets the requirements for convergent validity. In addition, the correlation with the Satisfaction subscale of Intrinsic School Satisfaction Scale (ISDS) was positive and significant, providing evidence of validity of association with other variables. However, no discriminatory correlation was found with the Boredom subscale. It’s concluded that the EECD-EF serves as an efficient instrument to assess the measurement invariance of the teachers’ competency from the students’ point of view according to gender.
References
Ainley, J. & Carstens, R. (2018). Teaching and Learning International Survey (TALIS) 2018 Conceptual Framework. OECD Publishing. https://doi.org/10.1787/799337c2-en
Aparicio, J.L., & Fraile, A. (2015). La evaluación de competencias interpersonales en la formación del profesorado de Educación Física a través de un programa de expresión corporal. International Journal for 21st Century Education, 2(2), 21-34. https://doi.org/10.21071/ij21ce.v2i2.4266
Baena-Extremera, A., Granero-Gallegos, A., & Martínez-Molina, M. (2015). Validación española de la Escala de la Competencia Docente, Evaluación en Educación Física de secundaria. Cuadernos de Psicología del Deporte, 15(3), 113-122. https://dx.doi.org/10.4321/S1578-84232015000300011
Baños, R., Baena-Extremera, A., & Granero-Gallegos, A. (2019). The Relationships between High School Subjects in terms of School Satisfaction and Academic Performance in Mexican Adolescents. Int. J. Environ. Res Public Health, 16(18), 3494-3507. https://doi.org/10.3390/ijerph16183494
Baños, R., Baena-Extremera, A., & Ortiz-Camacho, M.D.M. (2019). Prediction of the satisfaction with the student life, based on teaching competence and satisfaction with the school. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02506
Baños, R., Baena-Extremera, A., Ortiz-Camacho, M.M., Zamarripa, J., Beltrán A., & Juvera, J.L. (2019). Influencia de las competencias del profesorado de secundaria en los comportamientos disruptivos en el aula. Espiral. Cuadernos del Profesorado, 12(24), 3-10. https://doi.org/10.25115/ecp.v12i24.2141
Baños, R., Barretos-Ruvalcaba, M., & Baena-Extremera, A. (2019). Protocolo de estudio de las variables académicas, psicológicas y de actividad física que influyen en el rendimiento académico de adolescentes mexicanos y españoles. Espiral, 12, 89–99. https://doi.org/10.25115/ecp.v12i25.2480
Baños, R., Ortiz-Camacho, M.M., Baena-Extremera, A., & Tristán-Rodríguez, J.L. (2017). Satisfacción, motivación y rendimiento académico en estudiantes de Secundaria y Bachillerato. Espiral, Cuadernos del Profesorado, 10(20), 40–50. https://doi.org/10.25115/ecp.v10i20.1011
Barba-Martín, R.A., Hernando-Garijo, A., Hortigüela-Alcalá, D., & González-Calvo, G. (2020). After nearly a decade of Bolonia, have we really improved teaching quality?| Espiral. Cuadernos del Profesorado, 13(27), 97-108.http://dx.doi.org/10.25115/ecp.v13i27.3186
Blázquez, D. (2013). Diez competencias docents para ser major professor de Educación Física. Barcelona: Inde.
Bollen, K.A., & Long, J. (1994). Testing structural equation models. Newbury Park. Sage.
Brown, T. (2015). Confirmatory Factor Analysis for Applied Research. Guilford Publications.
Carretero-Dios, H., & Perez, C. (2007). Standards for the development and the review of instrumental studies: Considerations about test selection in psychological research. International Journal of Clinical and Health Psychology, 7(3), 863-882. http://www.aepc.es/ijchp/carretero_es.pdf
Catano, V. M., & Harvey, S. (2011). Student perception of teaching effectiveness: development and validation of the Evaluation of Teaching Competencies Scale (ETCS). Assess Eval High Edu, 36(6), 701-717. https://doi.org/10.1080/02602938.2010.484879
Chen, F.F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cheung, G.W., & Rensvold, R.B. (2002). Evaluating Goodness-Of-Fit Indexes for Testing Measurement Invariance. Struct. Equation Model. A Multidisciplinary J., 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Cochran, W, G. (1991). Sampling Techniques. John Wiley.
Colman, A.M., Norris, C.E., & Preston, C.C. (1997). Comparing rating scales of different lengths: Equivalence of scores from 5-point and 7-point scales. Psychological Reports, 80(2), 355–362. https://doi.org/10.2466/pr0.1997.80.2.355
de Winter, J.C.F., Gosling, S.D., & Potter, J. (2016). Comparing the pearson and spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data. Psychological Methods, 21(3), 273–290. https://doi.org/10.1037/met0000079
Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121–149. https://doi.org/10.1177/0748175610373459
Fortuin, J., van Geel, M., & Vedder, P. (2015). Peer influences on internalizing and externalizing problems among adolescents: A longitudinal social network analysis. Journal of Youth and Adolescence, 44, 887-897. https://doi.org/10.1007/s10964-014-0168-x
Gallego-Ortega, J.L., & Rodríguez-Fuentes, A. (2019) Percepciones del profesorado sobre competencias comunicativas de futuros maestros de educación. Revista Internacional de Medicina y Ciencias de la Actividad Física y el Deporte, 19(75), 479-492. https://doi.org/10.15366/rimcafd2018.71.005
Granero-Gallegos, A., Baños, R., Baena-Extremera, A., & Martínez-Molina, M. (2020). Analysis of misbehaviours and satisfaction with school in secondary education according to student gender and teaching competence. Frontiers in Psychology, 11(63). https://doi.org/10.3389/fpsyg.2020.00063
Guillén-Gámez, F. D., & Perrino, M. (2020). Análisis Univariante de la Competencia Digital en Educación Física: un estudio empírico. Retos: nuevas tendencias en educación física, deporte y recreación, (37), 326-332. https://doi.org/10.47197/retos.v37i37.72052
Hair, J.F., Black, W. C., Babin, B. J., & Anderson, R.E. (2019). Multivariate Data Analysis. Pearson New International Edition. Cengage Learning.
Helsinki Declaration (2008). World Medical Association. https://www.wma.net/es/policies-post/declaracion-de-helsinki-de-la-amm-principios-eticos-para-las-investigaciones-medicas-en-seres-humanos/
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria. Conventional criteria versus new alternatives, Structural Equation Modeling: A Multidisciplinary Journal, 6(1). https://doi.org/10.1080/10705519909540118
INEGI (2019). Características educativas de la población. Instituto Nacional de Estadística y Geografía. https://www.inegi.org.mx/temas/educacion/default.html#Tabulados
Jones-Jofré, J., Müller-Pérez, S., & Barraza-Gómez, F. (2022). Efecto de la asignatura de educación física en la percepción de los estudiantes frente al desarrollo de competencias genéricas. Retos: nuevas tendencias en educación física, deporte y recreación, 44, 496-503. https://doi.org/10.47197/retos.v44i0.90654
Jöreskog, K.G., & Sörbom, D. (2003). Structural equation modeling with the SIMPLIS command language. Chicago: Scientific Software International.
Liddell, T.M., & Kruschke, J.K. (2018). Analyzing ordinal data with metric models: What could possibly go wrong? Journal of Experimental Social Psychology, 79, 328–348. https://doi.org/10.1016/j.jesp.2018.08.009
Lidice, A., & Saglam, G. (2012). Using student evaluations to measure educational quality. Procedia-Social and Behavioral Sciences, 70, 1009-1015. https://doi.org/10.1016/j.sbspro.2013.01.152
Lleixá, T., Torralba, M.A., & Abrhao, S.R. (2010). Evaluación de competencias en Educación Física: Investigación-acción para el diseño de procedimientos de evaluación en la Etapa Primaria. Movimento, 6(4), 33-51. https://www.redalyc.org/pdf/1153/115316963003.pdf
Luna, E., Calderón, N., Caso, J. & Cordero, G. (2012). Desarrollo y validación de un cuestionario de evaluación de la competencia docente con base en la opinión de los estudiantes. En E. J. Cisneros-Cohernour, B. García-Cabrero, E. Luna y R. Marín (Coords.), Evaluación de Competencias Docentes en la Educación Superior (pp.119-158). Juan Pablos Editor.
Mardia, K.V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519
Marsh, H.W., Ginns, P., Morin, A.J.S., Nagengast, B., & Martin, A.J. (2011). Use of Student Ratings to Benchmark Universities: Multilevel Modeling of Responses to the Australian Course Experience Questionnaire (CEQ). Journal of Educational Psychology, 103(3), 733-748. https://psycnet.apa.org/doi/10.1037/a0024221
Martínez-Mínguez, L., Moya, L., & Arnau-Sabatés, L. (2022). ECPP-FIM an assessment tool for evaluating the professional psychomotor skills within the initial teacher training: validity evidences. Retos, 43, 510-520. https://recyt.fecyt.es/index.php/retos/index
Martínez-Molina, M., Granero-Gallegos, A., Baena-Extremera, A., & Baños, R. (2020). Invarianza factorial por sexo del Cuestionario para las Conductas Disruptivas y Escala de Evaluación de la Competencia Docente en Educación Física en estudiantes de secundaria. Psychology, Society, & Education, 12(2), 125-137. https://doi.org/10.25115/psye.v12i2.3172
McClowry, S.G., Rodriguez, E.T., Tamis-LeMonda, C.S., Spellmann, M.E., Carlson, A., & Snow, D. L. (2013). Teacher/student interactions and classroom behavior: the role of student temperament and gender. J. Res. Child Educ. 27, 283–301. https://doi.org/10.1080/02568543.2013.796330
Milfont, T.L., & Fisher, R. (2010). Testing measurement invariance across groups: Applications in cross. International Journal of Psychological Research, 3(1), 111–121. https://doi.org/10.21500/20112084.857
Moreno-Murcia, J.A., Silveira, Y., & Belando, N. (2015). Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university. New Approaches In Educational Research, 4(1), 54-61. https://doi.org/0.7821/naer.2015.1.106
Navio, A. (2005). Propuestas conceptuales en torno a la competencia profesional. Revista de Educación, 337, 213-234. https://redined.mecd.gob.es/xmlui/bitstream/handle/11162/68040/00820053000213.pdf?sequence=1
OECD (2013). Teaching and Learning International Survey TALIS 2013. Conceptual Framework. https://www.oecd.org/education/school/TALIS%20Conceptual%20Framework_FINAL.pdf
Ojeda-Nahuelcura, R., Carter-Thuillier, B., López-Pastor, V., Fuentes-Nieto, T., & Gallardo-Fuentes, F. (2022). Evaluación de competencias genéricas en profesores de Educación Física. Retos: nuevas tendencias en educación física, deporte y recreación, (43), 521-532. https://doi.org/10.47197/retos.v43i0.88796
OXFAM NOVID (2011). Educadores de calidad: Estudio internacional sobre las competencias y estándares para docentes. Internacional de la Educación. https://download.ei-ie.org/Docs/WebDepot/Quality%20Ed%20Study%20ES.PDF
Palacios, A., López-Pastor, V., & Fraile, A. (2019). Cuestionario de percepción de competencias docentes de Educación Física. Revista Internacional de Medicina y Ciencias de la Actividad Física y el Deporte, 19(75), 445-461. https://doi.org/10.15366/rimcafd2019.75.005
Perea R.L., & Abello, C. M. (2022). Competencias digitales en estudiantes y docentes universitarios del área de la educación física y el deporte. Retos: nuevas tendencias en educación física, deporte y recreación, (43), 1065-1072. https://dialnet.unirioja.es/servlet/articulo?codigo=8106411
Rivera, A., & Alfageme-González, M.B. (2019). Teacher Training for In-Service Secondary School Teachers in Mexico. Revista Educación, 43(1), 30-43. https://doi.org/10.15517/revedu.v43i1.28446
Ruiz-Juan, F., Baena-Extremera, A., & Baños, R. (2017). Nivel de actividad deportiva en el tiempo libre desde las etapas de cambio y motivación en estudiantes de Costa Rica, México y España. Cuadernos de Psicología del Deporte, 17(2), 53-64. https://revistas.um.es/cpd/article/view/301891
Salcines-Talledo, I., González-Fernández, N., Ramírez-García, A., & MartínezMínguez, L. (2018). Validación de la Escala de Autopercepción de Competencias Transversales y Profesionales de Estudiantes de Educación Superior. Profesorado. Revista de Currículum y formación del Profesorado, 22(3), 31-51. https://doi.org/10.30827/profesorado.v22i3.7989
Secretaría de Educación Pública (2017). Perfiles, parámetros e indicadores para docentes y técnicos docentes en Educación Básica. SEP. http://www.sev.gob.mx/servicio-profesional-docente/files/2017/01/PPI_INGRESO_EB_2017_2018.pdf
Stratton, G., Fairclough, S.J., & Ridgers, N.D. (2008). Physical activity levels during the school day. En A.L. Smith y S.J.H. Biddle (Eds), Youth Physical Activity and Sedentary Behavior. Challenges and Solutions (pp. 321–350). Human Kinetics.
Putnick, D.L., & Bornstein, M.H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004
Tejada, J. (2005). El trabajo por competencias en el prácticum: cómo organizarlo y cómo evaluarlo. Revista Electrónica de Investigación Educativa, 7(2). http://redie.uabc.mx/vol7no2/contents-tejada.html
Tul, M., Leskosek, B., Jurak, G., & Kovac, M. (2015). Perceived importance of slovenian physical education teachers’ professional competencies. HU Journal of Education, 30(1), 268-281. http://efdergi.hacettepe.edu.tr/yonetim/icerik/makaleler/35-published.pdf
Vandenberg, R.J., & Lance, C.E. (2000). A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organizational Res. Methods, 3(1), 4–70. https://psycnet.apa.org/doi/10.1177/109442810031002
Wallhead, T., & Buckworth, J. (2004). The role of physical education in the promotion of youth physical activity. Quest, 56, 285-301. https://www.researchgate.net/publication/234762436_The_Role_of_Physical_Education_in_the_Promotion_of_Youth_Physical_Activity
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Challenges
![Creative Commons License](http://i.creativecommons.org/l/by-nc-nd/4.0/88x31.png)
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and ensure the magazine the right to be the first publication of the work as licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of authorship of the work and the initial publication in this magazine.
- Authors can establish separate additional agreements for non-exclusive distribution of the version of the work published in the journal (eg, to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Is allowed and authors are encouraged to disseminate their work electronically (eg, in institutional repositories or on their own website) prior to and during the submission process, as it can lead to productive exchanges, as well as to a subpoena more Early and more of published work (See The Effect of Open Access) (in English).
This journal provides immediate open access to its content (BOAI, http://legacy.earlham.edu/~peters/fos/boaifaq.htm#openaccess) on the principle that making research freely available to the public supports a greater global exchange of knowledge. The authors may download the papers from the journal website, or will be provided with the PDF version of the article via e-mail.