Psychoeducational instruments for socio-pedagogical intervention: validation of criteria employed in the situational test for socio-emotional competence development among young people (DCSE-J)

Keywords: situational test, socio-emotional competences, young people, criterion validity, psychoeducational instrument

Abstract

Socio-emotional competences are fundamentally important for the psychological, social and academic development of young people, and especially those in highly vulnerable contexts. It is essential that Social Pedagogy socio-educational interventions with these young people take these competences into consideration. However, there are no copyleft diagnostical instruments in this area. In this study, we present a validation of the criteria employed in the situational test for Socio-emotional Competence Development among Young People (DCSE-J), a copyleft instrument designed for 12- to 18-year-old boys and girls and adapted for use with both young people who live with their families and in care centres. A total of 409 secondary school students were asked to take the test and identify peers whose behaviour showed signs of these competences. The results showed that those students nominated most often by their peers also scored highest in the test. It was also observed that girls were nominated more often and had higher test scores. In addition, the results showed the multidimensional nature of the test items and the multilevel interrelationship of the competences, meaning that the mastery of more complex competences requires the mastery of more basic ones. The results demonstrated the criterion validity of the test and that the DCSE-J test is a valid psycho-educational evaluation instrument for measuring socio-emotional competences among young people. This, in turn, allows for specific pedagogical intervention that addresses the specific socio-emotional competences of the group.

Author Biographies

Aida Urrea-Monclús, Autonomous University of Barcelona

Profesora lectora (ayudante doctor) Serra Hunter del Departamento de Teoría de la Educación y Pedagogía Social de la Universidad Autónoma de Barcelona. Su investigación y docencia se centra en la promoción de los derechos de la infancia tanto en el sistema de protección a la infancia como en el sistema educativo. Actualmente, participa en investigaciones para favorecer la participación de jóvenes en el sistema de protección, especialmente en su proceso de transición a la vida independiente y en los procesos de reunificación familiar. Forma parte del Grupo IARS (Infancia y Adolescencia en Riesgo Social), del Grupo GRISIJ y de la Cátedra Educación y Adolescencia.

Sara Rodríguez-Pérez, Universidad de Oviedo

Profesora ayudante doctor del Departamento de Ciencias de la Educación de la Universidad de Oviedo. Es maestra, pedagoga y sexóloga. Coordinó y desarrolló el proyecto Asexora (Asesoramiento Sexológico dirigido a población joven) en colaboración con elConsejo de la Juventud del Principado de Asturias. Ha participado en proyectos de investigación sobre intervención con familias en espacios formativos, influencia del género en las decisiones académicas, bienestar de jóvenes ex-tutelados, educación emocional y Formación Profesional Dual. Actualmente forma parte del grupo IARS.

Josefina Sala-Roca, Universitat Autònoma de Barcelona

Profesora Titular del Departamento de Teoría de la Educación y Pedagogía Social de la Universidad Autónoma de Barcelona. Coordina el Grupo de Investigación en Infancia y Adolescencia en Riesgo Social (IARS). El grupo IARS ha desarrollado diversos estudios sobre el desarrollo de competencias socioemocionales y de empleabilidad de niños, niñas y jóvenes.
También, en colaboración con FEPA, FEDAIA y DGAIA entre otros, ha desarrollado estudios sobre los factores que inciden en el bienestar y desarrollo positivo de los jóvenes tutelados, así como de las dificultades y apoyos a su transición a la vida independiente. Las investigaciones desarrolladas se han publicado en diversos artículos e informes.

Nair Elizabeth Zárate-Alva, Universitat Autònoma de Barcelona

Profesora Asociada del Departamento de Teoría de la Educación y Pedagogía Social de la Universidad Autónoma de Barcelona. Psicóloga con más de 15 años de experiencia en el ámbito clínico-social-educativo. Profesora e investigadora en la UAB y UB, siendo sus líneas de estudio los colectivos en riesgo social y la Inteligencia Emocional en el contexto Iberoamericano. Psicoterapeuta en LOAPSI, miembro fundadora de Yachay (Red de Investigador@s y Profesionales Peruan@s en Cataluña), y miembro activa de la Sección de Psicología Clínica, de la Salud y Psicoterapia del Colegio Oficial de Psicología de Cataluña (COPC) y Europsy.

References

Bar-On, R. & Parker, J. (2000). EQ-I: YV. Bar-On Emotional Quotient inventory: Youth version. Technical manual. Multi Health Systems, Inc.

Bono, J.E., & Vey, M.A. (2007). Personality and emotional performance: Extraversion, neuroticism, and self-monitoring. Journal of Occupational Health Psychology, 12(2), 177–192. https://doi.org/10.1037/1076-8998.12.2.177

Dozier, M., & Rutter, M. (2008). Challenges to the development of attachment relationships faced by young children in foster and adoptive care. In J. Cassidy & P. R. Shaver (Eds.), Handbook of attachment: Theory, research, and clinical applications (p. 698–717). The Guilford Press.

Extremera, N., Fernández-Berrocal, P., & Salovey, P. (2006). Spanish version of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). Version 2.0: reliabilities, age and gender differences. Psicothema, 18(Suppl), 42–48. Retrieved fromhttp://www.psicothema.com/psicothema.asp?ID=3274

Fernández-Berrocal, P., Cabello, R., Castillo, R., & Extremera, N. (2012). Gender differences in emotional intelligence: The mediating effect of age. Behavioral Psychology / Psicología Conductual: Revista Internacional Clínica y de la Salud, 20(1), 77–89.

Franco, M.G., Beja, M., Candeias, A. & Santos, N. (2017). Emotion Understanding, Social Competence and School Achievement in Children from Primary School in Portugal. Frontiers in Psychology, 8, Article 1376. https://doi.org/10.3389/fpsyg.2017.01376

Golubovich, J., Lake, C. J., Anguiano-Carrasco, C., & Seybert, J. (2020). Measuring achievement striving via a situational judgment test: the value of additional context. Journal of Work and Organizational Psychology, 36(2), 157-167.

Herde, C.N., Lievens, F., Solberg, E.G., Harbaugh, J.L., Strong, M.H., & Burkholder, G.J. (2019). Situational judgment tests as measures of 21st century competences: Evidence across Europe and Latin America. Journal of Work and Organizational Psychology, 35, 65-74. https://doi.org/10.5093/jwop2019a8

Lievens, F. (2017). Construct-driven SJTs: Toward an agenda for future research. International Journal of Testing, 17(3), 269-276. https://doi.org/10.1080/15305058.2017.1309857

Lievens, F., & Chan, D. (2017). Practical Intelligence, Emotional Intelligence, and Social Intelligence. En J.L. Farr, N.T. Tippins (Eds.), Handbook of Employee Selection (pp.342-364). Routledge. Retrieved from https://ink.library.smu.edu.sg/soss_research/550

Lievens, F., & Motowidlo, S. J. (2016). Situational judgment tests: From measures of situational judgment to measures of general domain knowledge. Industrial and Organizational Psychology: Perspectives on Science and Practice, 9(1), 3–22. https://doi.org/10.1017/iop.2015.71

Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational judgment tests: A review of recent research. Personnel Review, 37(4), 426-441. https://doi.org/10.1108/00483480810877598

Mancini, G., Passini, S. y Biolcati, R. (2020). The Influence of Trait Emotional Intelligence and Gender Interaction on Draw-A-Person Emotional Indicators during Childhood. Child Indicators Research 13, 1187–1201. https://doi.org/10.1007/s12187-019-09690-y

Mayer, J.D. & Salovey, P. (1997). What is emotional intelligence?. En P. Salovey y D. Sluyter (Eds). Emotional Development and Emotional Intelligence: Implications for Educators (pp.3-31). Basic Books. https://doi.org/10.1037/t05047-000

Mayer, J. D., Salovey, P., Caruso, D. R., & Cherkasskiy, L. (2011). Emotional intelligence. In R. J. Sternberg & S. B. Kaufman (Eds.), The Cambridge Handbook of Intelligence. (pp. 528-549). New York, NY: Cambridge University Press.

McDaniel, M.A., Hartman, N.S., Whetzel, D.L., & Grubb, W.L. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63–91. https://doi.org/10.1111/j.1744-6570.2007.00065.x

McDaniel, M.A., Morgeson, F.P., Finnegan, E.B., Campion, M.A., & Braverman, E.P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86(4), 730–740. https://doi.org/10.1037/0021-9010.86.4.730

McDaniel, M., List, S., & Kepes, S. (2016). The “Hot Mess” of Situational Judgment Test Construct Validity and Other Issues. Industrial and Organizational Psychology, 9(1), 47-51. https://doi.org/10.1017/iop.2015.115

Meshkat, M., & Nejati, R. (2017). Does Emotional Intelligence Depend on Gender? A Study on Undergraduate English Majors of Three Iranian Universities. SAGE Open. https://doi.org/10.1177/2158244017725796

Monnier, M. (2015). Difficulties in defining socio-emotional intelligence, competences and competences-a theoretical analysis and structural suggestion. International journal for research in vocational education and training, 2(1), 59-84. https://doi.org/10.13152/ijrvet.2.1.4

Oriol, X., Sala-Roca, J., & Filella, G. (2014). Emotional competences of adolescents in residential care: Analysis of emotional difficulties for intervention. Children and Youth Services Review, 44, 334-340.

Pérez-González, J.C., Petrides, K.V., & Furnham, A. (2007). La medida de la inteligencia emocional rasgo. En J.M. Mestre y P. Fernández-Berrocal (Coords.) Manual de inteligencia emocional (pp.81-98). Pirámide.

Riggio, H.R. & Riggio, R.E. (2002). Emotional Expressiveness, Extraversion, and Neuroticism: A Meta-Analysis. Journal of Nonverbal Behavior, 26, 195–218. https://doi.org/10.1023/A:1022117500440

Roberts, R.D., MacCann, C., Matthews, G., & Zeidner, M. (2010). Emotional intelligence: Toward a consensus of models and measures. Social and Personality Psychology Compass, 4(10), 821-840. https://doi.org/10.1111/j.1751-9004.2010.00277.x

Saarni, C. (1997). Emotional Competence and Self-Regulation in Childhood. En P. Salovey y D. Sluyter (Eds.), Emotional Development and Emotional Intelligence. Educational Implication (pp.35-64). Basic Books.

Saarni, C. (2000). Emotional competence: A developmental perspective. En R. Bar-On, J.D.A. Parker y D. Goleman (Eds.), The handbook of emotional intelligence: Theory, development, assessment, and application at home, school, and in the workplace (pp.68-91). Jossey-Bass.

Saarni, C. (2008). The interface of emotional development with social context. en M. Lewis, J. Haviland-Jones, y L. Feldman Barrett (Eds.), The handbook of emotions, Third edition (pp.332–347). Guilford Press.

Sala-Roca, J., Filella, G., Oriol, X., Ros, A., Secanilla, E., Rodríguez, M., Soldevila, A. (2016). Test Situacional de Desarrollo de Competencias Socioemocionales (DCSE-J). Versión revisada por Josefina Sala, Anna Soldevila, Sara Rodríguez Pérez, Aida Urrea-Monclús y Nair Zárate en 2020. Universitat Autònoma de Barcelona. Retrieved from https://ddd.uab.cat/record/212951

Sala-Roca, J., Rodríguez-Pérez, S., Doval-Dieguez, E. (2021). Design and validation of a Situational Judgment Test of Socioemotional Competence Development in Young People. In revision

Sánchez-Núñez, M.T., Fernández-Berrocal, P., Montañés, J., & Latorre, J.M. (2008). Does emotional intelligence depend on gender? The socialization of emotional competences in men and women and its implications. Electronic Journal of Research in Educational Psychology, 6(2), 455–474.

Schneider, T.R., Lyons, J.B., & Khazon, S. (2013). Emotional intelligence and resilience. Personality and Individual Differences, 55(8), 909-914. https://doi.org/10.1016/j.paid.2013.07.460

Secanilla, E. & Rodríguez, M. (2016). Guia per al desenvolupament de competències socioemocionals per a joves : estratègies per a les famílies. Universitat Autònoma. Retrieved from https://ddd.uab.cat/record/147585

Soldevila, A. (2016). Guia per al desenvolupament de competències socioemocionals per a joves: estratègies d'intervenció per a professionals. Universitat Autònoma. DDD: Retrieved from https://ddd.uab.cat/record/147654

Sorrel, M.A., Olea, J., Abad, F.J., de la Torre, J., Aguado, D., & Lievens, F. (2016). Validity and Reliability of Situational Judgement Test Scores A New Approach Based on Cognitive Diagnosis Models. Organizational Research Methods, 19(3), 506-532. https://doi.org/10.1177/1094428116630065

Webster, E.S., Paton, L.W., Crampton, P., & Tiffin, P.A. (2020). Situational judgement test validity for selection: a systematic review and meta‐analysis. Medical Education, 54(10), 888-902. https://doi.org/10.1111/medu.14201

Wu, Y., Lu, J., Chen, N., & Xiang, B. (2018). The influence of extraversion on emotional expression: A moderated mediation model. Social Behavior and Personality: an international journal, 46(4), 641-652. https://doi.org/10.2224/sbp.7049

Zárate-Alva, N. E., & Sala-Roca, J. (2019). Socio-emotional skills of girls and young mothers in foster care. Children and Youth Services Review, 100, 50-56. https://doi.org/10.1016/j.childyouth.2019.02.036

Published
2021-01-18