Preliminary test of a spanish version of the group engagement measure to advance evidence based practice in groups

Mark J. Macgowan; María Isabel Tapia; Catalina Cañizares

doi:10.7179/PSRI_2025.46.05

Authors

Mark J. Macgowan Florida International University https://orcid.org/0000-0002-8505-5515
María Isabel Tapia University of Miami https://orcid.org/0000-0002-0566-9497
Catalina Cañizares New York University https://orcid.org/0000-0002-6854-5205

DOI:

https://doi.org/10.7179/PSRI_2025.46.05

Keywords:

Group counseling, group engagemnet, Spanish, group assessment, family groups

Abstract

Evidence-based practice in groups includes research-based measures to assess group processes and outcomes. However, there are few evidence-based, culturally relevant instruments that can assist professionals in delivering evidence-based groups in Spanish to increase participant’s engagement and retention. This paper describes a project to translate a reliable and valid English version of the Group Engagement Measure (GEM) into Spanish and its relevancy to improve research outcomes when implementing socio-educational interventions in communities with family participation. The process of translation was deliberate and methodical, which produced a Spanish version for empirical testing named Medida de Compromiso en Trabajo Grupal (GEM-27). The measure demonstrated high internal consistency, with a Cronbach's alpha of .94, and a low standard error of measurement (3.74). As a part of evidence-based practice in groups, the Spanish GEM can help advance the measurement of important connections in the group, strengthening the helpfulness of group work in Spanish countries.

.

Downloads

Download data is not yet available.

Author Biographies

Mark J. Macgowan , Florida International University

Professor Mark Macgowan is Associate Dean of Academic Affairs and Professor of Social Work at Florida International University in Miami. His teaching, research, and practice focuses on evidence-based group work and improving psychosocial response to mass casualty events. His books include "Guide to Evidence-Based Group Work," "Group Work Research" (both Oxford University Press), “Evidence-Based Group Work in Community Settings” and “IASWG Standards for Social Work with Groups” (both Taylor & Francis) and co-editor of the upcoming “International Handbook on Social Work with Groups” (Routledge Press). Professor Macgowan has led research projects related to psychosocial response to mass casualty events. He has received international recognition, including two Fulbright awards to the University of Edinburgh in Scotland and at the University of Murcia, Spain.

María Isabel Tapia , University of Miami

Is a licensed professional psychotherapist with over 25 years of experience of conducting research studies at the University of Miami and private practice with clients. She has dedicated her career to the prevention and treatment of adolescent substance use, behavioral problems, sexual risk behaviors and mental health with Hispanic families. In her role as a senior researcher and clinical expert of evidence-based practices, she has trained and supervised agencies and therapists in the U.S., Latin America, and Europe. She has participated in groundbreaking, NIH-funded behavioral clinical trials, and has authored several articles and book chapters in minority HIV, drug abuse, mental health, and LGBTQ+ issues taking into consideration the cultural context and functioning of the Hispanic family. She was the recipient of a fellowship grant from The Center of Human Rights & Social Justice, to conduct research with the Lesbian, Gay, Bisexual and Transgender population.

Catalina Cañizares , New York University

Is a postdoctoral researcher at New York University specializing in adolescent mental health and suicide prevention. Her research combines data science and prevention science, focusing on developing machine learning algorithms to predict suicide attempts and advancing culturally tailored interventions. She is actively working on projects, including testing machine learning models across national datasets and evaluating evidence based programs for Latin American adolescents. Dr. Cañizares aims to enhance early suicide risk identification and inform evidence-based mental health policies for Spanish speakers.

References

Alldredge, C. T., Burlingame, G. M., Yang, C., & Rosendahl, J. (2021). Alliance in group therapy: A meta-analysis. Group Dynamics: Theory, Research, and Practice, 25(1), 13-28.

Anastasi, A. (1988). Psychological testing (6th ed.). Macmillan.

Arnau-Sabatés, L., Jariot-Garcia, M., & Sala-Roca, J. (2021). Evaluation and research instruments in social pedagogy. Journal of Research in Social Pedagogy (37), 17-19.

Badenes-Ribera, L., Frías-Navarro, D., & Bonilla-Campos, A. (2017). Un estudio exploratorio sobre el nivel de conocimiento sobre el tamaño del efecto y meta-análisis en psicólogos profesionales españoles [Effect size and meta-analysis in Spanish professional psychologists]. European Journal of Investigation in Health, Psychology and Education, 7, 111-122.

Bonilla Campos, A., & Badenes-Ribera, L. (2017). Barreras percibidas por los psicólogos profesionales españoles para una Práctica Basada en la Evidencia. European Journal of Child Development, Education and Psychopathology, 5.

Brave Heart, M. Y. H., Chase, J., Myers, O., Elkins, J., Skipper, B., Schmitt, C., Mootz, J., & Waldorf, V. A. (2020). Iwankapiya American Indian pilot clinical trial: Historical trauma and group interpersonal psychotherapy. Psychotherapy, 57, 184-196.

Burlingame, G. M., & Jensen, J. L. (2017). Small Group Process and Outcome Research Highlights: A 25-Year Perspective. International Journal of Group Psychotherapy, 67, S194-S218.

Cabrera, P. A., & Pardo, R. (2019). Review of evidence based clinical practice guidelines developed in Latin America and Caribbean during the last decade: An analysis of the methods for grading quality of evidence and topic prioritization. Global Health, 15, 14.

Caldas de Almeida, J. M. (2013). Mental health services development in Latin America and the Caribbean: achievements, barriers and facilitating factors. Int Health, 5, 15-18.

Chovanec, M. G. (2012). Examining Engagement of Men in a Domestic Abuse Program from Three Perspectives: An Exploratory Multimethod Study. Social Work With Groups, 35, 362-378.

Chovanec, M. G., & Roseborough, D. (2017). Examining Rates of Engagement over Time with Court-Ordered Men in a Domestic Abuse Treatment Program. Social Work with Groups, 40, 350-363.

Dyer, J., Kaufman, R., Cabrera, N., Fagan, J., & Pearson, J. (2015). FRPN Research Measure: Fathers' Engagement (English and Spanish Versions Available). https://www.frpn.org/

Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47-53.

Erkut, S. (2010). Developing Multiple Language Versions of Instruments for Intercultural Research. Child Development Perspectives, 4, 19-24.

Estrada, Y., Lee, T. K., Huang, S., Tapia, M. I., Velazquez, M. R., Martinez, M. J., Pantin, H., Ocasio, M. A., Vidot, D. C., Molleda, L., Villamar, J., Stepanenko, B. A., Brown, C. H., & Prado, G. (2017). Parent-Centered Prevention of Risky Behaviors Among Hispanic Youths in Florida. American Journal of Public Health, 107, 607-613.

Gomila, M.A., Pascual, B., Amer, J., & Orte, C. (2023) Intervenciones socioeducativas familiares en entornos escolares y comunitarios. Aula abierta, 52, 185-193.

Guillén, F., & Martínez-Alvarado, J. R. (2014). Escala de compromiso deportivo: una adaptación de la Escala de Compromiso en el Trabajo de Utrecht (UWES) para ambientes deportivos. Universitas Psychologica, 13.

Hernández, C. R., Rosario-Hernández, E., & Lorenzo Ruiz, A. (2020). Propiedades Psicométricas de la Escala para una Práctica Profesional Basada en la Evidencia en una Muestra de Psicólogos Clínicos en la República Dominicana. Revista Caribeña de Psicología, 4, 204-216.

Horigian, V. E., Espinal, P. S., Alonso, E., Verdeja, R. E., Duan, R., Usaga, I. M., Perez-Lopez, A., Marin-Navarrete, R., & Feaster, D. J. (2016). Readiness and barriers to adopt evidence-based practices for substance abuse treatment in Mexico. Salud Mental, 39, 77-84.

Hulin, C. L. (1987). A Psychometric Theory of Evaluations of Item and Scale Translations - Fidelity across Languages. Journal of Cross-Cultural Psychology, 18, 115-142.

Jacobs, P., Estrada, Y. A., Tapia, M. I., Teran, A. M. Q., Tamayo, C. C., Garcia, M. A., Trivino, G. M. V., Pantin, H., Velazquez, M. R., Horigian, V. E., Alonso, E., & Prado, G. (2016). Familias Unidas for high risk adolescents: Study design of a cultural adaptation and randomized controlled trial of a US drug and sexual risk behavior intervention in Ecuador. Contemporary Clinical Trials, 47, 244-253.

Koementas-de Vos, M. M. W., van Dijk, M., Tiemens, B., de Jong, K., Witteman, C. L. M., & Nugter, M. A. (2022). Feedback-informed Group Treatment: A Qualitative Study of the Experiences and Needs of Patients and Therapists. International Journal of Group Psychotherapy, 72, 193-227.

Levenson, J. S., & Macgowan, M. J. (2004). Engagement, denial and treatment progress among sex offenders in group therapy. Sexual Abuse: A Journal of Research and Treatment, 16, 49-63.

Levenson, J. S., Macgowan, M. J., Morin, J. W., & Cotter, L. P. (2009). Perceptions of sex offenders about treatment: Satisfaction and engagement in therapy. Sexual Abuse: A Journal of Research and Treatment, 21, 35-56.

Levin, K. G. (2006). Involuntary clients are different: Strategies for group engagement using individual relational theories in synergy with group development theories. Groupwork, 16, 61-84.

Lillo, S. n., & Martini, N. (2013). Principales Tendencias Iberoamericanas en Psicología Clínica. Un Estudio Basado en la Evidencia Científica. Terapia Psicológica, 31, 363-371.

Lo Coco, G., Gullo, S., Albano, G., Brugnera, A., Flückiger, C., & Tasca, G. A. (2022). The alliance-outcome association in group interventions: A multilevel meta-analysis. Journal of Consulting and Clinical Psychology, 90, 513-527.

Macgowan, M. J. (1997). A measure of engagement for social group work: The Groupwork Engagement Measure (GEM). Journal of Social Service Research, 23, 17-37.

Macgowan, M. J. (2000a). Evaluation of a measure of engagement for group work. Research on Social Work Practice, 10, 348-361.

Macgowan, M. J. (2000b). Prefacio. In G. Burford, J. Pennell, & S. MacLeod (Eds.), Manual para coordinadores y comunidades: Organización y práctica de la toma de decisiones de grupos familiares (Manual for Coordinators and Communities: The organization and practice of family group decision making [1995, August]). Memorial University of Newfoundland, School of Social Work.

Macgowan, M. J. (2003). Increasing engagement in groups: A measurement based approach. Social Work with Groups, 26, 5-28.

Macgowan, M. J. (2006a). The Group Engagement Measure: A review of its conceptual and empirical properties. Journal of Groups in Addiction and Recovery, 1, 33-52.

Macgowan, M. J. (2006b). Measuring and increasing engagement in substance abuse treatment groups: Advancing evidence-based group work. Journal of Groups in Addiction and Recovery, 1, 53-67.

Macgowan, M. J. (2008). A guide to evidence-based group work. Oxford University Press.

Macgowan, M. J. & Arias Astray, A. (2024). Trabajo en grupo basado en evidencias. En S Segado Sánchez Cabezudo & A. Arias Astray (Eds.). Modelos de trabajo social con grupos. Nuevas perspectivas y nuevos contextos (pp. 241-258). Aranzadi.

Macgowan, M. J., & Cañizares, C. (2023). La formación de grupos basada en la evidencia para el trabajo con familias. In C. O. Socias, M. B. P. Barrio, & L. Sánchez-Prieto (Eds.), La formación de los profesionales en programas de educación familiar: claves para el éxito (pp. 131-151). Octaedro.

Macgowan, M. J., & Hanbidge, A. S. (2022). Best practices in social work with groups: Foundations. In L. Rapp-McCall, K. Corcoran, & A. Roberts (Eds.), Social Workers' Desk Reference (4th ed., pp. 661-669). Oxford.

Macgowan, M. J., & Levenson, J. S. (2003). Psychometrics of the Group Engagement Measure with male sex offenders. Small Group Research, 34, 155-169.

Macgowan, M. J., & Newman, F. L. (2005). The factor structure of the Group Engagement Measure. Social Work Research, 29, 107-118.

Macgowan, M. J., & Vakharia, S. P. (2016). Evidence based practice: Challenges and opportunities in the global context. In M. Chakrabarti, D. Sidhva, & G. Palattiyil (Eds.), Social Work in a Global Context: Issues and Challenges (pp. 39-56). Taylor & Francis.

Magallares, A., Graffigna, G., Barello, S., Bonanomi, A., & Lozza, E. (2017). Spanish adaptation of the Patient Health Engagement scale (S.PHE-s) in patients with chronic diseases. Psicothema, 29, 408-413.

Mañas-Rodríguez, M. Á., Alcaraz-Pardo, L., Pecino-Medina, V., & Limbert, C. (2016). Validation of the Spanish version of Soane's ISA Engagement Scale. Revista de Psicología del Trabajo y de las Organizaciones, 32, 87-93.

Mejia, A., Leijten, P., Lachman, J. M., & Parra-Cardona, J. R. (2017). Different Strokes for Different Folks? Contrasting Approaches to Cultural Adaptation of Parenting Interventions. Prevention Science, 18, 630-639.

Morcillo-Martínez, A., Infantes-Paniagua, Á., García-Notario, A., & Contreras-Jordán, O. R. (2021). Validación de la Versión Española de la Escala de Compromiso Académico para Educación Primaria. RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa, 27.

Orte, C., Pascual, B., & Sánchez-Prieto, L. (Eds.). (2023). La formación de los profesionales en programas de educación familiar: claves para el éxito Octaedro.

Orte, C., Oliver, J. L., Amer, J., Vives, M., & Pozo, R. (2019). Universal Prevention. Evaluation of the effects of the universal Spanish Strengthening Families Program in elementary schools and high schools (SFP-U 11-14) Pedagogía Social. Revista Interuniversitaria, 34, 19-30.

Plasse, B. R. (2000). Components of engagement: Women in a psychoeducational parenting skills group in substance abuse treatment. Social Work with Groups, 22, 33-50.

Prado, G., Pantin, H., Schwartz, S. J., Lupei, N. S., & Szapocznik, J. (2006). Predictors of engagement and retention into a parent-centered, ecodevelopmental HIV preventive intervention for Hispanic adolescents and their families. Journal of Pediatric Psychology, 31, 874-890.

Quant-Quintero, D. M., & Trujillo-Lemus, S. (2014). Psicología clínica basada en la evidencia y su impacto en la formación profesional, la investigación y la práctica clínica. Revista Costarricense de Psicología, 33, 123-136.

Ramos-Diaz, E., Rodriguez-Fernandez, A., & Revuelta, L. (2016). Validation of the Spanish Version of the School Engagement Measure (SEM). Span J Psychol, 19, E86.

Riera i Romaní, J. (2011) Las familias y sus relaciones con la escuela y la sociedad frente al reto educativo, hoy. Educación Social, 49, 11-24.

Sánchez-Meca, J., Marín-Martínez, F., & López-López, J. A. (2011). Meta-análisis e Intervención Psicosocial Basada en la Evidencia [Meta-analysis and Evidence-Based Psychosocial Intervention]. Psychosocial Intervention, 20, 95-107.

Sireci, S. G., Yang, Y. W., Harter, J., & Ehrlich, E. J. (2006). Evaluating guidelines for test adaptations - A methodological analysis of translation quality. Journal of Cross-Cultural Psychology, 37, 557-567.

Tapia, M. I., Schwartz, S. J., Prado, G., Lopez, B., & Pantin, H. (2006). Parent-centered intervention: A practical approach for preventing drug abuse in Hispanic adolescents. Research on Social Work Practice, 16, 146-165.

Tetley, A., Jinks, M., Huband, N., & Howells, K. (2011). A systematic review of measures of therapeutic engagement in psychosocial and psychological treatment. Journal of Clinical Psychology, 67, 927-941.

Torío López, S. (2017). How to educate? Are we doing it well? Contributing to the on going debate in the literature about the Optimum parental educational style. Journal of Research in Social Pedagogy, (29), 9-17.

Waites, C., Macgowan, M. J., Pennell, J., Carlton-LaNey, I., & Weil, M. (2004). Increasing the cultural responsiveness of Family Group Conferencing. Social Work, 49, 291-300.

Wood , P., Moenne, G., Arteaga, C., Larraechea, R., Dosal, F., José Del Solar, M., Klempau , R., de Aguirre , J., Becerra , M., & Besio, C. (2018). Medición 2018 Engagement. Equipo Circular HR Fundación Chile.