University admission scores as predictor of academic
performance in the first year of university: Education VS
Social Services Oriented Degrees
1

La nota de acceso a la universidad como predictor del
rendimiento en el primer año de carrera: grados de
Magisterio versus otras carreras asistenciales

DOI: 10.4438/1988-592X-RE-2021-393-488

Eva Jiménez García

Universidad Europea de Madrid

Delia Arroyo Resino

Universidad Internacional de la Rioja

Marta Hurtado-Martín

Judit Ruiz-Lázaro

María Sánchez-Munilla

José Javier Illana Vicaria

Coral González Barbera

Universidad Complutense de Madrid

Abstract

Several research studies have shown that admission scores seem to be a good predictor of academic performance during the undergraduate degree. It is a fact that the first year of the undergraduate program is the one in which most students drop out of the program. Considering this idea, the general objective of this study is to identify the access profile (previous academic performance) and predict the future performances of the students at the Universidad Complutense de Madrid (UCM). The study involves first year students who enter the Education Programs, as well as those who enter Degrees with a Social Service Orientation. To address this objective, a secondary analysis of the UCM census’ data in the 2018/2019 academic year is carried out where the total sample is 2018 students. Several regression models are considered aiming to determine the effect of previous academic performance on the success rate (% of ECTS credits passed) at the end of the first academic year. The results show that the Education Degrees where admission scores have an impact on the success rate are those related to Primary Education. Furthermore, a differentiated profile was observed between Education Degrees compared to Degrees with a Social Service Orientation when explaining the success rate in the first year. In light of these results, it can be concluded that admission scores are a predictor of the academic performance achieved in the first year of the degree program, affecting in a differently students who pursue Education Degrees versus Social Services Oriented Degrees.

Key words: Education degree, social services-oriented degrees, academic performance, credits, regression models

Resumen

Diversas investigaciones demuestran que la nota de acceso a la universidad parece ser un buen predictor del rendimiento académico obtenido durante la carrera. Es un hecho que el primer curso de carrera es en el que se produce el mayor abandono. Partiendo de esta idea, el objetivo general que se plantea en este trabajo es conocer el perfil de acceso (rendimiento previo) y su efecto sobre el rendimiento en el primer año de carrera de los estudiantes de la Universidad Complutense de Madrid (UCM) que acceden a las titulaciones del grado de magisterio, así como de aquellos que acceden a otras carreras de carácter asistencial. Para dar respuesta a este objetivo se realiza un análisis secundario de los datos censales de la UCM en el curso 2018/2019 donde la muestra total es de 2018 estudiantes. Se plantean varios modelos de regresión con la finalidad de conocer el efecto del rendimiento previo sobre la tasa de éxito (% de créditos ECTS aprobados) al final del primer curso académico. Los resultados muestran que las titulaciones de magisterio donde la nota de acceso tiene un impacto sobre la tasa de éxito son las relativas a la etapa de Educación Primaria. Asimismo, se observa un perfil diferencial entre las titulaciones de magisterio y otras titulaciones de carácter asistencial, a la hora de explicar la tasa de éxito en el primer curso. A la vista de estos resultados se puede concluir que la nota de acceso a la universidad es un predictor del rendimiento académico obtenido en el primer año de carrera que afecta de manera diferente a los estudiantes que cursan carreras de magisterio versus otras carreras asistenciales.

Palabras clave: Titulaciones de magisterio, titulaciones asistenciales, rendimiento académico, créditos, modelos de regresión

Introducción

The causes associated to dropout rates in the first year of university studies are a concern that has sought to be analysed in recent decades (Organisation for Economic Co-operation and Development, 2008; Rooij, et al., 2017). As such, several research projects have focussed on studying the variables that may be associated with academic success during the first university year and that, as a result, could explain a substantial part of the university dropout rate (García, 2014; Fonteyne et al., 2017; Hepworth et al., 2018; Respondek et al., 2017).

Academic performance depends on a range of factors, the identification and effect of which could provide a more comprehensive overview that allows decisions to be made that improve the quality of education. In this regard, Schneider & Preckel (2017) identified in their meta-analysis a total of 105 variables in two areas related to students themselves or with the education process that could affect academic performance. Furthermore, Garbanzo (2007), established 26 factors arranged into three categories: personal determinants, social determinants and institutional determinants.

Despite the fact that all the variables identified appear to have an effect on academic performance, several national and international studies (Cerdeira, et al., 2018; Danilowicz-Göselea, et al., 2017; Fernández-Mellizo & Constante-Amores, 2020; Gallegos & Campos, 2019; Jiménez-Caballero et al., 2015) suggest that the university entry or admissions grade, a personal determinant according to Garbanzo (2007), is the best indicator for predicting the academic performance of students during the first degree year. Jiménez-Caballero et al. (2015) concluded, in a study undertaken at the University of Sevilla with 572 students enrolled on the first year of the finance and accounting course, that the entry grade is an explanatory factor in academic performance, implying on average an additional point in every subject grade. Gallegos & Campos (2019) arrived at the same conclusion, indicating not only a positive and significant effect on academic performance in the first year, but also that they observed the same effects in the fourth degree year.

Furthermore, Fernández-Mellizo & Constante-Amores (2020), in a study on determinants of academic performance, which included 10,720 students at the Complutense University of Madrid, concluded that the university entry grade is the most important predictor of students’ academic performance. Other authors, such as Danilowicz-Göselea et al. (2017), in a study conducted with 12,000 students on different degree courses at Göttingen University, which included humanity, social science and technical degrees, confirmed that although the magnitude of the effect depends on the degree course studied, the grade obtained in pre-university studies has a significant and positive effect, so much so that those who enter with lower grades are much less likely to graduate than those with higher grades.

Cerdeira et al. (2018) did a similar analysis in Portugal, analysing different factors, among them the entry grade and the final grade obtained in secondary education of 23,632 students. These authors found that the entry grade and the final grade obtained in secondary education can be used to significantly predict the final degree grade. Furthermore, on including other variables in the analysis, the explication did not change. As such, these two variables are by far the ones with the greatest predictive value in terms of the grades obtained at the end of university studies. Rodríguez et al. (2004) and Tejedor (2003) suggest that this important effect of the entry grade can be explained as being a reflection of other academic achievements in which other personal, social and institutional determinants also have an influence.

Admissions profile of students on teaching and care-related degrees

The large-scale international educational evaluation programmes, such as PISA, TIMSS and PIRLS, have shown the situation in terms of educational achievement of the different participating countries. In all of them in which the relative position is unsatisfactory, as is the case of Spain, social and political actions have taken place with the aim of adopting measures to remedy the shortfalls perceived. As a result of this increased focus on possible corrective measures, some international reports (OECD, 2017) show the importance of the qualifications and efficiency of teachers and, therefore, the impact that their training has on the academic results of their students.

The fundamental role of teachers in the quality of the education given is a fact backed by sufficient empirical evidence (Ponce et al., 2020; Rus et al., 2019; Vaillant & Rodríguez, 2018). However, the characteristics of those who study degrees corresponding to the teaching profession are not determined and neither standardised tools nor procedures exist for selecting those who aspire to be teachers or professors, a fact that heightens the concerns of governments in improving the quality of academic staff. In this regard, Hanushek (2016) concluded that students who have had for one year professors or lecturers with a relative efficiency position in the 90th percentile or higher, learn the corresponding material 150% more than students taught by professors or lecturers in the 10th percentile or lower (Hanushek et al., 2016). Furthermore, the McKinsey report affirms “the quality of an education system cannot exceed the quality of its teachers” (Barber & Mourshed, 2007, p.13).

As in the studies previously mentioned, prior performance also seems to be a predictor of subsequent academic performance in teaching degrees. In this regard, Belvis et al. (2009) conducted a study on academic success with 2,476 students on pedagogy, psycho-pedagogy, teaching and social education degrees at seven different Spanish universities. In the study they found that, among other factors that affect student success in higher education, the prior academic preparation of students has a very direct impact on their subsequent results. Also in this study, as well as in that of Barahona (2014) and Cortés & Palomar (2008), the university entry grade is considered as another factor that predicts subsequent academic performance.

In addition to the grades obtained by students, the credits passed and the study hours accumulated are two further indicators generally used to operationalise academic performance. As such, the Ministry of Science, Innovation and Universities used the credits passed as an indicator to calculate performance and success rates (Integrated University Information Systema [SIIU], 2019).

Taking into account, on the one hand, the effects of academic staff efficiency and, on the other, the importance prior performance seems to have as a predictor of students’ academic futures, knowing the student profiles interested in university degrees linked to the teaching profession appears particularly relevant. In 2006, the PISA programme (OECD, 2008) surveyed students from several countries about which profession they thought they would be working in at the age of 30. Only 5% of those surveyed saw themselves working as teachers or professors. Among the males surveyed, no more than 3% aspired to be teachers, while this figure rose to 6% among females (OECD, 2015). However, the biggest concern, regardless of gender, related to students whose mean grade in reading and maths skills was below the average. The major concern is that, in most countries, the low skill level of those who aspire to become teachers also coincides with low performance rates, obtained by working teachers in similar tests, as shown in the Survey of Adult Skills of the PIAAC (Programme for the International Assessment of Adult Competencies) (OCDE, 2016).

Camina & Salvador (2007) found a great variability in the characteristics of students on different teaching degrees. On more specialised degree courses, such as physical education, music education and foreign languages, there was a great variability in terms of age. Furthermore, students on pre-school education and physical education degrees, largely came from vocational training. In terms of academic performance, most of those who started said studies obtained in entrance exams scores of between 5 and 6 points. Similarly, between 20% and 50% would have preferred to have studied something else, which suggests that not all had a real interest in teaching.

All the foregoing is of particular concern considering that prior performance, as previously mentioned, is a predictor of subsequent academic performance. Therefore, a low entrance skill level allows us to predict a low performance on the degree course, ultimately affecting the quality of teachers and, therefore, the education provided.

In addition to teaching degrees, knowing the student profile of other degrees that prepare individuals for similar professions, due to their care or service-to-society nature, is of interest. Care professions are those with a common social purpose that are linked to contextualised degrees in the social, healthcare and educational field. In this study, degrees linked to the care professions in the database of the Student Observatory (Observatorio del Estudiante) of the Complutense University of Madrid have been considered as such, which include: dual degree in psychology-speech therapy, degree in speech therapy, degree in psychology, degree in social education, degree in pedagogy, degree in social work, degree in occupational therapy.

The aim of this study is to discover the university entry or admissions profile (prior academic performance) and its effect on performance in the first degree year of students at the Complutense University of Madrid (UCM) on the single and dual degree courses in teaching (in pre-school education and in primary education), as well as of those who study other care-related degrees. To specify the general objective, the following specific objectives have been established:

– To comparatively study the impact of the entry grade in studies that provide access to the teaching profession.

– To study if the effect of the university entry grade determines, in a different manner according to the degrees considered, academic performance in the first year (percentage of credits passed over those enrolled on).

Method

This study used a quantitative methodology, specifically, a non-experiment design in which a secondary analysis of the UCM census data was conducted for the 2018/19 year, provided by the Student Observatory of said university.

Participants

The participants in this study were students who first accessed the different teaching and care-related degree courses at UCM in academic year 2018/2019, which entailed a total of 2,018 subjects, of which 643 were students on the teaching degrees of the Faculty of Education and Teacher Training Centre and 1,375 students on degree courses linked to care professions.

Table I sets out in further detail the teaching and care-related degrees, the sampling distribution of participating students, as well as the mean and standard deviation in each degree of the university entry grade and of the centred entry grade regarding the mean of the degrees considered.

TABLE I. Sampling distribution according to the type of degree (teaching or care-related)

Degree

Frequency

Percentage

Mean entry grade

(Standard dev.)

Centred mean entry grade

(Standard dev.)

Teaching

(31.8%)

Dual degree in pre-school education - primary education teaching

54

8%

10,421

(.888)

1,164

(.888)

Dual degree in pre-school education teaching - pedagogy

47

7%

9,811

(1137)

.554

(1137)

Dual degree in primary education teaching - pedagogy

48

8%

11,082

(.951)

1,824

(.951)

Degree in primary education teaching

258

40%

9,055

(1194)

-.202

(1194)

Degree in pre-school education teaching

236

37%

8,319

(.763)

-.938

(.763)

Care-related

(68.2%)

Dual degree in psychology-speech therapy

50

3.6%

10,615

(.891)

1,358

(.891)

Degree in speech therapy

56

4.1%

8,900

(.720)

-.357

(.720)

Degree in nursing

267

19.4%

11,022

(1211)

1,764

(1211)

Degree in psychology

408

29.7%

9.4185

(1102)

.161

(1102)

Degree in social education

93

6.8%

9,451

(1009)

.194

(1009)

Degree in pedagogy

90

6.5%

8,776

(.726)

-.481

(.726)

Degree in social work

340

24.7%

7,855

(1028)

-1,402

(1028)

Degree in occupational therapy

71

5.2%

9,460

(.856)

.203

(.856)

The average age of students is 20, in both teaching and care-related degrees, (SDteaching= 2.88; SDcare-related=3.97), with 18 and 52 being the lowest and highest age, respectively, in the teaching degrees and 58 the highest in the care-related degrees. 17.9% of the students are male and 82.1% female in the teaching degrees, a trend also reflected in the care-related degrees, where 15.3% are male and 84.7% female. As regards the nationality of students, 97% and 95.5% on the teaching and care-related degrees, respectively, are Spanish.

The university admissions route for the teaching degrees was: further education (bachillerato): 72.5%; VT: 26.1%; over 25s: 6%; graduates: 6%; over 45s: 2%. As regards care-related degrees: further education (bachillerato): 80.6; VT: 17.2%; graduates: 4%; over 25s: 1.3%; over 40s 3%; and over 45s: 2%.

Process

The data used in this study was sourced from the anonymous information that the Complutense University of Madrid (UCM) reports each year to the Integrated University Information Systema (SIIU) and that has been provided by the Student Observatory of the UCM. Specifically, the data used for this analysis correspond to academic year 2018/19.

As regards the variables used in this study, the dependent variable relates to academic performance, understood as the rate of ECTS credits passed in the first year. On the teaching degrees, the average rate is 84% and, on care-related degrees, 79.5%.

As predictor variables, the type of degree (categorised as teaching or care-related degrees, Table I) and the university entry or admissions grade, understood as the total of the further education (bachillerato) grade (60%), results in the entrance exams (40%) and an additional 10% or 20% for the best grades obtained in the voluntary phase, depending on the degree course chosen, are the variables used. In order to facilitate the interpretation of the regression equation constant, the university entry grade has been centred on the mean entry grade of the students accepted onto the degrees in this study (teaching and care-related). As such, the value of the constant allows us to find the value of academic performance when the value of the university entry grade corresponds to the mean. Information on said variables is provided in Table II.

TABLE II. Descriptive statistics of the university entry grade variable.

Degree type

N

Minimum

Maximum

Mean

Standard deviation

University entry grade

Teaching degrees

643

5.29

13.33

9,106

1,307

Care-related degrees

1375

5.00

13.33

9,328

1,509

University entry grade centred on the mean entry grade of the sample used (centred entry grade)

Teaching degrees

643

-3.97

4.07

-.151

1,307

Care-related degrees

1375

-4.26

4.07

-.071

1,509

To meet the first specific objective –comparatively studying the impact of the entry grade in teaching studies–, a simple regression was undertaken comparing the teaching degrees (degree in primary education teaching, degree in primary education teaching (sic.), dual degree in pre-school education - primary education teaching, dual degree in pre-school education teaching - pedagogy, dual degree in primary education teaching - pedagogy) and using the entry grade as a predictor and the success rate in the first degree year (number of credits passed/number of credits enrolled on) as the criterion.

To meet the second specific objective –studying the differential effect between the entry grade and the type of degree on academic performance in the first year, different according to teaching or care-related degrees–, three regression models were undertaken, which will be represented with the corresponding equation in the results section: the null model used as a reference model to demonstrate any improvement in the predictor-related models that are going to be estimated; model 1, which is going to study the effect of the university entry grade, and model 2, which analyses the differential effect of the entry grade, type of degree and the relationship between them.

The stepwise method was used to select the variables, which Pardo & Ruiz (2013) say is a combination of the forward and backward methods, where first the variable that more closely correlates with the dependent variable is chosen, followed by the variable with the highest partial correlation coefficient.

To study the adjustment of the model, the residual is calculated, and the error reduction of the models with predictors is studied with regard to the null model. Therefore, the ratio between the difference of the deviance of the reference model and that of the proposed model and the deviance of the reference model is calculated (Pardo & Ruiz, 2013). Furthermore, R2 is calculated, which is the quotient between the explained variation and the total variation. Finally, AIC and BIC are used, which are modifications of the deviance, very common in both nested and non-nested comparison models (Montesinos, 2011). Furthermore, in all the predictor models, the size of the effect is calculated with Cohen’s d formula, where values around .20 indicate a small effect size, values around .50 a medium effect size and values around .80 and higher a large effect size (Cohen, 1992).

To guarantee the validity of the linear regression models, the residual independence assumptions, through the Durbin-Watson test statistic, and the non-collinearity assumptions, through tolerance and VIF estimations, were verified. The Durbin-Watson test values were within the range of 1.5 and 2.5, which allows us to accept the assumption of independence between the residuals (Durbin & Watson, 1971). In terms of the non-collinearity assumption, the tolerance of the models reflects values that exceed the minimum of .200 (Menard, 2002), which allows us to rule out collinearity and multi-collinearity issues. The variance inflation factors (VIF) once again allows us corroborate compliance of the non-collinearity assumption, given that the values reached in both do not exceed the limit of 10 (López, 1998).

For the statistical analysis, the SPSS program version 25.0 (IBM ® SPSS® Statistics 25) and the G*Power 3.1 program (to calculate the size effect) were used.

Results

The results section is arranged in two blocks, one for each research objective proposed in this study, where the different estimated regression models and the adjustment corresponding to each one are set out and interpreted.

Study comparing the impact of the entry grade on teaching studies

Firstly, Table III shows, for each teaching degree, the descriptive statistics of the variable considered for the study: academic performance (understood as the percentage of ECTS credits passed in the first year) and centred university entry grade. As can be seen, the highest percentage of ECTS credits passed in the first year corresponds to the dual degree in pre-school education teaching - pedagogy, while the lowest corresponds to the degree in pre-school education teaching. As regards the university entry grade, the students on the dual degree in primary education teaching and pedagogy obtained the highest grade (1.846 points above the mean of participants), while the lowest entry grade was obtained, once again, by those on the degree in pre-school education teaching (.802 points below the mean grade).

TABLE III. Descriptive statistics of the simple regression model

Degree

Variables

Mean

Standard
deviation

Dual degree in pre-school education - primary education teaching

ECTS passed/enrolled on

88,338

22,145

Centred entry grade

1.1750

.9287

Dual degree in pre-school education teaching - pedagogy

ECTS passed/enrolled on

93,650

11,613

Centred entry grade

.6424

.929

Dual degree in primary education teaching - pedagogy

ECTS passed/enrolled on

90,044

20,770

Centred entry grade

1,846

.949

Degree in primary education teaching

ECTS passed/enrolled on

81,870

21,874

Centred entry grade

.1095

1,254

Degree in pre-school education teaching

ECTS passed/enrolled on

81,138

26,525

Centred entry grade

-.802

.804

The results obtained in the simple regression analysis are set out in Table IV, where teaching degrees and the impact that entry grades in said degree courses have on the success rate in the first year are compared. The results suggest that in three teaching degrees the university entry grade has a significant influence on the success rate.

TABLE IV. Estimation of the effects of the simple regression analysis.

Confidence interval

Degree

Parameter

Estimate

Standard error

df

t

Sig.

Lower limit

Higher limit

Dual degree in pre-school education - primary education teaching

Intercept

78,674

4,870

47

16,154

.000

68,877

88,472

Centred entry grade

8,224

3,264

47

2,519

.015

1,657

14,791

Dual degree in pre-school education teaching - pedagogy

Intercept

92,275

2,181

40

42,301

.000

87,867

96,684

Centred entry grade

2,140

1,946

40

1,100

.278

-1,793

6,074

Dual degree in primary education teaching - pedagogy

Intercept

72,399

6,078

45

11,913

.000

60,158

84,640

Centred entry grade

9,557

2,933

45

3,257

.002

3,647

15,465

Degree in primary education teaching

Intercept

81,219

1,543

178

52,642

.000

78,174

84,264

Centred entry grade

5,947

1,228

178

4,840

.000

3,522

8,372

Degree in pre-school education teaching

Intercept

84,687

3,369

121

25,138

.000

78,018

91,357

Centred entry grade

4,424

2,972

121

1,488

.139

-1,460

10,307

In the case of the dual degree in pre-school and primary education teaching, as can be seen in the regression equations (Eq.1), for every point the university entry grade of these students increases, an 8.2% increase would be seen in the credits passed in the first year.

Eq.1

The greatest increase corresponds to the dual degree in primary education teaching - pedagogy (Eq.2), where for every point the university entry grade increases, a 9.5% increase would be seen in the credits passed in the first year.

Eq.2

With regard to the degree in primary education teaching, the increase is somewhat lower (Eq.3), as for every point the university entry grade increases, a 5.9% increase would be seen in the credits passed by those students in the first year.

Eq.3

A more intuitive way of interpreting these results would be to transform the percent of credits passed into the study hours dedicated by the students, using as a reference the guidelines of the European Higher Education Area, which establishes that the ECTS credits entails approximately 25 study hours (European Commission, 2017).

In the majority of the degrees, the most frequent distribution of the number of ECTS credits per academic year is usually 60 ECTS, accepting this datum as the total of the enrolled-on credits, we could affirm that the students on the degree in primary education teaching that have an entry grade 1 point higher than the average, would pass 3.54 ECTS credits (5.9%), which would equate to 88.5 study hours.

The dual degrees correspond to approximately 80 ECTS in the first year. As such, in the case of the dual degree in pre-school and primary education teaching, the students that have a university entry grade 1 point above the average, would pass 6.56 ECTS credits (8.2%) more than the other students, equating to 164 study hours by the students; on the dual degree in primary education teaching - pedagogy, the students would pass 7.68 ECTS credits more than the other students that is, 192 study hours.

Lastly, it is worth mentioning the existence of another two degrees where the university entry grade does not have a significant influence on the number of credits passed in the first year. These are: the dual degree in pre-school education teaching - pedagogy, and the degree in pre-school education teaching.

In terms of the adjustment of the model (Table V), it is exclusively presented for the three cases in which the university entry grade has a significant influence on the success rate. In said degrees, the residual is reduced, achieving an explanatory power of 15%, 31% and 18%, respectively, with large effects in all cases (d=.844; d=1.352; d=.944, respectively). As regards AIC and BIC, lower values are observed in the dual degree in primary education teaching - pedagogy, which suggests that the simple regression model adjusts better.

TABLE V. Adjustment of the simple regression model

Degree

Residual

Residual reduction

Explanatory power

R2

AIC

BIC

Cohen’s d

Dual degree in pre-school education - primary education teaching

441,249

78,557

15.1%

.151

429,207

431,057

Large effect

(.844)

Dual degree in primary education teaching - pedagogy

356,871

162,935

31.3%

.313

401,761

403,568

Large effect (1.352)

Degree in primary education teaching

425,210

94,595

18.2%

.182

1595.336

1598.518

Large effect (.944)

Differential effect between the entry grade and the type of degree

Table VI is a summary of the descriptive statistics of the variables that are going to be used in the estimated regression models: success rate (percentage of ECTS credits passed in the first year), centred university entry grade and type of degree (teaching and care-related).

The results show a higher percentage of ECTS credits passed in the first year on the teaching degrees, while the university entry grade is higher in care-related degrees (specifically, .3 points above the average entry grade).

TABLE VI. Descriptive statistics of the multiple linear regression models

Variables

Mean

Standard deviation

ECTS passed/enrolled on

80,913

24,212

Centred entry grade

.296

1,394

ECTS passed/enrolled on (teaching)

84,377

22,799

Centred entry grade (teaching)

.2095

1,336

ECTS passed/enrolled on (care-related)

79,467

24,644

Centred entry grade (care-related)

.332

1,417

To meet the second specific objective, which consists of studying the differential effect of the entry grade, the type of degree and the relationship between both, the three regression models in Table VII were considered.

TABLE VII. Estimation of the effects of the multiple linear regression analysis

Confidence interval

Model

Parameter

Estimate

Standard error

df

t

Sig.

Lower limit

Higher limit

Null model

Intercept

80,913

.625

1496

129,301

.000

79,686

82,141

Model 1

Intercept

80,143

.632

1495

126,657

.000

78,902

81,384

Centred entry grade

2,599

.443

1495

5,855

.000

1,728

3,470

Model 2

Intercept

78,890

.750

1493

105,094

.000

77,417

80,362

Centred entry grade

1,734

.515

1493

3,481

.001

.7226

2,746

[Type of degree=teaching]

4,401

1,368

1493

3,215

.001

1,716

7,086

[Type of degree= care-related]

0b

0

.

.

.

.

.

[Type of degree=teaching] *Entry grade

3,452

.991

1493

3,481

.001

1,506

5,397

[Type of degree=care-related] *Entry grade

0b

0

.

.

.

.

.

Dependent variable: ECTS passed/enrolled on (success rate).

b. This parameter is established on zero as it is redundant.

Regarding the results of model 1, the university entry grade has a significant influence on the academic performance (understood as a percentage of the credits passed in the first year). Said influence is represented in the following regression equation (Eq.4), where for each point the university entry grade increases, the students in the sample would increase by 2.59% the credits passed in the first year.

Eq.4

Model 2 adds, to the study of the effect of the entry grade, the type of degree (considering two categories: teaching and care-related) and the relationship between both factors.

The regression equation (Eq.5) represents the model.

Eq.5

From it, it is worth mentioning that:

– Regardless of the type of degree, for each point the university entry grade increases, the credits passed in the first year would increase by 1.73%.

– Considering the two types of degree, the students on the teaching degrees would increase by 4.40% the credits passed in the first year compared with the students on the degrees in the care-related category.

– Finally, the effect of the relationship between both variables indicates that for each point the university entry grade increases of students on teaching decrees, the credits passed in the first year would increase by 3.45%.

As a result, model 2 allows us to interpret that for every point the university entry grade of the teaching degree students increases, the credits passed in the first year would increase by 9.6% (1.73% effect of the university entry grade + 4.40% for belonging to the teaching degree group + 3.45% of the cross effect of the entry grade and teaching degree).

Lastly, the adjustment is shown of each of the estimated models with respect to the null model. In Table VIII, it can be seen how in model 1, which includes the centred university entry grade as a predictor, the residual is reduced, achieving an explanatory power of 2.2% and a small effect size (d= .2993). With regard to model 2, greater explanatory power, specifically of 3.8%, and a medium effect size can be seen, which is higher than in the previous model (d=.4). Despite there being an improvement in explanatory power in model 1 over model 2, the R2 is moderate, due to the fact that there are many other variables that may affect the success rate in the first year. Finally, AIC and BIC have lower values in model 2, which suggests, once again, that this model has a better adjustment.

TABLE VIII. Adjustment of the multiple linear regression models

Model

Residual

Residual reduction

Explanatory power

R2

AIC

BIC

Cohen’s d

Null model

586,226

13789.841

13795.151

Model 1

573,467

12,759

2.2%

.022

13755.706

13761.015

Small effect

(.299)

Model 2

563,948

22,278

3.8%

.038

13724.426

13729.735

Medium effect

(.397)

Conclusions

The results obtained in relation to the first objective formulated in this study allow us to confirm that there are differences as regards the impact that entry grades have on the percentage of credits passed according to the teaching degree studied. As has been observed, the degrees in which entry grades have an effect on the success rate are those relating to primary education teaching, specifically dual degrees in pre-school education teaching with primary education teaching and primary education teaching with pedagogy, as well as the degree in primary education teaching. No impact has been observed in the degree in pre-school education teaching or the dual degree in pre-school education teaching and pedagogy. It is interesting that the entry degree has an influence on the results of students on primary education degrees but not on those on pre-school education degrees. That would be, therefore, the first conclusion of the study: that the students in classrooms in the first year of primary education degrees at the UCM may be less [sic.] influential in terms of success rates than those on pre-school education degrees, where the grade with which they were accepted at the university appears to have no influence. Of course, this assertion should be accepted with caution, given that one of the limitations of this study is, without doubt, the use of success rates as the sole indicator of academic performance in the first year. The number of credits passed at the end of the first university year in degrees where the success rate is traditionally high, cannot give rise to categorical conclusions given that, as it is a transversal study, the differences found between students on both degrees could be due to other factors unrelated to the university entry grade.

Despite a lack of studies in the literature that delve into the characteristics of the teaching student profile according to degree, similar results may be seen in the study conducted by Belvis et al. (2009) with students in the first and final year of pedagogy, psycho-pedagogy, teaching and social education degrees, given their conclusion that the factors relating to the prior academic record and the entry grade are significantly linked to performance.

This study also had a second objective, which was related to the differential effect on university entry grades between the teaching degrees and other care-related studies at the Complutense University of Madrid. The results show that the entry grade alone, regardless of the type of degree studied, has an influence on the success rate, which is something completely coherent with the studies conducted on prior performance as a predictor of academic performance. Similarly, the fact of studying a degree linked to the teaching profession also appears to have an influence on the success rate. Are they easier than other care-related degrees? Are the students more vocation-oriented and perhaps more motivated, which could lead to a higher success rate? Lastly, a considerable influence seems to exist when both aspects converge: entry grade and teaching studies.

These differences in the predictive capacity of entry grades on performance according to the studies undertaken are found in other research, such as that of Garbanzo (2007), who finds a differentiation between degrees, in this case, according to demand, concluding that the entry grade is an important predictor of academic performance in high-demand degrees, but not in those of low demand.

In any case, this relationship has been emphasised in many other studies, as seen in the meta-analysis of Richardson et al. (2012) or the work of Gallegos & Campos (2019), Cerdeira et al. (2018), Barahona (2014), Ukpong & George (2013) and Cortés & Palomar (2008), which show very similar results.

The study of Fernández-Mellizo & Constante-Amores (2020) suggests that entry grades explain more than 6% of the performance variance in universities and it is by far the variable with the greatest predictive capacity of performance out of the 11 considered. Danilowicz-Göselea et al. (2017) supports this idea by suggesting that the entry grade is the best predictor of final grades and of the likelihood of finishing university studies. The study by Jiménez-Caballero et al. (2015) also indicates the impact of the entry grade on performance, suggesting that every point increase in the entry grade translates to around one additional point in the grades of degree studies, in this case with students in the first year of the degree in finance and accounting.

However, this study, as previously stated, has a number of limitations. The results are from one single university, the Complutense University of Madrid, and a sole cohort of students, which does not guarantee the external validity of the study. Furthermore, the explanatory power of the models is moderate, which means that other variables would have to be considered that allow the residual variance to be explained. Thus, we should be cautious and prudent in interpreting these results due to factors such as the level of difficulty of each degree, the size of the sample of each degree and the care-related degrees selected, which entail important limitations.

Therefore, replicating this study with data from other universities and more cohorts is deemed important in order to establish comparisons. In this regard, it is considered appropriate that future studies take into account other variables that the literature deems influential in academic performance. For example, Fernández-Mellizo & Constante-Amores, (2020) studied the effect of eleven variables grouped into three factors: demographic, socio-economic and academic, of which four of them (university entry grade, type of centre in secondary education, sex and autonomous community of the family) were statistically significant in the final model. Another noteworthy study is that of Richardson et al. (2012) in which five distinct but conceptually overlapping research domains were identified: personality traits, motivational factors, self-regulatory learning strategies, students’ approaches to learning, and psychosocial contextual influences. Finally, another variable that would be interesting to explore, due to having shown that it is influential in academic performance, is the branch of further education (bachillerato) to which the prior studies of university students belong, differentiating from STEM and non-STEM studies. Studies such as Perez-Felkner et al. (2012) and Henoch et al. (2015) highlight the existence of cognitive and personal differences among students whose studies belong to the STEM or non-STEM group and that these can affect in a different way academic performance.

In conclusion, this study, albeit with limitations, points to the idea that students on teaching degrees (particularly those linked to the stage of primary education) with a high university entry grade have many possibilities of obtaining a high success rate in the first university year. Discovering the profile of students that drop out of teaching degrees in the first year would be interesting so as to contrast hypotheses such as those on vocation, degree admissions grades and the level of degree difficulty.

References

Barahona, U. P. (2014). Factores determinantes del rendimiento académico de la Universidad de Atacama (UDA). Estudios Pedagógicos, 40(1), 25-39.

Barber, M., & Mourshed, M. (2007). How the world’s best-performing school systems come out on top. McKinsey & Co.

Belvis, E., Moreno, M. V., & Ferrer, F. (2009). Los factores explicativos del éxito y fracaso académico en las universidades españolas, en los años del cambio hacia la convergencia europea. Revista Española de Educación Comparada, 15, 61-92.

Camina, M. A., & Salvador, M. I. (2007). Condicionantes y características de los estudiantes que inician Magisterio: Estudio descriptivo y comparativo entre especialidades. Tendencias Pedagógicas, 12, 245-264.

Cerdeira, J. M., Catela, L., Balcao, A., & Seabra, C. (2018). Predictors of student success in Higher Education: Secondary school internal scores versus national exams. Higher Education Quarterly, 72, 304-313.

Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155

Comisión Europea (2017) Guía de uso del ECTS 2015. https://op.europa.eu/es/publication-detail/-/publication/da7467e6-8450-11e5-b8b7-01aa75ed71a1

Cortés, A., & Palomar, J. (2008). El proceso de admisión como predictor del rendimiento académico en la educación superior. Universitas Psychologica, 7(1), 199-215.

Danilowicz-Gösele, K., Lerche, K., Meya, J., & Schwager, R. (2017). Determinants of students’ success at university. Education Economics, 25(5), 513-532.

Durbin, J., & Watson, G.S. (1971). Testing for serial correlation in least squares regression. III. Biometrika, 58, 1-19.

Fernández-Mellizo, M., & Constante-Amores, A. (2020). Determinantes del rendimiento académico de los estudiantes de nuevo acceso a la Universidad Complutense de Madrid. Revista de Educación, 387(1), 11-38.

Gallegos, J., & Campos, N. A. (2019). Determinantes del rendimiento académico estudiantil: Caso Universidad Católica de la Santísima Concepción. Revista de Ciencias Sociales25(2), 163-177.

Garbanzo, G. M. (2007). Factores asociados al rendimiento académico en estudiantes universitarios. Una reflexión desde la calidad de la educación superior pública. Revista de Educación, 31(1), 43-63. http://dx.doi.org/10.15517/REVEDU.V31I1.1252

García, A. (2014). Rendimiento académico y abandono universitario: Modelos, resultados y alcances de la producción académica en la Argentina. Revista Argentina de Educación Superior, 8, 9-38.

Hanushek, E., Rivkin, S. G., Schiman, J. C. (2016). Dynamic Effects of Teacher Turnover on the Quality of Instruction. Economics of Education Review, 55, 132-148.

Henoch, J. R., Klusmann, U., Lüdtke, O., & Trautwein, U. (2015). Who becomes a teacher? Challenging the “negative selection” hypothesis. Learning and Instruction, 36, 46-56.

Hepworth, D., Littlepage, B., & Hancock, K. (2018). Factors influencing university student academic success. Educational Research Quarterly, 42(1), 45-61.

Jiménez Caballero, J. L., Camúñez Ruiz, J. A., De Fuentes Ruiz, P., & González-Rodríguez, M. R. (2015). Factores determinantes del rendimiento académico universitario en el Espacio Europeo de Educación Superior. Innovar, 25(58), 159-175. DOI: https://doi.org/10.15446/innovar.v25n58.52440

López, E. (1998). Tratamiento de la colinealidad en regresión múltiple. Psicothema, 10(2), 491-507.

Menard, S. (2002). Applied logistic regresión analysis. Londres, Inglaterra: Sage Publications.

Montesinos, A. (2011). Estudio del AIC y BIC en la Selección de Modelos de Vida con Datos Censurados (Tesis doctoral). Centro de Investigación en Matemáticas, A.C., México

OECD (2008). Education at a Glance 2008: OECD Indicators. OECD Publishing.

OECD (2015). “Who wants to become a teacher?”. PISA in Focus, 58, OECD Publishing, Paris. http://dx.doi.org/10.1787/5jrp3qdk2fzp-en

OECD (2017). TALIS Initial Teacher Preparation Study. http://www.oecd.org/edu/school/talis-initial-teacher-preparation-study.htm

Pardo, M., & Ruiz, M. (2013). Análisis de Datos en Ciencias Sociales y de la Salud III. Madrid: Síntesis.

Perez-Felkner, L., McDonald, S. K., Schneider, B., & Grogan, E. (2012). Female and male adolescents’ subjective orientations to mathematics and the influence of those orientations on postsecondary majors. Developmental psychology, 48(6), 1658-1673.

Ponce, R. S., Bertolín, A. G., & Luján, E. L. (2020). Docentes y pacto educativo: una cuestión urgente. Contextos educativos: Revista de educación, 26(1), 105-120. DOI: https://doi.org/10.18172/con.4399

Respondek, L., Seufert, T., Stupnisky, R., & Nett, U. (2017). Perceived Academic Control and Academic Emotions Predict Undergraduate University Student Success: Examining Effects on Dropout Intention and Achievement. Frontiers in Psychology, 8, 243-265.

Richardson, M., Abraham, C., & Bond, R. (2012). Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychological bulletin, 138(2), 353. http://dx.doi. org/10.1037/a0026838

Rodríguez, S., Fita, E., & Torrado, M. (2004). El rendimiento académico en la transición secundaria-universidad. Revista de Educación, 334(1), 391-414.

Rooij, E., Jansen, C., & Grift, M. (2017). First-year university students’ academic success: The importance of academic adjustment. European Journal of Psychology of Education, 33(4), 749-767.

Rus, T. I., Martínez, E. A., Frutos, A. E., & Moreno, J. R. (2019). El aprendizaje cooperativo en la formación de maestros de Educación Primaria. Revista de Investigación Educativa, 37(2), 543-559. https://doi.org/10.6018/rie.37.2.369731

Schneider, M., & Preckel, F. (2017). Variables associated with achievement in higher education: A systematic review of meta-analyses. Psychological Bulletin, 143(6), 565-600.

Sistema Integrado de Información Universitaria (2019). Indicadores universitarios de rendimiento académico. https://www.ciencia.gob.es/stfls/MICINN/Universidades/Ficheros/Estadisticas/metodologia-estadistica-indicadores-rendimiento-2019.pdf

Tejedor, F. (2003). Poder explicativo de algunos determinantes del rendimiento en los estudios universitarios. Revista Española de Pedagogía, 224, 5-32

Ukpong, D. E. & George, I. N. (2013). Length of Study-Time Behaviour and Academic Achievement of Social Studies Education Students in the University of Uyo. International Education Studies, 6(3), 172-178. https://doi.org/10.5539/ies.v6n3p172

Vaillant, D., & Rodríguez, E. (2018). Perspectivas de UNESCO y la OEI sobre la calidad de la educación. En Monarca, H. (Coord.), Calidad de la Educación en Iberoamérica: Discursos, políticas y prácticas (pp. 136-154). Dykinson.

Contact address: Eva Jiménez García. Universidad Europea de Madrid, Vicerrectorado de Profesorado e Investigación, Unidad de Calidad y Compliance. C/Tajo, s/n. 28670 Villaviciosa de Odón, Madrid. E-mail: eva.jimenez@universidadeuropea.es


1(1) This article has been carried out within the framework of the Project RTI2018-099365-B-I00: Differential Cognitive skills, attitudinal and previous academic achievement profile of teacher candidates: consequences for selection in the university access (PROTEACHER), funded by the Ministry of Science and Innovation.