How efficient are universities at publishing research? A data envelopment analysis of Spanish state universities

Palabras clave: Research publishing, Efficiency analysis, Benchmarking, Data envelopment analysis, State universities, Spain.


The level of efficiency regarding the production of published scientific research in 2015 for the 48 state universities of the Spanish education system is assessed. It is used a methodological approach based on output specifications of desirable outputs (total amount of published papers in Q1 journals) and undesirable outputs (non-cited publications). Relative measures are obtained under two efficiency schemes, natural and managerial. Results enable to identify certain management strategies to improve overall efficiency at publishing research of the Spanish university system. A higher allocation of budget resources among certain institutions would lead to efficiency gains for the system as a whole.

Biografía del autor/a

Alfonso Expósito-García, Universidad de Sevilla
Profesor Asistente Doctor del Departamento de Análisis Económico de la Universidad de Sevilla


Abbott, Malcolm; Doucouliagos, Chris (2003). “The efficiency of Australian universities: A data envelopment analysis”. Economics of education review, v. 22, n. 1, pp. 89-97.

Abramo, Giovanni; Cicero, Tindaro; D’Angelo, Ciriaco-Andrea (2013). “The impact of unproductive and top researchers on overall university research performance”. Journal of informetrics, v. 7, n. 1, pp. 166-175.

Albatch, Philip; Salmi, Jamil (2011). The road to academic excellence: The making of world-class research universities. Washington DC: The World Bank. ISBN: 978 0 8213 8805 1

Amabile, Teresa (1988). “A model of creativity and innovation in organizations”. In: Staw, Barry M.; Cummings, Larry L. (eds.). Research in organizational behaviour, Greenwich (CT): JAI Press, pp. 123-167. ISBN: 0892321512

Athanassopoulos, Antreas D.; Shale, Estelle (1997). “Assessing the comparative efficiency of higher education institutions in the UK by means of data envelopment analysis”. Education economics, v. 5, n. 2, pp. 117-134.

Avkiran, Necmi K. (2001). “Investigating technical and scale efficiencies of Australian universities through data envelopment analysis”. Socio-economic planning sciences, v. 35, n. 1, pp. 57-80.

Banker, Rajiv D.; Chang, Hsihui; Cooper, William W. (1996). “Simulation studies of efficiency, returns to scale and misspecification with nonlinear functions in DEA”. Annals of operation research, v. 66, n. 4, pp. 23-253.

Banker, Rajiv; Charnes, Abraham; Cooper, William (1984). “Some models for estimating technical and scale inefficiencies in data envelopment analysis”. Management science, v. 30, n. 9, pp. 1078-1092.

Buela-Casal, Gualberto; Guillén-Riquelme, Alejandro; Ramiro-Sánchez, Tamara; Quevedo-Blasco, Raúl (2017). “Ranking de investigación de las universidades públicas españolas”. Revista iberoamericana de psicología y salud, v. 8, n. 1, pp. 21-35.

Charnes, Abraham; Cooper, William; Rhodes, Edwardo (1978). “Measuring the efficiency of decision making units”. European journal of operational research, v. 2, n. 6, pp. 429-444.

Charnes, Abraham; Cooper, William; Rhodes, Edwardo (1981). “Evaluating program and managerial efficiency: An application of data envelopment analysis to Program Follow Through”. Management science, v. 27, n. 6, pp. 668-697.

Farrell, Michael-James (1957). “The measurement of productive efficiency”. Journal of The Royal Statistical Society, Series A, v. 120, n. 3, pp. 253-281.

Flegg, Anthony-Travers; Allen, David; Field, Kamal; Thurlow, Tom (2004). “Measuring the efficiency of British universities: A multi-period data envelopment analysis”. Education economics, v. 12, n. 3, pp. 231-249.

Hazelkorn, Ellen (2013). World-class universities or world-class systems? Ranking and higher education policy choices. In: Unesco global forum on rankings and accountability in higher education, Paris, France.

IUNE Observatory (2015). IUNE data base on indicators on scientific activity by Spanish universities. Research Institute for Higher Education and Science (Inaecu), Madrid, Spain.

Johnes, Jill (2006). “Data envelopment analysis and its application to the measurement of efficiency in higher education”. Economics of education review, v. 25, n. 3, pp. 273-288.

Lukman, Rebeka; Krajnc, Damjan; Glavic, Peter (2010). “University ranking using research, educational and environmental indicators”. Journal of cleaner production, v. 18, n. 7, pp. 619-628.

Martí-Selva, María-Luisa; Puertas-Medina, Rosa; Calafat-Marzal, María-Consuelo (2014). “Calidad y eficiencia de las universidades públicas españolas”. Revista de estudios regionales, v. 99, pp. 135-154.

McGrail, Matthew; Rickard, Claire; Jones, Rebecca (2006). “Publish or perish: A systematic review of interventions to increase academic publication rates”. Higher education, research & development, v. 25, n. 1, pp. 19-35.

Ministerio de Educación, Ciencia y Deporte del Gobierno de España (2015). Estadísticas de universidades.

Pino-Mejías, José-Luis; Solís-Cabrera, Francisco; Delgado-Fernández, Mercedes; Barea-Barrera, Rosario (2010). “Evaluación de la eficiencia de grupos de investigación mediante análisis envolvente de datos (DEA)”. El profesional de la información, v. 19, n. 2, pp. 160-167.

Priem, Jason (2013). “Scholarship: Beyond the paper”. Nature, v. 495, pp. 437-440.

Pusser, Brian; Marginson, Simon (2013). “University rankings in critical perspective”. The journal of higher education, v. 84, n. 4, pp. 544-568.

Salmi, Jamil (2009). The challenge of establishing world-class universities. Washington D.C.: The World Bank. ISBN: 978 0 8213 7865 6

Sexton, Thomas; Comunale, Christie; Gara, Stephen (2012). “Efficiency-based funding for public four-year colleges and universities”. Education finance and policy, v. 7, n. 3, pp. 331-359.

Shin, Jung-Cheol; Kehm, Barbara (2013). Institutionalization of world-class university in global competition. Dordrecht: Springer. ISBN: 978 94 007 4975 7

Shin, Jung-Cheol; Toutkouwshian, Robert; Teichler, Ulrich (2011). University rankings: Theoretical basis, methodology and impacts on global higher education. Dordrecht: Springer. ISBN: 978 94 007 1116 7

Sueyoshi, Toshiyuki; Goto, Mika (2010). “Should the US clear air act include CO2 emmision control?: examination by data envelopment analysis”. Energy policy, v. 38, n. 10, pp. 5902-5911.

Sueyoshi, Toshiyuki; Goto, Mika (2011). “Measurement of returns to scale and damages to scale for DEA-based operational and environmental assessment: how to manage desirable (good) and undesirable (bad) outputs?” European journal of operational research, v. 211, n. 1, pp. 76-89.

Sueyoshi, Toshiyuki; Goto, Mika (2012a). “Returns to scale and damages to scale under natural and managerial disposability: Strategy, efficiency and competitiveness of petroleum firms”. Energy economics, v. 34, n. 3, pp. 645-662.

Sueyoshi, Toshiyuki; Goto, Mika (2012b). “Returns to scale and damages to scale on US fossil fuel power plants: Radial and non-radial approaches for DEA environmental assessment”. Energy economics, v. 34, n. 6, pp. 2240-2259.

Sueyoshi, Toshiyuki; Sekitani, Kazuyuki (2009). “An occurrence of multiple projections in DEA-based measurement of technical efficiency: theoretical comparison among DEA models from desirable properties”. European journal of operational research, v. 196, n. 2, pp. 764-794.

Thanassoulis, Emmanuel; De-Witte, Kristof; Johnes, Jill; Johnes, Geraint; Karagiannis, Giannis; Portela, Conceição (2016). “Applications of data envelopment analysis in education”. In: Zhu, Joe (ed.) Data envelopment analysis: A handbook of empirical studies and applications. New York, US: Springer, pp. 367-438. ISBN: 978 1 4899 7684 0

Waltman, Ludo; Calero-Medina, Clara; Kosten, Joost; Noyons, Ed; Tijssen, Robert; Van-Eck, Nees-Jan; Van-Leeuwen, Thed; Van-Raan, Anthony; Visser, Martijn; Wouters, Paul (2012). “The Leiden Ranking 2011/2012: data collection, indicators, and interpretation”. Journal of the American Society for Information Science and Technology, v. 63, n. 12, pp. 2419-2432.

Worthington, Andrew C.; Lee, Boon L. (2008). “Efficiency, technology and productivity change in Australian universities 1998-2003”. Economics of education review, v. 27, n. 3, pp. 285-298.

Zornic, Nikola; Bornmann, Lutz; Maricic, Milica; Markovic, Aleksandar; Martic, Milan; Jeremic, Veljko (2015). “Ranking institutions within a university based on their scientific performance: A percentile-based approach”. El profesional de la información, v. 24, n. 5, pp. 551-566.

Artículos de investigación / Research articles