Métricas alternativas
Metrics
Keywords
system usability scale
virtual environment
Moodle
Vocational training Usabilidad percibida
escala de usabilidad del sistema
entorno virtual
Moodle
Formación Profesional
How to Cite
Abstract
This work revolves around the degree of satisfaction or perceived usability of Vocational Training teachers who teach in an LMS based on the Moodle 2.6 platform. In the last decade, there has been an increase in research related to the usability perceived on the basis of the ISO 9241-11 standard (1988) and the LMS incorporated in the training actions used in e-learning. This article analyses the results of the analysis of the degree of satisfaction of teachers in this platform used for distance vocational training in the Balearic Islands. The sample is made up of a total of 24 teachers out of a finite population of 134 teachers. The data collection was carried out by means of the questionnaire instrument, the central axis of which was the incorporation of the usability questionnaire System Usability Scale (SUS) designed by Brooke (1996). The results obtained show that the degree of satisfaction on the part of the teachers is positive at a general level; while in function of the variables formative cycle and gender, these results are not significant based on the contrast of hypotheses. The degree of satisfaction obtained from the sample is 70.20 points, which can be considered 'normal'. Likewise, the average score as a function of the training cycle is 74.4 for the CFGM and 67.66 for the CFGS. With regard to the comparison of results based on gender, the results obtained follow the line of other research carried out for this purpose, gender does not influence the degree of user satisfaction.
References
Bangor, A., Kortum, P. & Miller, J. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human-Computer interaction, 24(6), pp. 574-594. https://doi. org/10.1080/10447310802205776
Bangor, A., Kortum, P., & Miller, J. (2009). Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. Journal of Usability Studies, 4(3), pp. 114-123. Recuperado de https:// dl.acm.org/citation.cfm?id=2835589
Berkman, M.I. & Karahoca, D. (2016). Re-Assessing the Usability Metric for User Experience (UMUX) Scale. Journal of Usabilty Studies, 11(3), pp. 89.-109. Recuperado de https://bit.ly/2Cicdd1
Bevan, N., Carter, J., Earthy, J., Geis, T., & Harker, S. (2016). New ISO Standards for Usability, Usability Reports and Usability Measures. 9731, pp. 268-278. https://doi.org/10.1007/978-3-319-39510-4_25
Brooke, J. (1996). SUS: A ‘quick and dirty’ usability scale. In P. Jordan, B. Thomas, & B. Weerdmeester (Eds.), Usability Evaluation in Industry, pp. 189–194. Chapter 21. London, UK: Taylor & Francis.
Brooke, J. (2013). SUS: A retrospective. JUS, Journal of Usability Studies, 8(2), pp. 29–40. Recuperado de https://bit.ly/10l1nhp
Borsci, S. Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive processing, 10(3), pp. 193–197. https://doi. org/10.1007/s10339-009-0268-9
Borsci,S. Federeci, S. Bacci., Gnaldi, M., & Bartolucci, F.(2015). Assessing user satisfaction in the era of user experience: comparasion of the SUS, UMUX and UMUX-Lite as a Function of product experience. Internactional Journal of Human-Computer interaction, 31(8), pp. 484-495. https://doi.or g/10.1080/10447318.2015.1064648
Brusilovsky, P. (2004). KnowledgeTree: A distributed architecture for adaptive e-learning. In Proceedings of the 13th International World Wide Web conference on Alternate track papers & posters (WWW Alt. ’04). New York, USA: ACM Press. https://doi.org/10.1145/1013367.1013386
Dubost, A., Klein, M. R., & Dang, J. (2004). Building interoperability between LMS and Brokerage Platforms. In Proceedings of the E-ACTIVITIES conference (WSEAS 2004). Crete, Greece. Recuperado de https://bit.ly/2O7x4p2
Fernández-Coca, A. Lirola, F. & Ordinas, C. (2018). El rediseño total del aula digital bajo una estrategia en 360º, a partir de la escucha al usuario. I Congreso Internacional, Campus Digitales en Educación Superior. Recuperado de https://bit.ly/2QhONfY
Finstad, K. (2006). System usability scale and non-native English speakers. Journal of Usability Studies, 1(4), pp. 185-188. Recuperado de https://bit.ly/2pgowDP
Galanek, J., Gierdowski, D., & Christopher, D. (2018). ECAR Study of Undergraduate Students and Information Technology. Recuperado de https://bit.ly/2JT92wH
Georgsson, M. & Staggers. N (2016). Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics . Journal of the American Medical Informatics Association, 23(1), pp. 5–11, https://doi.org/10.1093/jamia/ocv099
Lewis, J.R. & Sauro, J. (2009). The factor structure of the System Usability Scale. In M. Kurosu, M. (Ed.), Human Centered Design, volumen (5619) (pp. 94–103). Heidelberg, Germany: Springer-Verlag. https://doi.org/10.1007/978-3-642-02806-9_12
Lewis, J.R. & Sauro (2012). Quantifying the User Experience: Practical statistics for user research (1a ed.). Cambridge, MA: Morgan-Kaufmann.
Lewis, J.R. & Sauro, J. (2017). Can i Leave this one out. The effect of dropping an item from SUS. JUS, Journal of Usability Studies, 13(1), pp. 38-46. Recuperado de https://bit.ly/2uH7HDT
Lewis, J.R. (2018). Item Bencharmarks for the system usability Scale. Journal of Usability Studies, 13(3), pp. 158-167. Recuperado de https://bit.ly/2WKxQw0
Kakasevski, G., Mihajlov, M., Arsenovski, S., & Chungurski. S. (2008). Evaluating usability in Learning Management System Moodle. In 30th International Conference on Information Technology Interfaces (ITI 2008). Cavtat, Croatia: IEEE, pp. 613-618. Recuperado de https://bit.ly/36Cxlsn. https://doi. org/10.1109/ITI.2008.4588480
Nakamura, W. T., Oliveira, E. H. T. y Conte, T. (2017). A systematic mapping on usability and user experience evaluation of Learning Management Systems. Recuperado de https://bit.ly/2OdgpQI
Nielsen, J., (1994). Heuristic evaluation. In Usability Inspection Methods. New York, USA: John Wiley & Sons.
Linek, S.B. (2017). Order effects in usability questionnaries. JUS, Journal of Usability Studies, volumen (12), número (4). 164-182. Recuperado de https://bit.ly/2O8POEn
Lirola, F. (2012). Diseño e implementación de un entorno virtual para las titulaciones deportivas del periodo transitorio en la C.A. de las Islas Baleares. Recuperado de https://bit.ly/2Jfre1x
Lirola, F. y Pérez. A. (2015). La usabilidad percibida y el grado de satisfacción en la plataforma moodle de la UIB a partir del cuestionario SUS. https://doi.org/10.13140/RG.2.1.3813.8329
Orfanou, K., Tselios, N. y Katsanos, C. (2015). Perceived Usability Evaluation of Learning Management Systems: Empirical Evaluation of the System Usability Scale. The International Review of Research in Open and Distributed Learning, volumen (16), número (2), pp. 227-246. https://doi.org/10.19173/ irrodl.v16i2.1955
Oztekin, A., Kong, Z. J. y Uysal, O. (2010). UseLearn: A novel checklist and usability evaluation method for eLearning systems by criticality metric analysis. International Journal of Industrial Ergonomics, volumen (40), número(4), pp. 455-469. https://doi.org/10.1016/j.ergon.2010.04.001
Revythi, A. y Tselios, N. (2017). Extension of Technology Acceptance Model by using System Usability Scale to assess behavioral intention to use e-learning. Education and Information Technologies. volumen (24), número(4). https://doi.org/10.1007/s10639-019-09869-4
Tullis, T. y Stetson, J. (2004). A comparison of questionnaires for assessing website usability. Proceedings of UPA 2004 Conference. Minneapolis, Minnesota. Recuperado de https://bit.ly/2QgHaXl