A Systematic Review of Instruments that Assess the Quality of Mobile Health Applications
PDF (Español/English) (Español (España))
HTML (Español (España))

Métricas alternativas

Keywords

Instrument, Evaluation, Quality, Mobile Application, Healthy Habits Instrumento, evaluación, calidad, aplicación móvil, hábitos saludables

How to Cite

Delgado-Morales, C., & Duarte-Hueros, A. (2023). A Systematic Review of Instruments that Assess the Quality of Mobile Health Applications: [Systematic Review of Instruments that Assess the Quality of Mobile Health Applications]. Pi­xel-Bit. Media and Education Journal, 67, 35–58. https://doi.org/10.12795/pixelbit.97867

Abstract

The download of the mobile applications (apps) aimed at fostering healthy habits in the general population has increased significantly in recent years. However, the majority of these apps are not subject to quality regulation processes, and the available instruments to assess the quality seem to be obsolete. This review has been made to know the state of the art about the processes of design, construction, validation and main results obtained in empirical studies about the instruments for assessing the quality of said apps, all this in order to identify the main dimensions and common indicators. Searches have been conducted in four databases with high impact. It concludes that is an interest current topic in scientific literature. From 11 documents which have been included, 17 dimensions and 97 indicators have been considered. Privacy and security-related issues were only included in two documents. In short, it has been possible to establish a significant and updated list that may be the basis for constructing an evaluation framework that allows a comprehensive study of these apps, considering that many of the assessment instruments have not been designed for the general population.

https://doi.org/10.12795/pixelbit.97867
PDF (Español/English) (Español (España))
HTML (Español (España))

References

Aitken, M. & Nass, D. (2021). Digital Health Trends 2021: Innovation, evidence, regulation, and adoption. IQVIA Institute for Human Data Science. https://bit.ly/33sHF9k

Azad-Khaneghah, P., Neubauer, N., Cruz, A.M. & Liu, L. (2021). Mobile Health App Usability and Quality Rating Scales: a Systematic Review. Disability and Rehabilitation: Assistive Technology, 16(7), 712-721. https://doi.org/10.1080/17483107.2019.1701103

Bardus, M., Awada, N., Ghandour, L.A., Fares, E., Gherbal, T., Al-Zanati, T. & Stoyanov, S.R. (2020). The Arabic Version of the Mobile App Rating Scale: Development and Validation Study. JMIR MHealth Uhealth, 8(3), e16965. https://doi.org/10.2196/16956

Baumel, A., Mathur, N., Kane, J.M. & Muench, F. (2017). Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions. Journal of Medical Internet Research, 19(3), e82. https://doi.org/10.2196/jmir.7270

BinDhim, N.F., Hawkey, A. & Trevena, L. (2015). A Systematic Review of Quality Assessment Methods for Smartphone Health App. Telemedicine and e-Health, 21(2), 97-104. https://doi.org/10.1089/tmj.2014.0088

Böhme, C., von Osthoff, M.B., Frey, K. & Hübner, J. (2019). Development of a Rating Tool for Mobile Cancer Apps: Information Analysis and Formal and Content-Related Evaluation of Selected Cancer App. Journal of Cancer Education, 34(1), 105-110. https://doi.org/10.1007/s13187-017-1273-9

Boudreaux, E.D., Waring, M.E., Hayes, R.B., Sadasivam, R.S., Mullen, S. & Pagoto, S. (2014). Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations. Translational Behavioral Medicine, 4(4), 363-371. https://doi.org/10.1007/s13142-014-0293-9

Collado-Borrell, R., Escudero-Vilaplana, V., Villanueva-Bueno, C., Herranz-Alonso, A. y Sanjurjo-Sáez, M. (2020). Features and Functionalities of Smartphone Apps Related to COVID-19: Systematic Search in App Stores and Content Analysis. Journal of Medical Internet Research, 22(8), e20334. https://doi.org/10.2196/20334

Coyne, E., Rands, H., Frommolt, V., Kain, V., Plugge, M. & Mitchell, M. (2018). Investigation of blended learning video resources to teach health students clinical skills: An integrative review. Nurse Education Today, 63, 101-107. https://doi.org/10.1016/j.nedt.2018.01.021

Domnich, A., Arata, L., Amicizia, D., Signori, A., Patrick, B., Stoyanov, S.R., Hides, L., Gasparini, R. & Panatto, D. (2016). Development and validation of the Italian version of the Mobile Application Rating Scale and its generalisability to Apps targeting primary prevention. BMC Medical Informatics and Decision Making, 16(83). https://doi.org/10.1186/s12911-016-0323-2

Duarte-Hueros, A., Delgado-Morales, C. y Field-Cabezas, N. (2021). Estudio sistemático sobre distintivos y sellos de calidad de aplicaciones móviles para la formación en hábitos saludables. En J. Ruiz-Palmero, E. Sánchez-Rivas, E. Colomo-Magaña y J. Sánchez-Rodríguez (Coords.), Innovación e investigación con tecnología educativa (pp. 105-116). Octaedro.

Grant, M.J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information and Libraries Journal, 26, 91-108. https://doi.org/10.1111/j.1471-1842.2009.00848.x

Hensher, M., Cooper, P., Dona, W.A., Angeles, M.R., Nguyen, D., Heynsbergh, N., Chatterton, M.L. & Peeters, A. (2021). Scoping review: Development and assessment of evaluation frameworks of mobile health Apps for recommendations to consumers. Journal of the American Medical Informatics Association, 28(6), 1318-1329, https://doi.org/10.1093/jamia/ocab041

Jake-Schoffman, D. E., Silfee, V. J., Waring, M. E., Boudreaux, E. D., Sadasivam, R. S., Mullen, S. P., ... & Pagoto, S.L. (2017). Methods for evaluating the content, usability, and efficacy of commercial mobile health apps. JMIR mHealth and uHealth, 5(12), e8758. https://doi.org/10.2196/mhealth.8758

Jeminiwa, R.N., Hohmann, N.S. & Fox, B.I. (2019). Developing a Theoretical Framework for Evaluating the Quality of mHealth Apps for Adolescent Users: A Systematic Review. The Journal of Pediatric Pharmacology and Therapeutics, 24(4), 254-269. https://doi.org/10.5863/1551-6776-24.4.254

Lee, C.Y. & Cherner, T.S. (2015). A comprehensive evaluation rubric for assessing instructional App. Journal of Information Technology Education: Research, 14, 21-53. https://doi.org/10.28945/2097

Llorens-Vernet, P. & Miró, J. (2020). The Mobile App Development and Assessment Guide (MAG): Delphi-Based Validity Study. JMIR MHealth Uhealth, 8(7), e17760. https://doi.org/10.2196/17760

Martín-Payo, R., Fernández-Álvarez, M.M., Blanco-Díaz, M., Cuesta-Izquierdo, M., Stoyanov, S.R. y Llaneza-Suárez, E. (2019). Spanish adaptation and validation of the Mobile Application Rating Scale questionnaire. International Journal of Medical Informatics, 129, 95-99. https://doi.org/10.1016/j.ijmedinf.2019.06.005

Messner, E., Terhorst, Y., Barke, A., Baumeister, H., Stoyanov, S.R, Hides, L., Kavanagh, D.J., Pryss, R., Sander, L. & Probst, T. (2020). The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study. JMIR MHealth Uhealth, 8(3), e14479. https://doi.org/10.2196/14479

Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G. & The PRISMA Group. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097

Nouri, R., Niakan-Kalhori, S.R., Ghazisaeedi, M., Marchand, G. & Yasini, M. (2018). Criteria for assessing the quality of mHealth apps: a systematic review. Journal of the American Medical Informatics Associations, 25(8), 1089-1098. https://doi.org/10.1093/jamia/ocy050

Palacios-Gálvez MS, Yot-Domínguez C, Merino-Godoy A. (2020). Healthy Jeart: promoción de la salud en la adolescencia a través de dispositivos móviles. Rev Esp Salud Pública, 94: 5 de marzo e202003010. https://pubmed.ncbi.nlm.nih.gov/32134049/

Pluye, P., Robert, E., Cargo, M., Bartlett, G., O’Cathain, A., Griffiths, F., Boardman, F., Gagnon, M.P. & Rousseau, M.C. (2011). Proposal: A mixed methods appraisal tool for systematic mixed studies reviews. McGill University. https://bit.ly/3EVOC0f

Powell AC, Landman AB, Bates DW. (2014). In search of a few good apps. JAMA, 14;311(18):1851-2. https://doi.org/10.1001/jama.2014.2564. PMID: 24664278

Saliasi, I., Martinon, P., Darlington, E., Smentek, C., Tardivo, D., Bourgeois, D., Dussart, C., Carrouel, F. & Fraticelli, L. (2021). Promoting Health via mHealth Applications Using a French Version of the Mobile App Rating Scale: Adaptation and Validation Study. JMIR MHealth Uhealth, 9(8), e30480. https://doi.org/10.2196/30480

Schulz, K.F. & Grimes, D.A. (2002). Blinding in randomised trials: hiding who got what. The Lancet, 359(9307), 696-700. https://doi.org/10.1016/S0140-6736(02)07816-9

Stoyanov, S.R., Hides, L., Kavanagh, D.J. & Wilson, H. (2016). Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS). JMIR MHealth Uhealth, 4(2), e72. https://doi.org/10.2196/mHealth.5849

Stoyanov, S.R., Hides, L., Kavanagh, D.J., Zelenko, O., Tjondronegoro, D. & Mani, M. (2015). Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile App. JMIR MHealth Uhealth, 3(1), e27. https://doi.org/10.2196/mHealth.3422

Terhorst, Y., Philippi, P., Sander, L.B., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G.C., Schoeppe, S., Bauereiß, N., Portenhauser, A., Domhardt, M., Walter, B., Krusche, M., Baumeister, H. & Messner, E.M. (2020). Validation of the Mobile Application Rating Scale (MARS). PLoS ONE, 15(11), e0241480. https://doi.org/10.1371/journal.pone.0241480

Willis, S., Neil, R., Mellick, M.C. & Wasley, D. (2019). The Relationship Between Occupational Demands and Well-Being of Performing Artists: A Systematic Review. Frontiers in Psychology, 10(393). https://doi.org/10.3389/fpsyg.2019.00393

WHO (2011). mHealth: new horizons for health through mobile technologies: second global survey on eHealth. Global Observatory for eHealth. https://bit.ly/33t5cXH

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Copyright (c) 2023 Pi­xel-Bit. Media and Education Journal

Downloads

Download data is not yet available.