Implementation of Machine Learning applications in health care organizations: protocol for a systematic Review of empirical studies

Background: An increasing interest in machine learning (ML) has been observed among scholars and health care professionals. However, while ML-based applications have been shown to be effective and have the potential to change the delivery of patient care, their implementation in health care organizations is complex. There are several challenges that currently hamper the uptake of ML in daily practice, and there is currently limited knowledge on how these challenges have been addressed in empirical studies on implemented ML-based applications. Objective: The aim of this systematic literature review is twofold: (1) to map the ML-based applications implemented in health care organizations, with a focus on investigating the organizational dimensions that are relevant in the implementation process; and (2) to analyze the processes and strategies adopted to foster a successful uptake of ML. Methods: We developed this protocol following the PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) guidelines. The search was conducted on 3 databases (PubMed, Scopus, and Web of Science), considering a 10-year time frame (2013-2023). The search strategy was built around 4 blocks of keywords (artificial intelligence, implementation, health care, and study type). Based on the detailed inclusion criteria defined, only empirical studies documenting the implementation of ML-based applications used by health care professionals in clinical settings will be considered. The study protocol was registered in PROSPERO (International Prospective Register of Systematic Reviews). Results: The review is ongoing and is expected to be completed by July 2023. Data analysis is currently underway, and the first results are expected to be submitted for publication in September 2023. The study was funded by the European Union within the Multilayered Urban Sustainability Action (MUSA) project. Conclusions: ML-based applications involving clinical decision support and automation of clinical tasks present unique traits that add several layers of complexity compared with earlier health technologies. Our review aims at contributing to the existing literature by investigating the implementation of ML from an organizational perspective and by systematizing a conspicuous amount of information on factors influencing implementation.