Practices for Managing Machine Learning Products: a Multivocal Literature

The data available is the replication package as supplementary material of the paper "Practices for Managing Machine Learning Products: a Multivocal Literature Review , providing a detailed chain of evidence so that any researcher can verify all codes and the most relevant excerpts. Abstract: Machine Learning (ML) has grown in popularity in the software industry due to its ability to solve complex problems. Developing ML Systems involves more uncertainty and risk because it requires identifying a business opportunity and managing source code, data, and trained models. Our research aims to identify the existing practices used in the industry for building ML applications, comprehending the organizational complexity of adopting ML Systems. We conducted a Multivocal Literature Review and, then, created a taxonomy of the practices applied to the ML System lifecycle discussed among practitioners and researchers. The core of the study emerged from 41 selected posts from the grey literature and 37 selected scientific papers. Applying Initial Coding and Focused Coding techniques into these data, we mapped 91 practices into six core categories related to designing, developing, testing, and deploying ML Systems. The results, including a taxonomy of practices, provide organizations with valuable insights to identify gaps in their current ML processes and practices and a roadmap for improving, optimizing, and managing ML systems.