Monitoring ML Systems: Challenges, Solutions and Metrics from a Practitioners' Perspective
收藏资源简介:
This is the dataset for the paper "Monitoring ML Systems: Challenges, Solutions and Metrics from a Practitioners' Perspective". The dataset is recorded in an MS Excel file which contains the following Excel sheets, and the description of each sheet is briefly presented below. (1) <strong>Selected Projects (GitHub)</strong> contain the 15 selected ML projects with the URL of each project. (2) <strong>Raw Data (GitHub)</strong> contains the information about the randomly selected 600 issues, such as issue titles, issue links, issue id. (3) <strong>Raw Data (SO) </strong>contains the information about the randomly selected 2088 SO posts (part of the 2174 SO posts), such as post titles, post link, post id, and open date. (4) <strong>MLOps (SO) </strong>contains the information about the 86 MLOps SO posts (part of the 2174 SO posts), such as post titles, post link, post id, and open date. (5) <strong>Identified Challenges (GitHub) </strong>contain the list of categories, subcategories, and codes of identified challenges from GitHub issues. (6) <strong>Identified Solutions (GitHub) </strong>contain the list of categories, subcategories, and codes of identified solutions from GitHub issues. (7) <strong>Identified Metrics (GitHub) </strong>contain the list of identified metrics from GitHub issues. (8) <strong>Identified Challenges (SO) </strong>contain the list of categories, subcategories, and codes of identified challenges from SO posts. (9) <strong>Identified Solutions (SO) </strong>contain the list of categories, subcategories, and codes of identified solutions from SO posts. (10) <strong>Identified Metrics (SO) </strong>contain the lists of identified metrics from SO posts. (11) <strong>Identified Challenges (Interview)</strong> contain the list of categories, subcategories, and codes of identified challenges from interviews. (12) <strong>Identified Solutions (Interview) </strong>contain the list of categories, subcategories, and codes of identified solutions from interviews. (13) <strong>Identified Metrics (Interview) </strong>contain the list of identified metrics from interviews. (14) <strong>Identified Challenges (Final) </strong>contain the taxonomy of the final challenges identified from GitHub issues, SO posts, and interviews. (15) <strong>Identified Solutions (Final) </strong>contain the<strong> </strong>taxonomy of the final solutions identified from GitHub issues, SO posts, and interviews. (16) <strong>Identified Metrics (Final) </strong>contain the<strong> </strong>final list of metrics identified from GitHub issues, SO posts, and interviews.



