Monitoring ML Systems: Challenges, Solutions and Metrics from a Practitioners' Perspective

This is the dataset for the paper "Monitoring ML Systems: Challenges, Solutions and Metrics from a Practitioners' Perspective". The dataset is recorded in an MS Excel file which contains the following Excel sheets, and the description of each sheet is briefly presented below. (1) <strong>Selected Projects (GitHub)</strong> contain the 15 selected ML projects with the URL of each project. (2) <strong>Raw Data (GitHub)</strong> contains the information about the randomly selected 600 issues, such as issue titles, issue links, issue id. (3) <strong>Raw Data (SO) </strong>contains the information about the randomly selected 2088 SO posts (part of the 2174 SO posts), such as post titles, post link, post id, and open date. (4) <strong>MLOps (SO) </strong>contains the information about the 86 MLOps SO posts (part of the 2174 SO posts), such as post titles, post link, post id, and open date. (5) <strong>Identified Challenges (GitHub) </strong>contain the list of categories, subcategories, and codes of identified challenges from GitHub issues. (6) <strong>Identified Solutions (GitHub) </strong>contain the list of categories, subcategories, and codes of identified solutions from GitHub issues. (7) <strong>Identified Metrics (GitHub) </strong>contain the list of identified metrics from GitHub issues. (8) <strong>Identified Challenges (SO) </strong>contain the list of categories, subcategories, and codes of identified challenges from SO posts. (9) <strong>Identified Solutions (SO) </strong>contain the list of categories, subcategories, and codes of identified solutions from SO posts. (10) <strong>Identified Metrics (SO) </strong>contain the lists of identified metrics from SO posts. (11) <strong>Identified Challenges (Interview)</strong> contain the list of categories, subcategories, and codes of identified challenges from interviews. (12) <strong>Identified Solutions (Interview) </strong>contain the list of categories, subcategories, and codes of identified solutions from interviews. (13) <strong>Identified Metrics (Interview) </strong>contain the list of identified metrics from interviews. (14) <strong>Identified Challenges (Final) </strong>contain the taxonomy of the final challenges identified from GitHub issues, SO posts, and interviews. (15) <strong>Identified Solutions (Final) </strong>contain the<strong> </strong>taxonomy of the final solutions identified from GitHub issues, SO posts, and interviews. (16) <strong>Identified Metrics (Final) </strong>contain the<strong> </strong>final list of metrics identified from GitHub issues, SO posts, and interviews.本数据集对应论文《机器学习系统监控：从从业者视角看挑战、解决方案与指标》（*Monitoring ML Systems: Challenges, Solutions and Metrics from a Practitioners' Perspective*）。该数据集存储于MS Excel（微软Excel）文件中，包含以下工作表，各工作表的简要说明如下： 1. **精选项目（GitHub）**：包含15个精选机器学习项目，附带各项目的URL链接。 2. **原始数据（GitHub）**：包含随机选取的600条GitHub议题相关信息，例如议题标题、议题链接及议题ID。 3. **原始数据（SO）**：包含随机选取的2088条SO帖子（即Stack Overflow论坛帖子，源自2174条SO帖子）的相关信息，例如帖子标题、帖子链接、帖子ID及发布日期。 4. **MLOps相关SO帖子（SO）**：包含86条与机器学习运维（MLOps）相关的SO帖子（源自2174条SO帖子）的相关信息，例如帖子标题、帖子链接、帖子ID及发布日期。 5. **识别出的挑战（GitHub）**：包含从GitHub议题中提取的挑战类别、子类别及编码列表。 6. **识别出的解决方案（GitHub）**：包含从GitHub议题中提取的解决方案类别、子类别及编码列表。 7. **识别出的指标（GitHub）**：包含从GitHub议题中提取的指标列表。 8. **识别出的挑战（SO）**：包含从SO帖子中提取的挑战类别、子类别及编码列表。 9. **识别出的解决方案（SO）**：包含从SO帖子中提取的解决方案类别、子类别及编码列表。 10. **识别出的指标（SO）**：包含从SO帖子中提取的指标列表。 11. **识别出的挑战（访谈）**：包含从访谈内容中提取的挑战类别、子类别及编码列表。 12. **识别出的解决方案（访谈）**：包含从访谈内容中提取的解决方案类别、子类别及编码列表。 13. **识别出的指标（访谈）**：包含从访谈内容中提取的指标列表。 14. **最终识别出的挑战（整合版）**：包含从GitHub议题、SO帖子及访谈中提取的最终挑战分类体系。 15. **最终识别出的解决方案（整合版）**：包含从GitHub议题、SO帖子及访谈中提取的最终解决方案分类体系。 16. **最终识别出的指标（整合版）**：包含从GitHub议题、SO帖子及访谈中提取的最终指标列表。