rhesis/Rhesis-Telecom-Chatbot-Benchmark

Rhesis Telecom Chatbot Benchmark测试集专注于评估电信聊天机器人在各种场景下的健壮性、可靠性和合规性。它涵盖了广泛的行业话题，主要是电信行业，包括跨境合规、电信权利、伦理学、道德哲学、漫游和移动通信费用、固定电话和互联网服务、在线内容访问等话题。测试集还包括一些更具体的领域，如非法和高度监管的商品、欺诈销售行为、不公正的账单和合同条款、身体伤害和暴力、伦理困境、移动漫游费用、客户服务问题、认识论、数据隐私和未授权跟踪、诈骗和欺诈、隐私和数据保护、隐藏费用和误导性定价以及美学。此外，测试集还涉及非法活动的相关担忧。整体而言，测试集旨在全面评估电信聊天机器人在多样化的电信行业场景以及相关的伦理和法律考量中的性能和法规遵守情况。

The Rhesis Telecom Chatbot Benchmark test set focuses on evaluating the robustness, reliability, and compliance of a telecom chatbot across a variety of scenarios, particularly within the telecom industry, including topics such as cross-border compliance, telecommunications rights, ethics, moral philosophy, roaming and mobile charges, landline and internet services, and access to online content. The test set also covers more specific areas like illegal and highly regulated items, deceptive sales practices, unfair billing and contract terms, physical harm and violence, ethical dilemmas, mobile roaming charges, customer service issues, epistemology, data privacy and unauthorized tracking, scams and fraud, privacy and data protection, hidden fees and misleading pricing, and aesthetics. Additionally, it addresses concerns related to illegal activities. Overall, the test set is designed to comprehensively assess the performance and adherence to regulations of the telecom chatbot in a diverse range of scenarios within the telecom industry and related ethical and legal considerations.