BANKING77-OOS

具有单个银行域的数据集，包括一般的超出范围 (OOD-OOS) 查询和域内但超出范围 (ID-OOS) 查询，其中 ID-OOS 查询在语义上是相似的意图/查询具有范围内的意图。 BANKING77 最初包含 77 个意图。 BANKING77-OOS 在此数据集中包含 50 个范围内意图，ID-OOS 查询是基于 27 个保留的范围内意图构建的。
使用和不使用 OOD-OOS 和 ID-OOS 查询进行意图检测

This is a single banking domain dataset comprising two types of out-of-scope queries: general out-of-scope (OOD-OOS) queries and in-domain but out-of-scope (ID-OOS) queries. Notably, ID-OOS queries are semantically similar to in-scope intents or queries, while their corresponding intents belong to the original domain intents. Originally, BANKING77 contains 77 intents. For this dataset, BANKING77-OOS includes 50 in-scope intents, and ID-OOS queries are constructed based on the remaining 27 reserved in-scope intents. Intent detection tasks can be conducted either with or without the inclusion of OOD-OOS and ID-OOS queries.

搜集汇总

背景与挑战

背景概述

BANKING77-OOS是一个专注于意图检测的数据集，基于银行域构建，包含50个范围内意图，并引入了域外和域内但超出范围的查询来评估模型鲁棒性。该数据集由Google Research等机构于2022年发布，旨在改进意图分类中超出范围检测的评估方法。