devrev-demo-eval-gpt-4o-mini
收藏魔搭社区2025-11-27 更新2025-05-03 收录
下载链接:
https://modelscope.cn/datasets/bespokelabs/devrev-demo-eval-gpt-4o-mini
下载链接
链接失效反馈官方服务:
资源简介:
<a href="https://github.com/bespokelabsai/curator/">
<img src="https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k/resolve/main/made_with_curator.png" alt="Made with Curator" width=200px>
</a>
## Dataset card for devrev-demo-eval-gpt-4o-mini
This dataset was made with [Curator](https://github.com/bespokelabsai/curator/).
## Dataset details
A sample from the dataset:
```python
{
"natural_language_query": "Show me all tickets for the AWS integration app",
"wisp_query": {
"semantic_query": "",
"syntactic_query": "apps:aws"
},
"complexity_level": 1,
"result_gpt-4o-mini": "{\n \"filter\": \"apps:\\\"AWS integration\\\"\",\n \"query\": \"\"\n}",
"is_identical_result_gpt-4o-mini": false
}
```
## Loading the dataset
You can load this dataset using the following code:
```python
from datasets import load_dataset
dataset = load_dataset("bespokelabs/devrev-demo-eval-gpt-4o-mini")
```
<a href="https://github.com/bespokelabsai/curator/">
<img src="https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k/resolve/main/made_with_curator.png" alt="Made with Curator" width=200px>
</a>
## devrev-demo-eval-gpt-4o-mini 数据集卡片
本数据集由[Curator](https://github.com/bespokelabsai/curator/)构建完成。
## 数据集详情
数据集示例如下:
python
{
"自然语言查询": "帮我查询所有与AWS集成应用相关的工单",
"Wisp查询": {
"语义查询": "",
"语法查询": "apps:aws"
},
"复杂度等级": 1,
"GPT-4o-mini生成结果": "{
"filter": "apps:\"AWS集成\"",
"query": ""
}",
"GPT-4o-mini生成结果与基准是否一致": false
}
## 数据集加载
你可以通过以下代码加载该数据集:
python
from datasets import load_dataset
dataset = load_dataset("bespokelabs/devrev-demo-eval-gpt-4o-mini")
提供机构:
maas
创建时间:
2025-05-01



