devrev-demo-eval-gpt-4o-mini

<a href="https://github.com/bespokelabsai/curator/">
<img src="https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k/resolve/main/made_with_curator.png" alt="Made with Curator" width=200px>
</a>

## Dataset card for devrev-demo-eval-gpt-4o-mini

This dataset was made with [Curator](https://github.com/bespokelabsai/curator/).

## Dataset details

A sample from the dataset:

```python
{
"natural_language_query": "Show me all tickets for the AWS integration app",
"wisp_query": {
"semantic_query": "",
"syntactic_query": "apps:aws"
},
"complexity_level": 1,
"result_gpt-4o-mini": "{\n \"filter\": \"apps:\\\"AWS integration\\\"\",\n \"query\": \"\"\n}",
"is_identical_result_gpt-4o-mini": false
}
```

## Loading the dataset

You can load this dataset using the following code:

```python
from datasets import load_dataset

dataset = load_dataset("bespokelabs/devrev-demo-eval-gpt-4o-mini")
```

<a href="https://github.com/bespokelabsai/curator/">
<img src="https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k/resolve/main/made_with_curator.png" alt="Made with Curator" width=200px>
</a>

## devrev-demo-eval-gpt-4o-mini 数据集卡片

本数据集由[Curator](https://github.com/bespokelabsai/curator/)构建完成。

## 数据集详情

数据集示例如下：
python
{
"自然语言查询": "帮我查询所有与AWS集成应用相关的工单",
"Wisp查询": {
"语义查询": "",
"语法查询": "apps:aws"
},
"复杂度等级": 1,
"GPT-4o-mini生成结果": "{
"filter": "apps:\"AWS集成\"",
"query": ""
}",
"GPT-4o-mini生成结果与基准是否一致": false
}

## 数据集加载

你可以通过以下代码加载该数据集：
python
from datasets import load_dataset

dataset = load_dataset("bespokelabs/devrev-demo-eval-gpt-4o-mini")

搜集汇总

背景与挑战

背景概述

该数据集名为'devrev-demo-eval-gpt-4o-mini'，由Curator创建，用于评估GPT-4o-mini模型，包含自然语言查询与Wisp查询的对比样本。它采用Apache License 2.0许可证，可通过datasets库加载使用。