KonradSzafer/lm-eval-results-demo

---
pretty_name: Evaluation run of microsoft/phi-2
dataset_summary: "Dataset automatically created during the evaluation run of model\
\ [microsoft/phi-2](https://huggingface.co/microsoft/phi-2)\nThe dataset is composed\
\ of 2 configuration(s), each one corresponding to one of the evaluated task.\n\n\
The dataset has been created from 2 run(s). Each run can be found as a specific\
\ split in each configuration, the split being named using the timestamp of the\
\ run.The \"train\" split is always pointing to the latest results.\n\nAn additional\
\ configuration \"results\" store all the aggregated results of the run.\n\nTo load\
\ the details from a run, you can for instance do the following:\n```python\nfrom\
\ datasets import load_dataset\ndata = load_dataset(\n\t\"KonradSzafer/lm-eval-results-private\"\
,\n\tname=\"microsoft__phi-2__arc_easy\",\n\tsplit=\"latest\"\n)\n```\n\n## Latest\
\ results\n\nThese are the [latest results from run 2024-05-31T06-06-35.913097](https://huggingface.co/datasets/KonradSzafer/lm-eval-results-private/blob/main/microsoft__phi-2/results_2024-05-31T06-06-35.913097.json)\
\ (note that there might be results for other tasks in the repos if successive evals\
\ didn't cover the same tasks. You find each in the results and the \"latest\" split\
\ for each eval):\n\n```python\n{\n \"all\": {\n \"gsm8k\": {\n \
\ \"exact_match,strict-match\": 0.45,\n \"exact_match_stderr,strict-match\"\
: 0.04999999999999999,\n \"exact_match,flexible-extract\": 0.47,\n \
\ \"exact_match_stderr,flexible-extract\": 0.05016135580465919,\n \
\ \"alias\": \"gsm8k\"\n },\n \"arc_easy\": {\n \"\
acc,none\": 0.82,\n \"acc_stderr,none\": 0.03861229196653696,\n \
\ \"acc_norm,none\": 0.83,\n \"acc_norm_stderr,none\": 0.03775251680686371,\n\
\ \"alias\": \"arc_easy\"\n }\n },\n \"gsm8k\": {\n \
\ \"exact_match,strict-match\": 0.45,\n \"exact_match_stderr,strict-match\"\
: 0.04999999999999999,\n \"exact_match,flexible-extract\": 0.47,\n \
\ \"exact_match_stderr,flexible-extract\": 0.05016135580465919,\n \"alias\"\
: \"gsm8k\"\n },\n \"arc_easy\": {\n \"acc,none\": 0.82,\n \"\
acc_stderr,none\": 0.03861229196653696,\n \"acc_norm,none\": 0.83,\n \
\ \"acc_norm_stderr,none\": 0.03775251680686371,\n \"alias\": \"arc_easy\"\
\n }\n}\n```"
repo_url: https://huggingface.co/microsoft/phi-2
leaderboard_url: ''
point_of_contact: ''
configs:
- config_name: microsoft__phi-2__arc_easy
data_files:
- split: 2024_05_30T21_07_22.554816
path:
- '**/samples_arc_easy_2024-05-30T21-07-22.554816.json'
- split: 2024_05_31T06_06_35.913097
path:
- '**/samples_arc_easy_2024-05-31T06-06-35.913097.json'
- split: latest
path:
- '**/samples_arc_easy_2024-05-31T06-06-35.913097.json'
- config_name: microsoft__phi-2__gsm8k
data_files:
- split: 2024_05_30T21_07_22.554816
path:
- '**/samples_gsm8k_2024-05-30T21-07-22.554816.json'
- split: 2024_05_31T06_06_35.913097
path:
- '**/samples_gsm8k_2024-05-31T06-06-35.913097.json'
- split: latest
path:
- '**/samples_gsm8k_2024-05-31T06-06-35.913097.json'
- config_name: microsoft__phi-2__results
data_files:
- split: 2024_05_30T21_07_22.554816
path:
- '**/results_2024-05-30T21-07-22.554816.json'
- split: 2024_05_31T06_06_35.913097
path:
- '**/results_2024-05-31T06-06-35.913097.json'
- split: latest
path:
- '**/results_2024-05-31T06-06-35.913097.json'
---

# Dataset Card for Evaluation run of microsoft/phi-2

<!-- Provide a quick summary of the dataset. -->

Dataset automatically created during the evaluation run of model [microsoft/phi-2](https://huggingface.co/microsoft/phi-2)
The dataset is composed of 2 configuration(s), each one corresponding to one of the evaluated task.

The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.

An additional configuration "results" store all the aggregated results of the run.

To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset(
"KonradSzafer/lm-eval-results-private",
name="microsoft__phi-2__arc_easy",
split="latest"
)
```

## Latest results

These are the [latest results from run 2024-05-31T06-06-35.913097](https://huggingface.co/datasets/KonradSzafer/lm-eval-results-private/blob/main/microsoft__phi-2/results_2024-05-31T06-06-35.913097.json) (note that there might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):

```python
{
"all": {
"gsm8k": {
"exact_match,strict-match": 0.45,
"exact_match_stderr,strict-match": 0.04999999999999999,
"exact_match,flexible-extract": 0.47,
"exact_match_stderr,flexible-extract": 0.05016135580465919,
"alias": "gsm8k"
},
"arc_easy": {
"acc,none": 0.82,
"acc_stderr,none": 0.03861229196653696,
"acc_norm,none": 0.83,
"acc_norm_stderr,none": 0.03775251680686371,
"alias": "arc_easy"
}
},
"gsm8k": {
"exact_match,strict-match": 0.45,
"exact_match_stderr,strict-match": 0.04999999999999999,
"exact_match,flexible-extract": 0.47,
"exact_match_stderr,flexible-extract": 0.05016135580465919,
"alias": "gsm8k"
},
"arc_easy": {
"acc,none": 0.82,
"acc_stderr,none": 0.03861229196653696,
"acc_norm,none": 0.83,
"acc_norm_stderr,none": 0.03775251680686371,
"alias": "arc_easy"
}
}
```

## Dataset Details

### Dataset Description

<!-- Provide a longer summary of what this dataset is. -->

- **Curated by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]

### Dataset Sources [optional]

<!-- Provide the basic links for the dataset. -->

- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]

## Uses

<!-- Address questions around how the dataset is intended to be used. -->

### Direct Use

<!-- This section describes suitable use cases for the dataset. -->

[More Information Needed]

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->

[More Information Needed]

## Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

[More Information Needed]

## Dataset Creation

### Curation Rationale

<!-- Motivation for the creation of this dataset. -->

[More Information Needed]

### Source Data

<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->

#### Data Collection and Processing

<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->

[More Information Needed]

#### Who are the source data producers?

<!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. -->

[More Information Needed]

### Annotations [optional]

<!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. -->

#### Annotation process

<!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. -->

[More Information Needed]

#### Who are the annotators?

<!-- This section describes the people or systems who created the annotations. -->

[More Information Needed]

#### Personal and Sensitive Information

<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->

[More Information Needed]

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

[More Information Needed]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.

## Citation [optional]

<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Dataset Card Authors [optional]

[More Information Needed]

## Dataset Card Contact

[More Information Needed]

原始信息汇总

数据集概述

数据集名称

Evaluation run of microsoft/phi-2

数据集创建

• 创建目的: 自动生成于模型microsoft/phi-2的评估运行过程中。
• 创建过程: 由2次运行创建，每次运行对应一个特定的分割，分割名称基于运行的时间戳。

数据集结构

• 配置数量: 2个
• 配置详情:
  • microsoft__phi-2__arc_easy: 包含3个分割，分别对应不同的时间戳和最新结果。
  • microsoft__phi-2__gsm8k: 包含3个分割，分别对应不同的时间戳和最新结果。
  • microsoft__phi-2__results: 存储所有运行的聚合结果，包含3个分割，分别对应不同的时间戳和最新结果。

数据集加载示例

python from datasets import load_dataset data = load_dataset( "KonradSzafer/lm-eval-results-private", name="microsoft__phi-2__arc_easy", split="latest" )

最新结果

• 结果来源: 来自2024-05-31T06-06-35.913097的运行。
• 结果详情:
  • gsm8k: 精确匹配（严格匹配）0.45，精确匹配（灵活提取）0.47。
  • arc_easy: 准确率（无）0.82，标准化准确率（无）0.83。