jasongraf1/annotation_app_data

---
license: cc-by-nc-4.0
---

# Dataset Card for Systematic Review of Acceptability Judgments data

A curated dataset of research articles used in a systematic review of judgment tasks in linguistics. Each entry records article-level metadata and experiment-level methodological features, supporting structured comparison and analysis across studies.

## Dataset Description

This annotation dataset comprises systematically coded observations from a corpus of published studies employing judgment tasks in linguistics. Each observation corresponds to an individual experiment within an article and encodes a range of study characteristics, including task design, administration conditions, and reporting practices. The dataset enables quantitative synthesis of methodological variation and facilitates meta-analytic investigation of factors related to the reliability and replicability of experimental outcomes.

- **Curated by:** Jason Grafmiller
- **Funded by:** British Academy Small Grant
- **License:** cc-by-nc-4.0

### Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

[TBD]

### Source

Research articles published between 1993-2023 from the following journals: [More Information Needed]

### Data Collection and Processing

<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->

[TBD]

### Annotators

<!-- This section describes the people or systems who created the annotations. -->

- Jason Grafmiller (University of Birmingham)
- Dagmar Divjak (University of Birmingham)
- Laura Rosseel (Vrije Universiteit Brussel)
- Marah Jaraisi (University of Birmingham)
- Fei Xie (University of Birmingham)

### Personal and Sensitive Information

<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->

Dataset contains only personal information published in the articles themselves, including author names and contact information provided by the corresponding author of each article.

## Citation
<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

```
@dataset{grafmiller_2026_annotation_dataset,
author = {Grafmiller, Jason},
title = {Annotation Dataset for Judgment Task Studies in Linguistics},
year = {2026},
version = {1.0},
publisher = {Hugging Face},
url = {https://huggingface.co/datasets/jasongraf1/annotation_app_data},
note = {Dataset}
}
```

**Universal Stylesheet for Linguistics:**

Grafmiller, Jason. 2026. *Annotation dataset for judgment task studies in linguistics* (Version 1.0) [Dataset]. Hugging Face. <https://huggingface.co/datasets/jasongraf1/annotation_app_data>

**APA:**

Grafmiller, J. (2026). *Annotation dataset for judgment task studies in linguistics* (Version 1.0) [Dataset]. Hugging Face. <https://huggingface.co/datasets/jasongraf1/annotation_app_data>

## Dataset Card Contact

Dr Jason Grafmiller [[e-mail]](mail_to:[e-mail])