zarnite/zarn-creative-brief-to-asset-plan

---
language:
- en
license: apache-2.0
annotations_creators:
- expert-generated
- machine-generated
language_creators:
- expert-generated
- machine-generated
source_datasets:
- original
task_categories:
- text-generation
tags:
- zarnite
- benchmark
- creative-briefs
- project-planning
- creative-tools
- gold-track
- benchmark-starter
pretty_name: Zarn Creative Brief to Asset Plan
size_categories:
- 10K<n<100K
configs:
- config_name: default
data_files:
- split: train
path: data/train.jsonl
- split: validation
path: data/validation.jsonl
- split: test
path: data/test.jsonl
---

# Zarn Creative Brief to Asset Plan

## Dataset Description

Creative briefs mapped to delivery plans, asset priorities, review checkpoints, and dependencies.

## Team Attribution

This dataset was created and reviewed by the Zarnite team through internal benchmark design, generation, and quality-control workflows. It should be presented as a Zarnite-authored benchmark starter pack, not as a purely human-collected field corpus.

## Ecosystem Need Tier

High Ecosystem Need

## Why This Category Is Attractive

Turning messy business goals into an actionable creative system is a high-value creative-ops use case, but few public datasets capture asset hierarchy, review flow, and handoff logic together.

## Benchmark Goal

Evaluate whether a model can transform a creative brief into a production-ready asset plan with strong message hierarchy, approval flow, and downstream handoff clarity.

## Included In This Folder

- `data/train.jsonl`, `data/validation.jsonl`, `data/test.jsonl`: starter benchmark splits with 1200 total rows.
- `schema.json`: JSON Schema for row validation.
- `benchmark_spec.json`: metrics, quality gates, and target release scale.
- `LICENSE.md`: folder-local license notice for self-contained publishing.
- `PUBLISHING.md`: repo-specific publish instructions for Hugging Face.
- `hf_repo_template.json`: machine-readable repo template used by the uploader script.

## Target Public Scale

- Train: 16,000
- Validation: 2,000
- Test: 2,000
- Total target rows: 20,000

## Recommended Metrics

- `coverage_and_constraint_score`
- `deliverable_fit`
- `message_hierarchy_quality`
- `dependency_clarity`
- `handoff_readiness`

## Gold-Track Benchmark Assets

- `ANNOTATION_GUIDELINES.md`: how to expand rows without drifting from the benchmark purpose.
- `REVIEW_PROTOCOL.md`: how to audit validation and test rows with dual review and adjudication.
- `BASELINE_EVAL_SPEC.json`: expected output contract, slice reporting, and release thresholds.
- `RELEASE_CHECKLIST.md`: final pre-publish checks for the public Hugging Face release.
- `SCORING_PROFILE.json`: prediction keys, scoring expectations, and slice reporting requirements.
- `prediction_template.jsonl`: starter template for benchmark submissions or baseline runs.

## Expanded Row Anatomy

- `project_frame`: why the work matters now, what commercial goal it serves, and what tension the plan must resolve.
- `message_hierarchy`: the ordered narrative the asset family should preserve.
- `channel_strategy` and `approval_matrix`: how the plan changes by surface and who has to approve what.
- `reference_brief_package`: the gold high-level asset system, not just a loose brainstorm.
- `difficulty_rationale`: why the row belongs in its difficulty bucket instead of a weaker slice.
- `benchmark_slices`: named reporting slices such as approval friction, proof preservation, or citation traps.
- `adversarial_features`, `expected_failure_modes`, and `review_readiness`: what the row is testing and how a gold-track reviewer should treat it.
- `evidence_manifest`, `reference_variants`, and `negative_examples`: the source evidence boundary, acceptable alternate answers, and concrete failure cases.

## Hugging Face Deployment

This folder is self-contained and can be uploaded as its own Hugging Face dataset repository.

- Suggested repo id: `zarnite/zarn-creative-brief-to-asset-plan`
- Example upload command: `python upload_to_huggingface.py --dataset-folder "push/high-ecosystem-need/Zarn-Creative-Brief-to-Asset-Plan" --repo-id "zarnite/zarn-creative-brief-to-asset-plan"`
- You can swap the namespace by passing `--namespace YOUR_USERNAME` to the uploader.

## Local Evaluation

- Example eval command: `python run_priority_eval.py --dataset-folder "push/high-ecosystem-need/Zarn-Creative-Brief-to-Asset-Plan" --splits validation test`
- `prediction_template.jsonl` gives the required output shape for local or leaderboard-style submissions.

## License

This package is marked `apache-2.0`. The rows in this folder are original starter examples for benchmark packaging.