AI Design Benchmark: language models as designers and image models on design work with text
收藏资源简介:
Open data from FontVibe's benchmarks of AI models doing design work with text (logos, posters, signs, invitations, thumbnails, packaging). 2026-10-llm-designer: eight language models from OpenAI, Anthropic and Google act as the designer in a fixed design pipeline (read the brief, propose three directions, write the image instructions); the image model is fixed (GPT Image 2.5 Sunburst, 2K, medium). 12 briefs in four layers (everyday requests, getting the information right, design judgement, language and culture) across six languages, three runs each (288 runs; 269 ranked designs plus 18 side-note reruns), scored blind against a published four-part standard, with cost, latency and failure causes. 2026-10-qwen-image-3 and 2026-10-grok-imagine-2 compare image models on ten design jobs with text. Every brief, output, image link, score and written reason is included; scripts/analyze.py recomputes the published tables of the llm-designer benchmark and scripts/verify.py checks the data. Write-ups: fontvibe.ai/blog/gpt-6-1-terra-vs-claude-gemini-design-test.



