ali-vilab/IDEA-Bench

IDEA-Bench是一个用于评估生成模型在专业设计任务中性能的综合基准。它包括100个精心挑选的任务，涵盖文本到图像、图像到图像、多图像到图像、文本到多图像和图像到多图像五大类别。这些任务包括故事板、视觉效果、照片修饰等广泛的应用。IDEA-Bench提供了一个强大的框架，通过275个测试案例和1650个详细的评估标准来评估模型的性能，旨在弥合当前生成模型能力和专业级要求之间的差距。

IDEA-Bench is a comprehensive benchmark designed to evaluate the performance of generative models in professional design tasks. It includes 100 carefully selected tasks across five categories: text-to-image, image-to-image, images-to-image, text-to-images, and image(s)-to-images. These tasks encompass a wide range of applications, including storyboarding, visual effects, photo retouching, and more. IDEA-Bench provides a robust framework for assessing models capabilities through 275 test cases and 1,650 detailed evaluation criteria, aiming to bridge the gap between current generative model capabilities and professional-grade requirements.