birdsql/bird-interact-lite

BIRD-INTERACT是一个交互式的text-to-SQL基准，它通过动态交互的方式重新设想了Text-to-SQL评估。该环境结合了分层知识库、数据库文档和一个函数驱动的用户模拟器，以重现完整的CRUD操作的真实企业环境。它提供了两种严格的测试模式：被动的对话交互和主动的代理交互。数据集分为精简版和完整版，精简版包含270个针对PostgreSQL的高质量现实世界任务，而完整版包含600个针对PostgreSQL的任务。

BIRD-INTERACT is an interactive text-to-SQL benchmark that re-imagines Text-to-SQL evaluation through dynamic interactions. The environment combines a hierarchical knowledge base, database documentation, and a function-driven user simulator to recreate authentic enterprise environments across full CRUD operations. It provides two rigorous test modes: passive Conversational Interaction and active Agentic Interaction. The dataset comes in two versions, a lite version with 270 high-quality real-world tasks for PostgreSQL, and a full version with 600 tasks for PostgreSQL.