RyeCatcher/dspy-optimizer-shootout-results
收藏Hugging Face2025-12-14 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/RyeCatcher/dspy-optimizer-shootout-results
下载链接
链接失效反馈官方服务：
资源简介：
DSPy优化器对比实验结果数据集，包含在GSM8K数学推理任务上对DSPy优化器进行系统比较的实验结果。研究问题为自动提示优化是否能使4B模型与32B模型竞争。关键发现显示DSPy优化使Qwen3-4B模型性能相对提高了28%，但未能完全缩小与Qwen3-32B模型的差距。数据集包含两个阶段的优化器比较和模型对比结果。
DSPy Optimizer Shootout - Results dataset contains experimental results from a systematic comparison of DSPy optimizers on GSM8K math reasoning. The research question explores whether automatic prompt optimization can make a 4B model competitive with a 32B model. Key findings show DSPy optimization improved Qwen3-4B by 28% relative, but couldnt close the gap to Qwen3-32B. The dataset includes two phases of optimizer comparison and model performance results.
提供机构：
RyeCatcher
