zvzv1919/gpt4o_swe-lite-augmentedhealed-test2

--- license: mit --- # gpt4o_swe-lite-augmentedhealed-test2 ## Summary | Metric | Value | | --- | --- | | Total instances | 56 | | File matches | 43 (76%) | | Function matches | 21 (37%) | | File mismatches | 13 | | No result | 0 | | Avg turns | 8.3 | ## Config ```yaml agent_func: locate agent_module: agents.locator.plain bench_name: gpt4o_swe-lite-augmentedhealed-test2 collection: zvzv1919/swe-lite-sympy-11400-69d146b3787b38cf81b3a888 commit_message: swe-lite healed, re-test dataset: zvzv1919/swe-lite-augmented limit: null max_turns: 20 max_workers: 20 model: gpt-4o offset: 0 repo_path: sympy__sympy-11400/sympy repo_path_prefix: /Users/xuan.zhao/Documents/GitHub-zv/ shuffle: false split: train top_k: 1 ```