IgakuQA119: LLM Evaluation on the 119th Japanese Medical Licensing Examination

IgakuQA119 is a reproducible framework for evaluating Large Language Models on the 119th Japanese Medical Licensing Examination (JMLE). It supports major cloud APIs (OpenAI, Anthropic, Gemini, OpenRouter) and local models via Ollama through a unified YAML-driven workflow, with automated grading and a leaderboard maintained in the repository README. The question set was processed from official JMLE PDFs by the author of nmle-rta (Daichi Nagashima) and is used here with permission. Grading logic follows official information from Japan's Ministry of Health, Labour and Welfare. Licenses Source code: Apache License 2.0. Dataset (`questions/`, `images/`): CC BY 4.0. For setup, usage, and per-version changes, see the GitHub repository.