five

STEM_QA_English

收藏
Zenodo2025-12-27 更新2026-05-26 收录
下载链接:
https://zenodo.org/doi/10.5281/zenodo.18067169
下载链接
链接失效反馈
官方服务:
资源简介:
The full corpus is curated across multiple STEM disciplines and structured for use in LLM training, evaluation, and instruction tuning (SFT/RLHF). This sample represents the structure and quality of the larger dataset. Dataset composition (full corpus): Text corpus: 1.6B+ words of curated STEM and Non-STEM educational content across 22000+ texbooks in 7 languages(English, Hindi, Arabic, Bahasa, Tamil, Telegu, Kannada) Question–Answer pairs: 6.5M+ high-quality Q&A pairs of STEM and Non-STEM in (English, Arabic, Hindi and Indic languages) Video data:100K+ hours of STEM Videos and 30K+ hours of UGC. Audio data: 821K+ hours of Podcasts and Call Center data(Dual Channel) Medical datasets: 30M+ files including clinical and diagnostic data like CT Scan, MRI, X-ray, Pathology, EHRs, USG Reports and Echo Reports. This repository includes:  A small preview subset of the STEM English Q&A data  Flat, viewer-friendly schema for inspection  Parquet files suitable for benchmarking and evaluation Purpose of this dataset: Dataset preview and validation Model evaluation and experimentation Schema and format inspection before full-scale access > ⚠️ *Note:* This repository contains sample data only. Access to the complete dataset is available separately under appropriate licensing or partnership terms. For more information please email us at vipulmishra@infobay.ai .
提供机构:
InfoBay AI
创建时间:
2025-12-27
二维码
社区交流群
二维码
科研交流群
商业服务