mesolitica/smollm-corpus-filter-malaysian-context
收藏Hugging Face2024-08-11 更新2025-04-12 收录
下载链接：
https://hf-mirror.com/datasets/mesolitica/smollm-corpus-filter-malaysian-context
下载链接
链接失效反馈官方服务：
资源简介：
---
language:
- en
---
# HuggingFaceTB/smollm-corpus filter Malaysian context
Originally from https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus, source code at https://github.com/mesolitica/malaysian-dataset/tree/master/corpus/smollm-corpus
1. we filter rows using `{'malay', 'malaysia', 'melayu', 'bursa', 'ringgit'}` keywords
2. using r5.16xlarge EC2 instance to filters
提供机构：
mesolitica
