mesolitica/smollm-corpus-filter-malaysian-context

--- language: - en --- # HuggingFaceTB/smollm-corpus filter Malaysian context Originally from https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus, source code at https://github.com/mesolitica/malaysian-dataset/tree/master/corpus/smollm-corpus 1. we filter rows using `{'malay', 'malaysia', 'melayu', 'bursa', 'ringgit'}` keywords 2. using r5.16xlarge EC2 instance to filters