Exqrch/Rebuttal-balinese-pixelgpt-debug
收藏官方服务：
资源简介：
# Balinese PixelGPT Tokenizer Ablation Dataset Optimized with **Font Size 6** and **Dynamic Trimming**. ## Tokenizer Schema 1. `tok_grapheme`: Language-specific Grapheme BPE (izzako/javanese-llama-tokenizer) 2. `tok_llama2`: Standard Llama-2 BPE (ernie-research/DualGPT) 3. `tok_komodo`: SEA-Optimized BPE (yellow-ai-central/komodo-7b-v1) 4. `tok_mt5`: Google Multilingual Unigram (google/mt5-small)
提供机构：
Exqrch
