Unannoted Swahili data

The Unannoted Swahili dataset contains 28,000 unique words with 6.84M, 970k, and 2M words for the train, development and test partitions respectively which represent the ratio 80:10:10. The dataset is meant for language modeling. The entire dataset is lowercased, has no punctuation marks and, the start and end of sentence markers have been incorporated to facilitate easy tokenization during language modeling. The train partition is the largest in order to support unsupervised learning of word representations while the hyper-parameters are adjusted based on the performance on the development partition before evaluating the language model on the test partition.