Hindi_Movie_Script_Corpus_by_Pratik_Kalamkar

DescriptionThe Hindi_Movie_Script_Corpus_by_Pratik_Kalamkar is a curated collection of 100 Hindi movie scripts developed to support Natural Language Processing (NLP), Computational Linguistics, and Artificial Intelligence research.

Although Hindi movie scripts are available on the internet, they are scattered across numerous websites and repositories and often exist in highly inconsistent formats. During corpus construction, scripts were encountered in Devanagari text, Romanized Hindi, PDF documents, scanned images, HTML pages, and plain text files. No consolidated, machine-readable corpus suitable for large-scale NLP experimentation was publicly available.

To address this challenge, scripts were collected from multiple publicly accessible sources, including screenplay archives, script-hosting websites, movie forums, and online repositories. The collected documents underwent extensive preprocessing and standardization to create a unified corpus.

The preprocessing workflow included:

• Collection from multiple public sources• Manual transcription of scanned documents where necessary• Spell correction and normalization• Conversion of Romanized Hindi to Devanagari script• UTF-8 encoding standardization• Regular-expression-based cleaning and normalization• Formatting standardization across files• Manual quality assurance and verification

The final corpus contains:

• 100 Hindi movie scripts• 170,744 lines of text• 1,029,826 words• UTF-8 encoded Devanagari text

SignificanceThis dataset provides one of the earliest publicly documented consolidated collections of Hindi movie scripts specifically prepared for NLP research. It offers researchers a standardized corpus suitable for benchmarking and evaluation of language-processing tools.

Potential applications include:

• Part-of-Speech Tagging• Named Entity Recognition• Morphological Analysis• Sentiment Analysis• Text Classification• Language Modeling• Information Extraction• Machine Translation• Computational Linguistics Research

NoveltyThe novelty of this dataset lies not merely in the collection of movie scripts, but in the consolidation, normalization, and standardization of highly fragmented resources into a single machine-readable corpus. At the time of creation, no publicly available dataset provided a large-scale, UTF-8 standardized Hindi movie-script corpus suitable for NLP experimentation and benchmarking.

Citation

If you use this dataset in academic research, please cite:

Kalamkar, P. N., Peddi, P., & Sharma, Y. K. (2026).

A Comparative Analysis of PoS Tagging Tools for Hindi and Marathi.

International Journal of Informatics and Communication Technology (IJ-ICT), 15(1), 120–137.

DOI: https://doi.org/10.11591/ijict.v15i1.pp120-137

BibTeX:

@article{kalamkar2026postagging,author = {Kalamkar, Pratik N. and Peddi, Prasadu and Sharma, Yogesh K.},title = {A Comparative Analysis of PoS Tagging Tools for Hindi and Marathi},journal = {International Journal of Informatics and Communication Technology},volume = {15},number = {1},pages = {120--137},year = {2026},doi = {10.11591/ijict.v15i1.pp120-137}}