vihaannnn/Indian-Supreme-Court-Judgements-Chunked

该数据集旨在通过处理印度最高法院的判决PDF文件，生成适合法律语言模型（LLMs）使用的结构化文本数据，以解决印度司法系统中的案件积压问题。数据集包含100-150个判决文件，经过多种分块和嵌入策略处理，并提供了多种格式的文本数据，包括原始PDF、普通文本、递归分块、语义分块和基于令牌的分块。数据集还提供了详细的元数据，并使用了Python、Langchain、OpenAI API等工具进行处理。

The dataset aims to address the chronic backlog in the Indian judiciary system, particularly in the Supreme Court, by creating a dataset optimized for legal language models (LLMs). The dataset consists of pre-processed, chunked, and embedded textual data derived from the Supreme Courts judgment PDFs. It includes 100-150 judgments processed using various chunking and embedding strategies, providing data in multiple formats such as original PDFs, plain text, recursive chunks, semantic chunks, and token-wise chunks. The dataset also includes detailed metadata and utilizes tools like Python, Langchain, and OpenAI API for processing.