csv duplicate parser

This tool helps you analyze CSV files to find duplicate or unique entries using the Levenshtein algorithm. You can precisely control how similar rows need to be by setting a similarity threshold. This means you decide the exact level of resemblance for rows to be considered a match. It's perfect for cleaning data, ensuring quality, or identifying distinct records.

本工具借助莱文斯坦距离算法（Levenshtein algorithm）分析CSV文件，可识别其中的重复条目与唯一记录。用户可通过设置相似度阈值，精准调控各行需达到的相似程度，即自行定义判定为匹配项的行之间的相似度标准。该工具适用于数据清洗、数据质量管控或独特记录识别等场景。