遇见数据集

International Labour Office Historical Studies and Reports English

收藏
Zenodo2019-12-18 更新2026-04-07 收录
数据链接:
官方服务:

资源简介:

This is a collection of English texts based on historical reports from the International Labour Office from the 20th century. The original documents can be found at https://www.ilo.org/public/libdoc/ilo/ILO-SR/ This collection may be used and distributed provided that the International Labour Office is always duly acknowledged as the original source and that the use is non-commercial. The collection was created with the tools curl, OCRmyPDF, Poppler and the following script on Debian GNU/Linux. <pre><code class="language-bash">curl https://www.ilo.org/public/libdoc/ilo/ILO-SR/ | grep -o 'ILO[^"]*engl[^"&gt;&lt;\/]*' | uniq | sed 's,ILO,https://www.ilo.org/public/libdoc/ilo/ILO-SR/ILO,g' &gt; list_of_files.txt xargs -n 1 curl -O &lt; list_of_files.txt rm list_of_files.txt find . -name '*.pdf' -exec ocrmypdf --language eng --deskew --clean '{}' '{}' \; &amp;&amp; find . -name '*.pdf' -exec pdftotext '{}' '{}.txt' \; rm *.pdf</code></pre>

提供机构:
ETH Zurich
创建时间:
2019-12-18
二维码
社区交流群
二维码
科研交流群
商业服务