Project PMD Immigrants in Chile

Authors: Francisco Pulgar, Daniel Hernández<br><br>This data files are a basic analysis of the data published by the Departamento de Estranjería y Migración de Chile [1]. Also this data is combined with indicators published by the World Bank Develpment Indicators [2].<br><br>[1] http://www.extranjeria.gob.cl/estadisticas-migratorias/<br>[2] https://www.kaggle.com/worldbank/world-development-indicators<br><br>The files in this fileset include:<br><br><b>in.tar.bz2</b>: the input files to analyze<br><br><b>script.py</b>: an Spark Python3 script that analyses the data.<br><br><b>immigrantsByCountry.csv</b>: a CSV table with the number of immigrants and the country code.<br><br><b>indicatorsJoin.txt.gzip</b>: a file created for debugging.<br><br><b>comparisons.csv</b>: a CSV table with the maximum between the numbers in the last two columns, the code of an indicator X, the name of the indicator X, the number of immigrants coming from a country where X is greater than in Chile, and the number of immigrants where X is lesser than in Chile. The sum of the numbers in the last two columns is lesser than the total of immigrants (i.e., 1497519) when there are countries where X is not available. <br><br>To run the script first decompress the input data in a folder and create another folder to save the output data. You have to edit the script to change the locations of these folders.<br><br><b>plot*.png:</b> Plot of indicators normalized by immigrants.<br>

作者：弗朗西斯科·普尔加（Francisco Pulgar）、丹尼尔·埃尔南德斯（Daniel Hernández）<br><br>本数据集文件基于智利外国与移民部（Departamento de Estranjería y Migración de Chile）发布的原始数据开展基础统计分析[1]，同时融合了世界银行发展指标（World Bank Development Indicators）发布的各类统计指标[2]。<br><br>[1] http://www.extranjeria.gob.cl/estadisticas-migratorias/<br>[2] https://www.kaggle.com/worldbank/world-development-indicators<br><br>本数据集包含以下文件：<br><br><b>in.tar.bz2</b>: 待分析的原始输入文件<br><br><b>script.py</b>: 用于开展数据分析的Spark Python 3脚本<br><br><b>immigrantsByCountry.csv</b>: 收录移民人数与国家代码的CSV表格<br><br><b>indicatorsJoin.txt.gzip</b>: 用于调试的中间文件<br><br><b>comparisons.csv</b>: 该CSV表格包含以下字段：最后两列数值的最大值、指标X的代码、指标X的名称、指标X数值高于智利的来源国移民人数，以及指标X数值低于智利的来源国移民人数。当存在指标X数据不可用的国家时，最后两列数值的总和将小于移民总规模（即1497519）。<br><br>运行该脚本前，请先将输入数据解压至指定文件夹，并另行创建文件夹用于存储输出结果；需通过编辑脚本文件以修改上述两个文件夹的路径。<br><br><b>plot*.png:</b> 以移民人数为基准进行归一化处理后的指标可视化图表。