Intermediate data files from the compilation of Economy-wide Material Flow Accounts for the Domestic Extraction of abiotic materials

These files represent a selection of intermediary files from the compilation of material flow accounts on Domestic Extraction (DE) of abiotic materials. The main output of this compilation has been integrated in the UNEP IRP Global Material Flow Database (GMFD).

These files include input files (e.g. IDs for data harmonization, or factors for data conversion), as well as output files (e.g. supplementary information, or detailed data accounts before aggregation and integration into the GMFD).

Please note: These files are published exclusively for the purpose of making this information available to interested parties in a transparent and orderly fashion, in particular to other research projects who may have use for it. Therefore, these files are not associated with any publication and have not been adjusted or formatted with regard to any publications standards, i.e. they are uploaded exactly as they have been processed in the respective R Github repository of the underlying data compilation.

The following description attempts to give a short overview of the respective types of files and their contents. For more detailed information on the data compilation, please refer to chapters 6, 8, and 10 in the technical report of the GMFD.

Main data output (i.e. detailed material flow accounts)

DE_met_min_fos_CCC_2021-11-04.csv: Data aggregated to the official categories (CCC/TCCC) used for integration into the GMFD. With IDs, without names (e.g. for materials and countries).

DE_met_min_fos_CCC_with_names_2021-11-04.csv: Same as above, but with names.

DE_met_min_fos_Detailed_2021-11-04.csv: Detailed accounts, as compiled, before final aggregation. With IDs, without names.

DE_met_min_fos_Detailed_with_names_2021-11-04.csv: Same as above, but with names.

DE_met_min_fos_Detailed_2022-05-24.csv: Slightly revised version from May 2022. But not included in current GMFD version.

ID and concordance tables

ccc_vs_mat_ids.csv: Concordance table for allocation of detailed material accounts to aggregated CCC accounts.

country_ids.csv: General ID table for country IDs and names

estimated_ids.csv: Material IDs which are assigned during application of ore estimation factors.

geo_exist.csv: Table for consistent geographic adjustment of data for specific countries which have disintegrated over time (not including regions like Germany, Yemen, Ethiopia, Sudan, which all have been dealt with individually if necessary).

material_ids.csv: General ID table for material IDs and names.

source_country_ids.csv: Concordance table for country IDs (i.e. for allocation of harmonized IDs to source namings/IDs)

source_material_ids.csv: Concordance table for material IDs (i.e. for allocation of harmonized IDs to source namings/IDs)

source_unit_ids.csv: Concordance table for unit IDs (i.e. for allocation of harmonized IDs to source namings/IDs)

unit_ids.csv: General ID table for unit IDs and names.

Conversion factors

conversion_elements.csv: Factors applied for conversion from metal compounds to elemental metals.

conversion_factors_units.csv: Factors applied for unit conversions.

Ore estimation factors

These factors represent content-to-ore ratios (i.e. "tonnes of extracted ore/mineral per ton of produced content”).

all_integrated_est_fac_2021-11-04.csv: Factors for estimation of metal and mineral ores (all which have been compiled/integrated)

applied_est_fac_2021-11-04.csv: Factors for estimation of metal and mineral ores (which have actually been applied)

average_metal_prices_1990-2020.csv: Metal prices applied in the compilation of estimation ratios.

raw_metal_to_ore_ratios_fineprint.csv: Raw metal-to-ore ratios derived from FINEPRINT mining data.

raw_metal_to_ore_ratios_snl.csv: Raw metal-to-ore ratios derived from SNL mining data.

Intermediate files from data processing

all_interm_conv_integr_2021-12-13.csv: Harmonized, converted (units & elemental metals), integrated (i.e. without double counting). Before any estimations (ores & construction minerals) and before final cleaning/formatting.

wmd_bgs_usgs_interm_harmonized_2021-12-13.csv: All harmonized raw data from WMD/BGS/USGS, before any further processing (i.e. with double counting).

Comparison data (for mining accounts from FINEPRINT project)

data_for_comparison_2022-05-24.csv: Data set specifically compiled for comparison with accounts on production of mines from the FINEPRINT project. Has been applied for verification of data published in "Jasansky et al. (2022) An open database on global coal and metal mining".

Includes all available types of materials which have been reported (e.g. ores and metals and metal compounds)

meaning: also materials which are associated with each other, for example iron ore and iron (and would therefore have been selectively integrated/excluded in the GMFD compilation).

Excludes any double counting for the exact same material from different data sources

Harmonized IDs, converted units

Includes metal compounds approximated/converted from reported elemental metals (where possible)

materialflows.net

data_sunburst_material_profiles_20220607.csv: Full detail of data underlying the Sunburst visualization "Global Domestic Extraction in 2019, by material group" in section "Raw Material Profiles" on materialsflow.net. However, for all available years. Includes data on Domestic Extraction of biomass. Includes detail for CCC, MFA13+, MFA4+

Outliers

overview_adjusted_outliers_2021-12-22.csv: Overview of outliers which were adjusted during final formatting.

Other

approximation_tailings_detailed_2021-09-26.csv: Estimation of tailings based on reported amounts of ores/minerals and their respective contents.