mikapfl/read_di_unfccc: Dataset containing all data available from the UNFCCC API available at https://di.unfccc.int, and scripts to generate it

Dataset containing all data available from the UNFCCC API available at https://di.unfccc.int, and scripts to generate it

38 Commits

3 Branches

0 Releases

Mika Pflüger 1592253c70 update README with zotero		3 years ago
.datalad	3c700b1f9e [DATALAD] new dataset	3 years ago
data	5b5b2301a2 [DATALAD RUNCMD] python3 download_all.py	3 years ago
.gitattributes	d5c0163d3a Instruct annex to add text files to Git	3 years ago
.gitignore	9104453ae1 add data	3 years ago
.pre-commit-config.yaml	c09bc6578d fix parsing performance	3 years ago
LICENSE	10c8252218 add licensing information	3 years ago
README.md	1592253c70 update README with zotero	3 years ago
datacite.yml	7bed682055 make references palatable for gin	3 years ago
download_all.py	21339ab943 correctly sort data into subdirectories	3 years ago
example.ipynb	27920b30c8 drop old index after sorting	3 years ago
read_di_unfccc.py	c42836a016 explicitly drop duplicates	3 years ago
requirements.txt	e09c74f85b added requirements.txt file based on script requirements	3 years ago
sanity_checks.py	b509ef8f0f add sanity checks	3 years ago

Dataset containing all data available from the UNFCCC API at https://di.unfccc.int as of 2020-10-25. Additionally, includes a small library to query the UNFCCC API for a subset of the data, and a script to refresh the data in case newer data is available.

Due to the large size of the full dataset, the dataset is shared using datalad, which is based on git. To download the data, see the dataset page on gin to download individual files from the data/ directory, or clone the whole dataset using datalad:

$ datalad clone https://github.com/mikapfl/read_di_unfccc.git

Then you can fetch the data using datalad:

$ cd read_di_unfccc
$ datalad get -r .

You can learn more about datalad in the datalad handbook.

References: All the data included in this dataset is available from the UNFCC API, which sources the data from:

GHG inventory data: UNFCCC: Greenhouse Gas Inventory Data, available at https://unfccc.int/process/transparency-and-reporting/greenhouse-gas-data/what-is-greenhouse-gas-data
Population data: UNSD Demographic Statistics, available at http://data.un.org
GDP data: The World Bank GDP data, available at https://data.worldbank.org/ and shared by The World Bank under the CC-BY 4.0 License and pusuant to their terms of use.

If you want to use the library to download data from the UNFCCC API, check out the example.ipynb notebook for a simple usage example. To re-download all of the data, use the download_all.py script.

License: the python scripts are provided under the Apache License, Version 2.0.

datacite.yml
Title	UNFCCC country-submitted greenhouse gas emissions data until 2020-10-25
Authors	Pflüger,Mika;Potsdam Institute for Climate Impact Research (PIK);ORCID:0000-0002-7814-8916 Gütschow,Johannes;Potsdam Institute for Climate Impact Research (PIK);ORCID:0000-0001-9944-3685
Description	Dataset containing all greenhouse gas emissions data submitted by countries under climate change convention (CRF data) as published by the UNFCCC secretariat at 2020-10-25.
License	Apache License, Version 2.0 (https://www.apache.org/licenses/LICENSE-2.0)
References
Funding
Keywords	emissions data UNFCCC country-reported format greenhouse gas emission register
Resource Type	Dataset

README.md