Skip to content

Support Ukraine and Moldova in the country list and in the dataset.#321

Merged
fneum merged 74 commits intomasterfrom
ukraine_hackathon
Dec 11, 2023
Merged

Support Ukraine and Moldova in the country list and in the dataset.#321
fneum merged 74 commits intomasterfrom
ukraine_hackathon

Conversation

@euronion
Copy link
Copy Markdown
Contributor

@euronion euronion commented Mar 4, 2022

TODO list

New country keys to be supported:

TODOs

  • Crimea: Is automatically included or not when using "UA" key (country_shapes.json)? (Crimea not included
  • Keep Crimea as part of "UA" key or not?
  • Updated power plants list incl. Moldova @FabianHofmann
  • OPSD (load demand) @martacki
  • ENTSO-E grid extract
  • 750 kV transmission electrical params @fneum @p-glaum
  • 750 kV lines types -> point release PyPSA to use with pypsa-eur @fneum -> 0.19.2 (conda may take 24h)
  • 750 kV transmission include in simplify_network & enable in pypsa-eur config line type & enforce min. version in environment.yaml for pypsa point release @p-glaum (alt.: 380kV assumptions)
  • GDP/POP data for assigning load data to bus regions. @euronion @martacki (decided to use GDP data only, i.e. no population)
  • No pop data considered for add_electricity for MD, UA (simlification)
  • Cutout containing Ukraine: ERA5 @euronion @fneum
  • Cutout containing Ukraine: SARAH @euronion
  • Hydro profiles for Ukraine (Moldova has only ~100 MW hydro if seen correctly, so less relevant) @euronion [Needs update to databundle, see below]
  • Renewable potentials?

Additions to databundle

Release

  • Release notes

Checklist

  • I tested my contribution locally and it seems to work fine.
  • Code and workflow changes are sufficiently documented.
  • Newly introduced dependencies are added to envs/environment.yaml and envs/environment.docs.yaml.
  • Changes in configuration options are added in all of config.default.yaml, config.tutorial.yaml, and test/config.test1.yaml.
  • Changes in configuration options are also documented in doc/configtables/*.csv and line references are adjusted in doc/configuration.rst and doc/tutorial.rst.
  • A note for the release notes doc/release_notes.rst is amended in the format of previous release notes.

@FabianHofmann FabianHofmann changed the title Support Ukraine and Moldoa in the country list and in the dataset. Support Ukraine and Moldova in the country list and in the dataset. Mar 4, 2022
@fneum
Copy link
Copy Markdown
Member

fneum commented Mar 4, 2022

config: set custom_poweplants to True
@p-glaum
Copy link
Copy Markdown
Contributor

p-glaum commented Mar 4, 2022

PR for new 750kV standard line type in PyPSA created at PyPSA/PyPSA#369

@euronion
Copy link
Copy Markdown
Contributor Author

euronion commented Mar 5, 2022

build_hydro requires input from the EIA. The last time we retrieved the data from there was 2017, they changed their data access and csv format since then quite abit. For prototyping, instead of adjusting all scripts and rule, I've added the values for Ukraine and Moldova to the EIA data file. See attached.

EIA_hydro_generation_2000_2014.csv

  • Needs to be added to the databundle.

edit:

With the updated EIA data build_hydro runs without issues for MD. I have no reason to believe it would not work for UA, I can' test it atm as I don't have access to the new cutouts right now.

Two things we should track (seperate issues):

Quality
Plotting inflow from build_hydro reveals unrealistic peaks for MD. A similar peak is also present for DE, other countries were not investigated. The peaks in both cases exceed what is possible with existing hydro capacities (DE: factor 2 ca. 4.5 GW installed, MD: factor 5-10, ca. 50 MW installed)

image

Since these are only temporary peaks they probably don't affect the results too much, also because they are relatively low.

Workflow
The EIA data format from our datasource changed. Suggestions

  • Automatic download of EIA data OR update the EIA .csv file with hydro generation to new dataformat
  • substitute the vresutils dependency in build_hydro by writing the pd.read_csv statement directl.y

@martacki
Copy link
Copy Markdown
Member

martacki commented Mar 5, 2022

if you want to run the last commits yourself (add_electricity), you need to generate or download the input data GDP_PPP_30arcsec_v3_mapped.csv once and move the file into pypsa-eur/data/bundle.
edit: in case you download the data and don't re-generate it, you should rename GDP_PPP_30arcsec_v3_mapped_default.csv to GDP_PPP_30arcsec_v3_mapped.csv

Available here:
https://github.com/martacki/pypsa-ua_gdp_data

Caution: Quick&Dirty solution; in case you execute the script - it runs very slow!! (~2h on my local machine)

@euronion
Copy link
Copy Markdown
Contributor Author

euronion commented Mar 7, 2022

if you want to run the last commits yourself (add_electricity), you need to generate or download the input data GDP_PPP_30arcsec_v3_mapped.csv once and move the file into pypsa-eur/data/bundle. edit: in case you download the data and don't re-generate it, you should rename GDP_PPP_30arcsec_v3_mapped_default.csv to GDP_PPP_30arcsec_v3_mapped.csv

Available here: https://github.com/martacki/pypsa-ua_gdp_data

Caution: Quick&Dirty solution; in case you execute the script - it runs very slow!! (~2h on my local machine)

How does the quality of distributing load based on this look? We two already talked about it, but we could use the same datasets and roll-out the same approach for everywhere and instead drop the NUTS3 approach currently used.

@fneum
Copy link
Copy Markdown
Member

fneum commented Mar 7, 2022

PyPSA 0.19.2 is out on PyPI with 750kV line type, conda may take 24h.

@fneum
Copy link
Copy Markdown
Member

fneum commented Mar 13, 2022

fneum and others added 27 commits August 1, 2023 08:50
@fneum fneum merged commit 4ad2254 into master Dec 11, 2023
@fneum fneum deleted the ukraine_hackathon branch December 11, 2023 17:26
@pz-max
Copy link
Copy Markdown
Collaborator

pz-max commented Dec 11, 2023

Just for reference. This PR is merged because of ENTSO-E news:

"Continental European TSOs announce completion of synchronisation project with Ukrenergo and significant increase in export capacity from Continental Europe to Ukraine. https://www.entsoe.eu/news/2023/11/28/continental-european-tsos-announce-completion-of-synchronisation-project-with-ukrenergo-and-significant-increase-in-export-capacity-from-continental-europe-to-ukraine/" 🇪🇺

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants