@toniseibold great! Just a few remarks:

1. in the long-term we would like to move away from the Zenodo sector-bundle repository. Can you add to the retrieve_sector_databundle.py some lines which download the necessary files from Eurostat directly?
2. The new data set is still also containing the previous years and the UK, so there is no need to keep the old ones, right? This simplifies the script, you can use as an input only the new one an remove the if-else statement depending on which Eurostat input you use.
3. Can you do some comparison of the output files between previous Eurostat and the new?

1. in the long-term we would like to move away from the Zenodo sector-bundle repository. Can you add to the retrieve_sector_databundle.py some lines which download the necessary files from Eurostat directly?

I think, a separate rule retrieve_eurostat would be better to have a clear distinction

@toniseibold
Have you done some comparison of the output files between previous Eurostat and the new? Can you plot it here or confirm that the outputs are similar? The CI is failing for the script build_energy_totals.py can you make sure that it is running through? It seems to be connected with the swiss data and the year 2019

Checked output of energy_totals.csv before and after and value changes are in an acceptable range.