add function to scale carrier capacity #285

JulianGeis · 2024-11-21T16:26:44Z

Before asking for a review for this PR make sure to complete the following checklist:

Workflow with target rule ariadne_all completes without errors
The logic of export_ariadne_variables has been adapted to the changes
One or several figures that validate the changes in the PR have been posted as a comment
A brief description of the changes has been added to Changelog.md
The latest main has been merged into the PR
The config has a new prefix of the format YYYYMMDDdescriptive_title

JulianGeis · 2024-11-21T16:29:45Z

now:
Capacity|Electricity|Gas | GW | 31.87381 | 28.83834 | 28.51586 | 26.41178 | 21.85024 | 17.86715

before:
Capacity|Electricity|Gas | GW | 24.6994 | 18.20426 | 16.01393 | 12.35314 | 8.56884 | 4.1887

explanation
Our capacity in 2020 was with 24 GW lower than the real one in 2020 (32 GW). To be fair we would have to compare it to the 2019 capacity (30 GW) as we only include components until then. This PR is a quick fix to scale up the CCGT capacity to 10 GW and the CHP capacity to 22 GW.

for more information, see https://pre-commit.ci

github-actions · 2024-11-22T08:39:49Z

Validator Report

I am the Validator. Download all artifacts here.
I'll be back and edit this comment for each new commit.

⚠️ Config changes detected!

Results may differ due to these changes:

diff --git a/config/config.yaml b/config/config.yaml
index 52f5752..713449c 100644
--- a/config/config.yaml
+++ b/config/config.yaml
@@ -4,7 +4,7 @@
 
 # docs in https://pypsa-eur.readthedocs.io/en/latest/configuration.html#run
 run:
-  prefix: 20241120-correct-wind
+  prefix: 20241121-fix-missing-gas-capa
 
   name:
   # - CurrentPolicies
@@ -655,10 +655,11 @@ co2_price_add_on_fossils:
   2020: 25
   2025: 60
 
-must_run_biogas:
-  enable: false
-  p_min_pu: 0.6
-  regions: ['DE']
+must_run:
+  2020:
+    DE:
+      lignite: 0.4
+      # biogas: 0.6
 
 transmission_projects:
   new_link_capacity: keep #keep or zero
@@ -672,3 +673,9 @@ onshore_nep_force:
 offshore_nep_force:
   cutin_year: 2025
   cutout_year: 2030
+
+scale_capacity:
+  2020:
+    DE:
+      CCGT: 10000
+      "urban central gas CHP": 22000

Ariadne Variables

Comparison

	NRMSE	Pearson
Capacity\|Hydrogen\|Gas	0.797	0.644
Capacity\|Hydrogen\|Gas\|w/o CCS	0.797	0.644
Investment\|Energy Supply\|Electricity\|Gas\|w/o CCS	0.577	0.000
Investment\|Energy Supply\|Electricity\|Gas	0.577	0.000
Capacity\|Electricity\|Gas\|CC	0.559	1.000
Capacity\|Heat\|Non-Renewable Waste	0.550	0.678
Capacity\|Electricity\|Non-Renewable Waste	0.545	0.673
Investment\|Energy Supply\|Heat\|Gas	0.531	-0.342
Investment\|Energy Supply\|Electricity\|Non-Renewable Waste	0.526	-0.374
Investment\|Energy Supply\|Heat\|Non-Renewable Waste	0.526	-0.374
Trade\|Secondary Energy\|Electricity\|Volume	0.514	0.167
Capacity\|Gases	0.505	0.425
Capacity\|Gases\|Biomass	0.505	0.425
Secondary Energy\|Heat\|Oil	0.501	0.247
Capacity Additions\|Heat\|Gas	0.467	-0.292
Secondary Energy\|Electricity\|Hydro	0.458	0.212
Investment\|Energy Supply\|Heat\|Biomass	0.444	1.000
Investment\|Energy Supply\|Electricity\|Biomass\|Solids	0.444	1.000
Investment\|Energy Supply\|Electricity\|Biomass\|w/o CCS	0.444	1.000
Investment\|Energy Supply\|Heat\|Biomass\|w/o CCS	0.444	1.000
Investment\|Energy Supply\|Electricity\|Biomass	0.444	1.000
Capacity Additions\|Methanol	0.444	0.083
Investment\|Energy Supply\|Methanol	0.444	0.449
Price\|Carbon\|National Climate Target	0.442	0.599
Investment\|Energy Supply\|Gases\|Biomass	0.441	0.412
Investment\|Energy Supply\|Gases	0.441	0.412
Price\|Secondary Energy\|Gases\|Biomass	0.424	0.600
Secondary Energy\|Electricity\|Oil	0.422	0.404
Secondary Energy\|Gases\|Biomass	0.420	0.156
Primary Energy\|Biomass\|Gases	0.420	0.156
Trade\|Secondary Energy\|Liquids\|Biomass\|Gross Import\|Volume	0.414	0.657
Trade\|Secondary Energy\|Methanol\|Gross Import\|Volume	0.411	0.401
Primary Energy\|Oil\|Electricity	0.409	0.483
Price\|Final Energy\|Residential and Commercial\|Liquids	0.409	0.000
Price\|Final Energy\|Residential and Commercial\|Liquids\|Oil	0.409	0.000
Final Energy\|Carbon Dioxide Removal\|Electricity	0.408	-0.415
Capacity Additions\|Electricity\|Gas	0.408	-0.200
Capacity Additions\|Electricity\|Gas\|w/o CCS	0.408	-0.200
Carbon Sequestration\|DACCS	0.408	-0.200
Final Energy\|Carbon Dioxide Removal	0.408	-0.222
Final Energy\|Carbon Dioxide Removal\|Heat	0.408	0.000
Capacity\|Electricity\|Gas\|w/o CCS	0.405	0.986
Capacity\|Electricity\|Gas	0.405	0.986
Investment\|Energy Supply\|Liquids	0.403	0.432
Capacity Additions\|Gases\|Biomass	0.398	0.003
Capacity Additions\|Gases	0.398	0.003
Capacity\|Electricity\|Storage Converter	0.395	0.549
Secondary Energy\|Electricity\|Waste	0.388	0.195
Primary Energy\|Waste\|Electricity	0.387	0.197
Final Energy\|Waste	0.387	0.204
Primary Energy\|Waste	0.387	0.204
Secondary Energy\|Heat\|Waste	0.387	0.204
Primary Energy\|Waste\|Heat	0.387	0.206
Final Energy\|Bunkers\|Navigation\|Liquids\|Biomass	0.386	0.638
Final Energy\|Industry excl Non-Energy Use\|Liquids\|Biomass	0.376	0.610
Price\|Secondary Energy\|Liquids\|Hydrogen	0.372	0.476
Secondary Energy\|Electricity\|Coal\|Lignite	0.372	0.656
Capacity\|Hydrogen\|Electricity	0.369	0.988
Trade\|Secondary Energy\|Liquids\|Biomass\|Volume	0.369	0.711
Primary Energy\|Coal\|Lignite	0.366	0.672
Capacity\|Electricity\|Hydrogen	0.364	1.000
Capacity\|Heat\|Hydrogen	0.364	1.000
Capacity\|Electricity\|Hydrogen\|CC	0.364	1.000
Secondary Energy Input\|Hydrogen\|Heat	0.364	1.000
Secondary Energy\|Heat\|Hydrogen	0.364	1.000
Secondary Energy\|Electricity\|Hydrogen	0.364	1.000
Secondary Energy Input\|Hydrogen\|Electricity	0.364	1.000
Investment\|Energy Supply\|Heat\|Hydrogen	0.364	1.000
Investment\|Energy Supply\|Electricity\|Hydrogen\|CC	0.364	1.000
Investment\|Energy Supply\|Electricity\|Hydrogen	0.364	1.000
Price\|Final Energy\|Residential and Commercial\|Gases	0.362	0.958
Trade\|Secondary Energy\|Methanol\|Volume	0.354	0.640
Final Energy\|Industry excl Non-Energy Use\|Liquids\|Efuel	0.353	0.522
Final Energy\|Liquids\|Efuel	0.353	0.508
Final Energy\|Transportation\|Liquids\|Biomass	0.350	0.668
Primary Energy\|Oil\|Heat	0.349	0.770
Secondary Energy Input\|Electricity\|Hydrogen	0.348	0.962
Secondary Energy\|Heat\|Gas	0.348	0.705
Secondary Energy\|Hydrogen\|Electricity	0.348	0.962
Capacity Additions\|Electricity\|Non-Renewable Waste	0.347	0.359
Capacity Additions\|Heat\|Non-Renewable Waste	0.345	0.380
Final Energy\|Transportation\|Liquids\|Efuel	0.341	0.489
Capacity\|Heat\|Gas	0.336	0.976
Capacity\|Heat	0.335	0.949
Price\|Secondary Energy\|Gases\|Hydrogen	0.333	0.000
Secondary Energy\|Hydrogen\|Gas	0.326	0.655
Secondary Energy\|Solids\|Biomass	0.322	0.153
Primary Energy\|Biomass\|Solids	0.322	0.153
Capacity Additions\|Liquids	0.320	0.494
Investment\|Energy Supply\|Liquids\|Hydrogen	0.320	0.714
Investment\|Energy Supply\|Liquids\|Biomass	0.319	1.000
Final Energy\|Liquids\|Biomass	0.317	0.718
Primary Energy\|Gas\|Hydrogen	0.317	0.685
Emissions\|CO2\|Energy\|Supply\|Hydrogen	0.317	0.685
Emissions\|Gross Fossil CO2\|Energy\|Supply\|Hydrogen	0.317	0.685
Capacity Additions\|Liquids\|Hydrogen	0.315	0.534
Capacity\|Methanol	0.314	0.817
Capacity Additions\|Electricity\|Biomass	0.310	1.000
Capacity Additions\|Electricity\|Biomass\|w/o CCS	0.310	1.000
Capacity Additions\|Electricity\|Biomass\|Solids	0.310	1.000
Capacity Additions\|Heat\|Biomass	0.310	1.000
Capacity Additions\|Heat\|Biomass\|w/o CCS	0.310	1.000
Capacity\|Hydrogen	0.308	0.991
Primary Energy\|Gas\|Heat	0.308	0.811
Capacity\|Heat\|Processes	0.307	0.959
Primary Energy\|Coal\|Hard Coal	0.304	0.788
Secondary Energy\|Hydrogen	0.297	0.905
Secondary Energy\|Electricity\|Coal\|Hard Coal	0.291	0.814
Primary Energy\|Coal\|Electricity	0.291	0.777
Secondary Energy Input\|Electricity\|Liquids	0.290	0.772
Secondary Energy\|Methanol	0.290	0.772
Investment\|Energy Supply\|Electricity\|Transmission\|AC\|Offshore	0.290	0.820
Secondary Energy\|Heat\|Other	0.290	0.924
Final Energy\|Solids\|Biomass	0.286	0.432
Investment\|Energy Supply\|Hydrogen\|Electrolysis	0.286	0.976
Investment\|Energy Supply\|Hydrogen\|Electricity	0.286	0.976
Investment\|Energy Supply\|Heat	0.285	0.672
Capacity Additions\|Electricity\|Wind\|Offshore	0.284	0.709
Capacity\|Electricity\|Oil	0.277	0.825
Investment\|Energy Supply\|Heat\|Processes	0.274	0.881
Capacity Additions\|Heat\|Heat pump	0.268	0.706
Capacity Additions\|Heat\|Processes	0.268	0.725
Capacity Additions\|Electricity\|Hydrogen	0.257	1.000
Capacity Additions\|Heat\|Hydrogen	0.257	1.000
Capacity Additions\|Electricity\|Hydrogen\|CC	0.257	1.000
Emissions\|CO2\|Efuels\|Liquids	0.254	0.856
Trade\|Secondary Energy\|Electricity\|Gross Import\|Volume	0.242	0.896
Emissions\|Gross Fossil CO2\|Energy\|Supply\|Electricity	0.239	0.870
Emissions\|CO2\|Energy\|Supply\|Electricity	0.239	0.870
Secondary Energy\|Heat\|Electricity\|Resistive	0.239	0.828
Secondary Energy\|Electricity\|Biomass\|Gaseous and Liquid	0.237	0.000
Capacity Additions\|Heat	0.231	0.757
Capacity Additions\|Hydrogen\|Electricity	0.231	0.950
Emissions\|CO2\|Model\|CCU	0.230	0.834
Primary Energy\|Biomass\|Electricity	0.228	0.872
Capacity Additions\|Liquids\|Biomass	0.226	1.000
Capacity\|Liquids\|Biomass	0.226	1.000
Final Energy\|Residential and Commercial\|Solids\|Biomass	0.226	0.747
Final Energy\|Residential and Commercial\|Solids	0.226	0.747
Capacity\|Liquids\|Hydrogen	0.223	0.911
Trade\|Secondary Energy\|Liquids\|Hydrogen\|Gross Import\|Volume	0.220	0.824
Secondary Energy\|Electricity\|Coal	0.215	0.880
Final Energy\|Residential and Commercial\|Liquids\|Biomass	0.212	0.930
Final Energy\|Residential and Commercial\|Liquids\|Petroleum	0.207	0.899
Secondary Energy\|Liquids\|Hydrogen	0.207	0.886
Capacity\|Electricity\|Gas\|OC	0.204	1.000
Capacity Additions\|Hydrogen	0.202	0.940
Secondary Energy Input\|Hydrogen\|Liquids	0.201	0.893
Investment\|Energy Supply\|Heat\|Heatpump	0.200	0.857
Investment\|Energy Supply\|Heat\|Heat pump	0.200	0.857
Price\|Primary Energy\|Coal	0.198	0.895
Investment\|Energy Supply\|Electricity\|Wind\|Offshore	0.196	0.867
Investment\|Energy Supply\|Electricity\|Wind Offshore	0.196	0.867
Final Energy\|Residential and Commercial\|Liquids	0.196	0.909
Final Energy\|Industry\|Liquids\|Biomass	0.193	0.911
Investment\|Energy Supply\|Hydrogen	0.192	0.988
Price\|Carbon	0.187	0.912
Capacity\|Liquids	0.187	0.922
Price\|Final Energy\|Industry\|Solids\|Coal	0.186	0.911
Secondary Energy\|Electricity\|Curtailment	0.184	0.922
Capacity Additions\|Heat\|Storage Reservoir	0.181	0.870
Trade\|Secondary Energy\|Liquids\|Hydrogen\|Volume	0.181	0.853
Primary Energy\|Biomass\|Liquids	0.180	0.904
Price\|Secondary Energy\|Gases	0.179	0.923
Investment\|Energy Supply\|Electricity\|Transmission\|Offshore	0.178	0.897
Capacity\|Heat\|Resistive heater	0.178	0.974
Capacity Additions\|Heat\|Resistive heater	0.177	0.947
Final Energy\|Non-Energy Use\|Liquids\|Biomass	0.174	0.930
Investment\|Energy Supply\|Hydrogen\|Transmission and Distribution\|Endogen\|New-build	0.172	0.976
Price\|Final Energy\|Industry\|Hydrogen	0.171	0.898
Investment\|Energy Supply\|Electricity\|Transmission\|DC\|Offshore	0.170	0.911
Emissions\|CO2\|Energy\|Supply\|Electricity and Heat	0.170	0.933
Primary Energy\|Coal	0.165	0.928
Price\|Primary Energy\|Gas	0.164	0.923
Investment\|Energy Supply\|Electricity\|Solar\|PV\|Open Field	0.164	0.929
Final Energy\|Industry\|Liquids\|Efuel	0.164	0.905
Trade\|Primary Energy\|Biomass\|Volume	0.162	0.989
Emissions\|Gross Fossil CO2\|Energy\|Supply	0.162	0.939
Price\|Final Energy\|Transportation\|Electricity	0.161	0.931
Price\|Final Energy\|Transportation\|Passenger\|Liquids	0.161	0.931
Price\|Final Energy\|Transportation\|Freight\|Liquids	0.161	0.932
Secondary Energy\|Electricity\|Biomass	0.160	0.944
Secondary Energy\|Electricity\|Biomass\|w/o CCS	0.160	0.944
Investment\|Energy Supply\|Heat\|Resistive heater	0.159	0.973
Price\|Final Energy\|Industry\|Liquids	0.159	0.921
Price\|Primary Energy\|Oil	0.159	0.934
Price\|Final Energy\|Industry\|Liquids\|Oil	0.159	0.921
Price\|Final Energy\|Industry\|Liquids\|Efuel	0.159	0.921
Investment\|Energy Supply\|Heat\|Storage Reservoir	0.159	0.927
Capacity\|Heat\|Heat pump	0.156	0.957
Capacity Additions\|Hydrogen\|Transmission\|Endogenous	0.156	0.899
Emissions\|CO2\|Efuels\|Gases	0.155	0.963
Final Energy\|Bunkers\|Aviation\|Liquids\|Biomass	0.154	0.948
Trade\|Secondary Energy\|Gases\|Biomass\|Volume	0.153	0.944
Capacity Additions\|Electricity\|Solar\|PV\|Open Field	0.152	0.966
Price\|Secondary Energy\|Liquids	0.152	0.951
Final Energy\|Non-Energy Use\|Liquids\|Efuel	0.151	0.919
Capacity Additions\|Electricity\|Wind	0.145	0.897
Secondary Energy\|Electricity\|Gas	0.144	0.936
Final Energy\|Solids	0.140	0.943
Capacity Additions\|Electricity\|Transmission\|AC	0.138	0.918
Length Additions\|Electricity\|Transmission\|AC	0.138	0.918
Emissions\|Gross Fossil CO2\|Energy\|Supply\|Heat	0.134	0.948
Emissions\|CO2\|Energy\|Supply\|Heat	0.134	0.948
Trade\|Secondary Energy\|Hydrogen\|Volume	0.134	0.987
Investment\|Energy Supply\|Hydrogen\|Transmission and Distribution\|Endogen	0.132	0.960
Emissions\|CO2\|Energy\|Supply	0.130	0.955
Capacity Additions\|Electricity\|Wind\|Onshore	0.130	0.920
Price\|Final Energy\|Industry\|Heat	0.129	0.956
Final Energy\|Bunkers\|Aviation\|Liquids\|Efuel	0.127	0.943
Trade\|Secondary Energy\|Gases\|Biomass\|Gross Import\|Volume	0.123	1.000
Primary Energy\|Gas\|Electricity	0.123	0.955
Primary Energy\|Biomass	0.122	0.961
Capacity Additions\|Hydrogen\|Gas\|w/o CCS	0.120	0.956
Capacity Additions\|Hydrogen\|Gas	0.120	0.956
Capacity Additions\|Heat\|Storage Converter	0.115	0.970
Capacity\|Heat\|Storage Converter	0.115	0.970
Capacity\|Heat\|Storage Reservoir	0.109	0.977
Investment\|Energy Supply\|Electricity\|Transmission\|DC	0.108	0.970
Capacity\|Electricity\|Solar\|PV\|Open Field	0.108	0.984
Price\|Final Energy\|Transportation\|Passenger\|Hydrogen	0.108	0.000
Price\|Final Energy\|Transportation\|Freight\|Hydrogen	0.108	0.000
Capacity Additions\|Electricity\|Transmission	0.108	0.955
Capacity\|Electricity\|Wind\|Offshore	0.104	0.981
Secondary Energy\|Electricity\|Fossil	0.104	0.981
Secondary Energy\|Electricity\|Wind\|Offshore	0.104	0.980
Primary Energy\|Biomass\|w/o CCS	0.103	0.980

NRMSE: Normalized (combined-min-max) Root Mean Square Error
Pearson: Pearson correlation coefficient
Threshold: NRMSE > 0.1
Only variables reaching the threshold are shown. Find the equivalent plot for all of them below.

Plots

Main branch	Feature branch

⚠️ Note: Only the first 20 variables are shown, but more are above the threshold. Find all of them in the artifacts.

General

Plots comparison

Main branch	Feature branch

Files comparison

	Status	NRMSE	MAE (norm)
csvs/prices.csv	⚠️Changed	0.018	0.05
csvs/curtailment.csv	⚠️Changed	0.000	0.13
csvs/price_statistics.csv	⚠️Changed	0.038	0.29
csvs/cumulative_cost.csv	⚠️Changed	0.003	0.10
csvs/metrics.csv	⚠️Changed	0.005	0.06
csvs/nodal_cfs.csv	⚠️ NaN mismatch
csvs/supply.csv	⚠️ NaN mismatch
csvs/nodal_supply_energy.csv	⚠️ NaN mismatch
csvs/capacities.csv	⚠️ NaN mismatch
csvs/nodal_costs.csv	⚠️ NaN mismatch
csvs/market_values.csv	⚠️ NaN mismatch
csvs/nodal_capacities.csv	⚠️ NaN mismatch
csvs/cfs.csv	⚠️ NaN mismatch
csvs/costs.csv	⚠️ NaN mismatch
csvs/supply_energy.csv	⚠️ NaN mismatch
csvs/energy.csv	⚠️ NaN mismatch
csvs/weighted_prices.csv	✅ Equal

NRMSE: Normalized (combined-min-max) Root Mean Square Error
MAE (norm): Mean Absolute Error on normalized data (min-max)
Status Threshold: MAE (norm) > 0.05 and NRMSE > 0.3

Model Metrics

Benchmarks

Comparing fix-missing-gas-capa (7ad93fd) with main (7044a7a).
Branch is 10 commits ahead and 0 commits behind.
Last updated on 2024-11-22 16:15:28 CET.

for more information, see https://pre-commit.ci

workflow/scripts/modify_prenetwork.py

for more information, see https://pre-commit.ci

add function to scale carrier capacity

8d6cd85

JulianGeis requested a review from lindnemi November 21, 2024 16:33

JulianGeis and others added 3 commits November 21, 2024 18:14

add scaling for gas CHP and set lifetime of gas CHP to 40 years

75000c1

Merge branch 'main' into fix-missing-gas-capa

d274758

[pre-commit.ci] auto fixes from pre-commit.com hooks

6e42021

for more information, see https://pre-commit.ci

lindnemi marked this pull request as ready for review November 22, 2024 08:32

JulianGeis and others added 2 commits November 22, 2024 14:46

fix negative investments

9ad43bd

[pre-commit.ci] auto fixes from pre-commit.com hooks

0cc403d

for more information, see https://pre-commit.ci

lindnemi reviewed Nov 22, 2024

View reviewed changes

workflow/scripts/modify_prenetwork.py Show resolved Hide resolved

JulianGeis and others added 4 commits November 22, 2024 15:03

only select extendable links

2df81fc

[pre-commit.ci] auto fixes from pre-commit.com hooks

f65d438

for more information, see https://pre-commit.ci

make must run function more general and add lignite in 2020

cb8bce2

[pre-commit.ci] auto fixes from pre-commit.com hooks

7ad93fd

for more information, see https://pre-commit.ci

lindnemi merged commit 26c20a1 into main Nov 22, 2024
2 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add function to scale carrier capacity #285

add function to scale carrier capacity #285

JulianGeis commented Nov 21, 2024 •

edited

Loading

JulianGeis commented Nov 21, 2024 •

edited

Loading

github-actions bot commented Nov 22, 2024 •

edited

Loading

add function to scale carrier capacity #285

add function to scale carrier capacity #285

Conversation

JulianGeis commented Nov 21, 2024 • edited Loading

JulianGeis commented Nov 21, 2024 • edited Loading

github-actions bot commented Nov 22, 2024 • edited Loading

Validator Report

JulianGeis commented Nov 21, 2024 •

edited

Loading

JulianGeis commented Nov 21, 2024 •

edited

Loading

github-actions bot commented Nov 22, 2024 •

edited

Loading