[BUG] <KeyError: "['Country code'] not in index">

[junohBede]

Conda environment check

• I have tried using the osemosys-global conda environment.

Current Behavior

A Key error occurred
/scripts/osemosys_global/demand/read.py", line 70, in import_ember_elec df[["Country code", "Year", "Variable", "Value"]] because ember_yearly_electricity_data.csv does not have 'Country code' column.

Expected Behavior

No response

Steps To Reproduce

Run the workflow without modifying any config from the repository.

Operating System

Linux

Log output

CalledProcessError in file "/var/home/jka358/share/hdd/CLEWs_Global/submodules/osemosys_global/workflow/rules/preprocess.smk", line 356:
Command 'set -euo pipefail;  /var/home/jka358/miniconda3/envs/osemosys-global/bin/python3.11 /var/home/jka358/share/hdd/CLEWs_Global/submodules/osemosys_global/.snakemake/scripts/tmpk5xs227l.figures.py' returned non-zero exit status 1.
[Mon Jun 30 12:16:18 2025]
Error in rule demand_projection_figures:
    message: None
    jobid: 1
    input: resources/data/default/PLEXOS_World_2015_Gold_V1.1.xlsx, resources/data/default/iamc_db_GDPppp_Countries.xlsx, resources/data/default/iamc_db_POP_Countries.xlsx, resources/data/default/iamc_db_URB_Countries.xlsx, resources/data/default/iamc_db_POP_GDPppp_URB_Countries_Missing.xlsx, resources/data/default/ember_yearly_electricity_data.csv
    output: results/figs/regression.png, results/figs/projection.png
    log: results/logs/demand_projection_plot.log (check log file(s) for error details)
RuleException:
CalledProcessError in file "/var/home/jka358/share/hdd/CLEWs_Global/submodules/osemosys_global/workflow/rules/preprocess.smk", line 151:
Command 'set -euo pipefail;  /var/home/jka358/miniconda3/envs/osemosys-global/bin/python3.11 /var/home/jka358/share/hdd/CLEWs_Global/submodules/osemosys_global/.snakemake/scripts/tmpig8towu7.main.py' returned non-zero exit status 1.
[Mon Jun 30 12:16:18 2025]
Error in rule demand_projections:
    message: None
    jobid: 12
    input: resources/data/default/PLEXOS_World_2015_Gold_V1.1.xlsx, resources/data/default/All_Demand_UTC_2015.csv, resources/data/default/iamc_db_GDPppp_Countries.xlsx, resources/data/default/iamc_db_POP_Countries.xlsx, resources/data/default/iamc_db_URB_Countries.xlsx, resources/data/default/iamc_db_POP_GDPppp_URB_Countries_Missing.xlsx, resources/data/default/T&D Losses.xlsx, resources/data/default/ember_yearly_electricity_data.csv, resources/data/custom/specified_annual_demand.csv
    output: results/data/SpecifiedAnnualDemand.csv
    log: results/logs/demand_projections.log (check log file(s) for error details)
Shutting down, this might take some time.
Exiting because a job execution failed. Look below for error messages
[Mon Jun 30 12:16:18 2025]
Error in rule demand_projections:
    message: None
    jobid: 12
    input: resources/data/default/PLEXOS_World_2015_Gold_V1.1.xlsx, resources/data/default/All_Demand_UTC_2015.csv, resources/data/default/iamc_db_GDPppp_Countries.xlsx, resources/data/default/iamc_db_POP_Countries.xlsx, resources/data/default/iamc_db_URB_Countries.xlsx, resources/data/default/iamc_db_POP_GDPppp_URB_Countries_Missing.xlsx, resources/data/default/T&D Losses.xlsx, resources/data/default/ember_yearly_electricity_data.csv, resources/data/custom/specified_annual_demand.csv
    output: results/data/SpecifiedAnnualDemand.csv
    log: results/logs/demand_projections.log (check log file(s) for error details)
[Mon Jun 30 12:16:18 2025]
Error in rule demand_projection_figures:
    message: None
    jobid: 1
    input: resources/data/default/PLEXOS_World_2015_Gold_V1.1.xlsx, resources/data/default/iamc_db_GDPppp_Countries.xlsx, resources/data/default/iamc_db_POP_Countries.xlsx, resources/data/default/iamc_db_URB_Countries.xlsx, resources/data/default/iamc_db_POP_GDPppp_URB_Countries_Missing.xlsx, resources/data/default/ember_yearly_electricity_data.csv
    output: results/figs/regression.png, results/figs/projection.png
    log: results/logs/demand_projection_plot.log (check log file(s) for error details)
Complete log(s): /var/home/jka358/share/hdd/CLEWs_Global/submodules/osemosys_global/.snakemake/log/2025-06-30T121613.514864.snakemake.log
WorkflowError:
At least one job did not complete successfully.

Anything else?

No response

[junohBede]

Possible solution:

1. changing ISO 3 code of ember_yearly_electricity_data.csv to Country code
2. Or changing Country code from 70th line of ./workflow/scripts/osemosys_global/demand/read.py to ISO 3 code