Code

Add data maturity for 923m#2936

Code

Merged

aesharpe merged 18 commits intodevcatalyst-cooperative/pudl:devfrom add-data-maturity-for-923mcatalyst-cooperative/pudl:add-data-maturity-for-923mCopy head branch name to clipboardNov 1, 2023

+561-378

Commits

Commits on Oct 12, 2023

• First pass of integrating the monthly EIA923 data into the rest of the EIA data. This includes updating the package data to account for the 2023 year and updating the way to assign data maturities …

  Show description for 6cd7712
  aesharpe

  committed
  6cd7712

• remove breakpoint

  aesharpe

  committed
  681b72d

• Merge branch 'dev' into add-data-maturity-for-923m

  aesharpe

  committed
  5899fc0

• Add function to drop ytd records for annual tables

  aesharpe

  committed
  2bff97d

• Adjust monthly row expectations for gf and frc tables after dropping ytd values for annual tables

  aesharpe

  committed
  796b5da

Commits on Oct 16, 2023

• Tweak the way we add data maturity to the eia923 monthly files and remove double returns from the drop_ytd_for_annual_tables function

  aesharpe

  committed
  77e052e

Commits on Oct 17, 2023

• Merge branch 'dev' into add-data-maturity-for-923m

  aesharpe

  committed
  44b4d44

Commits on Oct 24, 2023

• Merge with dev

  aesharpe

  committed
  63dee8e

Commits on Oct 25, 2023

• Litle updates:

  Show description for b50ea1d
  aesharpe

  committed
  b50ea1d

• For now, comment out the checks that make sure we have the same years of EIA923 and EIA860 data. This is causing issues for the monthly EIA923 data that gets integrated ahead of any available 860 d…

  Show description for 572147c
  aesharpe

  committed
  572147c

• Update min max rows

  aesharpe

  committed
  aa42b28

• Add data_maturity field to harvested EIA tables so that we can drop ytd records from annual EIA tables

  aesharpe

  committed
  a588420

Commits on Oct 27, 2023

• Address PR comments:

  Show description for 1d267ab
  aesharpe

  committed
  1d267ab

• Merge branch 'dev' into add-data-maturity-for-923m

  aesharpe

  committed
  8ccc44c

Commits on Oct 30, 2023

• Fix release note trailing whitespace error

  aesharpe

  committed
  b3c11c2

• Update test_eia923_dependency function to make sure some 860 and 923 years overlap but don't need to be the same

  aesharpe

  committed
  3b35892

Commits on Nov 1, 2023

• Update 923 settings files to accomodate 2023 data and update settings tests so that they aren't dependent on having the same years of EIA923 and EIA860 data

  aesharpe

  committed
  24f6b8d

• Update date validation function to only look at instances where data_maturity is not ytd_incremental

  aesharpe

  committed
  b376141