Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update pudl_out to integrate EIA 923 YTD #814

Open
cmgosnell opened this issue Nov 3, 2020 · 1 comment
Open

update pudl_out to integrate EIA 923 YTD #814

cmgosnell opened this issue Nov 3, 2020 · 1 comment
Assignees
Labels
eia923 Anything having to do with EIA Form 923 inframundo new-data Requests for integration of new data. output Exporting data from PUDL into other platforms or interchange formats.

Comments

@cmgosnell
Copy link
Member

The main issue with integrating truly monthly data from YTD sources is in aggregating. If we have only a quarter of data and freq="AS" in a pudl.output.pudltabl.PudlTabl object, then we need to do something to either have truly comparable annual data with the YTD months vs whole years.... or we make this an unacceptable behavior.

The later is my preference for now for a few reasons:

  • if we got the aggregation to look year-like, comparing partial years to full years of electricity data is generally incorrect. There is so much seasonable variability. If one were trying to compare the first few months of year A to year B, the more accurate thing to do would be to compare the first few months of year A to the first few months of year B.
  • honestly, speed. I'd like to get this integrated quickly and it would be pretty simple to raise a flag if someone was trying to aggregate in a bad way. I'd like to do a more nuanced version of outputs that properly examines YTD data, but this seems like a good interim solution.
@cmgosnell cmgosnell added eia923 Anything having to do with EIA Form 923 new-data Requests for integration of new data. output Exporting data from PUDL into other platforms or interchange formats. labels Nov 3, 2020
@cmgosnell cmgosnell self-assigned this Nov 3, 2020
@e-belfer
Copy link
Member

I think this was resolved in #2902 and can be closed. Thoughts, @cmgosnell ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
eia923 Anything having to do with EIA Form 923 inframundo new-data Requests for integration of new data. output Exporting data from PUDL into other platforms or interchange formats.
Projects
None yet
Development

No branches or pull requests

3 participants