Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Propagate XBRL column annotations to finished tables #2173

Open
Tracked by #1574
zaneselvans opened this issue Jan 4, 2023 · 0 comments
Open
Tracked by #1574

Propagate XBRL column annotations to finished tables #2173

zaneselvans opened this issue Jan 4, 2023 · 0 comments
Labels
ferc1 Anything having to do with FERC Form 1 inframundo metadata Anything having to do with the content, formatting, or storage of metadata. Mostly datapackages. xbrl Related to the FERC XBRL transition

Comments

@zaneselvans
Copy link
Member

The FERC XBRL Taxonomy contains lots of useful metadata, which generally gets associated with columns in the DB we build from the XBRL filings. When we reshape those tables so they can be combined with the DBF data in a long / tidy format, many of those columns end up turning into rows, or categorical values that allow the selection and aggregation of certain types of values (e.g. by FERC Account). In the process, we lose easy access to the original XBRL DB column annotations, which make the final output database harder to interpret.

We need a way to preserve these annotations, and integrate them into our data dictionaries -- potentially with a structure similar to what we do right now with the code definition tables that define the meanings of various standardized codes which show up all over the place in the PUDL DB.

E.g. what does it mean for Utility Plant to be leased from others vs. in service vs. for future use?

This might also involve adopting appropriate ENUM or foreign key constraints on categorical columns

@zaneselvans zaneselvans added ferc1 Anything having to do with FERC Form 1 metadata Anything having to do with the content, formatting, or storage of metadata. Mostly datapackages. xbrl Related to the FERC XBRL transition labels Jan 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ferc1 Anything having to do with FERC Form 1 inframundo metadata Anything having to do with the content, formatting, or storage of metadata. Mostly datapackages. xbrl Related to the FERC XBRL transition
Projects
Status: Icebox
Status: No status
Development

No branches or pull requests

2 participants