Skip to content

Prototype parsing features#1

Merged
castelao merged 22 commits intomainfrom
parsing_wind_features
Nov 25, 2024
Merged

Prototype parsing features#1
castelao merged 22 commits intomainfrom
parsing_wind_features

Conversation

@castelao
Copy link
Member

A proof of concept on parsing features from the default output from Paul's model.

This is the most unclear part in the pipeline for me, so better handle this early to shape the following decisions. Read the CSV is not a problem, but how to have an actionable database with such heterogenous records while keeping it flexible for future changes.

The goal here is to load the features in the database, thus modify the table features as needed to have actionable records. For now, don't worry on having version controlled data.

Handling the possible errors
@castelao castelao requested a review from ppinchuk November 24, 2024 15:39
@castelao castelao self-assigned this Nov 24, 2024
I know I'll change the API, so not many details in the documentation for
now.
Moving back to a flat generic features table to allow a proof of
concept. This is certainly not the way of storing this, but it allows to
move the other parts forwards before thinking about the best schema.
Custom Result is based on custom Errors for this crate, so it has a
better and consistem error handling along the full crate.
It is too early for integration tests. The API will change, so it's not
worth to harness sampling data yet. Note that I'm still running locally
with real data, so it won't be too off.
@castelao castelao changed the title [WIP] Prototype parsing features Prototype parsing features Nov 25, 2024
@castelao
Copy link
Member Author

Only a proof of concept to parse the features from a standard CSV and load into the internal database. The features table is still poorly defined, but developing the output should guide it better.

@castelao castelao merged commit 88e08ec into main Nov 25, 2024
@castelao castelao deleted the parsing_wind_features branch November 25, 2024 18:58
castelao added a commit that referenced this pull request Sep 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant