Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: sort dataframe rows by time #231

Merged
merged 6 commits into from
Feb 9, 2023
Merged

Conversation

axiomofjoy
Copy link
Contributor

resolves #230

@@ -50,6 +50,7 @@ def __init__(
name: Optional[str] = None,
persist_to_disc: bool = True,
):
dataframe = dataframe.reset_index()
Copy link
Contributor Author

@axiomofjoy axiomofjoy Feb 8, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If an input dataframe has an index containing one of the columns defined in the schema, our current validation code will fail with a missing column error since such a column is part of dataframe.index and not part of dataframe.columns.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this makes sense. we won't need any index we don't use

@axiomofjoy axiomofjoy changed the title feat: sort by time and index feat: wip sort by time and index Feb 8, 2023
@axiomofjoy axiomofjoy changed the title feat: wip sort by time and index feat: sort by time and index Feb 9, 2023
@axiomofjoy axiomofjoy marked this pull request as ready for review February 9, 2023 02:41
@axiomofjoy axiomofjoy changed the title feat: sort by time and index feat: sort dataframe rows by time Feb 9, 2023
@axiomofjoy axiomofjoy merged commit 07424e2 into main Feb 9, 2023
@axiomofjoy axiomofjoy deleted the feat/sort-by-time-and-index branch February 9, 2023 03:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Datasets] sort records by time, add timestamp index
2 participants