Skip to content

ENH: followup support for pd.read_parquet #17102

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
1 of 3 tasks
jreback opened this issue Jul 27, 2017 · 5 comments
Closed
1 of 3 tasks

ENH: followup support for pd.read_parquet #17102

jreback opened this issue Jul 27, 2017 · 5 comments
Labels
Enhancement IO Parquet parquet, feather

Comments

@jreback
Copy link
Contributor

jreback commented Jul 27, 2017 •
edited
Loading

after #15838
@jreback jreback added IO Data IO issues that don't fit into a more specific label Difficulty Intermediate Enhancement labels Jul 27, 2017
@jreback jreback added this to the 0.21.0 milestone Jul 27, 2017
@jreback jreback mentioned this issue Aug 1, 2017
Merged
2 tasks
@wesm
Copy link
Member

wesm commented Aug 2, 2017

The timestamps_to_ms used for pyarrow is planned for deprecation in https://issues.apache.org/jira/browse/ARROW-622

@jreback jreback changed the title ENH: add dir support in pd.read_parquet ENH: followup support for pd.read_parquet Aug 2, 2017
@chris-b1
Copy link
Contributor

chris-b1 commented Sep 2, 2017

Not sure if it should be on our side our or pyarrow's, but I think we should be raising a better message with Categoricals, the current one is somewhat cryptic.

In [3]: df_with_categorical.to_parquet('tmp.pq')
ArrowNotImplementedError: unhandled type

@wesm
Copy link
Member

wesm commented Sep 2, 2017

Could someone file a JIRA or submit a patch?

@wesm
Copy link
Member

wesm commented Sep 3, 2017

https://issues.apache.org/jira/browse/ARROW-1454

@jreback jreback added the IO Parquet parquet, feather label Sep 6, 2017
@jreback jreback modified the milestones: 0.21.0, Next Major Release Sep 23, 2017
@jreback jreback mentioned this issue Nov 8, 2017
Merged
1 task
@jorisvandenbossche jorisvandenbossche removed the IO Data IO issues that don't fit into a more specific label label Dec 6, 2017
@jreback jreback mentioned this issue May 29, 2019
Closed
@jorisvandenbossche
Copy link
Member

jorisvandenbossche commented Aug 8, 2019 •
edited
Loading

I think this issue can be closed. AFAIK reading a directory already works, and the filtering is done (or not) by the engines (and a filters keyword can already be passed through)

Let's open specific issues if there are remaining items to be done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Enhancement IO Parquet parquet, feather
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@wesm @jreback @jorisvandenbossche @chris-b1