Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider support the PETL library #744

Open
blais opened this issue Jan 21, 2022 · 1 comment
Open

Consider support the PETL library #744

blais opened this issue Jan 21, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@blais
Copy link

blais commented Jan 21, 2022

Is your feature request related to a problem? Please describe.
The petl library is an alternative to Pandas that confers several benefits.
It's also much more regular and predictable to do transformations.
It does not have schema declarations.

Describe the solution you'd like
A common schema solution that works for both Pandas and PETL would be a great idea.

Describe alternatives you've considered
I found Pandera as I was just about to write the same thing myself.
I'm going to try using it instead.

@blais blais added the enhancement New feature or request label Jan 21, 2022
@cosmicBboy
Copy link
Collaborator

cosmicBboy commented Jan 31, 2022

hi @blais, thanks for pointing out PETL, I wasn't aware of it!

As you may or may not know, pandera is figuring out how to scalably and maintainably support other data manipulation libraries. PETL seems to be a good candidate for another pandera-support validation backend.

The main blocker for this is #381, which will abstract out all the pandas-specific stuff into a "pandas validation backend". The architecture of this is still in the works, but if you can make a comment on that issue with:

  • a high-level description of the similarities and differences between pandas/PETL
  • how pandera's schema and schema component classes map onto PETL data structures

that would be very helpful to make pandera more easily extensible.

Please let me know if you have any questions, and feel free to pop into the discord if you want to chat!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants