Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Polars [Rust native solution] #185

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Conversation

ritchie46
Copy link
Contributor

This PR is the rust native solution of Polars. I renamed the python folder for the time being. Maybe it can be removed if all works?

I now log the duration of the queries (in milliseconds) and the chk answers to stdout. What kind of format is best for you?

@ritchie46
Copy link
Contributor Author

Hi @jangorecki, Is there anything I can do on this?

@jangorecki
Copy link
Contributor

@ritchie46 be patient. Unfortunately I have two other projects in queue as of now.

@ritchie46
Copy link
Contributor Author

Ok, I can do that. :)

@Dandandan
Copy link

@jangorecki what would be needed to get rust native benchmarks in here?

@jangorecki
Copy link
Contributor

Design well how to handle compiled languages. We don't have any yet in this benchmark suite.
Maybe it is already in this PR made well enough. It needs time to analyze. As long as python client is giving a minimal overhead that doesn't grow with data size, then it is not that high priority.

@ritchie46
Copy link
Contributor Author

I think the most notable difference is the conservative compiling we have to do for distributing python libraries. The compiler doesn't have the query in scope and cannot utilize all SIMD instructions available on the target architecture. At the moment only Julia compiles on the native machine JIT, or (just ahead of time) if I am not mistaken.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants