Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PyHive client is slower compared to Presto python client while querying Presto #337

Open
sandeshh opened this issue Jun 19, 2020 · 4 comments

Comments

@sandeshh
Copy link

PyHive client needs at least 2 seconds minimum. But presto python client can be much faster than that. Seen less than 1 seconds also.

https://prestosql.slack.com/archives/CFLB9AMBN/p1592593788123400

@tooptoop4
Copy link

PyHive/pyhive/presto.py

Lines 106 to 107 in 8eb0aea

:param poll_interval: int -- how often to ask the Presto REST interface for a progress
update, defaults to a second

time.sleep(self._poll_interval)

@sandeshh
Copy link
Author

poll_interval = 0.2 works fine, so comment needs to be updated.

@tooptoop4
Copy link

what comment?

@sandeshh
Copy link
Author

param poll_interval: int

poll_interval -> should be float.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants