Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need a command-line flag to allow changing HBase scanning behavior #33

Open
tsuna opened this issue Mar 27, 2011 · 2 comments
Open

Need a command-line flag to allow changing HBase scanning behavior #33

tsuna opened this issue Mar 27, 2011 · 2 comments

Comments

@tsuna
Copy link
Member

tsuna commented Mar 27, 2011

Reference discussion: Understanding query performance on the mailing list.

We need a command-line knob to tweak the number of rows HBase scanners fetch at once. The default value is a good estimate but can lead to sub-optimal performance on very sparse tables (lots of very small rows).

@anomalizer
Copy link
Contributor

I am living with this less than ideal patch for now
InMobi/opentsdb@c01cf6b30b7cbedb1490

There seems to be no way to configure Scanner properties given a HbbaseClient. We would either have to update asynchbase project to support this or add a helper function to tsdb that returns a pre-configured scanner and use it everywhere. Both seemed like a lot of code, so I a relying on environment variables and just updated the query code

@anomalizer
Copy link
Contributor

Changed implementation to work off command line arg instead of environmental variable
InMobi/opentsdb@f4f4af5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants