Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change embedding request limit to a smaller timeframe #46

Open
vorcigernix opened this issue Dec 30, 2023 · 0 comments
Open

Change embedding request limit to a smaller timeframe #46

vorcigernix opened this issue Dec 30, 2023 · 0 comments
Labels
feature request New feature request

Comments

@vorcigernix
Copy link

Is your feature request related to a problem? Please describe.
Since there is a time limit to run any worker, the only way to load a real dataset is to call the embedding in a batch. Limit of 200 requests per hour basically restricts the use case to a PoC.

Describe the solution you'd like
I'd rather limit the amount of requests to a shorter timeframe, like 10 requests per second. That would allow better control over enhancement progress and increase the speed of embedding process.

Describe alternatives you've considered
Perhaps a long running embedding API that will handle the request as fast as it can.

@macolso macolso added the feature request New feature request label Jan 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature request
Projects
None yet
Development

No branches or pull requests

2 participants