Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] microbatches should default run in parallel according to threads #10855

Closed
Tracked by #10624
graciegoheen opened this issue Oct 15, 2024 · 0 comments · Fixed by #10958
Closed
Tracked by #10624

[Feature] microbatches should default run in parallel according to threads #10855

graciegoheen opened this issue Oct 15, 2024 · 0 comments · Fixed by #10958
Assignees
Labels
enhancement New feature or request microbatch Issues related to the microbatch incremental strategy

Comments

@graciegoheen
Copy link
Contributor

graciegoheen commented Oct 15, 2024

Describe the feature

For faster processing of microbatch models, we should by default run the batches in parallel. We are assuming batches can be run independently unless the adapter doesn't support it.

We could additionally:

Slack thread

@graciegoheen graciegoheen added enhancement New feature or request triage microbatch Issues related to the microbatch incremental strategy and removed triage labels Oct 15, 2024
@QMalcolm QMalcolm mentioned this issue Nov 18, 2024
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request microbatch Issues related to the microbatch incremental strategy
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants