Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Provide base inference component #565

Open
Tracked by #563
RobbeSneyders opened this issue Oct 29, 2023 · 0 comments
Open
Tracked by #563

Provide base inference component #565

RobbeSneyders opened this issue Oct 29, 2023 · 0 comments
Labels
Core Core framework Ease of use

Comments

@RobbeSneyders
Copy link
Member

RobbeSneyders commented Oct 29, 2023 •
edited
Loading

By @philippe-ml6:

Implementing GPU components can be a bit tricky since we need to make sure that both preprocessing and inference are batched, would be nice if we can implement a generic inference transform component class that faciltiates this. A bit similar to Beam's run inference API
@RobbeSneyders RobbeSneyders converted this from a draft issue Oct 29, 2023
@RobbeSneyders RobbeSneyders mentioned this issue Oct 29, 2023
Closed
@RobbeSneyders RobbeSneyders changed the title General inference component Provide base inference component Oct 29, 2023
@RobbeSneyders RobbeSneyders mentioned this issue Feb 19, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Core Core framework Ease of use
Projects
Fondant development
Status: Breakdown
Milestone
No milestone
Development

No branches or pull requests
1 participant
@RobbeSneyders