Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Specify dtype at begin_forward for FlashInfer > 0.1.6 #2313

Closed
2 tasks
zhyncs opened this issue Dec 2, 2024 · 2 comments · Fixed by #2404
Closed
2 tasks

[Feature] Specify dtype at begin_forward for FlashInfer > 0.1.6 #2313

zhyncs opened this issue Dec 2, 2024 · 2 comments · Fixed by #2404
Assignees
@zhyncs
Labels
bug Something isn't working enhancement New feature or request

Comments

@zhyncs
Copy link
Member

zhyncs commented Dec 2, 2024

Checklist

Motivation

as titled
fix #2295 (comment)

Related resources

No response
@zhyncs zhyncs self-assigned this Dec 2, 2024
@zhyncs
Copy link
Member Author

zhyncs commented Dec 2, 2024

Note: Compatible with both AOT and JIT

@zhyncs zhyncs added bug Something isn't working enhancement New feature or request labels Dec 2, 2024
@zhyncs
Copy link
Member Author

zhyncs commented Dec 2, 2024

ref https://docs.flashinfer.ai/installation.html#install-from-source

@zhyncs zhyncs mentioned this issue Dec 8, 2024
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zhyncs zhyncs

Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: specify dtype with begin_forward aka plan sgl-project/sglang
1 participant
@zhyncs