Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Does hidet have inputs with dynamic shapes support now? #83

Closed
changcui opened this issue Feb 9, 2023 · 2 comments
Closed

Does hidet have inputs with dynamic shapes support now? #83

changcui opened this issue Feb 9, 2023 · 2 comments

Comments

@changcui
Copy link

changcui commented Feb 9, 2023

No description provided.

@yaoyaoding
Copy link
Member

Hi @changcui, sorry, we do not support dynamic shape for now. The support for dynamic shape is on the plan with high priority.

The Hidet Script has the ability to write kernel with dynamic shape, see the example. However, to support the model with dynamic input (i.e., sequence length in text-generation models), we still need to enhance our graph IR and scheduling system.

@changcui
Copy link
Author

Thanks for your reply. I will keep an eye on your work.

vadiklyutiy pushed a commit that referenced this issue Jul 22, 2024
@xiaocenxiaocen @KTong821 @vadiklyutiy
[Ir][Primitives] add hopper instructions (#83)
3131abe 
Co-authored-by: zita <zita.zhang@mail.utoronto.ca>
Co-authored-by: Kevin Tong <kevintong0821@gmail.com>
Co-authored-by: xiaocenxiaocen <xiao.zhang@centml.ai>
vadiklyutiy pushed a commit that referenced this issue Jul 23, 2024
@xiaocenxiaocen @KTong821 @vadiklyutiy
[Ir][Primitives] add hopper instructions (#83)
4225298 
Co-authored-by: zita <zita.zhang@mail.utoronto.ca>
Co-authored-by: Kevin Tong <kevintong0821@gmail.com>
Co-authored-by: xiaocenxiaocen <xiao.zhang@centml.ai>
vadiklyutiy pushed a commit that referenced this issue Dec 26, 2024
@xiaocenxiaocen @KTong821
[Ir][Primitives] add hopper instructions (#83)
e2a3f20 
Co-authored-by: zita <zita.zhang@mail.utoronto.ca>
Co-authored-by: Kevin Tong <kevintong0821@gmail.com>
Co-authored-by: xiaocenxiaocen <xiao.zhang@centml.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@changcui @yaoyaoding