Skip to content

Support of Llama 3.2 and AutoModelForImageTextToText model class #260

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 9 commits into from
Closed

Support of Llama 3.2 and AutoModelForImageTextToText model class #260

wants to merge 9 commits into from

Conversation

quic-amitraj
Copy link
Contributor

  1. Adding support of class AutoModelForImageTextToText
  2. Adding support of model- meta-llama/Llama-3.2-11B-Vision-Instruct
  3. CLI to handle models with different model classes [WIP]
  4. Test to check qeff model accuracy [WIP]

quic-rishinr and others added 7 commits January 30, 2025 11:11
@quic-rishinr @quic-amitraj
Mllama Vision support (#254)
3f57d3f 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
Signed-off-by: Rishin Raj <quic_rishinr@quicinc.com>
Co-authored-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-rishinr
Compiler command fix
538cc95 
Signed-off-by: Rishin Raj <quic_rishinr@quicinc.com>
@quic-amitraj @asmigosw
Mllama single qpc support added (#258)
8624eec 
1. Mllama single qpc support added
2. Simplified generate inputs for single and dual qpc

---------

Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
Co-authored-by: asmigosw <asmigosw@qti.qualcomm.com>
@quic-amitraj
Export fix
294a6fa 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj
Generate fix-1
52297c6 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj
minor-fix
3cda7ef 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj
Model swap fix at the time of export and compile
48dfa58 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj quic-amitraj marked this pull request as draft February 5, 2025 16:55
quic-rishinr and others added 2 commits February 6, 2025 07:08
@quic-rishinr
Revert "Model swap fix at the time of export and compile"
00eb6eb 
This reverts commit 48dfa58.
@ochougul
fixed tests
781ffbf 
Signed-off-by: Onkar Chougule <quic_ochougul@quicinc.com>
@ochougul
Copy link
Contributor

Closing as it is addressed in #267

@ochougul ochougul closed this Feb 13, 2025
@ochougul ochougul deleted the mllama_vision branch February 13, 2025 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@quic-rishinr quic-rishinr Awaiting requested review from quic-rishinr quic-rishinr is a code owner

@ochougul ochougul Awaiting requested review from ochougul ochougul is a code owner

@quic-hemagnih quic-hemagnih Awaiting requested review from quic-hemagnih quic-hemagnih will be requested when the pull request is marked ready for review quic-hemagnih is a code owner

Assignees

@quic-amitraj quic-amitraj

@quic-rishinr quic-rishinr

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@quic-amitraj @ochougul @quic-rishinr