Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] changes on llava_vid model #291

Merged
merged 5 commits into from
Oct 13, 2024

Conversation

ZhangYuanhan-AI
Copy link
Contributor

Before you open a pull-request, please check if a similar issue already exists or has been closed before.

When you open a pull-request, please be sure to include the following

  • A descriptive title: [xxx] XXXX
  • A detailed description

Thank you for your contributions!

elif self.torch_dtype == "bfloat16":
video = video.bfloat16()
else:
import pdb;pdb.set_trace()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can replace it with an error message or log warning message

lmms_eval/models/srt_api.py Outdated Show resolved Hide resolved
Comment on lines 230 to 232
if doc_id != 7:
response = "A"
return response
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this hardcoded? Looks like you need to remove this to output correctly

lmms_eval/models/srt_api.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@kcz358 kcz358 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, you can refer to the comments I wrote for further changes

@Luodian Luodian marked this pull request as draft October 3, 2024 14:17
@Luodian Luodian changed the title add some code for fitting the llava-video [feat] changes on llava_vid model Oct 4, 2024
@kcz358 kcz358 marked this pull request as ready for review October 13, 2024 04:38
@kcz358 kcz358 merged commit 7a191d2 into EvolvingLMMs-Lab:main Oct 13, 2024
1 check passed
KairuiHu pushed a commit that referenced this pull request Oct 24, 2024
* Update gitignore and videomme tasks configuration files

* Fix prompt post_prompt in videomme.yaml and videomme_w_subtitle.yaml

* Fix inconsistent indentation in utils.py
ZhaoCinyu pushed a commit to ZhaoCinyu/lmms-eval that referenced this pull request Dec 9, 2024
* Update gitignore and videomme tasks configuration files

* Fix prompt post_prompt in videomme.yaml and videomme_w_subtitle.yaml

* Fix inconsistent indentation in utils.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants