Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the dataset size 1000(images) too small for both LLaVA-NeXT and OneVision? #351

Open
Bleking opened this issue Nov 26, 2024 · 0 comments

Comments

@Bleking
Copy link

Bleking commented Nov 26, 2024

Hi. I have been trying to finetune LLaVA-NeXT and OneVision with my custom dataset with 1,000 images for training; there are 200 images for validation. I have had no issues with training when using LLaVA-v1.5 and v1.6 but things seem different with NeXT and OneVision since the loss seems to converge too fast before 1 epoch is over.

Therefore, I would like to check if 1000 size is way too small for these models, in general, unlike the previous versions, v1.5 and v1.6.

I will provide you with the scripts if you need some context.

Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant