Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

training alignment #5

Open
PanXiebit opened this issue Sep 1, 2023 · 2 comments
Open

training alignment #5

PanXiebit opened this issue Sep 1, 2023 · 2 comments

Comments

@PanXiebit
Copy link

PanXiebit commented Sep 1, 2023 •
edited
Loading

Thanks for your great works! I am trying to train the model on laion2B datasets.

My training details are: base_size=4096, learning_rate=1e-4, AdamW optimizer.

After 130000 iterations, the loss curve is as follows, it seems to flatten...
image

And the visualized images are:

image
prompts are:
A tiger in a lab coat with a 1980s Miami vibe, turning a well oiled science content machine, digital art
A group photo
a fish on a bike
star citizen aurora

Are you in a similar situation during training, what is the lowest loss you can achieve during training?? Hope to get your suggestions!
@PanXiebit PanXiebit changed the title training alignment? training alignment Sep 1, 2023
@lqniunjunlper
Copy link

lqniunjunlper commented Nov 2, 2023 •
edited
Loading

How many gpu are you used?
A100 or V100?

@lqniunjunlper
Copy link

@PanXiebit

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lqniunjunlper @PanXiebit