Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How much computing resources are needed for UniST? #1

Open
1700022825 opened this issue Jun 17, 2024 · 3 comments
Open

How much computing resources are needed for UniST? #1

1700022825 opened this issue Jun 17, 2024 · 3 comments

Comments

@1700022825
Copy link

Hello, how much time and computing resources are needed for UniST Pretrain and Prompt-tuning?

@YuanYuan98
Copy link
Collaborator

Time and computing resources required for UniST Pretrain and Prompt-tuning vary based on the number and size of datasets involved. In our experience, utilizing over 20 datasets typically necessitates approximately 8 hours for pretraining and an additional 12 hours for prompt-tuning.

@YuanYuan98 YuanYuan98 reopened this Jul 2, 2024
@jt-dcw
Copy link

jt-dcw commented Jul 6, 2024

Hello, thank you very much for the code provided by your team, please ask what kind of hardware configuration you use for model training

UniST 预训练和提示调优所需的时间和计算资源因所涉及的数据集的数量和大小而异。根据我们的经验,使用 20 多个数据集通常需要大约 8 小时的预训练和另外 12 小时的提示调整。

@YuanYuan98
Copy link
Collaborator

Hello, thank you very much for the code provided by your team, please ask what kind of hardware configuration you use for model training

UniST 预训练和提示调优所需的时间和计算资源因所涉及的数据集的数量和大小而异。根据我们的经验,使用 20 多个数据集通常需要大约 8 小时的预训练和另外 12 小时的提示调整。

1 HGX A100 GPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants