New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question about cls token #100

Open

eremo2002 opened this issue Sep 22, 2022 · 1 comment

eremo2002 commented Sep 22, 2022

Hi author! thanks for your nice work.

I have a question about cls token in PVT.

In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage.

Why PVT doesn't append cls token at input embedding process?

Thanks.

IwantNewway commented May 26, 2024

Hi author! thanks for your nice work.

I have a question about cls token in PVT.

In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage.

Why PVT doesn't append cls token at input embedding process?

Thanks.

would u tell me placement where appended cls ?, i find here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment