Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What does the inv_temp variable mean? #26

Open
hnyll opened this issue Jan 22, 2024 · 1 comment
Open

What does the inv_temp variable mean? #26

hnyll opened this issue Jan 22, 2024 · 1 comment

Comments

@hnyll
Copy link

hnyll commented Jan 22, 2024

i was looking at the code from

https://github.com/Parskatt/DeDoDe/blob/main/demo/demo_match.py

and at line 42 there is a variable named inv_temp but there isn't much description for what it is.
Can someone clarify?

@Parskatt
Copy link
Owner

Parskatt commented Jan 22, 2024

We match with softmax over scaled cosine similarly. We call the scaling inverse temperature. People often refer to temperature when scaling logits, probably it originally comes from statistical mechanics if you're wondering why its called temperature

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants