Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

factor initialization #81

Open
bhomass opened this issue Sep 10, 2018 · 2 comments
Open

factor initialization #81

bhomass opened this issue Sep 10, 2018 · 2 comments

Comments

@bhomass
Copy link

bhomass commented Sep 10, 2018

Any one see the logic in how the factors were initialized? apparently using QR decomposition to obtain 2 orthogonal matrices, dot product them by the lower of the two matrix dimensions, then divide by the square root of (n_topics + n_dim)

Does this guarantee a simplex condition? what exactly does this calculation do for you?

@bhomass
Copy link
Author

bhomass commented Sep 16, 2018

@bhomass bhomass closed this as completed Sep 16, 2018
@bhomass bhomass reopened this Sep 16, 2018
@bhomass
Copy link
Author

bhomass commented Sep 16, 2018

Having determined that the initialization aims to generate orthonormal random vectors, I see no basis in that requirement at all from the original paper. What would you want to impose orthogonality among the initial topic mixture?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant