Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to use other models ? #8

Open
Skylixia opened this issue Jul 15, 2020 · 4 comments
Open

How to use other models ? #8

Skylixia opened this issue Jul 15, 2020 · 4 comments

Comments

@Skylixia
Copy link

Which files should be changed if loading another pretrained bert with pytorch and other fasttext embeddings ?

@luxinyu1
Copy link

Check the newest version of transformers document and you can easily solve the problem
https://huggingface.co/transformers/serialization.html#from-pretrained-method
and if you want to use other embeddings, you may use a package called genism
https://radimrehurek.com/gensim/

@Skylixia
Copy link
Author

I have already acquired the model and embeddings I'd like to use and I have read the commands to load them. My question was about the necessary substitutions in this repo to make it work when using different ressources. In other words, which files are dependent on the Bert model and should be adapted, same goes for fasttext.

@luxinyu1
Copy link

You could try to adapt cache_dir and wordVecPath in LSBert1.py

@qiang2100
Copy link
Owner

qiang2100 commented Jul 16, 2020

you can change the path of your file in "run_LSBert1.sh" or "run_LSBert2.sh" file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants