You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As I understood there may be some incompatibles between yttm model dump file extension and you ReadModel method? Have I train the model with some specific parameters or load it in go with some extra parameters?
P.S. I also need to mention that I encountered an import error while loading the configuration, so I implemented the NewConfig method to resolve it.
Thanks a lot
UPD: as I understood yttm load model as a txt file of char2id and then merges, but your package loads as a binary, so they are incompatible.
The text was updated successfully, but these errors were encountered:
HI!
I want to read previously trained bpe model using yttm python module, with your lib, this is my code snippet:
and I have Broken input: unexpected EOF. This error appears on this line of code
go-YouTokenToMe/bpe.go
Line 164 in 2feb9cc
As I understood there may be some incompatibles between yttm model dump file extension and you
ReadModel
method? Have I train the model with some specific parameters or load it in go with some extra parameters?P.S. I also need to mention that I encountered an import error while loading the configuration, so I implemented the NewConfig method to resolve it.
Thanks a lot
UPD: as I understood yttm load model as a txt file of char2id and then merges, but your package loads as a binary, so they are incompatible.
The text was updated successfully, but these errors were encountered: