You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
// allocate space for ids and offsetsint[]Ids=newint[128];int[]Starts=newint[128];int[]Ends=newint[128];// tokenize with loaded XLM Roberta tokenization and output ids and start and end offsetsvaroutputCount=BlingFireUtils.TextToIdsWithOffsets(h,inBytes,inBytes.Length,Ids,Starts,Ends,Ids.Length,0);Console.WriteLine(String.Format("return length: {0}",outputCount));if(outputCount>=0){Console.Write("tokens from offsets: [");for(inti=0;i<outputCount;++i){intstartOffset=Starts[i];
Starts[0] will be -1 which will result to an exception while getting startOffset.
System.ArgumentOutOfRangeException: 'Non-negative number required. (Parameter 'offset')'
I can put a dummy fix - output results will be good.
if(Starts[0]==-1){Starts[0]=0;}
I'm not sure why I was getting negative offset.
System: Windows 11 x64 (getting the same error in WSL Ubuntu 22.04)
.NET 7.0 Console App
PS: I also have to add Console.OutputEncoding = System.Text.Encoding.UTF8; to display UTF-8 properly in the console app, but it is explainable fix.
The text was updated successfully, but these errors were encountered:
I'm trying to run a sample from readme file.
Starts[0]
will be-1
which will result to an exception while gettingstartOffset
.I can put a dummy fix - output results will be good.
I'm not sure why I was getting negative offset.
System: Windows 11 x64 (getting the same error in WSL Ubuntu 22.04)
.NET 7.0 Console App
PS: I also have to add
Console.OutputEncoding = System.Text.Encoding.UTF8;
to display UTF-8 properly in the console app, but it is explainable fix.The text was updated successfully, but these errors were encountered: