Fixes NER to correctly expand/shrink the labels

[michaelgsharp]

NER now will correctly expand/shrink the labels when a word is split into multiple tokens.

[codecov]

Codecov Report

Attention: 65 lines in your changes are missing coverage. Please review.

Comparison is base (a60be5f) 68.80% compared to head (9a2da18) 68.80%.
Report is 4 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff            @@
##             main    #6928    +/-   ##
========================================
  Coverage   68.80%   68.80%            
========================================
  Files        1249     1249            
  Lines      249433   249638   +205     
  Branches    25510    25481    -29     
========================================
+ Hits       171613   171774   +161     
- Misses      71210    71271    +61     
+ Partials     6610     6593    -17     

Flag	Coverage Δ
Debug	68.80% <70.45%> (+<0.01%)	⬆️
production	63.27% <95.45%> (+0.01%)	⬆️
test	88.41% <59.74%> (-0.09%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
.../Microsoft.ML.TorchSharp/NasBert/NasBertTrainer.cs	80.36% <100.00%> (+0.24%)	⬆️
...c/Microsoft.ML.TorchSharp/TorchSharpBaseTrainer.cs	84.98% <100.00%> (+1.36%)	⬆️
src/Microsoft.ML.TorchSharp/NasBert/NerTrainer.cs	91.10% <94.73%> (+2.86%)	⬆️
test/Microsoft.ML.Tests/NerTests.cs	67.02% <59.74%> (-32.98%)	⬇️

... and 17 files with indirect coverage changes

[michaelgsharp]

/backport to release/3.0

[github-actions]

Started backporting to release/3.0: https://github.com/dotnet/machinelearning/actions/runs/7453507161

[github-actions]

@michaelgsharp backporting to release/3.0 failed, the patch most likely resulted in conflicts:

$ git am --3way --ignore-whitespace --keep-non-patch changes.patch

Applying: ner options fix
Applying: Ner fixed.
error: sha1 information is lacking or useless (src/Microsoft.ML.TorchSharp/NasBert/NerTrainer.cs).
error: could not build fake ancestor
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0002 Ner fixed.
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".
Error: The process '/usr/bin/git' failed with exit code 128

Please backport manually!

[github-actions]

@michaelgsharp an error occurred while backporting to release/3.0, please check the run log for details!

Error: git am failed, most likely due to a merge conflict.

[michaelgsharp]

/backport to release/3.0

[github-actions]

Started backporting to release/3.0: https://github.com/dotnet/machinelearning/actions/runs/7454070942