You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently it seems that when loading datasets all documents which are truncated, also are excluded because their entities supposedly have been truncated as well.
This means, no document which has all its entities and still has been truncated exists. This seems highly unlikely.
Is there a bug in the code?
Or could it be that for max_seq_len == 128 there indeed is no tacred example in which the entities are preserved but the text is truncated.
The text was updated successfully, but these errors were encountered:
GabrielKP
changed the title
Lack of documents which are truncated, but without entity cutoff.
Lack of documents which are truncated without entity cutoff.
Mar 15, 2022
Currently it seems that when loading datasets all documents which are truncated, also are excluded because their entities supposedly have been truncated as well.
This means, no document which has all its entities and still has been truncated exists. This seems highly unlikely.
Is there a bug in the code?
Or could it be that for max_seq_len == 128 there indeed is no tacred example in which the entities are preserved but the text is truncated.
The text was updated successfully, but these errors were encountered: