[WIP] Added indexes in grouped entity NER #5677
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Add Microsoft's CodeBERT * link style * single modal * unused import
* Add model type check for pipelines * Add model type check for pipelines * rename func * Fix the init parameters * Fix format * rollback unnecessary refactor
prithvikannan
changed the title
Added general description, information about the tags and also some example usage code.
* Fix Trainer in DataParallel setting * Fix typo Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
* fix longformer global attention output * fix multi gpu problem * replace -10000 with 0 * better comment * make attention output equal local and global * Update src/transformers/modeling_longformer.py
* implement FlaubertForTokenClassification as a subclass of XLMForTokenClassification * fix mapping order * add the doc * add common tests
Minor doc fix.
…ation head for text classification (huggingface#5198) * Reformer model head classification implementation for text classification * Reformat the reformer model classification code * PR review comments, and test case implementation for reformer for classification head changes * CI/CD reformer for classification head test import error fix * CI/CD test case implementation added ReformerForSequenceClassification to all_model_classes * Code formatting- fixed * Normal test cases added for reformer classification head * Fix test cases implementation for the reformer classification head * removed token_type_id parameter from the reformer classification head * fixed the test case for reformer classification head * merge conflict with master fixed * merge conflict, changed reformer classification to accept the choice_label parameter added in latest code * refactored the the reformer classification head test code * reformer classification head, common transform test cases fixed * final set of the review comment, rearranging the reformer classes and docstring add to classification forward method * fixed the compilation error and text case fix for reformer classification head * Apply suggestions from code review Remove unnecessary dup Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* docs(wandb): explain how to use W&B integration fix huggingface#5262 * Also mention TensorBoard Co-authored-by: Julien Chaumond <chaumond@gmail.com>
Model card for hewiki-articles-distilGPT2py-il A tiny GPT2 model for generating Hebrew text
* Customize inference widget input * Update model_cards/mrm8488/RuPERTa-base/README.md Co-authored-by: Kevin Canwen Xu <canwenxu@126.com>
…uggingface#5665) * fix auto model causal lm * leverage given functionality * apply unused kwargs to all auto models
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
* add a link to README.md * Update README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Lysandre Debut <lysandre@huggingface.co> Co-authored-by: Teven <teven.lescao@gmail.com>
* Make all data collators accept dict * Style
* Fix huggingface#6092 * Format
…rithvikannan/transformers into add-index-grouped-ner-pipeline
Codecov Report
@@ Coverage Diff @@
## master #5677 +/- ##
==========================================
+ Coverage 78.11% 78.51% +0.39%
==========================================
Files 146 146
Lines 25983 26326 +343
==========================================
+ Hits 20297 20669 +372
+ Misses 5686 5657 -29
Continue to review full report at Codecov.
|
|
Made changes suggested by @LysandreJik, then rebased. |
|
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Based on issue #5676
Any application that requires users to locate grouped named entities would require some sort of index. This feature is present in the standard NER pipeline and should also exist in the grouped entity NER pipeline as well. This is a very short addition to the model and is a relevant use case to many developers.