Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Mr.TyDi regressions for arabic #1685

Merged
merged 7 commits into from
Dec 5, 2021
Merged

Add Mr.TyDi regressions for arabic #1685

merged 7 commits into from
Dec 5, 2021

Conversation

lintool
Copy link
Member

@lintool lintool commented Dec 4, 2021

python src/main/python/run_regression.py --index --collection mrtydi-v1.1-ar

@lintool lintool marked this pull request as draft December 4, 2021 19:04
@codecov-commenter
Copy link

codecov-commenter commented Dec 4, 2021

Codecov Report

Merging #1685 (b7b5a2f) into master (e33f1ff) will increase coverage by 0.08%.
The diff coverage is 74.54%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #1685      +/-   ##
============================================
+ Coverage     57.23%   57.31%   +0.08%     
- Complexity     1029     1032       +3     
============================================
  Files           172      173       +1     
  Lines          9668     9721      +53     
  Branches       1336     1344       +8     
============================================
+ Hits           5533     5572      +39     
- Misses         3666     3675       +9     
- Partials        469      474       +5     
Impacted Files Coverage Δ
.../java/io/anserini/collection/MrTyDiCollection.java 69.56% <69.56%> (ø)
src/main/java/io/anserini/eval/Qrels.java 100.00% <100.00%> (ø)
...c/main/java/io/anserini/index/IndexCollection.java 45.12% <100.00%> (+0.11%) ⬆️
...in/java/io/anserini/search/topicreader/Topics.java 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e33f1ff...b7b5a2f. Read the comment docs.

@lintool lintool marked this pull request as ready for review December 4, 2021 23:09
@lintool lintool merged commit aee51ad into master Dec 5, 2021
@lintool lintool deleted the mrtydi-ar branch December 5, 2021 12:36
crystina-z added a commit that referenced this pull request Dec 15, 2021
Add regression and test case for all other Mr. TyDi languages, following #1685. 

including: 
- template and yaml files (index stats, MRR@100 and Recall@100)
- test cases (size of topics and qrels, doc loading)
- unrelated to Mr.TyDi: add the path to `/bin/build.sh` in the readme
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants