Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code coverage nces and clip #419

Merged
merged 8 commits into from
Jul 4, 2024
Merged

Code coverage nces and clip #419

merged 8 commits into from
Jul 4, 2024

Conversation

Jean-KOUAGOU
Copy link
Collaborator

@Jean-KOUAGOU Jean-KOUAGOU commented Jul 2, 2024

I have added tests for NCES and CLIP. Other major changes include:

  1. Improving NCES benchmarking results by enabling repetitions in example sampling and setting num_predictions to 100 instead of the previous 5
  2. NCES fit method is now faster as I now use np.random.choice instead of the old implementation with list comprehension
  3. Added benchmarking results for CLIP
  4. Updated the documentation accordingly
  5. Updated both NCES and CLIP notebooks in examples folder, and removed unecessary/redundant NCES notebooks

@github-actions github-actions bot temporarily deployed to pull request July 2, 2024 16:42 Inactive
@Demirrr
Copy link
Member

Demirrr commented Jul 3, 2024

@alkidbaci Could you review it please ?

@github-actions github-actions bot temporarily deployed to pull request July 3, 2024 10:53 Inactive
@github-actions github-actions bot temporarily deployed to pull request July 3, 2024 11:03 Inactive
@github-actions github-actions bot temporarily deployed to pull request July 3, 2024 11:12 Inactive
@alkidbaci
Copy link
Collaborator

I integrated the coverage computation on the workflow so we can always see the coverage report after each push. If you check the action run of the latest commit: https://github.com/dice-group/Ontolearn/actions/runs/9776699022/job/26989784731?pr=419 , you can find the report under "Coverage report".

The overall coverage percentage has gone up indeed but there are still some NCES and CLIP modules that have very low coverage:

Name                                       Stmts   Miss  Cover   Missing
------------------------------------------------------------------------
ontolearn/clip_trainer.py                    120    101    16%   45-50, 53-55, 58-65, 69-75, 78-161
ontolearn/nces_trainer.py                    173    142    18%   56-62, 66-93, 96-103, 107-113, 116-134, 137, 140-225

If you can create some test cases for those modules, it would be great @Jean-KOUAGOU.

@Jean-KOUAGOU
Copy link
Collaborator Author

Jean-KOUAGOU commented Jul 3, 2024 via email

@github-actions github-actions bot temporarily deployed to pull request July 4, 2024 12:40 Inactive
@alkidbaci alkidbaci merged commit a306800 into develop Jul 4, 2024
4 checks passed
@github-actions github-actions bot temporarily deployed to pull request July 4, 2024 13:28 Inactive
@alkidbaci alkidbaci deleted the code_coverage_nces_clip branch July 4, 2024 14:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants