Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Coveralls for coverage #1783

Closed
wants to merge 8 commits into from
Closed

Conversation

ekilmer
Copy link
Contributor

@ekilmer ekilmer commented Jul 30, 2020

Codecov has been extremely frustrating lately with failing to upload the results of our tests.

Since our tests take so long already, we don't want to have to re-run them multiple times to get differential coverage data

  • We need to allow https://coveralls.io/ to access this repo

  • We will need to add a Github secret token COVERALLS_REPO_TOKEN related to this repo to enable it

  • The settings for failing a PR for bad coverage is only managed in the web interface (pic below)
    Screen Shot 2020-07-30 at 4 23 21 PM

@ekilmer ekilmer requested a review from ehennenfent July 30, 2020 20:27
pip install -e ".[dev-noks]"
- name: Run Tests
env:
TEST_TYPE: ${{ matrix.type }}
run: |
cp scripts/run_tests.sh .
./run_tests.sh
- name: Coverage Upload
uses: codecov/codecov-action@v1
- name: Coveralls Parallel
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it necessary to manually install and run the CLI tool? Or can we use the GH action as shown in the example here: https://github.com/marketplace/actions/coveralls-github-action#complete-parallel-job-example

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question. I couldn't get it to work since it expects a .lcov file.

Here's an open issue if you can find a better workaround coverallsapp/github-action#30

Copy link
Contributor

@ehennenfent ehennenfent left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As an additional note, once we've confirmed the URL, we should change the CI badge in README.md from CodeCov to Coveralls.

@ekilmer
Copy link
Contributor Author

ekilmer commented Jul 31, 2020

I set the decrease threshold to 0.2%, but I left the total threshold blank
Screen Shot 2020-07-31 at 4 45 31 PM

@ekilmer ekilmer mentioned this pull request Jul 31, 2020
@ekilmer
Copy link
Contributor Author

ekilmer commented Jul 31, 2020

Closing in favor of #1784

@ekilmer ekilmer closed this Jul 31, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants