Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update our Codecov setup #3190

Merged
merged 34 commits into from
Jun 25, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
160ace0
Update codecov gh action
antonpirker Jun 21, 2024
5e164a0
Out test results in junit xml format
antonpirker Jun 21, 2024
0916bbb
only specify output dir, not filename
antonpirker Jun 21, 2024
dd651b0
maybe this works
antonpirker Jun 21, 2024
638d323
introduce error to see error output
antonpirker Jun 21, 2024
f761e01
Actually upload test results
antonpirker Jun 21, 2024
60cc9bd
Always run covecov stuff
antonpirker Jun 21, 2024
cc5b668
other failing test
antonpirker Jun 21, 2024
8f73a45
other failing test
antonpirker Jun 21, 2024
430aa6d
other failing test
antonpirker Jun 21, 2024
2010114
Moved pytest config into pytest.ini
antonpirker Jun 21, 2024
9760ea7
Fix upload
antonpirker Jun 21, 2024
81082d1
ok, maybe I need it
antonpirker Jun 21, 2024
6552d07
Turn on PR comments
antonpirker Jun 21, 2024
0d598e3
test setup
antonpirker Jun 21, 2024
31467af
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 24, 2024
53862b9
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 24, 2024
49ea3da
Cleanup
antonpirker Jun 24, 2024
5d16526
Merge branch 'antonpirker/codecov' of github.com:getsentry/sentry-pyt…
antonpirker Jun 24, 2024
34441d9
Cleanup
antonpirker Jun 24, 2024
6acc71b
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 24, 2024
5a2dc19
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 24, 2024
b031441
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 25, 2024
37bcc51
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 25, 2024
2cbd99a
Have the comments later
antonpirker Jun 25, 2024
a2049bf
Merge branch 'antonpirker/codecov' of github.com:getsentry/sentry-pyt…
antonpirker Jun 25, 2024
3678caf
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 25, 2024
2c41899
Updated test matrix
antonpirker Jun 25, 2024
d8e38a4
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 25, 2024
05cc88c
more consistant naming
antonpirker Jun 25, 2024
54e04f3
Merge branch 'antonpirker/codecov' of github.com:getsentry/sentry-pyt…
antonpirker Jun 25, 2024
3d97a8f
Merge branch 'master' into antonpirker/codecov
antonpirker Jun 25, 2024
081b1fb
Removed useless comment
antonpirker Jun 25, 2024
d0c4b14
Merge branch 'antonpirker/codecov' of github.com:getsentry/sentry-pyt…
antonpirker Jun 25, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 28 additions & 12 deletions .github/workflows/test-integrations-ai.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,31 +45,39 @@ jobs:
- name: Test anthropic latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-anthropic-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-anthropic-latest"
- name: Test cohere latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-cohere-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-cohere-latest"
- name: Test langchain latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-langchain-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-langchain-latest"
- name: Test openai latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-openai-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-openai-latest"
- name: Test huggingface_hub latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-huggingface_hub-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-huggingface_hub-latest"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
test-ai-pinned:
name: AI (pinned)
timeout-minutes: 30
Expand Down Expand Up @@ -97,31 +105,39 @@ jobs:
- name: Test anthropic pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-anthropic" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-anthropic"
- name: Test cohere pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-cohere" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-cohere"
- name: Test langchain pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-langchain" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-langchain"
- name: Test openai pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-openai" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-openai"
- name: Test huggingface_hub pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-huggingface_hub" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-huggingface_hub"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
check_required_tests:
name: All AI tests passed
needs: test-ai-pinned
Expand Down
12 changes: 10 additions & 2 deletions .github/workflows/test-integrations-aws-lambda.yml
Original file line number Diff line number Diff line change
Expand Up @@ -80,15 +80,23 @@ jobs:
- name: Test aws_lambda pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-aws_lambda" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-aws_lambda"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
check_required_tests:
name: All AWS Lambda tests passed
needs: test-aws_lambda-pinned
Expand Down
36 changes: 26 additions & 10 deletions .github/workflows/test-integrations-cloud-computing.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,27 +45,35 @@ jobs:
- name: Test boto3 latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-boto3-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-boto3-latest"
- name: Test chalice latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-chalice-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-chalice-latest"
- name: Test cloud_resource_context latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-cloud_resource_context-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-cloud_resource_context-latest"
- name: Test gcp latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-gcp-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-gcp-latest"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
test-cloud_computing-pinned:
name: Cloud Computing (pinned)
timeout-minutes: 30
Expand Down Expand Up @@ -93,27 +101,35 @@ jobs:
- name: Test boto3 pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-boto3" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-boto3"
- name: Test chalice pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-chalice" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-chalice"
- name: Test cloud_resource_context pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-cloud_resource_context" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-cloud_resource_context"
- name: Test gcp pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-gcp" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-gcp"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
check_required_tests:
name: All Cloud Computing tests passed
needs: test-cloud_computing-pinned
Expand Down
12 changes: 10 additions & 2 deletions .github/workflows/test-integrations-common.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,15 +45,23 @@ jobs:
- name: Test common pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-common" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-common"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
check_required_tests:
name: All Common tests passed
needs: test-common-pinned
Expand Down
44 changes: 30 additions & 14 deletions .github/workflows/test-integrations-data-processing.yml
Original file line number Diff line number Diff line change
Expand Up @@ -47,35 +47,43 @@ jobs:
- name: Test arq latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-arq-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-arq-latest"
- name: Test beam latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-beam-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-beam-latest"
- name: Test celery latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-celery-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-celery-latest"
- name: Test huey latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-huey-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-huey-latest"
- name: Test rq latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-rq-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-rq-latest"
- name: Test spark latest
run: |
set -x # print commands that are executed
./scripts/runtox.sh "py${{ matrix.python-version }}-spark-latest" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh "py${{ matrix.python-version }}-spark-latest"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
test-data_processing-pinned:
name: Data Processing (pinned)
timeout-minutes: 30
Expand Down Expand Up @@ -105,35 +113,43 @@ jobs:
- name: Test arq pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-arq" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-arq"
- name: Test beam pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-beam" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-beam"
- name: Test celery pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-celery" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-celery"
- name: Test huey pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-huey" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-huey"
- name: Test rq pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-rq" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-rq"
- name: Test spark pinned
run: |
set -x # print commands that are executed
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-spark" --cov=tests --cov=sentry_sdk --cov-report= --cov-branch
./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-spark"
- name: Generate coverage XML
if: ${{ !cancelled() }}
run: |
coverage combine .coverage*
coverage xml -i
- uses: codecov/codecov-action@v4
- name: Upload coverage to Codecov
if: ${{ !cancelled() }}
uses: codecov/codecov-action@v4.5.0
with:
token: ${{ secrets.CODECOV_TOKEN }}
files: coverage.xml
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
token: ${{ secrets.CODECOV_TOKEN }}
check_required_tests:
name: All Data Processing tests passed
needs: test-data_processing-pinned
Expand Down
Loading
Loading