chore: upgrade testrunner image

[taegyunkim]

1. Upgrade testrunner image to the one generated by chore: update hatch version and remove hatch-containers #10373
2. testrunner now runs python 3.11.9 (upgraded from 3.11.3) and gevent isn't compatible with python 3.11.9, GH-114781 potentially breaks gevent: threading becomes pre-imported at startup python/cpython#117983, so update the test to run when version < 3.11.9
3. Regenerate riot file for appsec_integrations using python 3.12, as outdated pydantic doesn't work with 3.12.4, see TypeError: ForwardRef._evaluate() missing 1 required keyword-only argument: 'recursive_guard' pydantic/pydantic#9637. This also resulted in updating pytest version and setup_module is used instead of setup.

Checklist

• PR author has checked that all the criteria below are met
• The PR description includes an overview of the change
• The PR description articulates the motivation for the change
• The change includes tests OR the PR description describes a testing strategy
• The PR description notes risks associated with the change, if any
• Newly-added code is easy to change
• The change follows the library release note guidelines
• The change includes or references documentation updates if necessary
• Backport labels are set (if applicable)

Reviewer Checklist

• Reviewer has checked that all the criteria below are met
• Title is accurate
• All changes are related to the pull request's stated goal
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Newly-added code is easy to change
• Release note makes sense to a user of the library
• If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[github-actions]

CODEOWNERS have been resolved as:

.circleci/config.templ.yml                                              @DataDog/python-guild @DataDog/apm-core-python
.github/workflows/requirements-locks.yml                                @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/apm-core-python
.riot/requirements/1e2d655.txt                                          @DataDog/apm-python
docker-compose.yml                                                      @DataDog/apm-core-python
hatch.toml                                                              @DataDog/python-guild
scripts/ddtest                                                          @DataDog/apm-core-python
tests/appsec/integrations/pygoat_tests/Dockerfile.pygoat.2.0.1          @DataDog/asm-python
tests/appsec/integrations/test_psycopg2.py                              @DataDog/asm-python
tests/profiling/collector/test_stack.py                                 @DataDog/profiling-python

[datadog-dd-trace-py-rkomorn]

Datadog Report

Branch report: taegyunkim/testrunner-update
Commit report: 6a0d95a
Test service: dd-trace-py

✅ 0 Failed, 141229 Passed, 1659 Skipped, 5h 32m 20.11s Total Time

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-08-28 15:41:51

Comparing candidate commit 6a0d95a in PR branch taegyunkim/testrunner-update with baseline commit 3569551 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 353 metrics, 47 unstable metrics.

[taegyunkim]

Turned off auto-merge as it didn't trigger gitlab pipelines for some reason, and want to see gitlab pipelines running successfully.

[P403n1x87]

🙌 thanks!