Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rollback pyinstrument to v4.5.3 to resolve memory issues in profiling #1559

Merged
merged 1 commit into from
Dec 20, 2024

Conversation

matt-graham
Copy link
Collaborator

Reverts most of changes in #1466 (other than changing some processing options for flat HTML output).

It appears that in pyinstrument v4.7 and above we get continual fast growing memory usage during profiling runs, which is causing out of memory issues on GitHub Actions runs. This seems to not have been resolved in the latest pyinstrument v5.0 as also seeing same pattern of increasing memory there too.

Memory usage plots when running

python src/scripts/profiling/run_profiling.py -y 2 -m 0 -p 10000 --show-progress-bar --flat-html --html

with pyinstrument==4.3
mem-graph-after-pyinstrument-4 3

with pyinstrument==4.7
mem-graph-after-pyinstrument-4 7

with pyinstrument==5.0
mem-graph-after-pyinstrument-5 0

@matt-graham matt-graham requested a review from tamuri December 19, 2024 15:37
@tamuri tamuri merged commit 05d3679 into master Dec 20, 2024
62 checks passed
@tamuri tamuri deleted the mmg/rollback-pyinstrument branch December 20, 2024 01:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants