Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ASAN] TestDQMServicesDemo tries to allocate 15 TB of RAM #36063

Closed
iarspider opened this issue Nov 9, 2021 · 11 comments
Closed

[ASAN] TestDQMServicesDemo tries to allocate 15 TB of RAM #36063

iarspider opened this issue Nov 9, 2021 · 11 comments

Comments

@iarspider
Copy link
Contributor

iarspider commented Nov 9, 2021

Log file: https://cmssdt.cern.ch/SDT/cgi-bin/logreader/slc7_amd64_gcc10/CMSSW_12_2_ASAN_X_2021-11-08-2300/unitTestLogs/DQMServices/Demo#/5920-5920

Error message:

+ cmsRun .../src/DQMServices/Demo/test/run_analyzers_cfg.py outfile=huge.root numberEventsInRun=300 numberEventsInLuminosityBlock=100 nEvents=600 nThreads=10 nConcurrent=2 howmany=1000 nolegacy=True
==20036==ERROR: AddressSanitizer failed to allocate 0xdfff0001000 (15392894357504) bytes at address 2008fff7000 (errno: 12)
@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 9, 2021

A new Issue was created by @iarspider .

@Dr15Jones, @perrotta, @dpiparo, @makortel, @smuzaffar, @qliphy can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

@iarspider
Copy link
Contributor Author

assign dqm

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 9, 2021

New categories assigned: dqm

@jfernan2,@ahmad3213,@rvenditti,@emanueleusai,@pbo0,@pmandrik you have been requested to review this Pull request/Issue and eventually sign? Thanks

@jfernan2
Copy link
Contributor

jfernan2 commented Nov 9, 2021

Thanks @iarspider
I am not able to reproduce it, could you remind me of what should I set apart from using CMSSW_12_2_ASAN_X_2021-11-08-2300 ?

The error looks related to the setting ulimit -v 4000000 in:
https://github.com/cms-sw/cmssw/blob/master/DQMServices/Demo/test/runtests.sh#L85

Could you advise a better value which may work for ASAN?
Thank you

@jfernan2
Copy link
Contributor

@iarspider removing the ulimit makes the test working, would this be acceptable for ASAN and non-ASAN releases? Thanks

@iarspider
Copy link
Contributor Author

The entire test suite was originally added in 27dd907 by @schneiml , maybe he can comment?

@jfernan2
Copy link
Contributor

jfernan2 commented Nov 26, 2021

I am afraid @schneiml is not working on CMS since more than a year
My question is more related to the way ASAN works, which I completely ignore. Has something changed in the ASAN side to produce this error in a script which was working previously?
Thanks

@jfernan2
Copy link
Contributor

@iarspider I have created this PR to fix this crash and other UnitTest crashes in ASAN: #36269

@iarspider
Copy link
Contributor Author

@jfernan2 thanks!

@jfernan2
Copy link
Contributor

+1
Fixed in #36269

@cmsbuild
Copy link
Contributor

This issue is fully signed and ready to be closed.

@qliphy qliphy closed this as completed Dec 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants