Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add stress test projects #2997

Merged
merged 1 commit into from
May 6, 2017
Merged

add stress test projects #2997

merged 1 commit into from
May 6, 2017

Conversation

dsyme
Copy link
Contributor

@dsyme dsyme commented May 6, 2017

Add the stress test projects generated by @saul's script in this #2793 (comment)

Having these stress tests available as part of the repo will make it much easier to collaborate on improving performance. They are only 7MB though quite a few files

@dsyme
Copy link
Contributor Author

dsyme commented May 6, 2017

Example usage:

N=2:
devenv tests\projects\stress\tinsy\shallow\Shallow.sln
devenv tests\projects\stress\tinsy\dense\Dense.sln
devenv tests\projects\stress\tinsy\denseBin\DenseBin.sln

N=4:
devenv tests\projects\stress\tiny\shallow\Shallow.sln
devenv tests\projects\stress\tiny\dense\Dense.sln
devenv tests\projects\stress\tiny\denseBin\DenseBin.sln

N=10:
devenv tests\projects\stress\small\shallow\Shallow.sln
devenv tests\projects\stress\small\dense\Dense.sln
devenv tests\projects\stress\small\denseBin\DenseBin.sln

N=20:
devenv tests\projects\stress\medium\shallow\Shallow.sln
devenv tests\projects\stress\medium\dense\Dense.sln
devenv tests\projects\stress\medium\denseBin\DenseBin.sln

N=30;
devenv tests\projects\stress\big\shallow\Shallow.sln
devenv tests\projects\stress\big\dense\Dense.sln
devenv tests\projects\stress\big\denseBin\DenseBin.sln

N=100:
devenv tests\projects\stress\huge\shallow\Shallow.sln
devenv tests\projects\stress\huge\dense\Dense.sln
devenv tests\projects\stress\huge\denseBin\DenseBin.sln

and the C# equivalents e.g.

devenv tests\projects\stress\huge\shallowCSharp\ShallowCSharp.sln
devenv tests\projects\stress\huge\denseCSharp\DenseCSharp.sln
devenv tests\projects\stress\huge\denseBinCSharp\DenseBinCSharp.sln

For example on "master" today, times are on my laptop

  • small\shallow\Shallow.sln (15 projects) - opens after 38sec, 180MB

  • big\shallow\Shallow.sln (45 projects) - opens after 1 min of CPU time

  • huge\shallow\Shallow.sln (150 projects) - opens after 6 min of CPU time

  • small\dense\Dense.sln (10 projects) - opens after 28 sec, 150MB

  • big\dense\Dense.sln (30 projects) - does not open, memory grows > 2GB

  • huge\dense\Dense.sln (100 projects) - does not open, memory grows > 2GB

@dsyme
Copy link
Contributor Author

dsyme commented May 6, 2017

( Note: there is no actual code in these projects, each project has an empty list of source files)

@saul
Copy link
Contributor

saul commented May 7, 2017

Just for the record - the scripts aren't mine, @nickcowle wrote them! 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants