@@ -289,12 +289,12 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
289289Job=.NET 9.0 Runtime=.NET 9.0
290290
291291```
292- | Method | Mean | Error | StdDev |
293- | ------------- | ---------:| ---------:| ---------:|
294- | Build_TUnit | 976.9 ms | 19.49 ms | 37.54 ms |
295- | Build_NUnit | 846.7 ms | 16.31 ms | 41.51 ms |
296- | Build_xUnit | 812.6 ms | 16.21 ms | 34.19 ms |
297- | Build_MSTest | 843.1 ms | 16.35 ms | 14.49 ms |
292+ | Method | Mean | Error | StdDev |
293+ | ------------- | ----------- :| ---------:| ---------:|
294+ | Build_TUnit | 1,032.5 ms | 24.30 ms | 69.34 ms |
295+ | Build_NUnit | 862.2 ms | 17.19 ms | 44.37 ms |
296+ | Build_xUnit | 838.2 ms | 16.20 ms | 18.00 ms |
297+ | Build_MSTest | 827.3 ms | 16.20 ms | 27.94 ms |
298298
299299
300300
@@ -313,10 +313,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
313313```
314314| Method | Mean | Error | StdDev |
315315| ------------- | --------:| ---------:| ---------:|
316- | Build_TUnit | 1.883 s | 0.0289 s | 0.0270 s |
317- | Build_NUnit | 1.458 s | 0.0184 s | 0.0172 s |
318- | Build_xUnit | 1.430 s | 0.0133 s | 0.0118 s |
319- | Build_MSTest | 1.467 s | 0.0138 s | 0.0129 s |
316+ | Build_TUnit | 1.884 s | 0.0358 s | 0.0335 s |
317+ | Build_NUnit | 1.466 s | 0.0178 s | 0.0166 s |
318+ | Build_xUnit | 1.444 s | 0.0194 s | 0.0172 s |
319+ | Build_MSTest | 1.474 s | 0.0094 s | 0.0079 s |
320320
321321
322322
@@ -335,10 +335,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
335335```
336336| Method | Mean | Error | StdDev |
337337| ------------- | --------:| ---------:| ---------:|
338- | Build_TUnit | 1.895 s | 0.0286 s | 0.0268 s |
339- | Build_NUnit | 1.488 s | 0.0226 s | 0.0212 s |
340- | Build_xUnit | 1.498 s | 0.0293 s | 0.0326 s |
341- | Build_MSTest | 1.524 s | 0.0178 s | 0.0167 s |
338+ | Build_TUnit | 1.905 s | 0.0368 s | 0.0344 s |
339+ | Build_NUnit | 1.482 s | 0.0229 s | 0.0203 s |
340+ | Build_xUnit | 1.470 s | 0.0174 s | 0.0163 s |
341+ | Build_MSTest | 1.498 s | 0.0193 s | 0.0181 s |
342342
343343
344344### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
@@ -358,11 +358,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
358358```
359359| Method | Mean | Error | StdDev |
360360| ---------- | ----------:| ----------:| ----------:|
361- | TUnit_AOT | 65.17 ms | 0.486 ms | 0.379 ms |
362- | TUnit | 472.03 ms | 7.137 ms | 6.327 ms |
363- | NUnit | 718.53 ms | 14.122 ms | 20.699 ms |
364- | xUnit | 738.11 ms | 13.584 ms | 22.695 ms |
365- | MSTest | 655.93 ms | 12.897 ms | 17.654 ms |
361+ | TUnit_AOT | 75.05 ms | 1.107 ms | 1.184 ms |
362+ | TUnit | 482.40 ms | 9.355 ms | 13.114 ms |
363+ | NUnit | 726.90 ms | 14.373 ms | 28.704 ms |
364+ | xUnit | 719.62 ms | 10.508 ms | 8.775 ms |
365+ | MSTest | 627.12 ms | 5.685 ms | 5.318 ms |
366366
367367
368368
@@ -381,11 +381,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
381381```
382382| Method | Mean | Error | StdDev |
383383| ---------- | ------------:| ----------:| ----------:|
384- | TUnit_AOT | 26.84 ms | 0.730 ms | 2.153 ms |
385- | TUnit | 813.30 ms | 16.185 ms | 18.639 ms |
386- | NUnit | 1,286.72 ms | 12.162 ms | 11.376 ms |
387- | xUnit | 1,345.86 ms | 11.570 ms | 10.823 ms |
388- | MSTest | 1,136.00 ms | 8.496 ms | 7.947 ms |
384+ | TUnit_AOT | 26.07 ms | 0.759 ms | 2.213 ms |
385+ | TUnit | 819.56 ms | 16.291 ms | 21.182 ms |
386+ | NUnit | 1,293.59 ms | 17.787 ms | 16.638 ms |
387+ | xUnit | 1,341.51 ms | 10.971 ms | 10.262 ms |
388+ | MSTest | 1,127.98 ms | 8.273 ms | 7.739 ms |
389389
390390
391391
@@ -402,13 +402,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
402402Job=.NET 9.0 Runtime=.NET 9.0
403403
404404```
405- | Method | Mean | Error | StdDev |
406- | ---------- | ------------:| ----------:| ----------:|
407- | TUnit_AOT | 56.08 ms | 1.598 ms | 4.688 ms |
408- | TUnit | 864.57 ms | 17.159 ms | 27.216 ms |
409- | NUnit | 1,307.38 ms | 9.606 ms | 8.986 ms |
410- | xUnit | 1,357.92 ms | 12.528 ms | 11.719 ms |
411- | MSTest | 1,169.21 ms | 10.732 ms | 10.039 ms |
405+ | Method | Mean | Error | StdDev | Median |
406+ | ---------- | ------------:| ----------:| ----------:| ------------: |
407+ | TUnit_AOT | 57.61 ms | 1.990 ms | 5.773 ms | 57.23 ms |
408+ | TUnit | 862.07 ms | 17.028 ms | 27.978 ms | 844.91 ms |
409+ | NUnit | 1,297.04 ms | 11.350 ms | 10.616 ms | 1,297.50 ms |
410+ | xUnit | 1,344.54 ms | 14.171 ms | 13.255 ms | 1,346.66 ms |
411+ | MSTest | 1,155.84 ms | 16.671 ms | 15.594 ms | 1,154.58 ms |
412412
413413
414414### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
@@ -428,11 +428,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
428428```
429429| Method | Mean | Error | StdDev |
430430| ---------- | ------------:| ----------:| ----------:|
431- | TUnit_AOT | 240.0 ms | 12.53 ms | 36.95 ms |
432- | TUnit | 708.3 ms | 34.90 ms | 102.90 ms |
433- | NUnit | 14,145.9 ms | 282.91 ms | 602.90 ms |
434- | xUnit | 14,454.2 ms | 287.44 ms | 599.98 ms |
435- | MSTest | 14,172.0 ms | 277.41 ms | 485.86 ms |
431+ | TUnit_AOT | 234.4 ms | 10.55 ms | 31.10 ms |
432+ | TUnit | 789.9 ms | 28.28 ms | 81.60 ms |
433+ | NUnit | 14,163.7 ms | 275.78 ms | 445.33 ms |
434+ | xUnit | 14,463.1 ms | 287.81 ms | 472.87 ms |
435+ | MSTest | 14,202.9 ms | 277.76 ms | 361.16 ms |
436436
437437
438438
@@ -451,11 +451,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
451451```
452452| Method | Mean | Error | StdDev |
453453| ---------- | ------------:| ----------:| ----------:|
454- | TUnit_AOT | 74.47 ms | 0.481 ms | 0.402 ms |
455- | TUnit | 899.58 ms | 17.530 ms | 18.757 ms |
456- | NUnit | 6,295.68 ms | 11.861 ms | 11.095 ms |
457- | xUnit | 6,447.05 ms | 10.701 ms | 8.936 ms |
458- | MSTest | 6,277.17 ms | 14.879 ms | 13.918 ms |
454+ | TUnit_AOT | 74.13 ms | 0.309 ms | 0.274 ms |
455+ | TUnit | 891.59 ms | 17.339 ms | 20.641 ms |
456+ | NUnit | 6,286.42 ms | 14.263 ms | 13.342 ms |
457+ | xUnit | 6,436.15 ms | 26.129 ms | 24.442 ms |
458+ | MSTest | 6,262.93 ms | 13.677 ms | 12.794 ms |
459459
460460
461461
@@ -472,13 +472,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
472472Job=.NET 9.0 Runtime=.NET 9.0
473473
474474```
475- | Method | Mean | Error | StdDev |
476- | ---------- | -----------:| ---------:| ---------:|
477- | TUnit_AOT | 109.5 ms | 1.11 ms | 0.87 ms |
478- | TUnit | 943.1 ms | 18.41 ms | 23.94 ms |
479- | NUnit | 7,507.9 ms | 20.26 ms | 17.96 ms |
480- | xUnit | 7,565 .4 ms | 22.84 ms | 21.36 ms |
481- | MSTest | 7,452 .8 ms | 21.67 ms | 20.27 ms |
475+ | Method | Mean | Error | StdDev | Median |
476+ | ---------- | -----------:| ---------:| ---------:| -----------: |
477+ | TUnit_AOT | 111.2 ms | 2.20 ms | 2.54 ms | 109.5 ms |
478+ | TUnit | 951.6 ms | 18.87 ms | 25.19 ms | 950.1 ms |
479+ | NUnit | 7,518.2 ms | 23.30 ms | 18.19 ms | 7,522.9 ms |
480+ | xUnit | 7,590 .4 ms | 20.04 ms | 18.75 ms | 7,594.1 ms |
481+ | MSTest | 7,470 .8 ms | 26.39 ms | 24.68 ms | 7,473.0 ms |
482482
483483
484484
0 commit comments