Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generalize sparsity pattern representations #119

Merged
merged 54 commits into from
Jun 17, 2024
Merged

Generalize sparsity pattern representations #119

merged 54 commits into from
Jun 17, 2024

Conversation

adrhill
Copy link
Owner

@adrhill adrhill commented Jun 5, 2024 •
edited
Loading

Closes #114.
Closes #80.

This PR relaxes tracer field types and adds an additional layer of dispatch to X_tracer_Y_to_Z functions by adding X_tracer_Y_to_Z_inner, which dispatches on the field type.

It also adds a generic isempty field to tracers, which is handled in X_tracer_Y_to_Z, agnostic to the field types.

To use custom tracers, both the native interface and the ADTypes.jl interface now expect a full tracer type to be passed, e.g. TracerSparsityDetector(gradient_tracer_type, hessian_tracer_type).
This is therefore tagged as a breaking release.

This PR has also lead to the discovery of compile time problems, which have been described here: #120 (comment)

To catch this, some tests have been updated and refactored.

Outdated PR description

This PR adds a layer of Abstraction by introducing AbstractSparsityPatterns.

Over the last dozens of PRs, we've kept refactoring the Tracer type signatures to accommodate new representations for sparse vectors and sparse matrices, most notably:

The introduction of flexible first- and second-order sparsity pattern abstractions in AbstractFirstOrderPattern and AbstractSecondOrderPattern should facilitate shared sets (#107) and allow for the reintroduction of second-order DictIndexsets in the future.

Recommended reading order for reviews:

  1. indexsets.jl (could use a better name)
  2. tracers.jl
  3. updated overload files

@adrhill adrhill requested a review from gdalle June 5, 2024 19:08
@adrhill adrhill added the run benchmark Run benchmarks in CI label Jun 5, 2024
adrhill
adrhill commented Jun 5, 2024
View reviewed changes
src/indexsets.jl Outdated Show resolved Hide resolved
@codecov-commenter
Copy link

codecov-commenter commented Jun 5, 2024 •
edited
Loading

Codecov Report

Attention: Patch coverage is 88.88889% with 42 lines in your changes missing coverage. Please review.

Project coverage is 87.96%. Comparing base (701f911) to head (7f5fe78).

Files Patch % Lines
src/overload_connectivity.jl 68.57% 11 Missing ⚠️
src/tracers.jl 81.63% 9 Missing ⚠️
test/test_constructors.jl 94.06% 7 Missing ⚠️
src/interface.jl 68.42% 6 Missing ⚠️
src/overload_hessian.jl 90.19% 5 Missing ⚠️
src/adtypes.jl 90.90% 2 Missing ⚠️
src/conversion.jl 87.50% 1 Missing ⚠️
src/overload_gradient.jl 97.77% 1 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #119      +/-   ##
==========================================
- Coverage   89.10%   87.96%   -1.14%     
==========================================
  Files          31       31              
  Lines        1202     1354     +152     
==========================================
+ Hits         1071     1191     +120     
- Misses        131      163      +32

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

adrhill
adrhill commented Jun 5, 2024
View reviewed changes
src/overload_hessian.jl Outdated Show resolved Hide resolved
@adrhill adrhill changed the title Ah/generalize tracers Generalize sparsity pattern representations Jun 5, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 5, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 5 Jun 2024 - 20:07
    • Baseline: 5 Jun 2024 - 20:32
  • Package commits:
    • Target: 3f7172
    • Baseline: 178681
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 0.54 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 1.08 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 1.11 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.10 (5%) ❌ 1.01 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 1.13 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.05 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 0.93 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 0.92 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 1.01 (5%) 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.04 (5%) 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 1.05 (5%) 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.17 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 0.92 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 1.06 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 1.09 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 0.95 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.10 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 1.09 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 1.18 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 1.12 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 0.93 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 0.91 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 1.03 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.03 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 1.04 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 1.10 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.09 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.10 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 1.10 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2743 MHz       8547 s          0 s        475 s      26626 s          0 s
       #2  2767 MHz      10181 s          0 s        479 s      24983 s          0 s
       #3  2445 MHz       8188 s          0 s        483 s      26984 s          0 s
       #4  3243 MHz       9360 s          0 s        530 s      25757 s          0 s
  Memory: 15.606502532958984 GB (13340.87109375 MB free)
  Uptime: 3573.59 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz      11418 s          0 s        716 s      38440 s          0 s
       #2  3254 MHz      13544 s          0 s        670 s      36359 s          0 s
       #3  2445 MHz      12250 s          0 s        690 s      37647 s          0 s
       #4  2445 MHz      13602 s          0 s        753 s      36222 s          0 s
  Memory: 15.606502532958984 GB (13510.98828125 MB free)
  Uptime: 5069.15 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 5 Jun 2024 - 20:7
  • Package commit: 3f7172
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.716 ms (5%) 68.07 MiB (1%) 107986
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.218 ms (5%) 5.577 ms 347.47 MiB (1%) 303593
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 535.331 ms (5%) 10.282 ms 772.03 MiB (1%) 542730
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.224 s (5%) 19.018 ms 1.59 GiB (1%) 973461
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 169.888 ms (5%) 3.079 ms 226.63 MiB (1%) 221248
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 640.074 ms (5%) 11.670 ms 816.19 MiB (1%) 449663
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.017 ms (5%) 1.398 ms 96.99 MiB (1%) 84707
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 268.548 ms (5%) 4.562 ms 347.03 MiB (1%) 170451
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.190 ms (5%) 11.32 MiB (1%) 23677
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.340 s (5%) 17.124 ms 1.63 GiB (1%) 353853
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.197 ms (5%) 39.93 MiB (1%) 41065
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.145 ms (5%) 1.189 ms 155.89 MiB (1%) 78597
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 489.176 ms (5%) 23.606 ms 1.16 GiB (1%) 812702
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 255.878 ms (5%) 10.095 ms 438.86 MiB (1%) 529224
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 644.376 ms (5%) 17.584 ms 962.50 MiB (1%) 1213662
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.870 s (5%) 60.904 ms 2.97 GiB (1%) 3616982
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.091 s (5%) 51.429 ms 2.48 GiB (1%) 1667533
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.504 s (5%) 103.387 ms 5.40 GiB (1%) 3376702
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 139.183 ms (5%) 4.734 ms 248.54 MiB (1%) 735545
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 441.743 ms (5%) 17.294 ms 678.71 MiB (1%) 1545483
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.983 ms (5%) 17.72 MiB (1%) 23016
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.708 s (5%) 47.467 ms 2.29 GiB (1%) 3146535
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.623 ms (5%) 48.12 MiB (1%) 65936
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 140.619 ms (5%) 3.145 ms 176.47 MiB (1%) 192798
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 383.076 ms (5%) 21.431 ms 763.54 MiB (1%) 741561
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 696.492 ms (5%) 21.485 ms 683.82 MiB (1%) 1029044
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.415 s (5%) 36.670 ms 1.24 GiB (1%) 2067088
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.039 s (5%) 84.408 ms 2.82 GiB (1%) 4613073
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 925.852 ms (5%) 44.586 ms 1.60 GiB (1%) 1508273
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.480 s (5%) 98.042 ms 3.70 GiB (1%) 3059584
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 163.147 ms (5%) 9.677 ms 329.90 MiB (1%) 999716
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 495.327 ms (5%) 22.715 ms 830.40 MiB (1%) 2080113
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 25.463 ms (5%) 47.14 MiB (1%) 87447
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.890 s (5%) 57.009 ms 2.64 GiB (1%) 4236117
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 65.520 ms (5%) 88.71 MiB (1%) 166941
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 202.238 ms (5%) 5.354 ms 213.19 MiB (1%) 374670
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.297 ms (5%) 73.22 MiB (1%) 129840
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 225.287 ms (5%) 5.196 ms 382.45 MiB (1%) 332463
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 573.803 ms (5%) 12.172 ms 805.32 MiB (1%) 585306
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.275 s (5%) 27.082 ms 1.62 GiB (1%) 1053037
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.060 ms (5%) 3.982 ms 237.06 MiB (1%) 260840
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 659.806 ms (5%) 12.519 ms 839.94 MiB (1%) 523154
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.315 ms (5%) 1.552 ms 98.11 MiB (1%) 86551
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 273.172 ms (5%) 5.246 ms 351.44 MiB (1%) 174060
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.094 ms (5%) 15.64 MiB (1%) 26167
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.349 s (5%) 19.119 ms 1.64 GiB (1%) 348315
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.683 ms (5%) 43.88 MiB (1%) 41125
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 129.756 ms (5%) 1.457 ms 158.47 MiB (1%) 73910
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.483 ms (5%) 65.86 MiB (1%) 86077
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.528 ms (5%) 5.872 ms 344.03 MiB (1%) 234044
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 530.878 ms (5%) 9.750 ms 755.65 MiB (1%) 413162
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.211 s (5%) 20.913 ms 1.55 GiB (1%) 742944
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.778 ms (5%) 2.923 ms 222.02 MiB (1%) 172795
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 634.204 ms (5%) 10.615 ms 806.00 MiB (1%) 346329
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 59.988 ms (5%) 1.361 ms 88.19 MiB (1%) 50120
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 257.459 ms (5%) 3.352 ms 333.11 MiB (1%) 100707
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.241 ms (5%) 11.07 MiB (1%) 17238
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.311 s (5%) 16.031 ms 1.61 GiB (1%) 202519
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.009 ms (5%) 39.25 MiB (1%) 28455
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 125.778 ms (5%) 1.239 ms 154.54 MiB (1%) 53487
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.746 ms (5%) 68.07 MiB (1%) 107987
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.033 ms (5%) 5.232 ms 347.61 MiB (1%) 303595
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.394 ms (5%) 9.828 ms 772.18 MiB (1%) 542732
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.223 s (5%) 21.184 ms 1.59 GiB (1%) 973463
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 169.803 ms (5%) 3.151 ms 226.65 MiB (1%) 221249
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 639.242 ms (5%) 10.927 ms 816.22 MiB (1%) 449665
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 64.000 ms (5%) 1.468 ms 93.15 MiB (1%) 84717
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.893 ms (5%) 4.931 ms 352.58 MiB (1%) 171401
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.646 ms (5%) 13.45 MiB (1%) 24552
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.344 s (5%) 17.646 ms 1.64 GiB (1%) 354750
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.363 ms (5%) 41.09 MiB (1%) 41807
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.330 ms (5%) 1.325 ms 156.87 MiB (1%) 79368
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 502.043 ms (5%) 28.079 ms 1.16 GiB (1%) 812703
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 253.443 ms (5%) 9.843 ms 439.01 MiB (1%) 529226
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 649.361 ms (5%) 19.378 ms 962.65 MiB (1%) 1213664
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.882 s (5%) 64.292 ms 2.97 GiB (1%) 3616984
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.088 s (5%) 51.921 ms 2.48 GiB (1%) 1667534
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.573 s (5%) 124.136 ms 5.40 GiB (1%) 3376704
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 143.032 ms (5%) 7.392 ms 252.36 MiB (1%) 731694
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 439.874 ms (5%) 17.367 ms 678.39 MiB (1%) 1542253
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.143 ms (5%) 17.89 MiB (1%) 23704
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.691 s (5%) 47.468 ms 2.30 GiB (1%) 3149055
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.261 ms (5%) 49.22 MiB (1%) 66769
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 140.837 ms (5%) 3.480 ms 177.33 MiB (1%) 193679
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 381.887 ms (5%) 21.425 ms 763.55 MiB (1%) 741562
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 692.021 ms (5%) 20.839 ms 683.97 MiB (1%) 1029046
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.398 s (5%) 34.916 ms 1.24 GiB (1%) 2067090
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.038 s (5%) 79.970 ms 2.82 GiB (1%) 4613075
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 926.451 ms (5%) 44.582 ms 1.60 GiB (1%) 1508274
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.467 s (5%) 95.106 ms 3.70 GiB (1%) 3059586
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 160.824 ms (5%) 7.527 ms 327.79 MiB (1%) 999491
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 495.598 ms (5%) 20.813 ms 836.98 MiB (1%) 2078312
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 24.061 ms (5%) 43.78 MiB (1%) 83467
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.894 s (5%) 58.956 ms 2.62 GiB (1%) 4234506
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 58.652 ms (5%) 71.59 MiB (1%) 165027
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 199.960 ms (5%) 5.475 ms 204.36 MiB (1%) 373993
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.210 ms (5%) 73.23 MiB (1%) 129841
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 225.663 ms (5%) 5.102 ms 382.60 MiB (1%) 332465
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 574.238 ms (5%) 13.551 ms 805.46 MiB (1%) 585308
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.273 s (5%) 26.748 ms 1.62 GiB (1%) 1053039
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 178.622 ms (5%) 4.114 ms 237.08 MiB (1%) 260841
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 659.387 ms (5%) 12.175 ms 839.98 MiB (1%) 523156
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.424 ms (5%) 1.534 ms 97.08 MiB (1%) 86577
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 274.997 ms (5%) 5.264 ms 353.29 MiB (1%) 174485
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.351 ms (5%) 17.35 MiB (1%) 26784
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.351 s (5%) 19.156 ms 1.65 GiB (1%) 349356
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.007 ms (5%) 44.41 MiB (1%) 41749
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.171 ms (5%) 1.461 ms 161.05 MiB (1%) 74788
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.240 ms (5%) 65.87 MiB (1%) 86078
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.134 ms (5%) 5.744 ms 344.18 MiB (1%) 234046
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 531.054 ms (5%) 10.909 ms 755.79 MiB (1%) 413164
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.208 s (5%) 20.024 ms 1.55 GiB (1%) 742946
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.992 ms (5%) 3.229 ms 222.04 MiB (1%) 172796
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 632.661 ms (5%) 10.989 ms 806.03 MiB (1%) 346331
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 60.706 ms (5%) 1.377 ms 89.79 MiB (1%) 50462
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 262.936 ms (5%) 4.676 ms 344.59 MiB (1%) 101935
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.541 ms (5%) 13.23 MiB (1%) 18113
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.324 s (5%) 17.838 ms 1.62 GiB (1%) 202932
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.192 ms (5%) 40.41 MiB (1%) 29234
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.031 ms (5%) 1.379 ms 155.59 MiB (1%) 54204
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 187.481 ms (5%) 41.913 ms 744.28 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.561 ms (5%) 5.88 MiB (1%) 60508
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 146.503 μs (5%) 260.31 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 43.264 ms (5%) 146.28 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 996.888 μs (5%) 2.12 MiB (1%) 23420
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 54.742 μs (5%) 105.88 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.135 s (5%) 738.559 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 18.636 ms (5%) 63.39 MiB (1%) 416700
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.196 μs (5%) 19.61 KiB (1%) 203
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 76.272 μs (5%) 140.98 KiB (1%) 927
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 138.768 μs (5%) 298.88 KiB (1%) 2147
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 264.813 μs (5%) 524.50 KiB (1%) 5757
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 619.715 ms (5%) 52.389 ms 722.26 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.552 ms (5%) 42.04 MiB (1%) 288505
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.785 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.828 ms (5%) 5.451 ms 97.50 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.905 ms (5%) 5.67 MiB (1%) 55707
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 307.783 μs (5%) 369.56 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.744 s (5%) 85.289 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 59.210 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.852 μs (5%) 11.22 KiB (1%) 80
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.046 ms (5%) 2.65 MiB (1%) 15400
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.499 ms (5%) 13.00 MiB (1%) 38417
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.253 ms (5%) 25.06 MiB (1%) 68973
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.588 s (5%) 77.442 ms 837.65 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 79.066 ms (5%) 48.66 MiB (1%) 435601
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.743 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 177.671 ms (5%) 22.890 ms 216.52 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.071 ms (5%) 12.50 MiB (1%) 137136
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 411.858 μs (5%) 801.44 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 20.715 s (5%) 2.315 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 664.144 ms (5%) 44.605 ms 697.81 MiB (1%) 4174858
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 40.105 μs (5%) 132.78 KiB (1%) 1486
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 7.892 ms (5%) 4.40 MiB (1%) 26954
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 251.701 ms (5%) 14.08 MiB (1%) 60993
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 22.844 s (5%) 27.58 MiB (1%) 114313
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 298.762 ms (5%) 46.026 ms 331.11 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.623 ms (5%) 19.09 MiB (1%) 130321
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 654.169 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 43.267 ms (5%) 69.42 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.165 ms (5%) 4.03 MiB (1%) 38062
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 115.836 μs (5%) 259.14 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.605 s (5%) 287.083 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 89.572 ms (5%) 5.849 ms 144.46 MiB (1%) 928266
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.589 μs (5%) 37.66 KiB (1%) 341
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 296.593 μs (5%) 543.69 KiB (1%) 2889
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.180 ms (5%) 2.18 MiB (1%) 7756
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.099 ms (5%) 8.45 MiB (1%) 24997
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 33.803 ms (5%) 74.00 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.872 ms (5%) 4.28 MiB (1%) 23177
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 134.891 μs (5%) 282.06 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 11.137 ms (5%) 22.27 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 631.958 μs (5%) 1.31 MiB (1%) 10411
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 40.395 μs (5%) 85.00 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 663.444 ms (5%) 67.403 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.666 ms (5%) 41.72 MiB (1%) 177600
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.986 μs (5%) 14.19 KiB (1%) 128
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 60.172 μs (5%) 141.06 KiB (1%) 435
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 231.522 μs (5%) 721.12 KiB (1%) 1231
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 579.019 μs (5%) 1.97 MiB (1%) 3049
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 188.575 ms (5%) 43.057 ms 745.96 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.620 ms (5%) 5.98 MiB (1%) 60512
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 147.955 μs (5%) 266.58 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 43.385 ms (5%) 147.35 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.022 ms (5%) 2.18 MiB (1%) 23425
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 55.985 μs (5%) 110.06 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.424 s (5%) 413.166 ms 18.62 GiB (1%) 11525819
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.645 ms (5%) 63.51 MiB (1%) 416711
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.402 μs (5%) 28.69 KiB (1%) 217
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 67.465 μs (5%) 139.25 KiB (1%) 879
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 149.841 μs (5%) 318.77 KiB (1%) 2321
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 287.355 μs (5%) 562.14 KiB (1%) 6215
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 654.257 ms (5%) 61.116 ms 723.94 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.731 ms (5%) 42.14 MiB (1%) 288509
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.792 ms (5%) 2.65 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 93.631 ms (5%) 5.811 ms 98.56 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.959 ms (5%) 5.74 MiB (1%) 55712
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 311.121 μs (5%) 373.75 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.760 s (5%) 67.216 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 59.716 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.670 μs (5%) 22.27 KiB (1%) 100
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.680 ms (5%) 2.43 MiB (1%) 12904
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.633 ms (5%) 13.32 MiB (1%) 38956
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 11.982 ms (5%) 24.36 MiB (1%) 67178
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.618 s (5%) 86.302 ms 841.59 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 78.641 ms (5%) 48.76 MiB (1%) 435605
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.747 ms (5%) 3.06 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 178.785 ms (5%) 29.512 ms 217.59 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.118 ms (5%) 12.56 MiB (1%) 137141
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 412.460 μs (5%) 805.62 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 21.211 s (5%) 2.424 s 18.49 GiB (1%) 112017835
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 665.832 ms (5%) 46.361 ms 697.92 MiB (1%) 4174869
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 43.441 μs (5%) 147.30 KiB (1%) 1549
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 5.792 ms (5%) 4.36 MiB (1%) 24826
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 187.757 ms (5%) 13.06 MiB (1%) 58251
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 25.894 s (5%) 23.76 MiB (1%) 107744
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 295.971 ms (5%) 39.127 ms 332.79 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.481 ms (5%) 19.19 MiB (1%) 130325
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 661.274 μs (5%) 1.21 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.550 ms (5%) 70.49 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.184 ms (5%) 4.09 MiB (1%) 38067
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 117.720 μs (5%) 263.33 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.602 s (5%) 282.734 ms 3.69 GiB (1%) 24699853
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 89.458 ms (5%) 5.659 ms 144.58 MiB (1%) 928277
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.483 μs (5%) 47.45 KiB (1%) 353
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 242.823 μs (5%) 491.48 KiB (1%) 2526
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.231 ms (5%) 2.33 MiB (1%) 8032
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.076 ms (5%) 8.49 MiB (1%) 25147
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 35.419 ms (5%) 75.68 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.954 ms (5%) 4.38 MiB (1%) 23181
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 140.313 μs (5%) 288.33 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 11.465 ms (5%) 23.34 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 652.249 μs (5%) 1.38 MiB (1%) 10416
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 42.659 μs (5%) 89.19 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 707.165 ms (5%) 91.630 ms 1.03 GiB (1%) 4711225
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.888 ms (5%) 41.84 MiB (1%) 177611
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.810 μs (5%) 24.44 KiB (1%) 146
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 70.161 μs (5%) 172.75 KiB (1%) 507
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 223.297 μs (5%) 687.56 KiB (1%) 1184
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 568.542 μs (5%) 1.93 MiB (1%) 2972

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2743 MHz       8547 s          0 s        475 s      26626 s          0 s
       #2  2767 MHz      10181 s          0 s        479 s      24983 s          0 s
       #3  2445 MHz       8188 s          0 s        483 s      26984 s          0 s
       #4  3243 MHz       9360 s          0 s        530 s      25757 s          0 s
  Memory: 15.606502532958984 GB (13340.87109375 MB free)
  Uptime: 3573.59 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 5 Jun 2024 - 20:32
  • Package commit: 178681
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.682 ms (5%) 68.07 MiB (1%) 107996
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.457 ms (5%) 5.523 ms 347.44 MiB (1%) 303603
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 537.251 ms (5%) 11.145 ms 772.01 MiB (1%) 542740
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.233 s (5%) 25.606 ms 1.59 GiB (1%) 973471
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.745 ms (5%) 3.674 ms 226.63 MiB (1%) 221258
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 644.306 ms (5%) 13.203 ms 816.18 MiB (1%) 449672
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.896 ms (5%) 1.483 ms 98.88 MiB (1%) 84929
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.941 ms (5%) 5.405 ms 343.16 MiB (1%) 170129
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.148 ms (5%) 10.74 MiB (1%) 23647
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.346 s (5%) 21.854 ms 1.63 GiB (1%) 354088
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.680 ms (5%) 40.83 MiB (1%) 41053
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.727 ms (5%) 2.295 ms 155.24 MiB (1%) 78469
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 512.528 ms (5%) 28.024 ms 1.16 GiB (1%) 812709
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 251.048 ms (5%) 8.730 ms 438.84 MiB (1%) 529231
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 647.277 ms (5%) 18.479 ms 962.48 MiB (1%) 1213669
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.871 s (5%) 62.380 ms 2.97 GiB (1%) 3616989
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.125 s (5%) 56.118 ms 2.48 GiB (1%) 1667540
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.647 s (5%) 133.464 ms 5.40 GiB (1%) 3376708
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 141.304 ms (5%) 6.541 ms 244.98 MiB (1%) 730573
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 440.232 ms (5%) 17.219 ms 672.04 MiB (1%) 1535097
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.862 ms (5%) 16.49 MiB (1%) 22956
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.717 s (5%) 51.558 ms 2.30 GiB (1%) 3151660
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.374 ms (5%) 47.81 MiB (1%) 65783
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 141.721 ms (5%) 3.296 ms 176.79 MiB (1%) 193065
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 391.533 ms (5%) 25.267 ms 763.54 MiB (1%) 741594
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 690.402 ms (5%) 22.289 ms 683.80 MiB (1%) 1029077
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.418 s (5%) 38.474 ms 1.24 GiB (1%) 2067121
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.034 s (5%) 88.890 ms 2.82 GiB (1%) 4613106
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 949.875 ms (5%) 54.031 ms 1.60 GiB (1%) 1508306
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.566 s (5%) 119.826 ms 3.70 GiB (1%) 3059616
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 164.547 ms (5%) 9.714 ms 324.62 MiB (1%) 998934
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 501.164 ms (5%) 23.428 ms 830.44 MiB (1%) 2070558
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 24.711 ms (5%) 46.03 MiB (1%) 85975
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.910 s (5%) 61.300 ms 2.63 GiB (1%) 4241613
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 75.014 ms (5%) 2.608 ms 106.27 MiB (1%) 176052
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 215.065 ms (5%) 7.488 ms 242.75 MiB (1%) 389799
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.201 ms (5%) 73.22 MiB (1%) 129848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 226.639 ms (5%) 5.606 ms 382.43 MiB (1%) 332471
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 573.447 ms (5%) 12.355 ms 805.29 MiB (1%) 585314
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.274 s (5%) 27.331 ms 1.62 GiB (1%) 1053045
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.963 ms (5%) 5.158 ms 237.06 MiB (1%) 260848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 664.090 ms (5%) 14.981 ms 839.93 MiB (1%) 523161
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 68.184 ms (5%) 1.660 ms 98.45 MiB (1%) 86670
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 278.135 ms (5%) 5.845 ms 355.34 MiB (1%) 174470
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.104 ms (5%) 15.63 MiB (1%) 26106
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.360 s (5%) 23.000 ms 1.64 GiB (1%) 348428
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.642 ms (5%) 43.63 MiB (1%) 41022
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.654 ms (5%) 2.693 ms 160.04 MiB (1%) 73912
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.163 ms (5%) 65.86 MiB (1%) 86084
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.903 ms (5%) 5.736 ms 344.01 MiB (1%) 234051
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.753 ms (5%) 11.775 ms 755.62 MiB (1%) 413169
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.218 s (5%) 24.922 ms 1.55 GiB (1%) 742951
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 167.535 ms (5%) 3.248 ms 222.02 MiB (1%) 172802
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 635.225 ms (5%) 12.213 ms 805.99 MiB (1%) 346335
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 60.308 ms (5%) 1.435 ms 86.68 MiB (1%) 50017
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 262.697 ms (5%) 4.912 ms 337.11 MiB (1%) 100939
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.731 ms (5%) 14.03 MiB (1%) 17574
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.325 s (5%) 19.008 ms 1.62 GiB (1%) 201987
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.284 ms (5%) 40.28 MiB (1%) 28490
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.104 ms (5%) 1.211 ms 154.14 MiB (1%) 53443
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.478 ms (5%) 67.92 MiB (1%) 101597
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.213 ms (5%) 5.255 ms 347.22 MiB (1%) 290805
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.971 ms (5%) 10.729 ms 771.50 MiB (1%) 517142
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.231 s (5%) 23.650 ms 1.59 GiB (1%) 922273
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.108 ms (5%) 3.230 ms 226.35 MiB (1%) 208459
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 641.181 ms (5%) 12.569 ms 815.61 MiB (1%) 424074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 64.302 ms (5%) 1.524 ms 94.71 MiB (1%) 84691
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.497 ms (5%) 5.122 ms 347.69 MiB (1%) 170544
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.751 ms (5%) 14.51 MiB (1%) 23861
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.341 s (5%) 20.041 ms 1.64 GiB (1%) 353957
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.447 ms (5%) 40.82 MiB (1%) 41022
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.446 ms (5%) 1.651 ms 156.40 MiB (1%) 78578
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 502.517 ms (5%) 25.408 ms 1.16 GiB (1%) 812710
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 251.962 ms (5%) 9.096 ms 438.91 MiB (1%) 529233
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 647.214 ms (5%) 18.463 ms 962.55 MiB (1%) 1213671
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.877 s (5%) 61.716 ms 2.97 GiB (1%) 3616991
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.127 s (5%) 54.721 ms 2.48 GiB (1%) 1667541
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.602 s (5%) 119.048 ms 5.40 GiB (1%) 3376710
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 143.480 ms (5%) 6.382 ms 252.21 MiB (1%) 739195
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 442.281 ms (5%) 17.444 ms 674.93 MiB (1%) 1536225
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.441 ms (5%) 19.97 MiB (1%) 24069
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.717 s (5%) 52.271 ms 2.29 GiB (1%) 3147731
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.073 ms (5%) 49.13 MiB (1%) 66738
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 140.013 ms (5%) 3.556 ms 176.99 MiB (1%) 193828
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 391.713 ms (5%) 23.669 ms 763.54 MiB (1%) 741595
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 687.216 ms (5%) 19.037 ms 683.87 MiB (1%) 1029079
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.405 s (5%) 33.463 ms 1.24 GiB (1%) 2067123
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.011 s (5%) 82.193 ms 2.82 GiB (1%) 4613108
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 934.619 ms (5%) 48.711 ms 1.60 GiB (1%) 1508307
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.521 s (5%) 112.132 ms 3.70 GiB (1%) 3059618
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 162.894 ms (5%) 9.368 ms 322.34 MiB (1%) 996351
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 495.175 ms (5%) 22.977 ms 825.73 MiB (1%) 2072763
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 20.813 ms (5%) 31.00 MiB (1%) 80929
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.912 s (5%) 64.162 ms 2.63 GiB (1%) 4238513
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 61.766 ms (5%) 75.95 MiB (1%) 166771
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 208.060 ms (5%) 7.599 ms 221.20 MiB (1%) 379196
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.161 ms (5%) 73.22 MiB (1%) 129849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.566 ms (5%) 6.124 ms 382.50 MiB (1%) 332473
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 572.377 ms (5%) 12.755 ms 805.37 MiB (1%) 585316
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.276 s (5%) 27.809 ms 1.62 GiB (1%) 1053047
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 178.606 ms (5%) 3.986 ms 237.07 MiB (1%) 260849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 663.150 ms (5%) 14.951 ms 839.95 MiB (1%) 523163
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.425 ms (5%) 1.653 ms 98.38 MiB (1%) 86943
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 276.892 ms (5%) 5.823 ms 355.79 MiB (1%) 174959
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.501 ms (5%) 18.08 MiB (1%) 27050
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.356 s (5%) 23.070 ms 1.65 GiB (1%) 350336
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.073 ms (5%) 45.42 MiB (1%) 41857
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.597 ms (5%) 1.603 ms 160.64 MiB (1%) 74663
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.250 ms (5%) 65.86 MiB (1%) 86085
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 199.104 ms (5%) 5.940 ms 344.08 MiB (1%) 234053
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 531.943 ms (5%) 10.461 ms 755.70 MiB (1%) 413171
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.219 s (5%) 23.364 ms 1.55 GiB (1%) 742953
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.767 ms (5%) 3.714 ms 222.03 MiB (1%) 172803
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 637.265 ms (5%) 12.874 ms 806.01 MiB (1%) 346337
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.319 ms (5%) 1.443 ms 93.24 MiB (1%) 50588
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 260.322 ms (5%) 5.034 ms 333.18 MiB (1%) 101263
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.002 ms (5%) 15.67 MiB (1%) 18330
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.324 s (5%) 19.199 ms 1.61 GiB (1%) 203050
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.361 ms (5%) 40.54 MiB (1%) 29251
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.785 ms (5%) 1.391 ms 155.41 MiB (1%) 54196
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 349.435 ms (5%) 182.413 ms 743.21 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.374 ms (5%) 5.82 MiB (1%) 60501
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 132.096 μs (5%) 256.38 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 43.619 ms (5%) 4.618 ms 145.98 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 903.626 μs (5%) 2.10 MiB (1%) 23418
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 48.480 μs (5%) 104.75 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.163 s (5%) 703.500 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 19.111 ms (5%) 1.724 ms 63.36 MiB (1%) 416698
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.311 μs (5%) 16.77 KiB (1%) 201
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 62.788 μs (5%) 128.12 KiB (1%) 879
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 135.873 μs (5%) 308.02 KiB (1%) 2351
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 245.589 μs (5%) 531.77 KiB (1%) 5917
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 582.381 ms (5%) 41.927 ms 721.19 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.582 ms (5%) 41.98 MiB (1%) 288498
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.710 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 91.578 ms (5%) 5.308 ms 97.19 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.828 ms (5%) 5.66 MiB (1%) 55705
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 303.005 μs (5%) 368.44 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.576 s (5%) 46.340 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 58.084 ms (5%) 41.54 MiB (1%) 175246
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.099 μs (5%) 10.00 KiB (1%) 91
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.866 ms (5%) 2.78 MiB (1%) 13991
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.561 ms (5%) 13.21 MiB (1%) 38685
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.084 ms (5%) 24.97 MiB (1%) 68821
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.511 s (5%) 64.337 ms 836.59 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.797 ms (5%) 48.60 MiB (1%) 435594
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.704 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 160.171 ms (5%) 23.535 ms 216.21 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.157 ms (5%) 12.49 MiB (1%) 137134
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 396.680 μs (5%) 800.31 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 22.221 s (5%) 2.333 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 637.431 ms (5%) 40.978 ms 697.77 MiB (1%) 4174856
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 32.461 μs (5%) 116.20 KiB (1%) 1338
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 9.924 ms (5%) 5.37 MiB (1%) 29080
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 197.230 ms (5%) 12.27 MiB (1%) 57195
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 24.631 s (5%) 23.12 MiB (1%) 106803
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 287.123 ms (5%) 63.218 ms 330.04 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.504 ms (5%) 19.03 MiB (1%) 130314
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 635.856 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 44.788 ms (5%) 69.12 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.152 ms (5%) 4.01 MiB (1%) 38060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 111.778 μs (5%) 258.02 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.846 s (5%) 487.451 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 88.069 ms (5%) 4.409 ms 144.42 MiB (1%) 928264
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.109 μs (5%) 34.14 KiB (1%) 333
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 196.507 μs (5%) 410.56 KiB (1%) 2249
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.242 ms (5%) 2.33 MiB (1%) 8196
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.893 ms (5%) 8.14 MiB (1%) 24182
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 33.489 ms (5%) 72.93 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.802 ms (5%) 4.22 MiB (1%) 23170
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 129.001 μs (5%) 278.12 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 10.120 ms (5%) 21.97 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 576.376 μs (5%) 1.30 MiB (1%) 10409
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 37.660 μs (5%) 83.88 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 564.874 ms (5%) 48.141 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 18.564 ms (5%) 41.69 MiB (1%) 177598
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.558 μs (5%) 11.30 KiB (1%) 126
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 82.925 μs (5%) 184.16 KiB (1%) 535
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 195.725 μs (5%) 624.81 KiB (1%) 1086
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 530.230 μs (5%) 1.94 MiB (1%) 3012
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 204.478 ms (5%) 41.606 ms 744.59 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.481 ms (5%) 5.90 MiB (1%) 60510
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 135.954 μs (5%) 261.62 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 45.778 ms (5%) 5.221 ms 146.74 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 931.566 μs (5%) 2.14 MiB (1%) 23423
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 51.306 μs (5%) 107.84 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.051 s (5%) 531.698 ms 18.62 GiB (1%) 11587323
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 18.536 ms (5%) 63.59 MiB (1%) 419014
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.843 μs (5%) 23.86 KiB (1%) 203
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 76.573 μs (5%) 150.55 KiB (1%) 1021
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 135.412 μs (5%) 306.31 KiB (1%) 2201
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 261.658 μs (5%) 547.06 KiB (1%) 6037
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 609.070 ms (5%) 51.549 ms 722.56 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.024 ms (5%) 42.06 MiB (1%) 288507
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.784 ms (5%) 2.64 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.246 ms (5%) 5.259 ms 97.95 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.910 ms (5%) 5.70 MiB (1%) 55710
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 307.854 μs (5%) 371.53 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.709 s (5%) 76.323 ms 1.02 GiB (1%) 4692825
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 58.911 ms (5%) 41.70 MiB (1%) 176410
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.292 μs (5%) 18.56 KiB (1%) 103
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.298 ms (5%) 3.63 MiB (1%) 16384
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.443 ms (5%) 12.93 MiB (1%) 38124
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.009 ms (5%) 24.65 MiB (1%) 67925
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.568 s (5%) 74.048 ms 837.96 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 78.151 ms (5%) 48.68 MiB (1%) 435603
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.722 ms (5%) 3.05 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 160.303 ms (5%) 17.408 ms 216.97 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.172 ms (5%) 12.53 MiB (1%) 137139
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 413.060 μs (5%) 803.41 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 22.852 s (5%) 2.448 s 18.50 GiB (1%) 112202347
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 640.063 ms (5%) 40.435 ms 698.35 MiB (1%) 4181780
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 35.956 μs (5%) 123.91 KiB (1%) 1334
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 4.886 ms (5%) 3.46 MiB (1%) 21341
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 220.148 ms (5%) 13.05 MiB (1%) 58373
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 26.567 s (5%) 24.05 MiB (1%) 109165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 299.845 ms (5%) 51.837 ms 331.41 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.560 ms (5%) 19.11 MiB (1%) 130323
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 654.720 μs (5%) 1.20 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 42.592 ms (5%) 69.88 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.175 ms (5%) 4.06 MiB (1%) 38065
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 114.052 μs (5%) 261.11 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.846 s (5%) 493.383 ms 3.70 GiB (1%) 24822861
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 88.236 ms (5%) 4.913 ms 144.95 MiB (1%) 932884
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.353 μs (5%) 45.16 KiB (1%) 375
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 315.769 μs (5%) 562.30 KiB (1%) 2906
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.136 ms (5%) 2.10 MiB (1%) 7495
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.086 ms (5%) 8.38 MiB (1%) 25061
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 34.387 ms (5%) 74.30 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.891 ms (5%) 4.30 MiB (1%) 23179
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 135.443 μs (5%) 283.38 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 10.457 ms (5%) 22.73 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 600.068 μs (5%) 1.34 MiB (1%) 10414
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 38.772 μs (5%) 86.97 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 641.424 ms (5%) 73.616 ms 1.03 GiB (1%) 4741977
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.261 ms (5%) 41.85 MiB (1%) 178762
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.771 μs (5%) 20.08 KiB (1%) 141
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 75.150 μs (5%) 175.00 KiB (1%) 523
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 217.115 μs (5%) 685.36 KiB (1%) 1199
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 549.214 μs (5%) 1.93 MiB (1%) 2994

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz      11418 s          0 s        716 s      38440 s          0 s
       #2  3254 MHz      13544 s          0 s        670 s      36359 s          0 s
       #3  2445 MHz      12250 s          0 s        690 s      37647 s          0 s
       #4  2445 MHz      13602 s          0 s        753 s      36222 s          0 s
  Memory: 15.606502532958984 GB (13510.98828125 MB free)
  Uptime: 5069.15 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@adrhill adrhill mentioned this pull request Jun 5, 2024
Closed
@adrhill
Copy link
Owner Author

adrhill commented Jun 5, 2024

#118 made me too curious about #80, so I've added the handful of missing lines in 13582fe.

@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 5, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 5 Jun 2024 - 21:56
    • Baseline: 5 Jun 2024 - 22:21
  • Package commits:
    • Target: fec530
    • Baseline: 178681
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 0.60 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 1.09 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 1.08 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.08 (5%) ❌ 1.01 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 1.09 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 1.09 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.04 (5%) 0.98 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.99 (5%) 0.98 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 1.00 (5%) 0.98 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 0.86 (5%) ✅ 0.88 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 0.97 (5%) 0.88 (1%) ✅
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 0.93 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 1.13 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.20 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 1.19 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 1.30 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.26 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.21 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.18 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 1.09 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 0.94 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 1.11 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 0.95 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.09 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 1.06 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 1.08 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.99 (5%) 0.98 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.98 (5%) 0.98 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.98 (5%) 0.98 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 1.12 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 0.87 (5%) ✅ 0.88 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 0.95 (5%) 0.88 (1%) ✅
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 0.91 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 1.16 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.17 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 1.15 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 1.27 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.22 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.22 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 1.12 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3025 MHz       9798 s          0 s        503 s      25979 s          0 s
       #2  3243 MHz       9202 s          0 s        508 s      26556 s          0 s
       #3  3225 MHz       9929 s          0 s        544 s      25815 s          0 s
       #4  2595 MHz       7326 s          0 s        496 s      28453 s          0 s
  Memory: 15.606502532958984 GB (12942.97265625 MB free)
  Uptime: 3637.54 sec
  Load Avg:  1.07  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3261 MHz      13911 s          0 s        750 s      36544 s          0 s
       #2  3244 MHz      12231 s          0 s        745 s      38212 s          0 s
       #3  2604 MHz      14090 s          0 s        733 s      36391 s          0 s
       #4  3198 MHz      10549 s          0 s        698 s      39953 s          0 s
  Memory: 15.606502532958984 GB (13525.7109375 MB free)
  Uptime: 5132.66 sec
  Load Avg:  1.07  1.06  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 5 Jun 2024 - 21:56
  • Package commit: fec530
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.823 ms (5%) 67.96 MiB (1%) 107183
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.433 ms (5%) 5.786 ms 345.81 MiB (1%) 290793
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 537.756 ms (5%) 10.907 ms 770.37 MiB (1%) 529927
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.235 s (5%) 25.504 ms 1.58 GiB (1%) 960658
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.358 ms (5%) 3.577 ms 226.42 MiB (1%) 219645
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 641.674 ms (5%) 11.478 ms 815.77 MiB (1%) 446460
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 64.637 ms (5%) 1.533 ms 93.23 MiB (1%) 84768
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.201 ms (5%) 5.125 ms 347.58 MiB (1%) 170670
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.287 ms (5%) 11.91 MiB (1%) 23751
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.346 s (5%) 19.006 ms 1.64 GiB (1%) 354211
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.266 ms (5%) 39.55 MiB (1%) 41037
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.241 ms (5%) 1.401 ms 155.54 MiB (1%) 78597
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 486.541 ms (5%) 24.493 ms 1.16 GiB (1%) 811899
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 253.009 ms (5%) 9.044 ms 437.20 MiB (1%) 516424
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 651.428 ms (5%) 18.701 ms 960.84 MiB (1%) 1200859
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.891 s (5%) 67.981 ms 2.96 GiB (1%) 3604179
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.082 s (5%) 51.252 ms 2.48 GiB (1%) 1665930
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.532 s (5%) 116.276 ms 5.40 GiB (1%) 3373499
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 139.255 ms (5%) 4.642 ms 248.13 MiB (1%) 733377
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 441.931 ms (5%) 17.088 ms 675.64 MiB (1%) 1540930
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.311 ms (5%) 19.87 MiB (1%) 23204
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.719 s (5%) 48.695 ms 2.30 GiB (1%) 3150783
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.646 ms (5%) 47.71 MiB (1%) 65901
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 140.743 ms (5%) 3.204 ms 175.78 MiB (1%) 192859
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 382.236 ms (5%) 21.832 ms 763.34 MiB (1%) 739758
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 692.146 ms (5%) 23.328 ms 680.74 MiB (1%) 1000244
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.408 s (5%) 35.457 ms 1.23 GiB (1%) 2038285
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.030 s (5%) 81.329 ms 2.82 GiB (1%) 4584270
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 924.182 ms (5%) 47.909 ms 1.60 GiB (1%) 1504670
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.475 s (5%) 104.425 ms 3.70 GiB (1%) 3052381
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 162.136 ms (5%) 7.252 ms 328.17 MiB (1%) 1001699
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 500.001 ms (5%) 23.242 ms 837.17 MiB (1%) 2075392
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 22.407 ms (5%) 39.27 MiB (1%) 83324
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.907 s (5%) 61.344 ms 2.64 GiB (1%) 4231900
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 63.496 ms (5%) 82.69 MiB (1%) 164997
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 202.834 ms (5%) 5.350 ms 211.31 MiB (1%) 375949
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.483 ms (5%) 73.11 MiB (1%) 129037
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.661 ms (5%) 5.721 ms 380.79 MiB (1%) 319663
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 577.054 ms (5%) 13.201 ms 803.65 MiB (1%) 572503
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.282 s (5%) 27.553 ms 1.62 GiB (1%) 1040234
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 180.072 ms (5%) 4.362 ms 236.85 MiB (1%) 259237
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 665.768 ms (5%) 14.761 ms 839.52 MiB (1%) 519951
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.760 ms (5%) 1.684 ms 97.03 MiB (1%) 86666
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 276.578 ms (5%) 5.704 ms 353.42 MiB (1%) 174431
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.841 ms (5%) 14.36 MiB (1%) 25817
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.355 s (5%) 21.357 ms 1.63 GiB (1%) 348463
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.848 ms (5%) 43.14 MiB (1%) 40944
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.346 ms (5%) 1.657 ms 160.28 MiB (1%) 74089
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.579 ms (5%) 65.75 MiB (1%) 85274
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.395 ms (5%) 5.704 ms 342.37 MiB (1%) 221244
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 535.700 ms (5%) 10.754 ms 753.99 MiB (1%) 400359
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.222 s (5%) 24.025 ms 1.55 GiB (1%) 730141
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.543 ms (5%) 3.429 ms 221.81 MiB (1%) 171192
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 636.996 ms (5%) 11.266 ms 805.58 MiB (1%) 343126
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.120 ms (5%) 1.467 ms 90.37 MiB (1%) 50329
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 263.944 ms (5%) 5.163 ms 338.59 MiB (1%) 101271
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.556 ms (5%) 13.37 MiB (1%) 17438
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.331 s (5%) 18.993 ms 1.62 GiB (1%) 202179
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.129 ms (5%) 39.32 MiB (1%) 28445
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.997 ms (5%) 1.290 ms 154.35 MiB (1%) 53443
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.936 ms (5%) 67.97 MiB (1%) 107184
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.741 ms (5%) 5.659 ms 345.95 MiB (1%) 290795
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 538.999 ms (5%) 9.985 ms 770.52 MiB (1%) 529929
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.234 s (5%) 22.635 ms 1.59 GiB (1%) 960660
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.039 ms (5%) 3.435 ms 226.44 MiB (1%) 219646
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 642.865 ms (5%) 11.617 ms 815.81 MiB (1%) 446462
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 66.021 ms (5%) 1.530 ms 96.69 MiB (1%) 84981
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 272.992 ms (5%) 5.075 ms 350.38 MiB (1%) 171331
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.654 ms (5%) 14.28 MiB (1%) 24620
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.355 s (5%) 19.491 ms 1.63 GiB (1%) 354399
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.693 ms (5%) 40.69 MiB (1%) 41824
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.920 ms (5%) 1.386 ms 156.99 MiB (1%) 79354
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 484.756 ms (5%) 23.545 ms 1.16 GiB (1%) 811900
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 252.589 ms (5%) 8.870 ms 437.35 MiB (1%) 516426
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 650.615 ms (5%) 17.778 ms 960.99 MiB (1%) 1200861
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.896 s (5%) 63.714 ms 2.96 GiB (1%) 3604181
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.078 s (5%) 50.377 ms 2.48 GiB (1%) 1665931
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.525 s (5%) 113.686 ms 5.40 GiB (1%) 3373501
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 143.508 ms (5%) 6.960 ms 248.69 MiB (1%) 738523
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 442.733 ms (5%) 17.696 ms 684.24 MiB (1%) 1540458
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.952 ms (5%) 17.09 MiB (1%) 23680
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.700 s (5%) 48.191 ms 2.28 GiB (1%) 3139561
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.158 ms (5%) 50.05 MiB (1%) 66656
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 141.008 ms (5%) 3.326 ms 176.75 MiB (1%) 193509
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 379.990 ms (5%) 22.475 ms 763.35 MiB (1%) 739759
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 687.294 ms (5%) 20.101 ms 680.89 MiB (1%) 1000246
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.396 s (5%) 35.565 ms 1.23 GiB (1%) 2038287
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.010 s (5%) 76.302 ms 2.82 GiB (1%) 4584272
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 923.429 ms (5%) 44.187 ms 1.60 GiB (1%) 1504671
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.455 s (5%) 97.561 ms 3.70 GiB (1%) 3052383
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 161.473 ms (5%) 7.084 ms 325.56 MiB (1%) 995929
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 500.032 ms (5%) 22.939 ms 831.97 MiB (1%) 2084019
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 20.667 ms (5%) 31.37 MiB (1%) 79189
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.910 s (5%) 59.327 ms 2.64 GiB (1%) 4240003
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 65.964 ms (5%) 87.98 MiB (1%) 170117
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 203.908 ms (5%) 4.927 ms 215.32 MiB (1%) 376394
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.273 ms (5%) 73.12 MiB (1%) 129038
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 228.011 ms (5%) 5.561 ms 380.94 MiB (1%) 319665
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 576.380 ms (5%) 12.645 ms 803.80 MiB (1%) 572505
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.280 s (5%) 28.634 ms 1.62 GiB (1%) 1040236
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.277 ms (5%) 4.028 ms 236.87 MiB (1%) 259238
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 664.676 ms (5%) 14.355 ms 839.56 MiB (1%) 519953
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 69.076 ms (5%) 1.548 ms 101.76 MiB (1%) 87138
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 281.181 ms (5%) 5.457 ms 357.19 MiB (1%) 174820
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.965 ms (5%) 15.13 MiB (1%) 26513
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.369 s (5%) 19.540 ms 1.65 GiB (1%) 350105
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.572 ms (5%) 46.98 MiB (1%) 42175
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.804 ms (5%) 1.471 ms 160.92 MiB (1%) 74738
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.505 ms (5%) 65.76 MiB (1%) 85275
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.463 ms (5%) 5.701 ms 342.52 MiB (1%) 221246
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.500 ms (5%) 11.295 ms 754.13 MiB (1%) 400361
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.221 s (5%) 21.489 ms 1.55 GiB (1%) 730143
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.808 ms (5%) 3.409 ms 221.83 MiB (1%) 171193
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 636.984 ms (5%) 11.102 ms 805.62 MiB (1%) 343128
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.901 ms (5%) 1.342 ms 92.23 MiB (1%) 50592
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 264.447 ms (5%) 4.879 ms 337.54 MiB (1%) 101410
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.584 ms (5%) 12.88 MiB (1%) 18085
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.343 s (5%) 17.944 ms 1.62 GiB (1%) 203101
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.518 ms (5%) 41.13 MiB (1%) 29286
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.434 ms (5%) 1.271 ms 155.48 MiB (1%) 54289
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 216.142 ms (5%) 47.364 ms 744.28 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.720 ms (5%) 5.88 MiB (1%) 60508
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 152.025 μs (5%) 260.31 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 47.674 ms (5%) 5.876 ms 146.28 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.042 ms (5%) 2.12 MiB (1%) 23420
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 57.377 μs (5%) 105.88 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.257 s (5%) 772.882 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 20.114 ms (5%) 63.39 MiB (1%) 416700
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.885 μs (5%) 19.62 KiB (1%) 203
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 80.912 μs (5%) 143.44 KiB (1%) 995
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 144.180 μs (5%) 295.50 KiB (1%) 2109
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 286.337 μs (5%) 536.62 KiB (1%) 5951
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 633.648 ms (5%) 59.514 ms 722.26 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.728 ms (5%) 42.04 MiB (1%) 288505
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.794 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 93.636 ms (5%) 5.538 ms 97.50 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.901 ms (5%) 5.67 MiB (1%) 55707
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 308.038 μs (5%) 369.56 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.674 s (5%) 86.089 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 56.653 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.740 μs (5%) 12.75 KiB (1%) 91
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.217 ms (5%) 3.29 MiB (1%) 16129
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.692 ms (5%) 13.02 MiB (1%) 38358
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.334 ms (5%) 24.22 MiB (1%) 66923
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.586 s (5%) 78.067 ms 819.95 MiB (1%) 7360293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.524 ms (5%) 47.64 MiB (1%) 424081
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.686 ms (5%) 2.99 MiB (1%) 26621
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 178.469 ms (5%) 22.368 ms 216.52 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.134 ms (5%) 12.50 MiB (1%) 137136
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 410.611 μs (5%) 801.44 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 19.658 s (5%) 2.239 s 16.32 GiB (1%) 87887525
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 620.490 ms (5%) 42.643 ms 614.86 MiB (1%) 3271144
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 18.094 μs (5%) 63.64 KiB (1%) 728
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 5.060 ms (5%) 3.40 MiB (1%) 21472
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 191.539 ms (5%) 12.82 MiB (1%) 56894
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 22.875 s (5%) 23.21 MiB (1%) 105257
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 293.862 ms (5%) 57.973 ms 331.11 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.487 ms (5%) 19.09 MiB (1%) 130321
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 653.476 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 42.756 ms (5%) 69.42 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.172 ms (5%) 4.03 MiB (1%) 38062
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 115.336 μs (5%) 259.14 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.648 s (5%) 298.441 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 91.827 ms (5%) 6.378 ms 144.46 MiB (1%) 928266
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.460 μs (5%) 38.44 KiB (1%) 349
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 248.596 μs (5%) 490.30 KiB (1%) 2616
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.182 ms (5%) 2.14 MiB (1%) 7681
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.093 ms (5%) 8.31 MiB (1%) 24650
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 39.073 ms (5%) 74.00 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 2.139 ms (5%) 4.28 MiB (1%) 23177
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 151.840 μs (5%) 282.06 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 13.058 ms (5%) 22.27 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 724.540 μs (5%) 1.31 MiB (1%) 10411
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 45.696 μs (5%) 85.00 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 684.564 ms (5%) 63.762 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 20.427 ms (5%) 41.72 MiB (1%) 177600
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.937 μs (5%) 14.11 KiB (1%) 127
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 81.113 μs (5%) 166.73 KiB (1%) 493
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 225.684 μs (5%) 651.27 KiB (1%) 1124
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 606.851 μs (5%) 1.96 MiB (1%) 3032
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 208.244 ms (5%) 48.470 ms 745.96 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.780 ms (5%) 5.98 MiB (1%) 60512
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 157.605 μs (5%) 266.58 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 47.024 ms (5%) 147.35 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.076 ms (5%) 2.18 MiB (1%) 23425
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 58.339 μs (5%) 110.06 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.369 s (5%) 400.888 ms 18.62 GiB (1%) 11525819
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.962 ms (5%) 63.51 MiB (1%) 416711
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.737 μs (5%) 29.25 KiB (1%) 213
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 68.127 μs (5%) 135.88 KiB (1%) 815
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 151.905 μs (5%) 313.39 KiB (1%) 2249
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 292.909 μs (5%) 544.39 KiB (1%) 5931
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 648.455 ms (5%) 65.537 ms 723.94 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.359 ms (5%) 42.14 MiB (1%) 288509
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.782 ms (5%) 2.65 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.738 ms (5%) 5.388 ms 98.56 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.908 ms (5%) 5.74 MiB (1%) 55712
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 308.819 μs (5%) 373.75 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.672 s (5%) 64.888 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 57.348 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.007 μs (5%) 22.45 KiB (1%) 102
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.633 ms (5%) 2.09 MiB (1%) 12917
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.511 ms (5%) 13.07 MiB (1%) 38389
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.370 ms (5%) 24.62 MiB (1%) 68014
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.586 s (5%) 85.645 ms 821.63 MiB (1%) 7360297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.081 ms (5%) 47.74 MiB (1%) 424085
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.686 ms (5%) 2.99 MiB (1%) 26623
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 178.380 ms (5%) 23.899 ms 217.59 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.099 ms (5%) 12.56 MiB (1%) 137141
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 408.195 μs (5%) 805.62 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 19.910 s (5%) 2.276 s 16.33 GiB (1%) 87887537
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 621.776 ms (5%) 44.630 ms 614.97 MiB (1%) 3271155
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 21.501 μs (5%) 78.16 KiB (1%) 788
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 4.106 ms (5%) 3.17 MiB (1%) 19220
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 221.232 ms (5%) 12.11 MiB (1%) 56433
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 23.331 s (5%) 28.40 MiB (1%) 115498
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 303.298 ms (5%) 57.687 ms 332.79 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.557 ms (5%) 19.19 MiB (1%) 130325
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 653.616 μs (5%) 1.21 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.481 ms (5%) 70.49 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.162 ms (5%) 4.09 MiB (1%) 38067
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 114.795 μs (5%) 263.33 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.646 s (5%) 297.960 ms 3.69 GiB (1%) 24699853
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 90.395 ms (5%) 5.933 ms 144.58 MiB (1%) 928277
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.060 μs (5%) 45.86 KiB (1%) 337
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 263.725 μs (5%) 515.38 KiB (1%) 2707
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.305 ms (5%) 2.40 MiB (1%) 8218
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.138 ms (5%) 8.42 MiB (1%) 24975
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 39.445 ms (5%) 75.68 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 2.183 ms (5%) 4.38 MiB (1%) 23181
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 153.768 μs (5%) 288.33 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 13.370 ms (5%) 23.34 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 741.053 μs (5%) 1.38 MiB (1%) 10416
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 47.559 μs (5%) 89.19 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 714.307 ms (5%) 75.888 ms 1.03 GiB (1%) 4711225
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 20.482 ms (5%) 41.84 MiB (1%) 177611
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.142 μs (5%) 25.42 KiB (1%) 150
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 79.078 μs (5%) 169.64 KiB (1%) 474
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 227.747 μs (5%) 662.08 KiB (1%) 1152
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 595.106 μs (5%) 1.93 MiB (1%) 2969

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3025 MHz       9798 s          0 s        503 s      25979 s          0 s
       #2  3243 MHz       9202 s          0 s        508 s      26556 s          0 s
       #3  3225 MHz       9929 s          0 s        544 s      25815 s          0 s
       #4  2595 MHz       7326 s          0 s        496 s      28453 s          0 s
  Memory: 15.606502532958984 GB (12942.97265625 MB free)
  Uptime: 3637.54 sec
  Load Avg:  1.07  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 5 Jun 2024 - 22:21
  • Package commit: 178681
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.834 ms (5%) 68.07 MiB (1%) 107996
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.762 ms (5%) 5.614 ms 347.44 MiB (1%) 303603
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.837 ms (5%) 11.141 ms 772.01 MiB (1%) 542740
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.236 s (5%) 22.960 ms 1.59 GiB (1%) 973471
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.797 ms (5%) 3.237 ms 226.63 MiB (1%) 221258
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 644.433 ms (5%) 13.232 ms 816.18 MiB (1%) 449672
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.007 ms (5%) 1.506 ms 94.94 MiB (1%) 84568
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 271.136 ms (5%) 5.562 ms 348.29 MiB (1%) 170795
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.247 ms (5%) 11.05 MiB (1%) 23688
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.346 s (5%) 21.850 ms 1.62 GiB (1%) 352600
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.168 ms (5%) 39.36 MiB (1%) 40976
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.443 ms (5%) 2.398 ms 155.48 MiB (1%) 78586
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 512.721 ms (5%) 27.866 ms 1.16 GiB (1%) 812709
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 252.320 ms (5%) 9.356 ms 438.84 MiB (1%) 529231
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 648.286 ms (5%) 19.076 ms 962.48 MiB (1%) 1213669
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.884 s (5%) 63.635 ms 2.97 GiB (1%) 3616989
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.138 s (5%) 58.484 ms 2.48 GiB (1%) 1667540
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.622 s (5%) 125.477 ms 5.40 GiB (1%) 3376708
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 142.133 ms (5%) 6.427 ms 247.21 MiB (1%) 737869
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 443.010 ms (5%) 17.441 ms 681.03 MiB (1%) 1535581
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.925 ms (5%) 16.53 MiB (1%) 22871
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.714 s (5%) 53.562 ms 2.29 GiB (1%) 3141747
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.929 ms (5%) 49.09 MiB (1%) 65971
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 140.746 ms (5%) 3.249 ms 176.24 MiB (1%) 193051
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 390.415 ms (5%) 22.484 ms 763.54 MiB (1%) 741594
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 697.169 ms (5%) 22.865 ms 683.80 MiB (1%) 1029077
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.417 s (5%) 39.907 ms 1.24 GiB (1%) 2067121
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.062 s (5%) 88.678 ms 2.82 GiB (1%) 4613106
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 948.312 ms (5%) 52.774 ms 1.60 GiB (1%) 1508306
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.520 s (5%) 115.043 ms 3.70 GiB (1%) 3059616
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 163.435 ms (5%) 9.646 ms 321.65 MiB (1%) 996746
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 503.213 ms (5%) 23.259 ms 837.34 MiB (1%) 2084551
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 23.602 ms (5%) 41.60 MiB (1%) 84933
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.926 s (5%) 65.204 ms 2.64 GiB (1%) 4243294
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 59.158 ms (5%) 68.72 MiB (1%) 161498
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 208.884 ms (5%) 7.206 ms 224.50 MiB (1%) 382806
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.265 ms (5%) 73.22 MiB (1%) 129848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 229.718 ms (5%) 6.469 ms 382.43 MiB (1%) 332471
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 575.451 ms (5%) 12.954 ms 805.29 MiB (1%) 585314
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.283 s (5%) 28.688 ms 1.62 GiB (1%) 1053045
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.758 ms (5%) 4.440 ms 237.06 MiB (1%) 260848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 665.383 ms (5%) 15.247 ms 839.93 MiB (1%) 523161
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.766 ms (5%) 1.646 ms 98.53 MiB (1%) 86589
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 279.090 ms (5%) 6.067 ms 360.58 MiB (1%) 174852
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.301 ms (5%) 16.73 MiB (1%) 26174
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.369 s (5%) 23.853 ms 1.65 GiB (1%) 349322
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.685 ms (5%) 43.77 MiB (1%) 40918
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.359 ms (5%) 1.383 ms 159.31 MiB (1%) 73884
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.282 ms (5%) 65.86 MiB (1%) 86084
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 199.031 ms (5%) 6.008 ms 344.01 MiB (1%) 234051
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.260 ms (5%) 12.032 ms 755.62 MiB (1%) 413169
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.223 s (5%) 25.122 ms 1.55 GiB (1%) 742951
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 167.948 ms (5%) 3.560 ms 222.02 MiB (1%) 172802
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 637.089 ms (5%) 12.932 ms 805.99 MiB (1%) 346335
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.431 ms (5%) 1.481 ms 94.15 MiB (1%) 50769
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 263.375 ms (5%) 5.234 ms 339.34 MiB (1%) 101243
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.060 ms (5%) 17.32 MiB (1%) 17764
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.326 s (5%) 20.120 ms 1.61 GiB (1%) 202487
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 21.992 ms (5%) 39.42 MiB (1%) 28477
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.453 ms (5%) 1.406 ms 154.43 MiB (1%) 53422
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.688 ms (5%) 67.92 MiB (1%) 101597
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.021 ms (5%) 5.349 ms 347.22 MiB (1%) 290805
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.093 ms (5%) 11.119 ms 771.50 MiB (1%) 517142
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.233 s (5%) 23.164 ms 1.59 GiB (1%) 922273
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.993 ms (5%) 3.559 ms 226.35 MiB (1%) 208459
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 643.382 ms (5%) 13.390 ms 815.61 MiB (1%) 424074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.150 ms (5%) 1.581 ms 93.73 MiB (1%) 84507
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.625 ms (5%) 5.461 ms 350.60 MiB (1%) 170819
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.569 ms (5%) 12.58 MiB (1%) 23699
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.352 s (5%) 20.634 ms 1.64 GiB (1%) 354276
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.674 ms (5%) 41.15 MiB (1%) 41074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.139 ms (5%) 1.262 ms 155.89 MiB (1%) 78616
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 510.962 ms (5%) 27.249 ms 1.16 GiB (1%) 812710
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 252.918 ms (5%) 9.655 ms 438.91 MiB (1%) 529233
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 648.917 ms (5%) 20.056 ms 962.55 MiB (1%) 1213671
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.901 s (5%) 68.713 ms 2.97 GiB (1%) 3616991
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.140 s (5%) 59.865 ms 2.48 GiB (1%) 1667541
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.652 s (5%) 128.246 ms 5.40 GiB (1%) 3376710
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 142.578 ms (5%) 7.674 ms 245.23 MiB (1%) 735074
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 448.096 ms (5%) 19.070 ms 680.97 MiB (1%) 1540620
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.343 ms (5%) 17.67 MiB (1%) 23726
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.724 s (5%) 54.201 ms 2.29 GiB (1%) 3151808
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.778 ms (5%) 48.84 MiB (1%) 66579
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 141.534 ms (5%) 3.627 ms 176.89 MiB (1%) 193721
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 394.093 ms (5%) 25.229 ms 763.54 MiB (1%) 741595
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 701.763 ms (5%) 19.561 ms 683.87 MiB (1%) 1029079
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.418 s (5%) 35.312 ms 1.24 GiB (1%) 2067123
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.063 s (5%) 89.077 ms 2.82 GiB (1%) 4613108
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 953.270 ms (5%) 52.276 ms 1.60 GiB (1%) 1508307
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.532 s (5%) 118.210 ms 3.70 GiB (1%) 3059618
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 165.944 ms (5%) 10.325 ms 324.52 MiB (1%) 1002985
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 501.461 ms (5%) 24.302 ms 829.50 MiB (1%) 2071454
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 21.727 ms (5%) 34.40 MiB (1%) 80097
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.933 s (5%) 68.246 ms 2.63 GiB (1%) 4239491
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 63.208 ms (5%) 80.40 MiB (1%) 164253
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 213.636 ms (5%) 7.631 ms 232.33 MiB (1%) 384779
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.193 ms (5%) 73.22 MiB (1%) 129849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 228.791 ms (5%) 7.562 ms 382.50 MiB (1%) 332473
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 575.793 ms (5%) 13.239 ms 805.37 MiB (1%) 585316
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.281 s (5%) 32.419 ms 1.62 GiB (1%) 1053047
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.282 ms (5%) 4.152 ms 237.07 MiB (1%) 260849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 666.763 ms (5%) 15.867 ms 839.95 MiB (1%) 523163
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 69.861 ms (5%) 1.752 ms 105.76 MiB (1%) 87561
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 276.359 ms (5%) 6.201 ms 350.98 MiB (1%) 174537
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.644 ms (5%) 18.32 MiB (1%) 27061
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.366 s (5%) 23.205 ms 1.64 GiB (1%) 349521
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.155 ms (5%) 44.68 MiB (1%) 41787
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.199 ms (5%) 1.636 ms 160.81 MiB (1%) 74672
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.237 ms (5%) 65.86 MiB (1%) 86085
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 200.624 ms (5%) 6.246 ms 344.08 MiB (1%) 234053
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 532.657 ms (5%) 10.714 ms 755.70 MiB (1%) 413171
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.217 s (5%) 23.298 ms 1.55 GiB (1%) 742953
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 167.939 ms (5%) 3.427 ms 222.03 MiB (1%) 172803
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 637.957 ms (5%) 13.257 ms 806.01 MiB (1%) 346337
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 60.935 ms (5%) 1.463 ms 89.50 MiB (1%) 50315
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 261.451 ms (5%) 5.075 ms 336.75 MiB (1%) 101314
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.798 ms (5%) 13.80 MiB (1%) 18156
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.326 s (5%) 18.832 ms 1.61 GiB (1%) 202507
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.497 ms (5%) 41.15 MiB (1%) 29279
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 125.846 ms (5%) 1.249 ms 154.78 MiB (1%) 54218
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 363.224 ms (5%) 188.138 ms 743.21 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.498 ms (5%) 5.82 MiB (1%) 60501
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 140.584 μs (5%) 256.38 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 49.086 ms (5%) 12.134 ms 145.98 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 963.537 μs (5%) 2.10 MiB (1%) 23418
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 52.488 μs (5%) 104.75 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.238 s (5%) 716.169 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 19.670 ms (5%) 1.853 ms 63.36 MiB (1%) 416698
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.581 μs (5%) 15.06 KiB (1%) 187
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 64.310 μs (5%) 128.00 KiB (1%) 855
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 138.120 μs (5%) 304.14 KiB (1%) 2289
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 259.106 μs (5%) 532.02 KiB (1%) 5921
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 580.258 ms (5%) 46.671 ms 721.19 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.638 ms (5%) 41.98 MiB (1%) 288498
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.755 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.267 ms (5%) 5.997 ms 97.19 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.857 ms (5%) 5.66 MiB (1%) 55705
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 305.322 μs (5%) 368.44 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.639 s (5%) 49.083 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 58.214 ms (5%) 41.54 MiB (1%) 175246
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.188 μs (5%) 8.02 KiB (1%) 74
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.565 ms (5%) 1.98 MiB (1%) 12312
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.434 ms (5%) 13.10 MiB (1%) 38418
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.118 ms (5%) 24.56 MiB (1%) 67719
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.529 s (5%) 70.023 ms 836.59 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 78.249 ms (5%) 48.60 MiB (1%) 435594
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.697 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 160.421 ms (5%) 22.344 ms 216.21 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.039 ms (5%) 12.49 MiB (1%) 137134
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 395.552 μs (5%) 800.31 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 22.731 s (5%) 2.401 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 642.680 ms (5%) 43.380 ms 697.77 MiB (1%) 4174856
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 32.170 μs (5%) 113.12 KiB (1%) 1297
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 6.004 ms (5%) 4.05 MiB (1%) 24784
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 167.946 ms (5%) 14.15 MiB (1%) 59952
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 20.972 s (5%) 28.15 MiB (1%) 111163
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 292.400 ms (5%) 63.804 ms 330.04 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.426 ms (5%) 19.03 MiB (1%) 130314
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 644.359 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 43.713 ms (5%) 69.12 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.160 ms (5%) 4.01 MiB (1%) 38060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 112.852 μs (5%) 258.02 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.843 s (5%) 472.636 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 86.600 ms (5%) 4.154 ms 144.42 MiB (1%) 928264
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.149 μs (5%) 34.16 KiB (1%) 333
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 237.095 μs (5%) 465.01 KiB (1%) 2521
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.272 ms (5%) 2.41 MiB (1%) 8311
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.205 ms (5%) 8.43 MiB (1%) 24927
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 34.469 ms (5%) 72.93 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.779 ms (5%) 4.22 MiB (1%) 23170
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 127.139 μs (5%) 278.12 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 10.032 ms (5%) 21.97 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 577.192 μs (5%) 1.30 MiB (1%) 10409
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 37.801 μs (5%) 83.88 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 581.308 ms (5%) 50.358 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 18.817 ms (5%) 41.69 MiB (1%) 177598
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.628 μs (5%) 11.45 KiB (1%) 128
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 78.888 μs (5%) 177.73 KiB (1%) 529
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 202.149 μs (5%) 643.27 KiB (1%) 1137
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 537.838 μs (5%) 1.96 MiB (1%) 3043
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 221.141 ms (5%) 47.598 ms 744.59 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.590 ms (5%) 5.90 MiB (1%) 60510
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 142.607 μs (5%) 261.62 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 49.714 ms (5%) 5.746 ms 146.74 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 990.116 μs (5%) 2.14 MiB (1%) 23423
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 55.073 μs (5%) 107.84 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.202 s (5%) 581.813 ms 18.62 GiB (1%) 11587323
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.656 ms (5%) 63.59 MiB (1%) 419014
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.434 μs (5%) 25.42 KiB (1%) 215
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 67.266 μs (5%) 136.42 KiB (1%) 865
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 141.034 μs (5%) 306.19 KiB (1%) 2199
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 271.669 μs (5%) 551.69 KiB (1%) 6111
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 611.998 ms (5%) 51.583 ms 722.56 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.916 ms (5%) 42.06 MiB (1%) 288507
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.788 ms (5%) 2.64 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.511 ms (5%) 5.485 ms 97.95 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.909 ms (5%) 5.70 MiB (1%) 55710
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 308.479 μs (5%) 371.53 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.694 s (5%) 75.934 ms 1.02 GiB (1%) 4692825
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 58.829 ms (5%) 41.70 MiB (1%) 176410
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.771 μs (5%) 18.08 KiB (1%) 97
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.574 ms (5%) 2.23 MiB (1%) 12174
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.585 ms (5%) 13.02 MiB (1%) 38258
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.220 ms (5%) 24.35 MiB (1%) 67223
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.595 s (5%) 82.488 ms 837.96 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 78.554 ms (5%) 48.68 MiB (1%) 435603
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.764 ms (5%) 3.05 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 159.599 ms (5%) 17.466 ms 216.97 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.169 ms (5%) 12.53 MiB (1%) 137139
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 410.620 μs (5%) 803.41 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 22.939 s (5%) 2.480 s 18.50 GiB (1%) 112202347
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 654.008 ms (5%) 41.451 ms 698.35 MiB (1%) 4181780
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 37.561 μs (5%) 129.77 KiB (1%) 1406
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 9.092 ms (5%) 6.62 MiB (1%) 31521
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 205.955 ms (5%) 12.46 MiB (1%) 57787
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 24.568 s (5%) 7.341 ms 31.46 MiB (1%) 123067
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 308.516 ms (5%) 54.902 ms 331.41 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.485 ms (5%) 19.11 MiB (1%) 130323
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 652.265 μs (5%) 1.20 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.486 ms (5%) 69.88 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.201 ms (5%) 4.06 MiB (1%) 38065
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 114.926 μs (5%) 261.11 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.896 s (5%) 519.112 ms 3.70 GiB (1%) 24822861
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 88.930 ms (5%) 5.045 ms 144.95 MiB (1%) 932884
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.912 μs (5%) 43.50 KiB (1%) 353
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 249.618 μs (5%) 487.49 KiB (1%) 2609
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.316 ms (5%) 2.44 MiB (1%) 8437
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.998 ms (5%) 8.02 MiB (1%) 23970
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 34.041 ms (5%) 74.30 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.871 ms (5%) 4.30 MiB (1%) 23179
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 133.561 μs (5%) 283.38 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 10.527 ms (5%) 22.73 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 606.738 μs (5%) 1.34 MiB (1%) 10414
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 39.083 μs (5%) 86.97 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 638.495 ms (5%) 76.843 ms 1.03 GiB (1%) 4741977
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.353 ms (5%) 41.85 MiB (1%) 178762
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.731 μs (5%) 20.00 KiB (1%) 140
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 66.394 μs (5%) 161.19 KiB (1%) 489
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 211.898 μs (5%) 674.75 KiB (1%) 1168
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 574.578 μs (5%) 2.01 MiB (1%) 3115

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3261 MHz      13911 s          0 s        750 s      36544 s          0 s
       #2  3244 MHz      12231 s          0 s        745 s      38212 s          0 s
       #3  2604 MHz      14090 s          0 s        733 s      36391 s          0 s
       #4  3198 MHz      10549 s          0 s        698 s      39953 s          0 s
  Memory: 15.606502532958984 GB (13525.7109375 MB free)
  Uptime: 5132.66 sec
  Load Avg:  1.07  1.06  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 6, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 6 Jun 2024 - 09:17
    • Baseline: 6 Jun 2024 - 09:41
  • Package commits:
    • Target: ac7e33
    • Baseline: 178681
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 0.52 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 1.08 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 0.92 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 1.06 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.74 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.62 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.61 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.67 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.70 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.69 (5%) ✅ 0.75 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 0.68 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 0.63 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.71 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.70 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.72 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.52 (5%) ✅ 0.41 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.49 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.51 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 0.53 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 0.59 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 1.13 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 1.05 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 0.92 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 1.09 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.15 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 1.13 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 1.18 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.18 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.19 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.25 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 1.08 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 1.10 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 1.05 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 1.21 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 1.09 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.74 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.63 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.62 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.66 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.69 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.68 (5%) ✅ 0.76 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 0.69 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 0.65 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.69 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.71 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.72 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.49 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 0.54 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 0.59 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 1.12 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 1.13 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.12 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 1.11 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 1.17 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.15 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.15 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 1.14 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3262 MHz       9226 s          0 s        455 s      24258 s          0 s
       #2  3242 MHz       9021 s          0 s        469 s      24449 s          0 s
       #3  2445 MHz       9030 s          0 s        465 s      24431 s          0 s
       #4  2445 MHz       7269 s          0 s        443 s      26222 s          0 s
  Memory: 15.606502532958984 GB (13573.4140625 MB free)
  Uptime: 3402.37 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz      12664 s          0 s        646 s      35372 s          0 s
       #2  2594 MHz      12799 s          0 s        680 s      35204 s          0 s
       #3  2445 MHz      12327 s          0 s        658 s      35685 s          0 s
       #4  3244 MHz      11095 s          0 s        634 s      36951 s          0 s
  Memory: 15.606502532958984 GB (13500.85546875 MB free)
  Uptime: 4879.37 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 6 Jun 2024 - 9:17
  • Package commit: ac7e33
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 47.055 ms (5%) 67.96 MiB (1%) 107183
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 199.474 ms (5%) 5.747 ms 345.81 MiB (1%) 290793
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 541.565 ms (5%) 11.787 ms 770.37 MiB (1%) 529927
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.231 s (5%) 21.369 ms 1.58 GiB (1%) 960658
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.355 ms (5%) 3.438 ms 226.42 MiB (1%) 219645
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 645.191 ms (5%) 12.024 ms 815.77 MiB (1%) 446460
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 66.037 ms (5%) 1.609 ms 96.25 MiB (1%) 84805
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.030 ms (5%) 4.293 ms 347.29 MiB (1%) 170597
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.491 ms (5%) 13.48 MiB (1%) 23870
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.367 s (5%) 19.451 ms 1.64 GiB (1%) 353699
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.149 ms (5%) 39.60 MiB (1%) 40961
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.494 ms (5%) 1.315 ms 155.87 MiB (1%) 78708
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 478.537 ms (5%) 21.897 ms 1.16 GiB (1%) 792458
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 210.585 ms (5%) 6.665 ms 420.94 MiB (1%) 450196
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 603.577 ms (5%) 16.734 ms 1000.56 MiB (1%) 1109569
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.836 s (5%) 65.788 ms 3.11 GiB (1%) 3452128
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.072 s (5%) 48.525 ms 2.50 GiB (1%) 1626489
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.480 s (5%) 100.326 ms 5.49 GiB (1%) 3293110
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 138.332 ms (5%) 4.788 ms 251.31 MiB (1%) 722315
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 435.472 ms (5%) 15.897 ms 677.67 MiB (1%) 1509283
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.243 ms (5%) 14.28 MiB (1%) 17036
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.695 s (5%) 47.580 ms 2.31 GiB (1%) 3076023
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.235 ms (5%) 45.47 MiB (1%) 56851
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 133.351 ms (5%) 1.658 ms 174.20 MiB (1%) 177684
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 345.145 ms (5%) 21.858 ms 751.93 MiB (1%) 634196
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 234.445 ms (5%) 8.629 ms 384.66 MiB (1%) 694752
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 632.150 ms (5%) 20.690 ms 949.87 MiB (1%) 1542194
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.687 s (5%) 62.149 ms 2.47 GiB (1%) 3693393
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 776.310 ms (5%) 42.088 ms 1.57 GiB (1%) 1289158
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.892 s (5%) 95.374 ms 3.58 GiB (1%) 2607447
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 147.016 ms (5%) 7.091 ms 321.08 MiB (1%) 959346
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 449.449 ms (5%) 20.084 ms 814.51 MiB (1%) 1983233
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.401 ms (5%) 14.39 MiB (1%) 58460
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.723 s (5%) 59.043 ms 2.57 GiB (1%) 4046528
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.859 ms (5%) 50.10 MiB (1%) 131295
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 145.465 ms (5%) 2.857 ms 184.84 MiB (1%) 327068
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.440 ms (5%) 73.11 MiB (1%) 129037
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 233.859 ms (5%) 9.468 ms 380.79 MiB (1%) 319663
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 578.222 ms (5%) 12.404 ms 803.65 MiB (1%) 572503
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.284 s (5%) 28.395 ms 1.62 GiB (1%) 1040234
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.682 ms (5%) 4.065 ms 236.85 MiB (1%) 259237
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 667.663 ms (5%) 14.176 ms 839.52 MiB (1%) 519951
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 69.215 ms (5%) 1.828 ms 100.60 MiB (1%) 86599
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 279.876 ms (5%) 4.777 ms 357.27 MiB (1%) 174531
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.104 ms (5%) 15.48 MiB (1%) 26134
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.357 s (5%) 19.789 ms 1.64 GiB (1%) 348102
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.324 ms (5%) 45.71 MiB (1%) 41483
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 133.288 ms (5%) 1.560 ms 159.59 MiB (1%) 73844
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.286 ms (5%) 65.75 MiB (1%) 85274
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.323 ms (5%) 5.533 ms 342.37 MiB (1%) 221244
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.023 ms (5%) 10.507 ms 753.99 MiB (1%) 400359
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.218 s (5%) 22.302 ms 1.55 GiB (1%) 730141
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.216 ms (5%) 3.310 ms 221.81 MiB (1%) 171192
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 635.479 ms (5%) 10.432 ms 805.58 MiB (1%) 343126
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.938 ms (5%) 1.466 ms 92.26 MiB (1%) 50403
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 263.566 ms (5%) 3.883 ms 341.10 MiB (1%) 101198
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.947 ms (5%) 16.66 MiB (1%) 17751
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.321 s (5%) 16.982 ms 1.60 GiB (1%) 202069
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.234 ms (5%) 39.77 MiB (1%) 28492
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.018 ms (5%) 1.360 ms 154.57 MiB (1%) 53468
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.926 ms (5%) 67.97 MiB (1%) 107184
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.531 ms (5%) 5.317 ms 345.95 MiB (1%) 290795
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 537.493 ms (5%) 9.763 ms 770.52 MiB (1%) 529929
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.231 s (5%) 22.399 ms 1.59 GiB (1%) 960660
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.081 ms (5%) 3.369 ms 226.44 MiB (1%) 219646
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 641.285 ms (5%) 11.090 ms 815.81 MiB (1%) 446462
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.466 ms (5%) 1.461 ms 95.62 MiB (1%) 84887
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 271.936 ms (5%) 3.743 ms 352.56 MiB (1%) 171555
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.395 ms (5%) 12.40 MiB (1%) 24440
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.374 s (5%) 19.696 ms 1.64 GiB (1%) 354919
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.678 ms (5%) 41.27 MiB (1%) 41770
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 129.737 ms (5%) 1.266 ms 156.87 MiB (1%) 79365
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 476.231 ms (5%) 21.377 ms 1.16 GiB (1%) 792459
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 210.576 ms (5%) 6.147 ms 421.08 MiB (1%) 450198
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 600.982 ms (5%) 15.557 ms 1000.71 MiB (1%) 1109571
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.825 s (5%) 60.299 ms 3.11 GiB (1%) 3452130
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.062 s (5%) 44.950 ms 2.50 GiB (1%) 1626490
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.469 s (5%) 98.614 ms 5.49 GiB (1%) 3293112
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 137.786 ms (5%) 4.889 ms 249.24 MiB (1%) 720464
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 434.527 ms (5%) 15.067 ms 676.95 MiB (1%) 1507109
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.613 ms (5%) 15.79 MiB (1%) 17854
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.703 s (5%) 46.044 ms 2.31 GiB (1%) 3075226
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.346 ms (5%) 46.21 MiB (1%) 57652
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 134.953 ms (5%) 1.637 ms 175.80 MiB (1%) 178252
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 342.314 ms (5%) 20.062 ms 751.94 MiB (1%) 634197
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 236.926 ms (5%) 12.993 ms 384.80 MiB (1%) 694754
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 640.434 ms (5%) 22.093 ms 950.01 MiB (1%) 1542196
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.691 s (5%) 63.281 ms 2.47 GiB (1%) 3693395
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 774.757 ms (5%) 42.069 ms 1.57 GiB (1%) 1289159
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.884 s (5%) 93.253 ms 3.58 GiB (1%) 2607449
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 150.732 ms (5%) 8.518 ms 315.21 MiB (1%) 953810
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 454.351 ms (5%) 20.384 ms 819.96 MiB (1%) 1991278
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.693 ms (5%) 16.19 MiB (1%) 59331
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.735 s (5%) 56.527 ms 2.58 GiB (1%) 4047720
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 28.401 ms (5%) 50.21 MiB (1%) 132002
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 147.454 ms (5%) 2.875 ms 185.53 MiB (1%) 327705
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.452 ms (5%) 73.12 MiB (1%) 129038
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.492 ms (5%) 5.349 ms 380.94 MiB (1%) 319665
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 576.556 ms (5%) 12.413 ms 803.80 MiB (1%) 572505
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.284 s (5%) 27.817 ms 1.62 GiB (1%) 1040236
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.771 ms (5%) 4.053 ms 236.87 MiB (1%) 259238
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 662.416 ms (5%) 12.946 ms 839.56 MiB (1%) 519953
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 69.472 ms (5%) 1.704 ms 104.09 MiB (1%) 87289
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 277.224 ms (5%) 4.398 ms 353.92 MiB (1%) 174756
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.194 ms (5%) 16.71 MiB (1%) 26602
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.366 s (5%) 19.073 ms 1.65 GiB (1%) 350149
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.870 ms (5%) 44.05 MiB (1%) 41679
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 134.060 ms (5%) 1.498 ms 160.94 MiB (1%) 74674
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.530 ms (5%) 65.76 MiB (1%) 85275
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.986 ms (5%) 5.513 ms 342.52 MiB (1%) 221246
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 533.937 ms (5%) 10.023 ms 754.13 MiB (1%) 400361
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.217 s (5%) 20.411 ms 1.55 GiB (1%) 730143
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.210 ms (5%) 3.268 ms 221.83 MiB (1%) 171193
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 635.220 ms (5%) 10.283 ms 805.62 MiB (1%) 343128
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.874 ms (5%) 1.385 ms 96.37 MiB (1%) 51138
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 263.563 ms (5%) 3.680 ms 335.50 MiB (1%) 101305
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.636 ms (5%) 13.76 MiB (1%) 18158
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.345 s (5%) 19.461 ms 1.62 GiB (1%) 202705
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.351 ms (5%) 41.32 MiB (1%) 29314
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.585 ms (5%) 1.341 ms 155.31 MiB (1%) 54199
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 176.985 ms (5%) 38.960 ms 744.28 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.610 ms (5%) 5.88 MiB (1%) 60508
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 145.243 μs (5%) 260.31 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 42.562 ms (5%) 146.28 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 978.363 μs (5%) 2.12 MiB (1%) 23420
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 53.060 μs (5%) 105.88 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.037 s (5%) 314.161 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 18.967 ms (5%) 63.39 MiB (1%) 416700
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.119 μs (5%) 18.67 KiB (1%) 201
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 71.164 μs (5%) 134.52 KiB (1%) 879
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 135.065 μs (5%) 292.25 KiB (1%) 2063
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 269.287 μs (5%) 535.12 KiB (1%) 5927
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 412.062 ms (5%) 42.047 ms 515.81 MiB (1%) 3040153
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.398 ms (5%) 30.12 MiB (1%) 175241
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.056 ms (5%) 1.89 MiB (1%) 11061
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 60.767 ms (5%) 74.61 MiB (1%) 720057
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.399 ms (5%) 4.33 MiB (1%) 41515
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 210.104 μs (5%) 277.94 KiB (1%) 2621
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.125 s (5%) 71.553 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 36.774 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.443 μs (5%) 12.73 KiB (1%) 91
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.398 ms (5%) 1.79 MiB (1%) 10521
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 5.910 ms (5%) 13.73 MiB (1%) 26202
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 175.787 ms (5%) 5.451 ms 903.90 MiB (1%) 29711
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.073 s (5%) 48.575 ms 444.58 MiB (1%) 3740275
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 54.087 ms (5%) 26.02 MiB (1%) 215569
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.370 ms (5%) 1.63 MiB (1%) 13589
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 79.408 ms (5%) 9.782 ms 89.56 MiB (1%) 980062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.422 ms (5%) 5.19 MiB (1%) 56496
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 202.051 μs (5%) 333.44 KiB (1%) 3562
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 11.985 s (5%) 1.375 s 10.11 GiB (1%) 46325551
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 364.595 ms (5%) 24.053 ms 380.61 MiB (1%) 1721554
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 15.980 μs (5%) 59.14 KiB (1%) 679
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 6.643 ms (5%) 3.18 MiB (1%) 18469
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 159.252 ms (5%) 8.16 MiB (1%) 35627
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 21.626 s (5%) 9.17 MiB (1%) 39976
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 311.891 ms (5%) 61.614 ms 331.11 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.759 ms (5%) 19.09 MiB (1%) 130321
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 662.656 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 43.349 ms (5%) 69.42 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.158 ms (5%) 4.03 MiB (1%) 38062
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 114.746 μs (5%) 259.14 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.646 s (5%) 308.752 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 91.142 ms (5%) 6.181 ms 144.46 MiB (1%) 928266
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.377 μs (5%) 35.44 KiB (1%) 323
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 329.029 μs (5%) 552.41 KiB (1%) 2841
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.239 ms (5%) 2.31 MiB (1%) 8008
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.996 ms (5%) 8.08 MiB (1%) 23963
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 36.037 ms (5%) 74.00 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 2.009 ms (5%) 4.28 MiB (1%) 23177
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 141.236 μs (5%) 282.06 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 11.703 ms (5%) 22.27 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 665.188 μs (5%) 1.31 MiB (1%) 10411
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 43.412 μs (5%) 85.00 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 692.421 ms (5%) 70.910 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.613 ms (5%) 41.72 MiB (1%) 177600
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.504 μs (5%) 15.00 KiB (1%) 138
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 72.637 μs (5%) 157.55 KiB (1%) 462
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 218.441 μs (5%) 653.30 KiB (1%) 1155
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 591.483 μs (5%) 1.99 MiB (1%) 3053
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 204.239 ms (5%) 46.177 ms 745.96 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.705 ms (5%) 5.98 MiB (1%) 60512
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 151.475 μs (5%) 266.58 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 46.477 ms (5%) 147.35 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.023 ms (5%) 2.18 MiB (1%) 23425
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 55.976 μs (5%) 110.06 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.436 s (5%) 842.706 ms 18.62 GiB (1%) 11525819
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 20.174 ms (5%) 63.51 MiB (1%) 416711
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.492 μs (5%) 27.81 KiB (1%) 203
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 77.034 μs (5%) 145.95 KiB (1%) 897
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 147.027 μs (5%) 308.02 KiB (1%) 2165
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 282.722 μs (5%) 546.77 KiB (1%) 5969
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 439.293 ms (5%) 50.052 ms 517.49 MiB (1%) 3040157
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.865 ms (5%) 30.22 MiB (1%) 175245
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.089 ms (5%) 1.90 MiB (1%) 11063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 61.163 ms (5%) 75.68 MiB (1%) 720063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.411 ms (5%) 4.39 MiB (1%) 41520
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 211.237 μs (5%) 282.12 KiB (1%) 2624
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.203 s (5%) 95.677 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 38.135 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.677 μs (5%) 22.12 KiB (1%) 98
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.190 ms (5%) 3.56 MiB (1%) 14771
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.117 ms (5%) 14.57 MiB (1%) 26758
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 153.450 ms (5%) 4.369 ms 755.53 MiB (1%) 29556
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.087 s (5%) 55.754 ms 446.26 MiB (1%) 3740279
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 54.624 ms (5%) 26.12 MiB (1%) 215573
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.386 ms (5%) 1.64 MiB (1%) 13591
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 81.328 ms (5%) 90.63 MiB (1%) 980068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.456 ms (5%) 5.25 MiB (1%) 56501
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 204.224 μs (5%) 337.62 KiB (1%) 3565
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 12.410 s (5%) 1.480 s 10.11 GiB (1%) 46325563
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 385.726 ms (5%) 26.982 ms 380.73 MiB (1%) 1721565
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 17.853 μs (5%) 68.94 KiB (1%) 692
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 6.118 ms (5%) 3.82 MiB (1%) 20579
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 203.844 ms (5%) 11.52 MiB (1%) 42262
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 20.343 s (5%) 10.63 MiB (1%) 42703
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 321.510 ms (5%) 61.369 ms 332.79 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.946 ms (5%) 19.19 MiB (1%) 130325
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 659.057 μs (5%) 1.21 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 44.465 ms (5%) 70.49 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.171 ms (5%) 4.09 MiB (1%) 38067
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 116.439 μs (5%) 263.33 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.651 s (5%) 285.542 ms 3.69 GiB (1%) 24699853
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 91.392 ms (5%) 6.595 ms 144.58 MiB (1%) 928277
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.772 μs (5%) 47.45 KiB (1%) 353
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 259.487 μs (5%) 521.62 KiB (1%) 2721
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.262 ms (5%) 2.38 MiB (1%) 8236
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.127 ms (5%) 8.38 MiB (1%) 24833
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 38.031 ms (5%) 75.68 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 2.060 ms (5%) 4.38 MiB (1%) 23181
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 146.866 μs (5%) 288.33 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 12.149 ms (5%) 23.34 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 681.079 μs (5%) 1.38 MiB (1%) 10416
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 44.764 μs (5%) 89.19 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 724.323 ms (5%) 82.086 ms 1.03 GiB (1%) 4711225
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 20.432 ms (5%) 41.84 MiB (1%) 177611
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.276 μs (5%) 25.42 KiB (1%) 150
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 73.288 μs (5%) 165.97 KiB (1%) 513
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 238.989 μs (5%) 696.88 KiB (1%) 1195
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 607.490 μs (5%) 1.93 MiB (1%) 2998

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3262 MHz       9226 s          0 s        455 s      24258 s          0 s
       #2  3242 MHz       9021 s          0 s        469 s      24449 s          0 s
       #3  2445 MHz       9030 s          0 s        465 s      24431 s          0 s
       #4  2445 MHz       7269 s          0 s        443 s      26222 s          0 s
  Memory: 15.606502532958984 GB (13573.4140625 MB free)
  Uptime: 3402.37 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 6 Jun 2024 - 9:41
  • Package commit: 178681
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.687 ms (5%) 68.07 MiB (1%) 107996
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.968 ms (5%) 4.995 ms 347.44 MiB (1%) 303603
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 535.392 ms (5%) 10.389 ms 772.01 MiB (1%) 542740
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.227 s (5%) 22.485 ms 1.59 GiB (1%) 973471
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.142 ms (5%) 3.463 ms 226.63 MiB (1%) 221258
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 642.100 ms (5%) 12.420 ms 816.18 MiB (1%) 449672
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 63.727 ms (5%) 1.521 ms 92.73 MiB (1%) 84627
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.743 ms (5%) 5.305 ms 346.97 MiB (1%) 170428
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.148 ms (5%) 10.83 MiB (1%) 23647
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.345 s (5%) 20.412 ms 1.64 GiB (1%) 354133
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.025 ms (5%) 42.96 MiB (1%) 41172
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.465 ms (5%) 2.285 ms 155.45 MiB (1%) 78547
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 497.003 ms (5%) 23.663 ms 1.16 GiB (1%) 812709
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 250.518 ms (5%) 8.388 ms 438.84 MiB (1%) 529231
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 642.704 ms (5%) 16.500 ms 962.48 MiB (1%) 1213669
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.880 s (5%) 65.597 ms 2.97 GiB (1%) 3616989
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.107 s (5%) 52.070 ms 2.48 GiB (1%) 1667540
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.568 s (5%) 109.782 ms 5.40 GiB (1%) 3376708
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 142.521 ms (5%) 5.776 ms 255.35 MiB (1%) 740591
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 441.886 ms (5%) 18.231 ms 673.91 MiB (1%) 1545627
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.746 ms (5%) 15.77 MiB (1%) 22863
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.699 s (5%) 50.705 ms 2.29 GiB (1%) 3141637
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.418 ms (5%) 47.68 MiB (1%) 65953
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 140.215 ms (5%) 3.093 ms 176.48 MiB (1%) 193009
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 387.457 ms (5%) 22.538 ms 763.54 MiB (1%) 741594
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 692.210 ms (5%) 21.091 ms 683.80 MiB (1%) 1029077
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.406 s (5%) 34.282 ms 1.24 GiB (1%) 2067121
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.039 s (5%) 83.173 ms 2.82 GiB (1%) 4613106
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 935.287 ms (5%) 47.173 ms 1.60 GiB (1%) 1508306
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.507 s (5%) 106.196 ms 3.70 GiB (1%) 3059616
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 162.001 ms (5%) 9.357 ms 320.05 MiB (1%) 996801
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 496.744 ms (5%) 22.411 ms 834.93 MiB (1%) 2073239
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 20.647 ms (5%) 30.36 MiB (1%) 79009
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.907 s (5%) 60.018 ms 2.62 GiB (1%) 4241779
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 69.287 ms (5%) 2.465 ms 97.76 MiB (1%) 170478
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 204.019 ms (5%) 4.817 ms 211.19 MiB (1%) 376198
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.102 ms (5%) 73.22 MiB (1%) 129848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.537 ms (5%) 5.449 ms 382.43 MiB (1%) 332471
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 570.960 ms (5%) 11.703 ms 805.29 MiB (1%) 585314
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.275 s (5%) 26.716 ms 1.62 GiB (1%) 1053045
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.699 ms (5%) 4.972 ms 237.06 MiB (1%) 260848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 664.073 ms (5%) 14.301 ms 839.93 MiB (1%) 523161
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.251 ms (5%) 1.564 ms 96.11 MiB (1%) 86557
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 276.217 ms (5%) 5.504 ms 350.80 MiB (1%) 173846
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.359 ms (5%) 18.77 MiB (1%) 26113
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.351 s (5%) 21.889 ms 1.63 GiB (1%) 347990
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.554 ms (5%) 42.93 MiB (1%) 40917
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.469 ms (5%) 2.687 ms 160.31 MiB (1%) 74005
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 44.955 ms (5%) 65.86 MiB (1%) 86084
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.370 ms (5%) 5.600 ms 344.01 MiB (1%) 234051
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 530.944 ms (5%) 10.537 ms 755.62 MiB (1%) 413169
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.218 s (5%) 23.231 ms 1.55 GiB (1%) 742951
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.748 ms (5%) 3.133 ms 222.02 MiB (1%) 172802
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 634.106 ms (5%) 11.878 ms 805.99 MiB (1%) 346335
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.678 ms (5%) 1.406 ms 91.37 MiB (1%) 50334
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 261.189 ms (5%) 4.996 ms 336.05 MiB (1%) 100928
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.309 ms (5%) 11.41 MiB (1%) 17273
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.323 s (5%) 19.052 ms 1.62 GiB (1%) 202860
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.213 ms (5%) 40.61 MiB (1%) 28522
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.312 ms (5%) 1.261 ms 154.26 MiB (1%) 53448
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.580 ms (5%) 67.92 MiB (1%) 101597
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.330 ms (5%) 4.953 ms 347.22 MiB (1%) 290805
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.013 ms (5%) 10.607 ms 771.50 MiB (1%) 517142
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.229 s (5%) 23.262 ms 1.59 GiB (1%) 922273
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.018 ms (5%) 3.189 ms 226.35 MiB (1%) 208459
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 642.066 ms (5%) 13.010 ms 815.61 MiB (1%) 424074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 64.851 ms (5%) 1.473 ms 95.14 MiB (1%) 84862
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.212 ms (5%) 5.187 ms 351.84 MiB (1%) 170984
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.101 ms (5%) 17.19 MiB (1%) 24194
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.341 s (5%) 19.181 ms 1.64 GiB (1%) 353674
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.506 ms (5%) 41.04 MiB (1%) 41054
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.411 ms (5%) 1.183 ms 155.89 MiB (1%) 78604
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 507.541 ms (5%) 27.971 ms 1.16 GiB (1%) 812710
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 249.545 ms (5%) 8.613 ms 438.91 MiB (1%) 529233
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 645.804 ms (5%) 18.482 ms 962.55 MiB (1%) 1213671
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.878 s (5%) 65.098 ms 2.97 GiB (1%) 3616991
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.142 s (5%) 63.654 ms 2.48 GiB (1%) 1667541
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.627 s (5%) 129.861 ms 5.40 GiB (1%) 3376710
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 143.696 ms (5%) 7.132 ms 248.04 MiB (1%) 732975
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 444.443 ms (5%) 18.508 ms 683.95 MiB (1%) 1535151
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.326 ms (5%) 19.10 MiB (1%) 23912
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.729 s (5%) 55.644 ms 2.29 GiB (1%) 3145694
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.968 ms (5%) 49.30 MiB (1%) 66790
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 141.077 ms (5%) 3.498 ms 177.39 MiB (1%) 193683
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 388.833 ms (5%) 22.208 ms 763.54 MiB (1%) 741595
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 694.065 ms (5%) 23.304 ms 683.87 MiB (1%) 1029079
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.404 s (5%) 37.263 ms 1.24 GiB (1%) 2067123
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.038 s (5%) 83.112 ms 2.82 GiB (1%) 4613108
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 937.628 ms (5%) 47.849 ms 1.60 GiB (1%) 1508307
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.505 s (5%) 105.719 ms 3.70 GiB (1%) 3059618
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 161.777 ms (5%) 9.360 ms 324.00 MiB (1%) 1000631
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 499.609 ms (5%) 21.843 ms 840.98 MiB (1%) 2089652
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 24.812 ms (5%) 43.53 MiB (1%) 90606
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.909 s (5%) 64.459 ms 2.64 GiB (1%) 4240843
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 61.853 ms (5%) 76.88 MiB (1%) 163244
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 208.763 ms (5%) 7.218 ms 227.34 MiB (1%) 379809
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.061 ms (5%) 73.22 MiB (1%) 129849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.475 ms (5%) 5.888 ms 382.50 MiB (1%) 332473
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 573.100 ms (5%) 12.286 ms 805.37 MiB (1%) 585316
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.273 s (5%) 27.434 ms 1.62 GiB (1%) 1053047
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 178.541 ms (5%) 3.918 ms 237.07 MiB (1%) 260849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 661.733 ms (5%) 14.443 ms 839.95 MiB (1%) 523163
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.923 ms (5%) 1.625 ms 99.45 MiB (1%) 87054
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 274.794 ms (5%) 5.757 ms 353.34 MiB (1%) 174698
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.976 ms (5%) 15.06 MiB (1%) 26467
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.363 s (5%) 23.188 ms 1.65 GiB (1%) 349805
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.063 ms (5%) 45.59 MiB (1%) 41788
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 130.998 ms (5%) 1.435 ms 160.40 MiB (1%) 74611
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.278 ms (5%) 65.86 MiB (1%) 86085
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 200.747 ms (5%) 6.235 ms 344.08 MiB (1%) 234053
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.920 ms (5%) 12.851 ms 755.70 MiB (1%) 413171
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.219 s (5%) 24.172 ms 1.55 GiB (1%) 742953
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.337 ms (5%) 3.559 ms 222.03 MiB (1%) 172803
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 637.410 ms (5%) 13.337 ms 806.01 MiB (1%) 346337
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.810 ms (5%) 1.561 ms 89.50 MiB (1%) 50397
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 265.503 ms (5%) 5.664 ms 344.59 MiB (1%) 101970
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.042 ms (5%) 16.17 MiB (1%) 18426
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.329 s (5%) 20.979 ms 1.61 GiB (1%) 202359
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.203 ms (5%) 40.66 MiB (1%) 29268
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.355 ms (5%) 1.372 ms 154.96 MiB (1%) 54202
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 342.628 ms (5%) 173.301 ms 743.21 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.441 ms (5%) 5.82 MiB (1%) 60501
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 134.523 μs (5%) 256.38 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 46.026 ms (5%) 10.331 ms 145.98 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 934.325 μs (5%) 2.10 MiB (1%) 23418
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 50.144 μs (5%) 104.75 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.038 s (5%) 649.888 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 18.408 ms (5%) 1.426 ms 63.36 MiB (1%) 416698
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.362 μs (5%) 17.00 KiB (1%) 205
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 57.107 μs (5%) 118.64 KiB (1%) 757
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 132.839 μs (5%) 297.77 KiB (1%) 2173
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 249.739 μs (5%) 525.89 KiB (1%) 5823
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 559.536 ms (5%) 37.785 ms 721.19 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.238 ms (5%) 41.98 MiB (1%) 288498
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.739 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 90.143 ms (5%) 4.923 ms 97.19 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.853 ms (5%) 5.66 MiB (1%) 55705
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 303.971 μs (5%) 368.44 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.647 s (5%) 62.339 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 58.625 ms (5%) 41.54 MiB (1%) 175246
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.089 μs (5%) 9.88 KiB (1%) 89
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.045 ms (5%) 3.08 MiB (1%) 15201
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.335 ms (5%) 12.91 MiB (1%) 37988
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 11.750 ms (5%) 24.25 MiB (1%) 67091
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.510 s (5%) 62.858 ms 836.59 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 76.735 ms (5%) 48.60 MiB (1%) 435594
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.661 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 153.968 ms (5%) 20.674 ms 216.21 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 6.979 ms (5%) 12.49 MiB (1%) 137134
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 397.917 μs (5%) 800.31 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 22.420 s (5%) 2.293 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 617.570 ms (5%) 36.573 ms 697.77 MiB (1%) 4174856
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 31.960 μs (5%) 113.09 KiB (1%) 1296
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 9.220 ms (5%) 5.26 MiB (1%) 29797
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 223.689 ms (5%) 12.31 MiB (1%) 57341
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 22.037 s (5%) 33.76 MiB (1%) 126758
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 275.188 ms (5%) 56.487 ms 330.04 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.331 ms (5%) 19.03 MiB (1%) 130314
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 629.841 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 42.254 ms (5%) 69.12 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.130 ms (5%) 4.01 MiB (1%) 38060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 111.410 μs (5%) 258.02 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.873 s (5%) 479.967 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 90.701 ms (5%) 8.448 ms 144.42 MiB (1%) 928264
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.699 μs (5%) 32.98 KiB (1%) 321
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 185.598 μs (5%) 404.87 KiB (1%) 2281
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.235 ms (5%) 2.37 MiB (1%) 8180
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.230 ms (5%) 8.67 MiB (1%) 25666
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 33.105 ms (5%) 72.93 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.742 ms (5%) 4.22 MiB (1%) 23170
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 124.925 μs (5%) 278.12 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 9.919 ms (5%) 21.97 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 565.332 μs (5%) 1.30 MiB (1%) 10409
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 36.389 μs (5%) 83.88 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 555.852 ms (5%) 44.652 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 18.128 ms (5%) 41.69 MiB (1%) 177598
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.250 μs (5%) 13.14 KiB (1%) 141
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 62.798 μs (5%) 150.77 KiB (1%) 467
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 200.897 μs (5%) 657.12 KiB (1%) 1149
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 513.224 μs (5%) 1.92 MiB (1%) 2956
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 185.679 ms (5%) 42.330 ms 744.59 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.540 ms (5%) 5.90 MiB (1%) 60510
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 141.215 μs (5%) 261.62 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 46.484 ms (5%) 6.006 ms 146.74 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 959.991 μs (5%) 2.14 MiB (1%) 23423
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 53.231 μs (5%) 107.84 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.008 s (5%) 527.635 ms 18.62 GiB (1%) 11587323
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 18.571 ms (5%) 63.59 MiB (1%) 419014
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.755 μs (5%) 25.95 KiB (1%) 223
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 66.013 μs (5%) 137.80 KiB (1%) 913
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 141.105 μs (5%) 312.31 KiB (1%) 2281
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 262.172 μs (5%) 536.81 KiB (1%) 5873
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 597.443 ms (5%) 48.603 ms 722.56 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.544 ms (5%) 42.06 MiB (1%) 288507
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.759 ms (5%) 2.64 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.422 ms (5%) 5.930 ms 97.95 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.917 ms (5%) 5.70 MiB (1%) 55710
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 308.611 μs (5%) 371.53 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.741 s (5%) 79.618 ms 1.02 GiB (1%) 4692825
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 58.832 ms (5%) 41.70 MiB (1%) 176410
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.841 μs (5%) 18.00 KiB (1%) 96
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.904 ms (5%) 2.88 MiB (1%) 14037
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.524 ms (5%) 13.04 MiB (1%) 38243
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 11.922 ms (5%) 24.41 MiB (1%) 67525
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.580 s (5%) 79.422 ms 837.96 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.231 ms (5%) 48.68 MiB (1%) 435603
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.718 ms (5%) 3.05 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 161.181 ms (5%) 19.083 ms 216.97 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.061 ms (5%) 12.53 MiB (1%) 137139
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 410.800 μs (5%) 803.41 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 22.833 s (5%) 2.445 s 18.50 GiB (1%) 112202347
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 658.848 ms (5%) 45.068 ms 698.35 MiB (1%) 4181780
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 36.509 μs (5%) 127.33 KiB (1%) 1382
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 5.278 ms (5%) 3.74 MiB (1%) 23531
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 210.873 ms (5%) 12.77 MiB (1%) 57736
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 22.797 s (5%) 23.01 MiB (1%) 106363
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 286.128 ms (5%) 40.339 ms 331.41 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.460 ms (5%) 19.11 MiB (1%) 130323
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 648.470 μs (5%) 1.20 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 42.725 ms (5%) 69.88 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.163 ms (5%) 4.06 MiB (1%) 38065
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 114.917 μs (5%) 261.11 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.788 s (5%) 470.641 ms 3.70 GiB (1%) 24822861
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 89.250 ms (5%) 5.598 ms 144.95 MiB (1%) 932884
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.041 μs (5%) 42.03 KiB (1%) 343
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 282.782 μs (5%) 540.10 KiB (1%) 2817
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.190 ms (5%) 2.27 MiB (1%) 7934
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.119 ms (5%) 8.44 MiB (1%) 24956
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 33.557 ms (5%) 74.30 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.844 ms (5%) 4.30 MiB (1%) 23179
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 132.579 μs (5%) 283.38 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 10.398 ms (5%) 22.73 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 592.442 μs (5%) 1.34 MiB (1%) 10414
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 38.883 μs (5%) 86.97 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 636.292 ms (5%) 73.334 ms 1.03 GiB (1%) 4741977
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.194 ms (5%) 41.85 MiB (1%) 178762
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.201 μs (5%) 21.22 KiB (1%) 147
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 78.558 μs (5%) 185.39 KiB (1%) 517
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 202.120 μs (5%) 637.97 KiB (1%) 1132
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 547.136 μs (5%) 1.96 MiB (1%) 3020

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz      12664 s          0 s        646 s      35372 s          0 s
       #2  2594 MHz      12799 s          0 s        680 s      35204 s          0 s
       #3  2445 MHz      12327 s          0 s        658 s      35685 s          0 s
       #4  3244 MHz      11095 s          0 s        634 s      36951 s          0 s
  Memory: 15.606502532958984 GB (13500.85546875 MB free)
  Uptime: 4879.37 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@adrhill
Copy link
Owner Author

adrhill commented Jun 6, 2024 •
edited
Loading

Looks like NLPModels tests failed at the same place after one hour of runtime twice in a row:

[ Info: Testing Jacobian sparsity for britgas
Error: The operation was canceled.

@gdalle
Copy link
Collaborator

gdalle commented Jun 6, 2024

after one hour of runtime

SparseConnectivityTracer.jl/.github/workflows/CI.yml

Line 18 in 1786815

timeout-minutes: 60

@adrhill
Copy link
Owner Author

adrhill commented Jun 6, 2024

In 2ec6489, the full suite passed in 30 minutes...

gdalle
gdalle requested changes Jun 6, 2024
View reviewed changes
src/indexsets.jl Outdated Show resolved Hide resolved
src/indexsets.jl Outdated Show resolved Hide resolved
src/indexsets.jl Outdated Show resolved Hide resolved
src/indexsets.jl Outdated Show resolved Hide resolved
src/indexsets.jl Outdated Show resolved Hide resolved
src/interface.jl Outdated Show resolved Hide resolved
src/overload_hessian.jl Outdated Show resolved Hide resolved
src/tracers.jl Outdated Show resolved Hide resolved
src/tracers.jl Outdated Show resolved Hide resolved
src/tracers.jl Outdated Show resolved Hide resolved
@adrhill adrhill mentioned this pull request Jun 6, 2024
Closed
@adrhill
Copy link
Owner Author

adrhill commented Jun 14, 2024 •
edited
Loading

A description of our compile time problems (cause & solution) can be found here: #120 (comment).

The fix is commit 875d90d.

@adrhill adrhill added the run benchmark Run benchmarks in CI label Jun 14, 2024
@github-actions GitHub Actions
Copy link

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 14 Jun 2024 - 16:16
    • Baseline: 14 Jun 2024 - 16:41
  • Package commits:
    • Target: b5491f
    • Baseline: 178681
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 0.56 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 1.10 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 0.91 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.08 (5%) ❌ 1.01 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 1.09 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 1.16 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 1.17 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.71 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.60 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.62 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.67 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.72 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.70 (5%) ✅ 0.75 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 0.69 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 0.65 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.70 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.69 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.72 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.50 (5%) ✅ 0.41 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.49 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.52 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 0.55 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 0.59 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 1.05 (5%) 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.11 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 1.08 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.12 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.20 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 1.05 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 1.05 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 0.94 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.06 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 1.05 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.69 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.60 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.61 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.68 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.72 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.71 (5%) ✅ 0.76 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 0.70 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 0.64 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.68 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.69 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.71 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.49 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 0.55 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 0.58 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 0.96 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.05 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 1.05 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 1.05 (5%) 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.06 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 1.08 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 1.05 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       7926 s          0 s        430 s      25863 s          0 s
       #2  3243 MHz      10100 s          0 s        501 s      23627 s          0 s
       #3  2445 MHz       7823 s          0 s        389 s      26005 s          0 s
       #4  3050 MHz       8615 s          0 s        543 s      25070 s          0 s
  Memory: 15.606502532958984 GB (13547.828125 MB free)
  Uptime: 3431.01 sec
  Load Avg:  1.0  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2590 MHz      11225 s          0 s        607 s      37264 s          0 s
       #2  2445 MHz      13311 s          0 s        656 s      35137 s          0 s
       #3  2784 MHz      12619 s          0 s        625 s      35855 s          0 s
       #4  3243 MHz      11783 s          0 s        750 s      36573 s          0 s
  Memory: 15.606502532958984 GB (13124.87109375 MB free)
  Uptime: 4921.53 sec
  Load Avg:  1.06  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 14 Jun 2024 - 16:16
  • Package commit: b5491f
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.906 ms (5%) 67.96 MiB (1%) 107183
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.896 ms (5%) 5.861 ms 345.81 MiB (1%) 290793
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 538.176 ms (5%) 10.684 ms 770.37 MiB (1%) 529927
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.231 s (5%) 20.757 ms 1.58 GiB (1%) 960658
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.713 ms (5%) 3.453 ms 226.42 MiB (1%) 219645
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 639.069 ms (5%) 10.415 ms 815.77 MiB (1%) 446460
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 66.168 ms (5%) 1.704 ms 97.68 MiB (1%) 85008
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.192 ms (5%) 4.155 ms 346.91 MiB (1%) 170567
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.255 ms (5%) 10.94 MiB (1%) 23682
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.336 s (5%) 18.230 ms 1.64 GiB (1%) 354537
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.352 ms (5%) 39.55 MiB (1%) 41016
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.225 ms (5%) 1.387 ms 154.96 MiB (1%) 78508
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 495.380 ms (5%) 22.977 ms 1.16 GiB (1%) 792458
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 211.812 ms (5%) 6.490 ms 420.94 MiB (1%) 450196
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 601.929 ms (5%) 16.145 ms 1000.56 MiB (1%) 1109569
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.827 s (5%) 58.865 ms 3.11 GiB (1%) 3452128
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.120 s (5%) 53.024 ms 2.50 GiB (1%) 1626489
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.603 s (5%) 118.027 ms 5.49 GiB (1%) 3293110
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 137.907 ms (5%) 5.076 ms 249.82 MiB (1%) 715234
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 433.880 ms (5%) 15.762 ms 675.39 MiB (1%) 1504600
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.265 ms (5%) 12.42 MiB (1%) 16881
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.689 s (5%) 44.111 ms 2.30 GiB (1%) 3074773
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.021 ms (5%) 45.04 MiB (1%) 56815
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 133.985 ms (5%) 1.761 ms 174.65 MiB (1%) 177675
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 348.309 ms (5%) 20.274 ms 751.93 MiB (1%) 634196
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.494 ms (5%) 8.434 ms 384.66 MiB (1%) 694752
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 629.216 ms (5%) 22.608 ms 949.87 MiB (1%) 1542194
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.693 s (5%) 66.448 ms 2.47 GiB (1%) 3693393
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 788.088 ms (5%) 43.058 ms 1.57 GiB (1%) 1289158
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.917 s (5%) 99.163 ms 3.58 GiB (1%) 2607447
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 148.965 ms (5%) 7.925 ms 315.22 MiB (1%) 954525
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 448.224 ms (5%) 19.404 ms 810.40 MiB (1%) 1980225
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.602 ms (5%) 14.75 MiB (1%) 58515
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.719 s (5%) 53.215 ms 2.57 GiB (1%) 4050527
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.313 ms (5%) 49.27 MiB (1%) 131199
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 145.722 ms (5%) 3.212 ms 185.75 MiB (1%) 327053
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.469 ms (5%) 73.11 MiB (1%) 129037
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 228.169 ms (5%) 6.014 ms 380.79 MiB (1%) 319663
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 573.080 ms (5%) 12.185 ms 803.65 MiB (1%) 572503
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.275 s (5%) 26.569 ms 1.62 GiB (1%) 1040234
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.439 ms (5%) 4.124 ms 236.85 MiB (1%) 259237
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 660.968 ms (5%) 13.036 ms 839.52 MiB (1%) 519951
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.421 ms (5%) 1.765 ms 96.84 MiB (1%) 86400
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 277.131 ms (5%) 4.478 ms 353.79 MiB (1%) 174343
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.296 ms (5%) 16.40 MiB (1%) 26060
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.347 s (5%) 19.461 ms 1.64 GiB (1%) 348601
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.983 ms (5%) 44.21 MiB (1%) 40971
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.254 ms (5%) 1.517 ms 159.20 MiB (1%) 73920
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.370 ms (5%) 65.75 MiB (1%) 85274
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 199.092 ms (5%) 5.056 ms 342.37 MiB (1%) 221244
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 532.240 ms (5%) 10.377 ms 753.99 MiB (1%) 400359
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.217 s (5%) 22.256 ms 1.55 GiB (1%) 730141
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 167.769 ms (5%) 3.329 ms 221.81 MiB (1%) 171192
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 633.487 ms (5%) 10.317 ms 805.58 MiB (1%) 343126
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 59.470 ms (5%) 87.50 MiB (1%) 49934
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 262.573 ms (5%) 4.134 ms 341.61 MiB (1%) 101555
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.364 ms (5%) 11.12 MiB (1%) 17268
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.324 s (5%) 16.606 ms 1.60 GiB (1%) 201874
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.128 ms (5%) 39.21 MiB (1%) 28435
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.254 ms (5%) 1.335 ms 154.17 MiB (1%) 53449
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.998 ms (5%) 67.97 MiB (1%) 107184
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.619 ms (5%) 4.616 ms 345.95 MiB (1%) 290795
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 537.505 ms (5%) 10.604 ms 770.52 MiB (1%) 529929
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.224 s (5%) 19.162 ms 1.59 GiB (1%) 960660
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.598 ms (5%) 3.290 ms 226.44 MiB (1%) 219646
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 640.651 ms (5%) 10.287 ms 815.81 MiB (1%) 446462
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.336 ms (5%) 1.676 ms 95.92 MiB (1%) 85020
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.604 ms (5%) 4.002 ms 350.32 MiB (1%) 171321
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.575 ms (5%) 12.28 MiB (1%) 24448
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.348 s (5%) 17.505 ms 1.64 GiB (1%) 354677
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.802 ms (5%) 40.77 MiB (1%) 41793
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.646 ms (5%) 1.443 ms 157.16 MiB (1%) 79416
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 500.699 ms (5%) 24.751 ms 1.16 GiB (1%) 792459
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 213.980 ms (5%) 7.380 ms 421.08 MiB (1%) 450198
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 604.755 ms (5%) 17.578 ms 1000.71 MiB (1%) 1109571
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.831 s (5%) 61.814 ms 3.11 GiB (1%) 3452130
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.108 s (5%) 51.202 ms 2.50 GiB (1%) 1626490
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.571 s (5%) 112.648 ms 5.49 GiB (1%) 3293112
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 138.474 ms (5%) 5.273 ms 249.71 MiB (1%) 716775
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 435.662 ms (5%) 16.357 ms 673.17 MiB (1%) 1500500
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.874 ms (5%) 16.01 MiB (1%) 17857
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.687 s (5%) 43.385 ms 2.29 GiB (1%) 3067606
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.551 ms (5%) 46.12 MiB (1%) 57630
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 133.627 ms (5%) 1.831 ms 175.38 MiB (1%) 178394
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 351.193 ms (5%) 22.417 ms 751.94 MiB (1%) 634197
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.185 ms (5%) 9.273 ms 384.80 MiB (1%) 694754
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 629.031 ms (5%) 25.488 ms 950.01 MiB (1%) 1542196
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.694 s (5%) 68.972 ms 2.47 GiB (1%) 3693395
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 791.768 ms (5%) 45.438 ms 1.57 GiB (1%) 1289159
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.930 s (5%) 98.972 ms 3.58 GiB (1%) 2607449
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 151.388 ms (5%) 8.498 ms 320.61 MiB (1%) 954816
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 450.994 ms (5%) 19.852 ms 819.15 MiB (1%) 1984750
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.890 ms (5%) 16.12 MiB (1%) 59285
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.723 s (5%) 56.740 ms 2.56 GiB (1%) 4045707
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.041 ms (5%) 50.27 MiB (1%) 131993
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 145.312 ms (5%) 3.357 ms 186.33 MiB (1%) 327784
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.510 ms (5%) 73.12 MiB (1%) 129038
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 226.851 ms (5%) 5.935 ms 380.94 MiB (1%) 319665
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 575.790 ms (5%) 12.923 ms 803.80 MiB (1%) 572505
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.281 s (5%) 26.155 ms 1.62 GiB (1%) 1040236
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 180.048 ms (5%) 4.193 ms 236.87 MiB (1%) 259238
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 662.851 ms (5%) 12.160 ms 839.56 MiB (1%) 519953
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 68.756 ms (5%) 1.824 ms 99.93 MiB (1%) 86891
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 274.548 ms (5%) 4.319 ms 353.47 MiB (1%) 174914
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.415 ms (5%) 16.45 MiB (1%) 26741
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.355 s (5%) 17.954 ms 1.65 GiB (1%) 350218
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.142 ms (5%) 44.68 MiB (1%) 41831
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.554 ms (5%) 1.584 ms 161.42 MiB (1%) 74755
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.600 ms (5%) 65.76 MiB (1%) 85275
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 199.760 ms (5%) 6.017 ms 342.52 MiB (1%) 221246
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 533.301 ms (5%) 10.109 ms 754.13 MiB (1%) 400361
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.215 s (5%) 20.521 ms 1.55 GiB (1%) 730143
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 167.897 ms (5%) 3.298 ms 221.83 MiB (1%) 171193
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 634.300 ms (5%) 10.374 ms 805.62 MiB (1%) 343128
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.983 ms (5%) 1.585 ms 93.70 MiB (1%) 50902
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 262.205 ms (5%) 3.978 ms 342.28 MiB (1%) 101957
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.781 ms (5%) 13.20 MiB (1%) 18112
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.323 s (5%) 16.292 ms 1.61 GiB (1%) 203132
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.785 ms (5%) 41.88 MiB (1%) 29362
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.126 ms (5%) 1.356 ms 155.57 MiB (1%) 54238
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 191.780 ms (5%) 41.512 ms 744.28 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.587 ms (5%) 5.88 MiB (1%) 60508
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 144.300 μs (5%) 260.31 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 41.731 ms (5%) 146.28 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 983.594 μs (5%) 2.12 MiB (1%) 23420
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 52.448 μs (5%) 105.88 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.180 s (5%) 357.339 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 19.579 ms (5%) 63.39 MiB (1%) 416700
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.067 μs (5%) 18.17 KiB (1%) 193
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 73.427 μs (5%) 133.02 KiB (1%) 859
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 141.144 μs (5%) 296.50 KiB (1%) 2139
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 272.367 μs (5%) 534.00 KiB (1%) 5909
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 410.498 ms (5%) 40.871 ms 515.81 MiB (1%) 3040153
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.664 ms (5%) 30.12 MiB (1%) 175241
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.089 ms (5%) 1.89 MiB (1%) 11061
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 63.061 ms (5%) 74.61 MiB (1%) 720057
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.560 ms (5%) 4.33 MiB (1%) 41515
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 218.077 μs (5%) 277.94 KiB (1%) 2621
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.181 s (5%) 65.008 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 38.925 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.379 μs (5%) 12.36 KiB (1%) 86
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.885 ms (5%) 2.98 MiB (1%) 12921
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 5.457 ms (5%) 13.58 MiB (1%) 24743
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 369.318 ms (5%) 187.898 ms 1.00 GiB (1%) 29806
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.054 s (5%) 48.506 ms 444.58 MiB (1%) 3740275
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 53.220 ms (5%) 26.02 MiB (1%) 215569
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.343 ms (5%) 1.63 MiB (1%) 13589
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 80.052 ms (5%) 89.56 MiB (1%) 980062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.431 ms (5%) 5.19 MiB (1%) 56496
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 203.861 μs (5%) 333.44 KiB (1%) 3562
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 12.329 s (5%) 1.488 s 10.21 GiB (1%) 50938351
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 367.287 ms (5%) 26.998 ms 384.57 MiB (1%) 1894354
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 20.358 μs (5%) 61.44 KiB (1%) 697
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 4.328 ms (5%) 2.84 MiB (1%) 16702
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 156.609 ms (5%) 10.98 MiB (1%) 40584
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 19.978 s (5%) 8.68 MiB (1%) 39022
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 304.154 ms (5%) 48.361 ms 331.11 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.537 ms (5%) 19.09 MiB (1%) 130321
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 664.099 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 43.158 ms (5%) 69.42 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.186 ms (5%) 4.03 MiB (1%) 38062
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 116.406 μs (5%) 259.14 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.652 s (5%) 304.243 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 89.241 ms (5%) 5.500 ms 144.46 MiB (1%) 928266
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 13.405 μs (5%) 37.69 KiB (1%) 341
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 191.307 μs (5%) 400.59 KiB (1%) 2312
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.296 ms (5%) 2.37 MiB (1%) 8327
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.120 ms (5%) 8.38 MiB (1%) 25040
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 34.913 ms (5%) 74.00 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.922 ms (5%) 4.28 MiB (1%) 23177
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 138.418 μs (5%) 282.06 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 10.958 ms (5%) 22.27 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 621.489 μs (5%) 1.31 MiB (1%) 10411
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 40.736 μs (5%) 85.00 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 704.693 ms (5%) 86.338 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 20.203 ms (5%) 41.72 MiB (1%) 177600
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.122 μs (5%) 13.95 KiB (1%) 125
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 81.172 μs (5%) 174.53 KiB (1%) 503
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 222.105 μs (5%) 656.52 KiB (1%) 1153
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 571.316 μs (5%) 1.91 MiB (1%) 2974
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 179.972 ms (5%) 44.066 ms 745.96 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.619 ms (5%) 5.98 MiB (1%) 60512
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 146.643 μs (5%) 266.58 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 43.016 ms (5%) 147.35 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 994.439 μs (5%) 2.18 MiB (1%) 23425
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 54.031 μs (5%) 110.06 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.052 s (5%) 695.810 ms 18.62 GiB (1%) 11525819
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.202 ms (5%) 63.51 MiB (1%) 416711
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.259 μs (5%) 27.94 KiB (1%) 205
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 76.143 μs (5%) 142.62 KiB (1%) 891
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 152.194 μs (5%) 307.64 KiB (1%) 2143
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 301.903 μs (5%) 542.64 KiB (1%) 5903
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 425.310 ms (5%) 47.441 ms 517.49 MiB (1%) 3040157
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.758 ms (5%) 30.22 MiB (1%) 175245
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.096 ms (5%) 1.90 MiB (1%) 11063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 64.085 ms (5%) 75.68 MiB (1%) 720063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.582 ms (5%) 4.39 MiB (1%) 41520
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 221.082 μs (5%) 282.12 KiB (1%) 2624
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.198 s (5%) 66.419 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 38.798 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.386 μs (5%) 21.06 KiB (1%) 93
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.433 ms (5%) 2.00 MiB (1%) 10921
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 5.622 ms (5%) 13.79 MiB (1%) 25706
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 181.530 ms (5%) 4.813 ms 979.52 MiB (1%) 29797
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.060 s (5%) 50.878 ms 446.26 MiB (1%) 3740279
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 53.380 ms (5%) 26.12 MiB (1%) 215573
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.340 ms (5%) 1.64 MiB (1%) 13591
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 79.710 ms (5%) 90.63 MiB (1%) 980068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.445 ms (5%) 5.25 MiB (1%) 56501
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 205.092 μs (5%) 337.62 KiB (1%) 3565
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 12.493 s (5%) 1.519 s 10.21 GiB (1%) 50938363
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 372.553 ms (5%) 26.021 ms 384.68 MiB (1%) 1894365
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 20.268 μs (5%) 68.94 KiB (1%) 692
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 5.843 ms (5%) 4.15 MiB (1%) 20203
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 191.267 ms (5%) 8.95 MiB (1%) 37751
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 21.217 s (5%) 8.69 MiB (1%) 39030
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 319.608 ms (5%) 55.065 ms 332.79 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.703 ms (5%) 19.19 MiB (1%) 130325
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 663.959 μs (5%) 1.21 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.396 ms (5%) 70.49 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.208 ms (5%) 4.09 MiB (1%) 38067
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 118.260 μs (5%) 263.33 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.811 s (5%) 447.630 ms 3.69 GiB (1%) 24699853
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 91.170 ms (5%) 6.182 ms 144.58 MiB (1%) 928277
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 15.058 μs (5%) 48.23 KiB (1%) 361
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 226.513 μs (5%) 447.61 KiB (1%) 2401
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.211 ms (5%) 2.24 MiB (1%) 7872
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.409 ms (5%) 8.83 MiB (1%) 26076
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 35.473 ms (5%) 75.68 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.964 ms (5%) 4.38 MiB (1%) 23181
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 140.663 μs (5%) 288.33 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 11.304 ms (5%) 23.34 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 647.098 μs (5%) 1.38 MiB (1%) 10416
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 42.249 μs (5%) 89.19 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 702.580 ms (5%) 70.544 ms 1.03 GiB (1%) 4711225
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 20.708 ms (5%) 41.84 MiB (1%) 177611
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.757 μs (5%) 23.64 KiB (1%) 136
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 81.442 μs (5%) 177.25 KiB (1%) 508
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 231.543 μs (5%) 684.97 KiB (1%) 1180
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 589.130 μs (5%) 1.95 MiB (1%) 2996

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       7926 s          0 s        430 s      25863 s          0 s
       #2  3243 MHz      10100 s          0 s        501 s      23627 s          0 s
       #3  2445 MHz       7823 s          0 s        389 s      26005 s          0 s
       #4  3050 MHz       8615 s          0 s        543 s      25070 s          0 s
  Memory: 15.606502532958984 GB (13547.828125 MB free)
  Uptime: 3431.01 sec
  Load Avg:  1.0  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 14 Jun 2024 - 16:41
  • Package commit: 178681
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.486 ms (5%) 68.07 MiB (1%) 107996
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 195.147 ms (5%) 4.622 ms 347.44 MiB (1%) 303603
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.818 ms (5%) 11.001 ms 772.01 MiB (1%) 542740
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.221 s (5%) 22.322 ms 1.59 GiB (1%) 973471
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 169.464 ms (5%) 2.998 ms 226.63 MiB (1%) 221258
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 636.855 ms (5%) 11.093 ms 816.18 MiB (1%) 449672
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 63.927 ms (5%) 1.360 ms 91.68 MiB (1%) 84420
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 269.316 ms (5%) 4.776 ms 348.52 MiB (1%) 170633
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.193 ms (5%) 11.49 MiB (1%) 23695
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.335 s (5%) 17.672 ms 1.64 GiB (1%) 353596
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.293 ms (5%) 39.76 MiB (1%) 40993
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.644 ms (5%) 1.265 ms 155.61 MiB (1%) 78539
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 481.326 ms (5%) 23.724 ms 1.16 GiB (1%) 812709
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 249.596 ms (5%) 8.685 ms 438.84 MiB (1%) 529231
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 644.810 ms (5%) 17.843 ms 962.48 MiB (1%) 1213669
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.875 s (5%) 64.731 ms 2.97 GiB (1%) 3616989
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.077 s (5%) 52.859 ms 2.48 GiB (1%) 1667540
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.494 s (5%) 110.934 ms 5.40 GiB (1%) 3376708
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 140.210 ms (5%) 6.728 ms 247.80 MiB (1%) 733206
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 435.373 ms (5%) 15.867 ms 673.08 MiB (1%) 1531911
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.379 ms (5%) 21.37 MiB (1%) 23414
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.687 s (5%) 44.402 ms 2.29 GiB (1%) 3141701
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.311 ms (5%) 47.70 MiB (1%) 65920
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 139.175 ms (5%) 2.910 ms 175.56 MiB (1%) 193039
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 376.848 ms (5%) 20.506 ms 763.54 MiB (1%) 741594
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 689.288 ms (5%) 18.582 ms 683.80 MiB (1%) 1029077
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.397 s (5%) 33.383 ms 1.24 GiB (1%) 2067121
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.004 s (5%) 75.868 ms 2.82 GiB (1%) 4613106
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 912.421 ms (5%) 42.955 ms 1.60 GiB (1%) 1508306
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.459 s (5%) 93.848 ms 3.70 GiB (1%) 3059616
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 159.218 ms (5%) 8.719 ms 320.41 MiB (1%) 992037
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 488.089 ms (5%) 20.533 ms 827.35 MiB (1%) 2072741
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 22.719 ms (5%) 37.90 MiB (1%) 87691
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.881 s (5%) 55.022 ms 2.63 GiB (1%) 4235650
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 60.627 ms (5%) 77.69 MiB (1%) 162754
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 206.174 ms (5%) 6.337 ms 222.07 MiB (1%) 379381
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.079 ms (5%) 73.22 MiB (1%) 129848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 225.175 ms (5%) 5.344 ms 382.43 MiB (1%) 332471
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 573.123 ms (5%) 13.065 ms 805.29 MiB (1%) 585314
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.271 s (5%) 26.971 ms 1.62 GiB (1%) 1053045
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 179.108 ms (5%) 4.732 ms 237.06 MiB (1%) 260848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 658.618 ms (5%) 13.150 ms 839.93 MiB (1%) 523161
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 66.226 ms (5%) 1.474 ms 97.43 MiB (1%) 86774
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 271.664 ms (5%) 4.582 ms 351.64 MiB (1%) 174033
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.070 ms (5%) 15.66 MiB (1%) 26133
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.341 s (5%) 18.157 ms 1.64 GiB (1%) 348403
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.253 ms (5%) 42.86 MiB (1%) 40910
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 130.737 ms (5%) 1.325 ms 159.73 MiB (1%) 73910
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.296 ms (5%) 65.86 MiB (1%) 86084
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.795 ms (5%) 5.488 ms 344.01 MiB (1%) 234051
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 530.242 ms (5%) 9.892 ms 755.62 MiB (1%) 413169
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.207 s (5%) 20.535 ms 1.55 GiB (1%) 742951
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.123 ms (5%) 2.998 ms 222.02 MiB (1%) 172802
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 630.375 ms (5%) 10.593 ms 805.99 MiB (1%) 346335
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.010 ms (5%) 1.280 ms 93.49 MiB (1%) 50603
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 259.932 ms (5%) 4.407 ms 340.86 MiB (1%) 101456
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.227 ms (5%) 11.32 MiB (1%) 17265
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.307 s (5%) 17.177 ms 1.61 GiB (1%) 201608
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.125 ms (5%) 40.98 MiB (1%) 28561
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 125.506 ms (5%) 1.157 ms 154.45 MiB (1%) 53353
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.325 ms (5%) 67.92 MiB (1%) 101597
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 195.199 ms (5%) 4.953 ms 347.22 MiB (1%) 290805
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.863 ms (5%) 11.677 ms 771.50 MiB (1%) 517142
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.220 s (5%) 22.641 ms 1.59 GiB (1%) 922273
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 169.407 ms (5%) 3.254 ms 226.35 MiB (1%) 208459
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 636.479 ms (5%) 11.438 ms 815.61 MiB (1%) 424074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 63.805 ms (5%) 1.377 ms 95.98 MiB (1%) 84814
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 267.865 ms (5%) 4.700 ms 352.86 MiB (1%) 171006
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.707 ms (5%) 14.98 MiB (1%) 23884
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.329 s (5%) 18.236 ms 1.64 GiB (1%) 353472
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.238 ms (5%) 40.81 MiB (1%) 41016
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.111 ms (5%) 1.219 ms 156.81 MiB (1%) 78555
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 478.388 ms (5%) 22.273 ms 1.16 GiB (1%) 812710
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 250.124 ms (5%) 8.673 ms 438.91 MiB (1%) 529233
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 644.448 ms (5%) 17.998 ms 962.55 MiB (1%) 1213671
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.869 s (5%) 57.753 ms 2.97 GiB (1%) 3616991
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.070 s (5%) 49.782 ms 2.48 GiB (1%) 1667541
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.497 s (5%) 110.845 ms 5.40 GiB (1%) 3376710
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 141.833 ms (5%) 6.192 ms 253.96 MiB (1%) 738543
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 436.758 ms (5%) 16.682 ms 677.99 MiB (1%) 1538557
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.890 ms (5%) 16.99 MiB (1%) 23699
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.689 s (5%) 44.958 ms 2.30 GiB (1%) 3144127
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.506 ms (5%) 48.91 MiB (1%) 66645
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 139.826 ms (5%) 3.032 ms 177.63 MiB (1%) 194005
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 377.307 ms (5%) 20.269 ms 763.54 MiB (1%) 741595
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 684.884 ms (5%) 20.127 ms 683.87 MiB (1%) 1029079
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.408 s (5%) 38.184 ms 1.24 GiB (1%) 2067123
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.021 s (5%) 79.983 ms 2.82 GiB (1%) 4613108
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 919.095 ms (5%) 46.009 ms 1.60 GiB (1%) 1508307
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.446 s (5%) 98.191 ms 3.70 GiB (1%) 3059618
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 165.058 ms (5%) 9.992 ms 326.77 MiB (1%) 1001452
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 494.209 ms (5%) 21.572 ms 836.86 MiB (1%) 2079926
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 19.547 ms (5%) 28.97 MiB (1%) 78670
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.894 s (5%) 57.570 ms 2.63 GiB (1%) 4243899
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 70.983 ms (5%) 2.761 ms 96.84 MiB (1%) 173456
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 204.347 ms (5%) 5.330 ms 220.83 MiB (1%) 380990
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.054 ms (5%) 73.22 MiB (1%) 129849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 225.291 ms (5%) 5.258 ms 382.50 MiB (1%) 332473
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 571.171 ms (5%) 12.976 ms 805.37 MiB (1%) 585316
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.266 s (5%) 26.368 ms 1.62 GiB (1%) 1053047
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 178.028 ms (5%) 3.974 ms 237.07 MiB (1%) 260849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 657.483 ms (5%) 13.516 ms 839.95 MiB (1%) 523163
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 66.819 ms (5%) 1.540 ms 98.81 MiB (1%) 86916
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.950 ms (5%) 5.288 ms 349.43 MiB (1%) 174342
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.209 ms (5%) 16.20 MiB (1%) 26803
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.350 s (5%) 21.591 ms 1.65 GiB (1%) 349908
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.783 ms (5%) 45.03 MiB (1%) 41808
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.130 ms (5%) 1.448 ms 161.85 MiB (1%) 74849
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.213 ms (5%) 65.86 MiB (1%) 86085
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.636 ms (5%) 6.685 ms 344.08 MiB (1%) 234053
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 529.870 ms (5%) 10.558 ms 755.70 MiB (1%) 413171
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.206 s (5%) 21.130 ms 1.55 GiB (1%) 742953
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.165 ms (5%) 3.100 ms 222.03 MiB (1%) 172803
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 628.755 ms (5%) 10.417 ms 806.01 MiB (1%) 346337
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 60.503 ms (5%) 1.382 ms 90.40 MiB (1%) 50551
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 258.706 ms (5%) 4.734 ms 337.94 MiB (1%) 101595
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.684 ms (5%) 14.60 MiB (1%) 18230
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.312 s (5%) 18.787 ms 1.62 GiB (1%) 203285
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.136 ms (5%) 40.67 MiB (1%) 29243
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 125.709 ms (5%) 1.199 ms 156.14 MiB (1%) 54306
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 345.464 ms (5%) 178.958 ms 743.21 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.354 ms (5%) 5.82 MiB (1%) 60501
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 130.935 μs (5%) 256.38 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 45.937 ms (5%) 8.839 ms 145.98 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 910.932 μs (5%) 2.10 MiB (1%) 23418
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 48.230 μs (5%) 104.75 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 1.873 s (5%) 484.295 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 16.723 ms (5%) 63.36 MiB (1%) 416698
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.841 μs (5%) 15.69 KiB (1%) 197
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 67.927 μs (5%) 132.91 KiB (1%) 891
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 129.782 μs (5%) 297.64 KiB (1%) 2171
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 246.440 μs (5%) 531.14 KiB (1%) 5907
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 580.706 ms (5%) 43.548 ms 721.19 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.318 ms (5%) 41.98 MiB (1%) 288498
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.766 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 93.701 ms (5%) 5.332 ms 97.19 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.943 ms (5%) 5.66 MiB (1%) 55705
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 310.519 μs (5%) 368.44 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.703 s (5%) 49.778 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 60.257 ms (5%) 41.54 MiB (1%) 175246
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.039 μs (5%) 9.92 KiB (1%) 90
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.982 ms (5%) 2.93 MiB (1%) 14528
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.516 ms (5%) 13.11 MiB (1%) 38387
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 11.889 ms (5%) 24.50 MiB (1%) 67623
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.508 s (5%) 61.983 ms 836.59 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 76.989 ms (5%) 48.60 MiB (1%) 435594
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.641 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 159.961 ms (5%) 26.711 ms 216.21 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 6.959 ms (5%) 12.49 MiB (1%) 137134
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 388.325 μs (5%) 800.31 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 22.220 s (5%) 2.335 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 627.456 ms (5%) 40.694 ms 697.77 MiB (1%) 4174856
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 32.160 μs (5%) 109.03 KiB (1%) 1259
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 9.114 ms (5%) 6.07 MiB (1%) 30408
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 201.782 ms (5%) 12.20 MiB (1%) 56752
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 25.246 s (5%) 28.68 MiB (1%) 117835
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 273.463 ms (5%) 47.999 ms 330.04 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.373 ms (5%) 19.03 MiB (1%) 130314
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 644.382 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 44.051 ms (5%) 69.12 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.132 ms (5%) 4.01 MiB (1%) 38060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 111.518 μs (5%) 258.02 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.614 s (5%) 283.611 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 89.850 ms (5%) 8.133 ms 144.42 MiB (1%) 928264
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.798 μs (5%) 33.48 KiB (1%) 331
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 273.830 μs (5%) 537.02 KiB (1%) 2795
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.307 ms (5%) 2.51 MiB (1%) 8556
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.004 ms (5%) 8.25 MiB (1%) 24393
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 33.262 ms (5%) 72.93 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.735 ms (5%) 4.22 MiB (1%) 23170
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 125.274 μs (5%) 278.12 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 10.134 ms (5%) 21.97 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 562.961 μs (5%) 1.30 MiB (1%) 10409
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 36.528 μs (5%) 83.88 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 589.312 ms (5%) 48.203 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.151 ms (5%) 41.69 MiB (1%) 177598
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.658 μs (5%) 11.53 KiB (1%) 129
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 56.636 μs (5%) 141.09 KiB (1%) 449
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 209.662 μs (5%) 690.83 KiB (1%) 1187
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 525.302 μs (5%) 1.95 MiB (1%) 2992
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 177.873 ms (5%) 38.089 ms 744.59 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.492 ms (5%) 5.90 MiB (1%) 60510
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 137.216 μs (5%) 261.62 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 45.782 ms (5%) 5.427 ms 146.74 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 940.645 μs (5%) 2.14 MiB (1%) 23423
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 51.446 μs (5%) 107.84 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.147 s (5%) 570.833 ms 18.62 GiB (1%) 11587323
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 17.947 ms (5%) 63.59 MiB (1%) 419014
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.602 μs (5%) 23.48 KiB (1%) 197
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 69.360 μs (5%) 141.08 KiB (1%) 911
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 134.702 μs (5%) 306.94 KiB (1%) 2241
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 260.566 μs (5%) 542.56 KiB (1%) 5965
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 614.450 ms (5%) 53.090 ms 722.56 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.464 ms (5%) 42.06 MiB (1%) 288507
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.807 ms (5%) 2.64 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 93.999 ms (5%) 5.317 ms 97.95 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.954 ms (5%) 5.70 MiB (1%) 55710
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 312.333 μs (5%) 371.53 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.723 s (5%) 56.262 ms 1.02 GiB (1%) 4692825
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 60.592 ms (5%) 41.70 MiB (1%) 176410
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.815 μs (5%) 18.58 KiB (1%) 103
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.901 ms (5%) 2.58 MiB (1%) 14362
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.415 ms (5%) 13.07 MiB (1%) 38267
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.183 ms (5%) 24.90 MiB (1%) 68630
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.567 s (5%) 76.933 ms 837.96 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.565 ms (5%) 48.68 MiB (1%) 435603
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.706 ms (5%) 3.05 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 160.506 ms (5%) 18.664 ms 216.97 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.026 ms (5%) 12.53 MiB (1%) 137139
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 407.340 μs (5%) 803.41 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 22.637 s (5%) 2.461 s 18.50 GiB (1%) 112202347
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 647.878 ms (5%) 46.191 ms 698.35 MiB (1%) 4181780
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 37.289 μs (5%) 126.83 KiB (1%) 1369
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 8.983 ms (5%) 5.05 MiB (1%) 28546
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 232.951 ms (5%) 14.48 MiB (1%) 62294
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 24.224 s (5%) 23.24 MiB (1%) 106521
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 297.598 ms (5%) 38.406 ms 331.41 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.435 ms (5%) 19.11 MiB (1%) 130323
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 653.048 μs (5%) 1.20 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.157 ms (5%) 69.88 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.160 ms (5%) 4.06 MiB (1%) 38065
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 115.626 μs (5%) 261.11 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.652 s (5%) 292.105 ms 3.70 GiB (1%) 24822861
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 88.670 ms (5%) 4.875 ms 144.95 MiB (1%) 932884
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.791 μs (5%) 44.28 KiB (1%) 361
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 205.453 μs (5%) 431.96 KiB (1%) 2405
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.300 ms (5%) 2.45 MiB (1%) 8493
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.163 ms (5%) 8.58 MiB (1%) 25313
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 36.973 ms (5%) 3.337 ms 74.30 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.865 ms (5%) 4.30 MiB (1%) 23179
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 133.699 μs (5%) 283.38 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 10.797 ms (5%) 22.73 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 609.717 μs (5%) 1.34 MiB (1%) 10414
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 39.594 μs (5%) 86.97 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 651.152 ms (5%) 71.942 ms 1.03 GiB (1%) 4741977
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.663 ms (5%) 41.85 MiB (1%) 178762
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.111 μs (5%) 21.20 KiB (1%) 147
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 76.984 μs (5%) 183.91 KiB (1%) 502
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 206.535 μs (5%) 666.86 KiB (1%) 1141
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 550.457 μs (5%) 1.96 MiB (1%) 3006

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2590 MHz      11225 s          0 s        607 s      37264 s          0 s
       #2  2445 MHz      13311 s          0 s        656 s      35137 s          0 s
       #3  2784 MHz      12619 s          0 s        625 s      35855 s          0 s
       #4  3243 MHz      11783 s          0 s        750 s      36573 s          0 s
  Memory: 15.606502532958984 GB (13124.87109375 MB free)
  Uptime: 4921.53 sec
  Load Avg:  1.06  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 14 Jun 2024 - 23:12
    • Baseline: 14 Jun 2024 - 23:39
  • Package commits:
    • Target: 11674e
    • Baseline: 701f91
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 0.91 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 1.08 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 1.08 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 1.08 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.07 (5%) ❌ 1.01 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.72 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.62 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.61 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.68 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.71 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.70 (5%) ✅ 0.75 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 0.67 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 0.62 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.69 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.68 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.70 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.46 (5%) ✅ 0.41 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.48 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 0.65 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 0.61 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 1.05 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 0.92 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 1.11 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.12 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 1.11 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.11 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.12 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.15 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 1.05 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 1.06 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 0.93 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.66 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.61 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.61 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.68 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.72 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.70 (5%) ✅ 0.76 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 0.66 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 0.62 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.65 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.68 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.70 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.44 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.48 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 0.60 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 0.60 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 1.10 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.10 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.10 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 1.13 (5%) ❌ 1.00 (1%)
["OptimizationProblems", "britgas", "Jacobian"] 0.02 (5%) ✅ 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz      10075 s          0 s        677 s      26775 s          0 s
       #2  3242 MHz      11307 s          0 s        748 s      25483 s          0 s
       #3  2445 MHz       9320 s          0 s        625 s      27592 s          0 s
       #4  3239 MHz       9951 s          0 s        673 s      26912 s          0 s
  Memory: 15.606502532958984 GB (13329.45703125 MB free)
  Uptime: 3762.42 sec
  Load Avg:  1.01  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz      12747 s          0 s        873 s      40117 s          0 s
       #2  3243 MHz      14912 s          0 s       1003 s      37838 s          0 s
       #3  2779 MHz      12980 s          0 s        844 s      39925 s          0 s
       #4  3373 MHz      15745 s          0 s       1001 s      37009 s          0 s
  Memory: 15.606502532958984 GB (12972.3125 MB free)
  Uptime: 5386.45 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 14 Jun 2024 - 23:12
  • Package commit: 11674e
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.658 ms (5%) 67.96 MiB (1%) 107183
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 194.836 ms (5%) 4.106 ms 345.81 MiB (1%) 290793
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 533.960 ms (5%) 9.615 ms 770.37 MiB (1%) 529927
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.221 s (5%) 19.618 ms 1.58 GiB (1%) 960658
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 170.017 ms (5%) 3.468 ms 226.42 MiB (1%) 219645
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 638.054 ms (5%) 10.285 ms 815.77 MiB (1%) 446460
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 63.437 ms (5%) 99.08 MiB (1%) 85081
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 268.825 ms (5%) 4.552 ms 350.50 MiB (1%) 170674
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.451 ms (5%) 12.65 MiB (1%) 23835
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.334 s (5%) 15.542 ms 1.63 GiB (1%) 353295
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 21.935 ms (5%) 39.22 MiB (1%) 40926
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.415 ms (5%) 1.343 ms 154.80 MiB (1%) 78547
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 486.362 ms (5%) 19.857 ms 1.16 GiB (1%) 792458
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 211.344 ms (5%) 6.708 ms 420.94 MiB (1%) 450196
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 600.893 ms (5%) 15.228 ms 1000.56 MiB (1%) 1109569
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.821 s (5%) 58.918 ms 3.11 GiB (1%) 3452128
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.083 s (5%) 44.987 ms 2.50 GiB (1%) 1626489
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.511 s (5%) 97.168 ms 5.49 GiB (1%) 3293110
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 149.112 ms (5%) 8.422 ms 250.47 MiB (1%) 721244
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 428.122 ms (5%) 12.514 ms 680.36 MiB (1%) 1505674
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.133 ms (5%) 12.48 MiB (1%) 16974
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.672 s (5%) 40.849 ms 2.30 GiB (1%) 3072952
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.339 ms (5%) 46.31 MiB (1%) 56907
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.496 ms (5%) 1.701 ms 174.23 MiB (1%) 177652
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 335.764 ms (5%) 16.540 ms 751.93 MiB (1%) 634196
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 219.712 ms (5%) 9.273 ms 384.66 MiB (1%) 694752
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 616.984 ms (5%) 20.957 ms 949.87 MiB (1%) 1542194
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.671 s (5%) 60.907 ms 2.47 GiB (1%) 3693393
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 771.625 ms (5%) 39.315 ms 1.57 GiB (1%) 1289158
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.880 s (5%) 88.338 ms 3.58 GiB (1%) 2607447
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 160.567 ms (5%) 10.228 ms 315.09 MiB (1%) 949496
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 449.536 ms (5%) 19.248 ms 811.38 MiB (1%) 1983380
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.490 ms (5%) 14.99 MiB (1%) 58483
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.708 s (5%) 51.258 ms 2.58 GiB (1%) 4046197
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.221 ms (5%) 48.90 MiB (1%) 131172
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 142.404 ms (5%) 3.060 ms 184.55 MiB (1%) 326985
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.045 ms (5%) 73.11 MiB (1%) 129037
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 224.570 ms (5%) 4.509 ms 380.79 MiB (1%) 319663
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 570.316 ms (5%) 10.830 ms 803.65 MiB (1%) 572503
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.269 s (5%) 22.931 ms 1.62 GiB (1%) 1040234
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 178.243 ms (5%) 3.925 ms 236.85 MiB (1%) 259237
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 658.802 ms (5%) 11.851 ms 839.52 MiB (1%) 519951
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.053 ms (5%) 95.53 MiB (1%) 86297
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 275.972 ms (5%) 4.843 ms 362.92 MiB (1%) 175070
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.392 ms (5%) 20.07 MiB (1%) 26223
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.349 s (5%) 17.401 ms 1.65 GiB (1%) 348858
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.394 ms (5%) 43.25 MiB (1%) 40943
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.290 ms (5%) 1.474 ms 159.75 MiB (1%) 73868
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.144 ms (5%) 65.75 MiB (1%) 85274
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.851 ms (5%) 4.433 ms 342.37 MiB (1%) 221244
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 529.958 ms (5%) 9.559 ms 753.99 MiB (1%) 400359
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.208 s (5%) 17.990 ms 1.55 GiB (1%) 730141
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.426 ms (5%) 2.369 ms 221.81 MiB (1%) 171192
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 631.687 ms (5%) 9.821 ms 805.58 MiB (1%) 343126
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 59.517 ms (5%) 90.22 MiB (1%) 50233
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 257.591 ms (5%) 2.946 ms 333.87 MiB (1%) 100963
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.488 ms (5%) 12.64 MiB (1%) 17492
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.319 s (5%) 14.398 ms 1.62 GiB (1%) 202143
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 21.837 ms (5%) 40.00 MiB (1%) 28503
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 125.378 ms (5%) 1.293 ms 153.84 MiB (1%) 53416
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.543 ms (5%) 67.97 MiB (1%) 107184
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 194.527 ms (5%) 3.799 ms 345.95 MiB (1%) 290795
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 533.579 ms (5%) 9.298 ms 770.52 MiB (1%) 529929
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.217 s (5%) 17.831 ms 1.59 GiB (1%) 960660
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.218 ms (5%) 1.816 ms 226.44 MiB (1%) 219646
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 637.543 ms (5%) 9.869 ms 815.81 MiB (1%) 446462
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.932 ms (5%) 94.22 MiB (1%) 84906
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 267.409 ms (5%) 4.401 ms 349.00 MiB (1%) 171220
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.484 ms (5%) 12.19 MiB (1%) 24449
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.330 s (5%) 14.815 ms 1.64 GiB (1%) 354619
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.399 ms (5%) 40.69 MiB (1%) 41819
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.555 ms (5%) 1.351 ms 156.72 MiB (1%) 79358
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 483.655 ms (5%) 20.158 ms 1.16 GiB (1%) 792459
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 210.586 ms (5%) 6.567 ms 421.08 MiB (1%) 450198
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 598.363 ms (5%) 14.697 ms 1000.71 MiB (1%) 1109571
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.818 s (5%) 58.535 ms 3.11 GiB (1%) 3452130
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.103 s (5%) 48.487 ms 2.50 GiB (1%) 1626490
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.514 s (5%) 96.223 ms 5.49 GiB (1%) 3293112
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 149.319 ms (5%) 9.048 ms 247.03 MiB (1%) 715538
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 430.000 ms (5%) 13.401 ms 678.21 MiB (1%) 1504112
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.465 ms (5%) 13.72 MiB (1%) 17672
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.676 s (5%) 39.635 ms 2.30 GiB (1%) 3075163
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.203 ms (5%) 46.21 MiB (1%) 57569
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.202 ms (5%) 1.839 ms 175.11 MiB (1%) 178334
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 337.780 ms (5%) 17.077 ms 751.94 MiB (1%) 634197
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 228.695 ms (5%) 9.084 ms 384.80 MiB (1%) 694754
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 627.985 ms (5%) 21.052 ms 950.01 MiB (1%) 1542196
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.671 s (5%) 57.067 ms 2.47 GiB (1%) 3693395
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 768.813 ms (5%) 38.456 ms 1.57 GiB (1%) 1289159
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.885 s (5%) 87.599 ms 3.58 GiB (1%) 2607449
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 164.967 ms (5%) 10.328 ms 318.92 MiB (1%) 955871
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 452.184 ms (5%) 19.261 ms 820.47 MiB (1%) 1988118
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.854 ms (5%) 17.74 MiB (1%) 59410
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.710 s (5%) 50.213 ms 2.57 GiB (1%) 4051790
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.910 ms (5%) 50.13 MiB (1%) 131930
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 144.128 ms (5%) 3.500 ms 185.76 MiB (1%) 327686
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.022 ms (5%) 73.12 MiB (1%) 129038
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 224.686 ms (5%) 4.801 ms 380.94 MiB (1%) 319665
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 571.470 ms (5%) 11.580 ms 803.80 MiB (1%) 572505
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.271 s (5%) 22.018 ms 1.62 GiB (1%) 1040236
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 178.702 ms (5%) 4.127 ms 236.87 MiB (1%) 259238
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 658.283 ms (5%) 11.208 ms 839.56 MiB (1%) 519953
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.003 ms (5%) 96.99 MiB (1%) 86708
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 274.930 ms (5%) 4.881 ms 353.11 MiB (1%) 174491
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.164 ms (5%) 16.27 MiB (1%) 26772
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.345 s (5%) 17.422 ms 1.64 GiB (1%) 350132
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.991 ms (5%) 45.07 MiB (1%) 41923
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.576 ms (5%) 1.541 ms 162.92 MiB (1%) 74858
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.189 ms (5%) 65.76 MiB (1%) 85275
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.745 ms (5%) 4.650 ms 342.52 MiB (1%) 221246
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 530.046 ms (5%) 9.699 ms 754.13 MiB (1%) 400361
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.207 s (5%) 19.598 ms 1.55 GiB (1%) 730143
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 165.532 ms (5%) 1.880 ms 221.83 MiB (1%) 171193
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 631.802 ms (5%) 9.879 ms 805.62 MiB (1%) 343128
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 59.254 ms (5%) 90.38 MiB (1%) 50540
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 258.951 ms (5%) 3.112 ms 340.22 MiB (1%) 101799
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.732 ms (5%) 14.25 MiB (1%) 18182
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.322 s (5%) 14.902 ms 1.63 GiB (1%) 203762
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.655 ms (5%) 42.50 MiB (1%) 29435
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.874 ms (5%) 1.333 ms 155.37 MiB (1%) 54233
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 154.863 ms (5%) 30.184 ms 744.28 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.634 ms (5%) 5.88 MiB (1%) 60508
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 146.051 μs (5%) 260.31 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 39.947 ms (5%) 146.28 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 996.935 μs (5%) 2.12 MiB (1%) 23420
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 54.201 μs (5%) 105.88 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.159 s (5%) 574.836 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 19.139 ms (5%) 63.39 MiB (1%) 416700
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.699 μs (5%) 19.23 KiB (1%) 197
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 71.833 μs (5%) 132.61 KiB (1%) 901
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 144.569 μs (5%) 297.62 KiB (1%) 2143
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 293.065 μs (5%) 548.88 KiB (1%) 6147
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 438.143 ms (5%) 42.825 ms 515.81 MiB (1%) 3040153
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.448 ms (5%) 30.12 MiB (1%) 175241
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.073 ms (5%) 1.89 MiB (1%) 11061
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 62.274 ms (5%) 74.61 MiB (1%) 720057
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.499 ms (5%) 4.33 MiB (1%) 41515
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 215.331 μs (5%) 277.94 KiB (1%) 2621
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.126 s (5%) 70.231 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 35.833 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.176 μs (5%) 11.53 KiB (1%) 84
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.248 ms (5%) 3.94 MiB (1%) 15188
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.144 ms (5%) 15.42 MiB (1%) 26795
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 141.807 ms (5%) 4.133 ms 736.83 MiB (1%) 29500
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.088 s (5%) 55.028 ms 446.84 MiB (1%) 3740275
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 52.712 ms (5%) 26.02 MiB (1%) 215569
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.312 ms (5%) 1.63 MiB (1%) 13589
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 75.013 ms (5%) 89.56 MiB (1%) 980062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.425 ms (5%) 5.19 MiB (1%) 56496
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 202.096 μs (5%) 333.44 KiB (1%) 3562
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 12.948 s (5%) 2.010 s 10.21 GiB (1%) 50938351
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 380.670 ms (5%) 32.104 ms 384.57 MiB (1%) 1894354
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 21.140 μs (5%) 63.55 KiB (1%) 721
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 4.249 ms (5%) 2.56 MiB (1%) 15411
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 189.175 ms (5%) 10.68 MiB (1%) 40554
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 18.957 s (5%) 8.93 MiB (1%) 39293
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 281.479 ms (5%) 32.691 ms 331.11 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.493 ms (5%) 19.09 MiB (1%) 130321
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 644.619 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 43.619 ms (5%) 69.42 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.205 ms (5%) 4.03 MiB (1%) 38062
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 115.895 μs (5%) 259.14 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.570 s (5%) 244.964 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 87.849 ms (5%) 5.640 ms 144.46 MiB (1%) 928266
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.914 μs (5%) 36.61 KiB (1%) 335
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 277.646 μs (5%) 512.99 KiB (1%) 2718
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.218 ms (5%) 2.33 MiB (1%) 8110
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.989 ms (5%) 8.31 MiB (1%) 24716
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 34.597 ms (5%) 74.00 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.936 ms (5%) 4.28 MiB (1%) 23177
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 136.324 μs (5%) 282.06 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 10.858 ms (5%) 22.27 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 621.807 μs (5%) 1.31 MiB (1%) 10411
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 40.104 μs (5%) 85.00 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 730.469 ms (5%) 75.426 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.638 ms (5%) 41.72 MiB (1%) 177600
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.726 μs (5%) 15.72 KiB (1%) 139
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 72.405 μs (5%) 153.61 KiB (1%) 461
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 206.504 μs (5%) 619.09 KiB (1%) 1115
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 558.840 μs (5%) 1.90 MiB (1%) 2954
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 176.306 ms (5%) 40.235 ms 745.96 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.638 ms (5%) 5.98 MiB (1%) 60512
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 148.506 μs (5%) 266.58 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 41.071 ms (5%) 147.35 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.022 ms (5%) 2.18 MiB (1%) 23425
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 55.393 μs (5%) 110.06 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 1.940 s (5%) 295.856 ms 18.62 GiB (1%) 11525819
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.191 ms (5%) 63.51 MiB (1%) 416711
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.930 μs (5%) 29.62 KiB (1%) 219
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 75.239 μs (5%) 144.12 KiB (1%) 935
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 150.350 μs (5%) 310.77 KiB (1%) 2207
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 293.846 μs (5%) 551.39 KiB (1%) 6043
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 442.787 ms (5%) 47.976 ms 519.74 MiB (1%) 3040157
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.482 ms (5%) 30.22 MiB (1%) 175245
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.074 ms (5%) 1.90 MiB (1%) 11063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 62.646 ms (5%) 75.68 MiB (1%) 720063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.534 ms (5%) 4.39 MiB (1%) 41520
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 217.504 μs (5%) 282.12 KiB (1%) 2624
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.161 s (5%) 74.704 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 36.483 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.429 μs (5%) 22.20 KiB (1%) 99
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.458 ms (5%) 1.96 MiB (1%) 11003
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 5.599 ms (5%) 13.70 MiB (1%) 26704
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 170.059 ms (5%) 5.047 ms 914.07 MiB (1%) 29729
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.066 s (5%) 53.753 ms 446.26 MiB (1%) 3740279
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 52.566 ms (5%) 26.12 MiB (1%) 215573
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.307 ms (5%) 1.64 MiB (1%) 13591
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 76.162 ms (5%) 90.63 MiB (1%) 980068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.461 ms (5%) 5.25 MiB (1%) 56501
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 204.069 μs (5%) 337.62 KiB (1%) 3565
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 13.156 s (5%) 2.061 s 10.21 GiB (1%) 50938363
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 404.724 ms (5%) 32.045 ms 384.68 MiB (1%) 1894365
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 25.407 μs (5%) 77.75 KiB (1%) 777
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 7.168 ms (5%) 4.34 MiB (1%) 21932
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 199.197 ms (5%) 9.85 MiB (1%) 39433
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 20.342 s (5%) 8.69 MiB (1%) 39042
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 294.073 ms (5%) 35.997 ms 332.79 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.575 ms (5%) 19.19 MiB (1%) 130325
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 649.347 μs (5%) 1.21 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.438 ms (5%) 70.49 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.205 ms (5%) 4.09 MiB (1%) 38067
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 116.637 μs (5%) 263.33 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.583 s (5%) 254.729 ms 3.69 GiB (1%) 24699853
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 87.600 ms (5%) 5.516 ms 144.58 MiB (1%) 928277
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 13.334 μs (5%) 44.42 KiB (1%) 327
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 315.237 μs (5%) 576.94 KiB (1%) 2945
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.272 ms (5%) 2.42 MiB (1%) 8328
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.103 ms (5%) 8.55 MiB (1%) 25158
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 34.930 ms (5%) 75.68 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.953 ms (5%) 4.38 MiB (1%) 23181
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 138.367 μs (5%) 288.33 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 11.192 ms (5%) 23.34 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 641.734 μs (5%) 1.38 MiB (1%) 10416
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 41.798 μs (5%) 89.19 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 747.182 ms (5%) 104.590 ms 1.03 GiB (1%) 4711225
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.771 ms (5%) 41.84 MiB (1%) 177611
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.388 μs (5%) 24.11 KiB (1%) 142
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 77.504 μs (5%) 171.55 KiB (1%) 471
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 211.383 μs (5%) 631.11 KiB (1%) 1104
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 575.009 μs (5%) 1.97 MiB (1%) 3034
["OptimizationProblems", "britgas", "Hessian"] 4.993 ms (5%) 10.43 MiB (1%) 35148
["OptimizationProblems", "britgas", "Jacobian"] 309.616 μs (5%) 484.22 KiB (1%) 6118

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz      10075 s          0 s        677 s      26775 s          0 s
       #2  3242 MHz      11307 s          0 s        748 s      25483 s          0 s
       #3  2445 MHz       9320 s          0 s        625 s      27592 s          0 s
       #4  3239 MHz       9951 s          0 s        673 s      26912 s          0 s
  Memory: 15.606502532958984 GB (13329.45703125 MB free)
  Uptime: 3762.42 sec
  Load Avg:  1.01  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 14 Jun 2024 - 23:39
  • Package commit: 701f91
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.949 ms (5%) 68.07 MiB (1%) 107996
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 195.931 ms (5%) 3.610 ms 347.44 MiB (1%) 303603
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 540.731 ms (5%) 9.790 ms 772.01 MiB (1%) 542740
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.241 s (5%) 20.264 ms 1.59 GiB (1%) 973471
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.287 ms (5%) 2.933 ms 226.63 MiB (1%) 221258
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 645.233 ms (5%) 10.164 ms 816.18 MiB (1%) 449672
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.850 ms (5%) 94.62 MiB (1%) 84521
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.806 ms (5%) 3.871 ms 353.64 MiB (1%) 171369
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.068 ms (5%) 10.83 MiB (1%) 23677
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.347 s (5%) 15.927 ms 1.63 GiB (1%) 352748
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.478 ms (5%) 40.41 MiB (1%) 41052
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.773 ms (5%) 1.219 ms 155.85 MiB (1%) 78621
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 469.113 ms (5%) 20.167 ms 1.16 GiB (1%) 812709
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 250.794 ms (5%) 7.539 ms 438.84 MiB (1%) 529231
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 651.395 ms (5%) 16.653 ms 962.48 MiB (1%) 1213669
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.880 s (5%) 58.204 ms 2.97 GiB (1%) 3616989
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.056 s (5%) 44.482 ms 2.48 GiB (1%) 1667540
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.453 s (5%) 93.691 ms 5.40 GiB (1%) 3376708
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 142.415 ms (5%) 5.640 ms 250.69 MiB (1%) 735499
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 438.359 ms (5%) 14.900 ms 678.80 MiB (1%) 1538707
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.090 ms (5%) 19.69 MiB (1%) 23160
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.705 s (5%) 40.467 ms 2.29 GiB (1%) 3146828
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.670 ms (5%) 48.50 MiB (1%) 65952
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 139.466 ms (5%) 1.724 ms 175.87 MiB (1%) 193073
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 376.089 ms (5%) 16.704 ms 763.54 MiB (1%) 741594
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 674.966 ms (5%) 18.353 ms 683.80 MiB (1%) 1029077
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.391 s (5%) 32.290 ms 1.24 GiB (1%) 2067121
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.021 s (5%) 70.606 ms 2.82 GiB (1%) 4613106
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 909.094 ms (5%) 36.459 ms 1.60 GiB (1%) 1508306
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.445 s (5%) 85.423 ms 3.70 GiB (1%) 3059616
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 168.556 ms (5%) 8.983 ms 329.51 MiB (1%) 1010343
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 490.894 ms (5%) 18.088 ms 832.93 MiB (1%) 2077373
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 20.676 ms (5%) 33.20 MiB (1%) 81757
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.901 s (5%) 51.256 ms 2.63 GiB (1%) 4238487
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 75.841 ms (5%) 2.625 ms 115.79 MiB (1%) 183045
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 209.092 ms (5%) 5.029 ms 237.23 MiB (1%) 387733
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.415 ms (5%) 73.22 MiB (1%) 129848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 226.701 ms (5%) 5.279 ms 382.43 MiB (1%) 332471
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 579.653 ms (5%) 12.876 ms 805.29 MiB (1%) 585314
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.284 s (5%) 23.850 ms 1.62 GiB (1%) 1053045
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 180.066 ms (5%) 3.876 ms 237.06 MiB (1%) 260848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 665.900 ms (5%) 11.825 ms 839.93 MiB (1%) 523161
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.437 ms (5%) 1.711 ms 99.53 MiB (1%) 86669
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 274.006 ms (5%) 4.167 ms 350.57 MiB (1%) 173907
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.918 ms (5%) 15.22 MiB (1%) 26080
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.359 s (5%) 17.498 ms 1.65 GiB (1%) 349571
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.683 ms (5%) 43.73 MiB (1%) 40913
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.915 ms (5%) 1.348 ms 159.51 MiB (1%) 73896
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.590 ms (5%) 65.86 MiB (1%) 86084
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.298 ms (5%) 5.200 ms 344.01 MiB (1%) 234051
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 536.727 ms (5%) 9.484 ms 755.62 MiB (1%) 413169
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.223 s (5%) 18.241 ms 1.55 GiB (1%) 742951
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.347 ms (5%) 2.946 ms 222.02 MiB (1%) 172802
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 638.525 ms (5%) 9.811 ms 805.99 MiB (1%) 346335
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 58.972 ms (5%) 89.07 MiB (1%) 50162
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 259.703 ms (5%) 3.637 ms 332.68 MiB (1%) 100742
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.179 ms (5%) 11.31 MiB (1%) 17258
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.331 s (5%) 15.373 ms 1.61 GiB (1%) 202242
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 21.840 ms (5%) 39.38 MiB (1%) 28460
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.628 ms (5%) 1.165 ms 154.83 MiB (1%) 53479
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.932 ms (5%) 67.92 MiB (1%) 101597
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.551 ms (5%) 3.690 ms 347.22 MiB (1%) 290805
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 539.238 ms (5%) 8.642 ms 771.50 MiB (1%) 517142
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.232 s (5%) 18.001 ms 1.59 GiB (1%) 922273
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 171.423 ms (5%) 2.934 ms 226.35 MiB (1%) 208459
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 644.407 ms (5%) 9.827 ms 815.61 MiB (1%) 424074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 63.651 ms (5%) 95.95 MiB (1%) 84715
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 268.832 ms (5%) 3.853 ms 348.23 MiB (1%) 170566
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.377 ms (5%) 12.32 MiB (1%) 23655
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.348 s (5%) 15.620 ms 1.64 GiB (1%) 354322
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.553 ms (5%) 40.72 MiB (1%) 41001
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 128.606 ms (5%) 1.205 ms 156.67 MiB (1%) 78528
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 471.749 ms (5%) 21.374 ms 1.16 GiB (1%) 812710
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 253.189 ms (5%) 7.944 ms 438.91 MiB (1%) 529233
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 649.510 ms (5%) 17.437 ms 962.55 MiB (1%) 1213671
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.864 s (5%) 55.585 ms 2.97 GiB (1%) 3616991
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.047 s (5%) 44.811 ms 2.48 GiB (1%) 1667541
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.439 s (5%) 95.246 ms 5.40 GiB (1%) 3376710
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 144.285 ms (5%) 6.054 ms 252.54 MiB (1%) 742669
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 434.119 ms (5%) 13.350 ms 672.83 MiB (1%) 1536304
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.941 ms (5%) 17.55 MiB (1%) 23731
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.702 s (5%) 42.561 ms 2.30 GiB (1%) 3148009
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.009 ms (5%) 49.38 MiB (1%) 66606
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 139.814 ms (5%) 1.874 ms 176.89 MiB (1%) 193537
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 374.897 ms (5%) 17.292 ms 763.54 MiB (1%) 741595
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 677.401 ms (5%) 18.988 ms 683.87 MiB (1%) 1029079
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.401 s (5%) 30.815 ms 1.24 GiB (1%) 2067123
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.002 s (5%) 69.723 ms 2.82 GiB (1%) 4613108
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 913.946 ms (5%) 38.486 ms 1.60 GiB (1%) 1508307
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.441 s (5%) 87.155 ms 3.70 GiB (1%) 3059618
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 167.354 ms (5%) 9.543 ms 324.00 MiB (1%) 996843
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 500.022 ms (5%) 21.701 ms 841.49 MiB (1%) 2079543
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 21.665 ms (5%) 35.86 MiB (1%) 81910
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.896 s (5%) 52.219 ms 2.64 GiB (1%) 4241145
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 63.688 ms (5%) 84.75 MiB (1%) 168488
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 205.139 ms (5%) 5.130 ms 223.89 MiB (1%) 382664
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.654 ms (5%) 73.22 MiB (1%) 129849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 226.855 ms (5%) 5.770 ms 382.50 MiB (1%) 332473
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 575.909 ms (5%) 11.188 ms 805.37 MiB (1%) 585316
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.284 s (5%) 24.560 ms 1.62 GiB (1%) 1053047
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 180.420 ms (5%) 3.926 ms 237.07 MiB (1%) 260849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 666.861 ms (5%) 12.232 ms 839.95 MiB (1%) 523163
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 68.141 ms (5%) 1.658 ms 102.35 MiB (1%) 87120
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 274.409 ms (5%) 4.185 ms 350.69 MiB (1%) 174429
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.096 ms (5%) 16.52 MiB (1%) 26673
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.361 s (5%) 17.598 ms 1.64 GiB (1%) 349379
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.859 ms (5%) 44.43 MiB (1%) 41776
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 133.271 ms (5%) 1.430 ms 161.67 MiB (1%) 74768
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.667 ms (5%) 65.86 MiB (1%) 86085
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.599 ms (5%) 4.482 ms 344.08 MiB (1%) 234053
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 534.910 ms (5%) 8.946 ms 755.70 MiB (1%) 413171
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.226 s (5%) 19.312 ms 1.55 GiB (1%) 742953
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.998 ms (5%) 3.268 ms 222.03 MiB (1%) 172803
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 639.136 ms (5%) 10.405 ms 806.01 MiB (1%) 346337
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 59.851 ms (5%) 91.63 MiB (1%) 50497
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 260.274 ms (5%) 3.966 ms 334.30 MiB (1%) 101096
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.418 ms (5%) 12.39 MiB (1%) 18043
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.347 s (5%) 18.474 ms 1.61 GiB (1%) 202732
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.218 ms (5%) 40.38 MiB (1%) 29232
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 127.344 ms (5%) 1.342 ms 155.46 MiB (1%) 54284
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 169.541 ms (5%) 36.619 ms 743.21 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.433 ms (5%) 5.82 MiB (1%) 60501
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 135.752 μs (5%) 256.38 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 36.927 ms (5%) 145.98 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 930.982 μs (5%) 2.10 MiB (1%) 23418
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 50.654 μs (5%) 104.75 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 1.939 s (5%) 283.386 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 17.187 ms (5%) 63.36 MiB (1%) 416698
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.362 μs (5%) 15.94 KiB (1%) 201
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 64.250 μs (5%) 130.00 KiB (1%) 905
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 134.310 μs (5%) 298.14 KiB (1%) 2183
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 253.601 μs (5%) 530.64 KiB (1%) 5899
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 610.393 ms (5%) 51.587 ms 721.19 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.262 ms (5%) 41.98 MiB (1%) 288498
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.753 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 91.656 ms (5%) 5.136 ms 97.19 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.893 ms (5%) 5.66 MiB (1%) 55705
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 306.380 μs (5%) 368.44 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.672 s (5%) 54.266 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 57.607 ms (5%) 41.54 MiB (1%) 175246
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 4.238 μs (5%) 8.25 KiB (1%) 77
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.336 ms (5%) 1.81 MiB (1%) 11260
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.167 ms (5%) 12.65 MiB (1%) 37494
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 11.506 ms (5%) 24.39 MiB (1%) 67216
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.573 s (5%) 81.342 ms 838.84 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.646 ms (5%) 48.60 MiB (1%) 435594
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.705 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 162.154 ms (5%) 19.758 ms 216.21 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.093 ms (5%) 12.49 MiB (1%) 137134
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 406.195 μs (5%) 800.31 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 19.957 s (5%) 1.916 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 626.306 ms (5%) 36.315 ms 697.77 MiB (1%) 4174856
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 31.048 μs (5%) 105.73 KiB (1%) 1222
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 7.202 ms (5%) 4.49 MiB (1%) 25282
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 210.964 ms (5%) 12.69 MiB (1%) 58412
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 23.057 s (5%) 23.88 MiB (1%) 108141
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 282.106 ms (5%) 45.268 ms 330.04 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.285 ms (5%) 19.03 MiB (1%) 130314
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 635.121 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 41.504 ms (5%) 69.12 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.127 ms (5%) 4.01 MiB (1%) 38060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 112.239 μs (5%) 258.02 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.805 s (5%) 537.956 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 85.821 ms (5%) 4.950 ms 144.42 MiB (1%) 928264
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.267 μs (5%) 31.92 KiB (1%) 315
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 190.685 μs (5%) 421.48 KiB (1%) 2383
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.204 ms (5%) 2.26 MiB (1%) 8155
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.769 ms (5%) 7.97 MiB (1%) 23896
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 31.180 ms (5%) 72.93 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.723 ms (5%) 4.22 MiB (1%) 23170
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 124.351 μs (5%) 278.12 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 9.774 ms (5%) 21.97 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 557.687 μs (5%) 1.30 MiB (1%) 10409
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 35.677 μs (5%) 83.88 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 636.798 ms (5%) 82.740 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 18.709 ms (5%) 41.69 MiB (1%) 177598
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.310 μs (5%) 13.05 KiB (1%) 140
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 58.518 μs (5%) 141.31 KiB (1%) 461
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 201.404 μs (5%) 663.31 KiB (1%) 1156
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 544.773 μs (5%) 2.04 MiB (1%) 3117
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 170.626 ms (5%) 35.526 ms 744.59 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.504 ms (5%) 5.90 MiB (1%) 60510
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 140.121 μs (5%) 261.62 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 38.592 ms (5%) 146.74 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 951.450 μs (5%) 2.14 MiB (1%) 23423
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 51.997 μs (5%) 107.84 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.094 s (5%) 824.435 ms 18.62 GiB (1%) 11587323
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 18.565 ms (5%) 63.59 MiB (1%) 419014
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.714 μs (5%) 25.80 KiB (1%) 221
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 71.383 μs (5%) 144.20 KiB (1%) 943
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 133.959 μs (5%) 302.81 KiB (1%) 2153
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 257.559 μs (5%) 538.44 KiB (1%) 5899
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 669.299 ms (5%) 64.197 ms 722.56 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 28.598 ms (5%) 42.06 MiB (1%) 288507
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.772 ms (5%) 2.64 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 91.500 ms (5%) 97.95 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.924 ms (5%) 5.70 MiB (1%) 55710
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 310.097 μs (5%) 371.53 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.748 s (5%) 94.690 ms 1.02 GiB (1%) 4692825
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 58.591 ms (5%) 41.70 MiB (1%) 176410
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.410 μs (5%) 16.72 KiB (1%) 88
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.829 ms (5%) 2.82 MiB (1%) 13548
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.431 ms (5%) 13.03 MiB (1%) 38092
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 11.815 ms (5%) 24.55 MiB (1%) 67757
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.636 s (5%) 95.332 ms 840.22 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.408 ms (5%) 48.68 MiB (1%) 435603
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.725 ms (5%) 3.05 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 173.332 ms (5%) 23.238 ms 216.97 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.138 ms (5%) 12.53 MiB (1%) 137139
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 410.865 μs (5%) 803.41 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 21.779 s (5%) 2.670 s 18.50 GiB (1%) 112202347
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 669.274 ms (5%) 45.223 ms 698.35 MiB (1%) 4181780
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 40.074 μs (5%) 135.33 KiB (1%) 1459
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 4.815 ms (5%) 3.20 MiB (1%) 20895
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 236.753 ms (5%) 12.53 MiB (1%) 58303
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 23.479 s (5%) 27.89 MiB (1%) 112992
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 283.831 ms (5%) 41.112 ms 331.41 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.349 ms (5%) 19.11 MiB (1%) 130323
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 642.224 μs (5%) 1.20 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 42.162 ms (5%) 69.88 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.150 ms (5%) 4.06 MiB (1%) 38065
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 112.760 μs (5%) 261.11 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.551 s (5%) 284.272 ms 3.70 GiB (1%) 24822861
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 86.288 ms (5%) 5.219 ms 144.95 MiB (1%) 932884
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.350 μs (5%) 42.03 KiB (1%) 343
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 316.018 μs (5%) 578.90 KiB (1%) 2961
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.278 ms (5%) 2.46 MiB (1%) 8408
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.994 ms (5%) 8.37 MiB (1%) 24769
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 32.643 ms (5%) 74.30 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.819 ms (5%) 4.30 MiB (1%) 23179
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 129.731 μs (5%) 283.38 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 10.136 ms (5%) 22.73 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 584.257 μs (5%) 1.34 MiB (1%) 10414
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 37.951 μs (5%) 86.97 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 662.947 ms (5%) 63.870 ms 1.03 GiB (1%) 4741977
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.095 ms (5%) 41.85 MiB (1%) 178762
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.850 μs (5%) 20.23 KiB (1%) 143
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 82.243 μs (5%) 192.47 KiB (1%) 534
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 213.998 μs (5%) 698.64 KiB (1%) 1212
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 531.559 μs (5%) 1.91 MiB (1%) 2986
["OptimizationProblems", "britgas", "Hessian"] 5.159 ms (5%) 10.42 MiB (1%) 35097
["OptimizationProblems", "britgas", "Jacobian"] 13.513 ms (5%) 13.120 ms 477.91 KiB (1%) 6118

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz      12747 s          0 s        873 s      40117 s          0 s
       #2  3243 MHz      14912 s          0 s       1003 s      37838 s          0 s
       #3  2779 MHz      12980 s          0 s        844 s      39925 s          0 s
       #4  3373 MHz      15745 s          0 s       1001 s      37009 s          0 s
  Memory: 15.606502532958984 GB (12972.3125 MB free)
  Uptime: 5386.45 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@adrhill
Copy link
Owner Author

adrhill commented Jun 16, 2024

Looks like there is a minor decrease in performance in BitSet and SortedVector and a major increase in performance in DuplicateVector and RecursiveSet.

Technically speaking, we don't need @noinline on GradientTracer, since the compile times weren't horrible. I have no strong opinions on this, what do you think @gdalle?

gdalle
gdalle reviewed Jun 17, 2024
View reviewed changes
Copy link
Collaborator

@gdalle gdalle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me apart from some minor comments

src/adtypes.jl Outdated Show resolved Hide resolved
src/SparseConnectivityTracer.jl Outdated Show resolved Hide resolved
src/adtypes.jl Show resolved Hide resolved
src/overload_connectivity.jl Show resolved Hide resolved
src/overload_connectivity.jl Show resolved Hide resolved
src/tracers.jl Show resolved Hide resolved
src/tracers.jl Show resolved Hide resolved
@adrhill
Copy link
Owner Author

adrhill commented Jun 17, 2024 •
edited
Loading

I double-checked and the inlining makes no difference on first-order tracers:

GradientTracer with @noinline:

first jacobian: 0.756304 seconds (729.08 k allocations: 48.768 MiB, 0.66% gc time, 99.98% compilation time)
second jacobian: 0.000062 seconds (2.05 k allocations: 169.844 KiB)

without @noinline:

first jacobian: 0.746296 seconds (846.85 k allocations: 54.726 MiB, 0.76% gc time, 99.97% compilation time)
second jacobian: 0.000059 seconds (2.05 k allocations: 169.844 KiB)

@gdalle
Copy link
Collaborator

gdalle commented Jun 17, 2024

your call

@adrhill
Copy link
Owner Author

adrhill commented Jun 17, 2024

Since there is no cost in performance, let's just bring it back so we don't have to worry about it in the future!

@adrhill adrhill merged commit 9ccf210 into main Jun 17, 2024
5 checks passed
@adrhill adrhill deleted the ah/generalize-tracers branch June 17, 2024 12:24
@github-actions GitHub Actions
Copy link

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 17 Jun 2024 - 13:00
    • Baseline: 17 Jun 2024 - 13:27
  • Package commits:
    • Target: 48b100
    • Baseline: 701f91
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 0.37 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 1.07 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.06 (5%) ❌ 1.01 (1%)
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 1.08 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 1.15 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.71 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.60 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.61 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.67 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.71 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.69 (5%) ✅ 0.75 (1%) ✅
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 0.71 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 0.65 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.69 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.68 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.71 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.46 (5%) ✅ 0.41 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.50 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.52 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 0.64 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 0.62 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 1.05 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 0.90 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 1.09 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.09 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 1.10 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.13 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.13 (5%) ❌ 1.01 (1%) ❌
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 1.02 (5%) 1.01 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 1.03 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.05 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 1.05 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 0.91 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 0.67 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 0.60 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 0.60 (5%) ✅ 0.72 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 0.68 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 0.70 (5%) ✅ 0.77 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 0.69 (5%) ✅ 0.76 (1%) ✅
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 0.70 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 0.65 (5%) ✅ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 0.65 (5%) ✅ 0.53 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 0.68 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 0.71 (5%) ✅ 0.54 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 0.43 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 0.49 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 0.51 (5%) ✅ 0.42 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 0.57 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 0.58 (5%) ✅ 0.55 (1%) ✅
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 1.09 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 1.05 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.04 (5%) 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 1.06 (5%) ❌ 1.02 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 1.09 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.09 (5%) ❌ 1.03 (1%) ❌
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.09 (5%) ❌ 1.03 (1%) ❌
["OptimizationProblems", "britgas", "Jacobian"] 1.17 (5%) ❌ 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3244 MHz      10740 s          0 s        636 s      28998 s          0 s
       #2  3250 MHz      11118 s          0 s        712 s      28550 s          0 s
       #3  2607 MHz      10921 s          0 s        775 s      28666 s          0 s
       #4  3117 MHz       8974 s          0 s        607 s      30790 s          0 s
  Memory: 15.606498718261719 GB (12913.15234375 MB free)
  Uptime: 4046.82 sec
  Load Avg:  1.03  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz      15397 s          0 s        828 s      40740 s          0 s
       #2  2595 MHz      15922 s          0 s        971 s      40082 s          0 s
       #3  3243 MHz      14658 s          0 s       1067 s      41229 s          0 s
       #4  2445 MHz      11888 s          0 s        903 s      44169 s          0 s
  Memory: 15.606498718261719 GB (13205.71484375 MB free)
  Uptime: 5708.97 sec
  Load Avg:  1.02  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 17 Jun 2024 - 13:0
  • Package commit: 48b100
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 48.508 ms (5%) 67.96 MiB (1%) 107183
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 200.622 ms (5%) 4.976 ms 345.81 MiB (1%) 290793
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 554.813 ms (5%) 9.880 ms 770.37 MiB (1%) 529927
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.280 s (5%) 19.218 ms 1.58 GiB (1%) 960658
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 177.636 ms (5%) 3.461 ms 226.42 MiB (1%) 219645
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 666.591 ms (5%) 9.746 ms 815.77 MiB (1%) 446460
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 64.707 ms (5%) 96.21 MiB (1%) 84816
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 276.874 ms (5%) 4.096 ms 348.89 MiB (1%) 170918
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.184 ms (5%) 11.09 MiB (1%) 23668
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.384 s (5%) 15.226 ms 1.63 GiB (1%) 353494
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.626 ms (5%) 40.35 MiB (1%) 41016
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.777 ms (5%) 1.372 ms 155.22 MiB (1%) 78621
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 484.235 ms (5%) 24.046 ms 1.16 GiB (1%) 792458
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 214.917 ms (5%) 7.135 ms 420.94 MiB (1%) 450196
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 621.947 ms (5%) 17.701 ms 1000.56 MiB (1%) 1109569
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.879 s (5%) 59.867 ms 3.11 GiB (1%) 3452128
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.079 s (5%) 49.210 ms 2.50 GiB (1%) 1626489
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.513 s (5%) 104.453 ms 5.49 GiB (1%) 3293110
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 152.805 ms (5%) 9.056 ms 253.27 MiB (1%) 722246
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 443.947 ms (5%) 16.374 ms 679.40 MiB (1%) 1504395
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.103 ms (5%) 12.15 MiB (1%) 16846
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.751 s (5%) 44.491 ms 2.30 GiB (1%) 3079759
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.465 ms (5%) 45.39 MiB (1%) 56831
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 137.985 ms (5%) 1.816 ms 174.15 MiB (1%) 177692
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 340.183 ms (5%) 17.486 ms 751.93 MiB (1%) 634196
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 235.178 ms (5%) 12.272 ms 384.66 MiB (1%) 694752
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 657.688 ms (5%) 21.708 ms 949.87 MiB (1%) 1542194
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.731 s (5%) 60.665 ms 2.47 GiB (1%) 3693393
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 774.176 ms (5%) 39.414 ms 1.57 GiB (1%) 1289158
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.910 s (5%) 89.620 ms 3.58 GiB (1%) 2607447
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 168.442 ms (5%) 10.789 ms 320.24 MiB (1%) 954038
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 467.143 ms (5%) 22.386 ms 814.66 MiB (1%) 1983371
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.298 ms (5%) 14.19 MiB (1%) 58437
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.783 s (5%) 54.509 ms 2.57 GiB (1%) 4048070
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.543 ms (5%) 49.31 MiB (1%) 131199
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 149.850 ms (5%) 2.961 ms 183.90 MiB (1%) 326733
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 52.744 ms (5%) 73.11 MiB (1%) 129037
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 229.020 ms (5%) 4.694 ms 380.79 MiB (1%) 319663
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 594.858 ms (5%) 12.987 ms 803.65 MiB (1%) 572503
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.325 s (5%) 24.387 ms 1.62 GiB (1%) 1040234
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 186.065 ms (5%) 4.346 ms 236.85 MiB (1%) 259237
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 688.911 ms (5%) 13.063 ms 839.52 MiB (1%) 519951
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 68.088 ms (5%) 100.52 MiB (1%) 86799
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 283.863 ms (5%) 4.679 ms 350.81 MiB (1%) 173797
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.799 ms (5%) 14.10 MiB (1%) 25715
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.413 s (5%) 16.281 ms 1.65 GiB (1%) 348969
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.969 ms (5%) 48.36 MiB (1%) 41457
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 134.967 ms (5%) 1.431 ms 158.53 MiB (1%) 73847
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.931 ms (5%) 65.75 MiB (1%) 85274
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 201.021 ms (5%) 5.149 ms 342.37 MiB (1%) 221244
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 551.490 ms (5%) 10.175 ms 753.99 MiB (1%) 400359
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.265 s (5%) 20.524 ms 1.55 GiB (1%) 730141
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 172.583 ms (5%) 2.055 ms 221.81 MiB (1%) 171192
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 661.288 ms (5%) 11.047 ms 805.58 MiB (1%) 343126
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.247 ms (5%) 90.07 MiB (1%) 50296
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.870 ms (5%) 4.199 ms 340.49 MiB (1%) 101238
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.258 ms (5%) 11.20 MiB (1%) 17250
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.379 s (5%) 16.495 ms 1.60 GiB (1%) 201575
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.156 ms (5%) 38.98 MiB (1%) 28427
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.880 ms (5%) 1.363 ms 154.33 MiB (1%) 53356
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 48.361 ms (5%) 67.97 MiB (1%) 107184
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 199.280 ms (5%) 4.347 ms 345.95 MiB (1%) 290795
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 554.891 ms (5%) 9.466 ms 770.52 MiB (1%) 529929
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.274 s (5%) 18.577 ms 1.59 GiB (1%) 960660
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 177.290 ms (5%) 3.405 ms 226.44 MiB (1%) 219646
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 664.961 ms (5%) 9.506 ms 815.81 MiB (1%) 446462
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 66.130 ms (5%) 100.22 MiB (1%) 85504
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 277.955 ms (5%) 4.104 ms 354.23 MiB (1%) 171712
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.689 ms (5%) 14.48 MiB (1%) 24661
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.389 s (5%) 14.277 ms 1.63 GiB (1%) 354810
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.943 ms (5%) 41.16 MiB (1%) 41843
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 132.100 ms (5%) 1.273 ms 156.62 MiB (1%) 79438
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 485.084 ms (5%) 22.943 ms 1.16 GiB (1%) 792459
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 213.372 ms (5%) 6.818 ms 421.08 MiB (1%) 450198
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 620.991 ms (5%) 16.839 ms 1000.71 MiB (1%) 1109571
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.884 s (5%) 60.317 ms 3.11 GiB (1%) 3452130
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.082 s (5%) 49.821 ms 2.50 GiB (1%) 1626490
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.537 s (5%) 108.346 ms 5.49 GiB (1%) 3293112
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 153.035 ms (5%) 8.998 ms 253.97 MiB (1%) 721523
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 441.522 ms (5%) 17.042 ms 675.35 MiB (1%) 1504961
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.421 ms (5%) 14.79 MiB (1%) 17763
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.741 s (5%) 43.481 ms 2.30 GiB (1%) 3073449
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 23.575 ms (5%) 46.18 MiB (1%) 57555
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 138.608 ms (5%) 1.768 ms 175.40 MiB (1%) 178459
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 343.045 ms (5%) 20.295 ms 751.94 MiB (1%) 634197
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 241.653 ms (5%) 9.846 ms 384.80 MiB (1%) 694754
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 660.372 ms (5%) 21.381 ms 950.01 MiB (1%) 1542196
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.735 s (5%) 60.268 ms 2.47 GiB (1%) 3693395
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 778.289 ms (5%) 40.637 ms 1.57 GiB (1%) 1289159
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 1.906 s (5%) 90.928 ms 3.58 GiB (1%) 2607449
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 168.341 ms (5%) 10.780 ms 317.19 MiB (1%) 951985
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 466.132 ms (5%) 22.855 ms 812.26 MiB (1%) 1976230
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.762 ms (5%) 16.05 MiB (1%) 59313
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.791 s (5%) 56.012 ms 2.57 GiB (1%) 4043789
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 28.010 ms (5%) 50.15 MiB (1%) 132052
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 151.238 ms (5%) 2.833 ms 185.66 MiB (1%) 327645
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 51.920 ms (5%) 73.12 MiB (1%) 129038
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 228.942 ms (5%) 4.840 ms 380.94 MiB (1%) 319665
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 596.423 ms (5%) 13.224 ms 803.80 MiB (1%) 572505
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.328 s (5%) 25.775 ms 1.62 GiB (1%) 1040236
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 186.903 ms (5%) 4.381 ms 236.87 MiB (1%) 259238
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 688.180 ms (5%) 11.370 ms 839.56 MiB (1%) 519953
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.740 ms (5%) 98.86 MiB (1%) 86819
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 283.025 ms (5%) 4.688 ms 351.03 MiB (1%) 174264
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.094 ms (5%) 15.50 MiB (1%) 26627
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.416 s (5%) 16.687 ms 1.65 GiB (1%) 350115
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.369 ms (5%) 44.08 MiB (1%) 41681
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 136.613 ms (5%) 1.567 ms 160.75 MiB (1%) 74766
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.911 ms (5%) 65.76 MiB (1%) 85275
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 200.102 ms (5%) 4.890 ms 342.52 MiB (1%) 221246
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 551.493 ms (5%) 9.651 ms 754.13 MiB (1%) 400361
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.264 s (5%) 20.111 ms 1.55 GiB (1%) 730143
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 173.691 ms (5%) 2.398 ms 221.83 MiB (1%) 171193
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 661.057 ms (5%) 9.935 ms 805.62 MiB (1%) 343128
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.107 ms (5%) 91.20 MiB (1%) 50506
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 270.796 ms (5%) 4.183 ms 338.15 MiB (1%) 101396
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.663 ms (5%) 13.35 MiB (1%) 18128
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.377 s (5%) 15.318 ms 1.61 GiB (1%) 202819
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.605 ms (5%) 40.44 MiB (1%) 29232
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 131.589 ms (5%) 1.544 ms 155.50 MiB (1%) 54286
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 173.507 ms (5%) 34.768 ms 744.28 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.646 ms (5%) 5.88 MiB (1%) 60508
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 147.745 μs (5%) 260.31 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 42.662 ms (5%) 146.28 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 1.002 ms (5%) 2.12 MiB (1%) 23420
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 54.732 μs (5%) 105.88 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.468 s (5%) 969.171 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 19.674 ms (5%) 63.39 MiB (1%) 416700
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.577 μs (5%) 18.42 KiB (1%) 197
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 84.989 μs (5%) 145.48 KiB (1%) 1011
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 149.388 μs (5%) 305.38 KiB (1%) 2279
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 283.297 μs (5%) 531.88 KiB (1%) 5875
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 444.781 ms (5%) 56.842 ms 515.81 MiB (1%) 3040153
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.542 ms (5%) 30.12 MiB (1%) 175241
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.078 ms (5%) 1.89 MiB (1%) 11061
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 61.942 ms (5%) 74.61 MiB (1%) 720057
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.469 ms (5%) 4.33 MiB (1%) 41515
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 213.618 μs (5%) 277.94 KiB (1%) 2621
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.194 s (5%) 78.405 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 37.822 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.536 μs (5%) 10.75 KiB (1%) 74
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.809 ms (5%) 2.68 MiB (1%) 12746
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 5.596 ms (5%) 13.26 MiB (1%) 26660
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 162.051 ms (5%) 5.123 ms 882.64 MiB (1%) 29642
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.096 s (5%) 63.165 ms 445.71 MiB (1%) 3740275
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 53.064 ms (5%) 26.02 MiB (1%) 215569
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.337 ms (5%) 1.63 MiB (1%) 13589
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 76.200 ms (5%) 89.56 MiB (1%) 980062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.450 ms (5%) 5.19 MiB (1%) 56496
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 205.132 μs (5%) 333.44 KiB (1%) 3562
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 13.298 s (5%) 2.138 s 10.21 GiB (1%) 50938351
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 391.666 ms (5%) 35.842 ms 384.57 MiB (1%) 1894354
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 19.887 μs (5%) 59.36 KiB (1%) 686
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 6.748 ms (5%) 3.80 MiB (1%) 19912
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 217.801 ms (5%) 9.44 MiB (1%) 38511
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 19.133 s (5%) 8.68 MiB (1%) 38983
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 295.956 ms (5%) 38.006 ms 331.11 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.619 ms (5%) 19.09 MiB (1%) 130321
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 660.279 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 44.846 ms (5%) 69.42 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.219 ms (5%) 4.03 MiB (1%) 38062
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 116.527 μs (5%) 259.14 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.673 s (5%) 293.348 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 90.445 ms (5%) 6.200 ms 144.46 MiB (1%) 928266
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.734 μs (5%) 35.83 KiB (1%) 327
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 277.717 μs (5%) 505.72 KiB (1%) 2715
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.188 ms (5%) 2.24 MiB (1%) 7899
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 3.936 ms (5%) 8.18 MiB (1%) 24455
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 34.949 ms (5%) 74.00 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.941 ms (5%) 4.28 MiB (1%) 23177
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 140.150 μs (5%) 282.06 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 11.084 ms (5%) 22.27 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 634.471 μs (5%) 1.31 MiB (1%) 10411
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 41.447 μs (5%) 85.00 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 732.618 ms (5%) 85.946 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 20.057 ms (5%) 41.72 MiB (1%) 177600
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.526 μs (5%) 15.62 KiB (1%) 138
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 71.934 μs (5%) 151.36 KiB (1%) 475
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 228.345 μs (5%) 669.94 KiB (1%) 1150
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 643.327 μs (5%) 2.10 MiB (1%) 3206
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 175.596 ms (5%) 40.639 ms 745.96 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.654 ms (5%) 5.98 MiB (1%) 60512
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 149.819 μs (5%) 266.58 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 42.894 ms (5%) 147.35 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 1.016 ms (5%) 2.18 MiB (1%) 23425
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 56.475 μs (5%) 110.06 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.204 s (5%) 373.885 ms 18.62 GiB (1%) 11525819
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.338 ms (5%) 63.51 MiB (1%) 416711
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.711 μs (5%) 28.06 KiB (1%) 207
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 75.741 μs (5%) 141.02 KiB (1%) 861
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 152.584 μs (5%) 314.77 KiB (1%) 2257
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 294.959 μs (5%) 554.27 KiB (1%) 6089
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 451.147 ms (5%) 49.164 ms 519.74 MiB (1%) 3040157
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.714 ms (5%) 30.22 MiB (1%) 175245
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.093 ms (5%) 1.90 MiB (1%) 11063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 62.559 ms (5%) 75.68 MiB (1%) 720063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.492 ms (5%) 4.39 MiB (1%) 41520
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 214.359 μs (5%) 282.12 KiB (1%) 2624
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.205 s (5%) 77.284 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 38.188 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.935 μs (5%) 20.75 KiB (1%) 89
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.022 ms (5%) 3.51 MiB (1%) 13682
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 5.612 ms (5%) 13.15 MiB (1%) 26667
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 162.739 ms (5%) 5.143 ms 869.23 MiB (1%) 29676
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.072 s (5%) 52.456 ms 446.26 MiB (1%) 3740279
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 52.968 ms (5%) 26.12 MiB (1%) 215573
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.321 ms (5%) 1.64 MiB (1%) 13591
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 75.850 ms (5%) 90.63 MiB (1%) 980068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.465 ms (5%) 5.25 MiB (1%) 56501
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 206.915 μs (5%) 337.62 KiB (1%) 3565
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 12.929 s (5%) 1.771 s 10.21 GiB (1%) 50938363
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 399.965 ms (5%) 33.098 ms 384.68 MiB (1%) 1894365
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 21.740 μs (5%) 70.86 KiB (1%) 708
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 6.028 ms (5%) 3.39 MiB (1%) 17953
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 161.795 ms (5%) 8.50 MiB (1%) 36278
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 19.461 s (5%) 14.79 MiB (1%) 46509
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 310.310 ms (5%) 40.796 ms 332.79 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.596 ms (5%) 19.19 MiB (1%) 130325
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 665.709 μs (5%) 1.21 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 44.737 ms (5%) 70.49 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.232 ms (5%) 4.09 MiB (1%) 38067
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 118.039 μs (5%) 263.33 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.935 s (5%) 557.771 ms 3.69 GiB (1%) 24699853
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 89.704 ms (5%) 6.030 ms 144.58 MiB (1%) 928277
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 14.457 μs (5%) 47.03 KiB (1%) 349
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 240.588 μs (5%) 479.61 KiB (1%) 2501
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.230 ms (5%) 2.30 MiB (1%) 8019
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.263 ms (5%) 8.92 MiB (1%) 26249
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 35.609 ms (5%) 75.68 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.960 ms (5%) 4.38 MiB (1%) 23181
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 142.555 μs (5%) 288.33 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 11.233 ms (5%) 23.34 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 641.474 μs (5%) 1.38 MiB (1%) 10416
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 42.119 μs (5%) 89.19 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 731.200 ms (5%) 83.141 ms 1.03 GiB (1%) 4711225
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 20.228 ms (5%) 41.84 MiB (1%) 177611
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.748 μs (5%) 25.48 KiB (1%) 151
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 84.227 μs (5%) 178.69 KiB (1%) 518
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 222.594 μs (5%) 668.20 KiB (1%) 1154
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 588.004 μs (5%) 1.98 MiB (1%) 3039
["OptimizationProblems", "britgas", "Hessian"] 5.288 ms (5%) 10.43 MiB (1%) 35148
["OptimizationProblems", "britgas", "Jacobian"] 312.272 μs (5%) 484.22 KiB (1%) 6118

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3244 MHz      10740 s          0 s        636 s      28998 s          0 s
       #2  3250 MHz      11118 s          0 s        712 s      28550 s          0 s
       #3  2607 MHz      10921 s          0 s        775 s      28666 s          0 s
       #4  3117 MHz       8974 s          0 s        607 s      30790 s          0 s
  Memory: 15.606498718261719 GB (12913.15234375 MB free)
  Uptime: 4046.82 sec
  Load Avg:  1.03  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 17 Jun 2024 - 13:27
  • Package commit: 701f91
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.608 ms (5%) 68.07 MiB (1%) 107996
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.640 ms (5%) 5.258 ms 347.44 MiB (1%) 303603
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 533.957 ms (5%) 9.287 ms 772.01 MiB (1%) 542740
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.216 s (5%) 19.374 ms 1.59 GiB (1%) 973471
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 169.131 ms (5%) 3.090 ms 226.63 MiB (1%) 221258
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 636.291 ms (5%) 10.877 ms 816.18 MiB (1%) 449672
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 64.938 ms (5%) 1.698 ms 96.15 MiB (1%) 84941
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 268.550 ms (5%) 4.162 ms 348.50 MiB (1%) 170675
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.356 ms (5%) 12.28 MiB (1%) 23895
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.334 s (5%) 17.875 ms 1.63 GiB (1%) 353576
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.044 ms (5%) 39.29 MiB (1%) 40965
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.502 ms (5%) 1.248 ms 155.88 MiB (1%) 78622
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 492.145 ms (5%) 24.911 ms 1.16 GiB (1%) 812709
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 251.574 ms (5%) 8.955 ms 438.84 MiB (1%) 529231
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 644.179 ms (5%) 17.616 ms 962.48 MiB (1%) 1213669
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.861 s (5%) 58.291 ms 2.97 GiB (1%) 3616989
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.113 s (5%) 55.518 ms 2.48 GiB (1%) 1667540
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.559 s (5%) 115.315 ms 5.40 GiB (1%) 3376708
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 144.627 ms (5%) 6.242 ms 252.51 MiB (1%) 738927
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 434.159 ms (5%) 15.619 ms 677.69 MiB (1%) 1538293
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.697 ms (5%) 15.49 MiB (1%) 22836
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.689 s (5%) 42.330 ms 2.30 GiB (1%) 3150976
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 26.784 ms (5%) 48.14 MiB (1%) 66065
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 138.485 ms (5%) 1.871 ms 175.90 MiB (1%) 193066
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 383.267 ms (5%) 20.494 ms 763.54 MiB (1%) 741594
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 692.890 ms (5%) 21.919 ms 683.80 MiB (1%) 1029077
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.406 s (5%) 33.779 ms 1.24 GiB (1%) 2067121
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.017 s (5%) 78.004 ms 2.82 GiB (1%) 4613106
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 930.490 ms (5%) 47.904 ms 1.60 GiB (1%) 1508306
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.477 s (5%) 100.733 ms 3.70 GiB (1%) 3059616
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 164.540 ms (5%) 8.839 ms 323.96 MiB (1%) 995755
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 490.389 ms (5%) 19.817 ms 828.05 MiB (1%) 2072376
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 25.320 ms (5%) 49.42 MiB (1%) 87547
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.879 s (5%) 53.678 ms 2.61 GiB (1%) 4236346
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 62.475 ms (5%) 77.57 MiB (1%) 165845
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 204.186 ms (5%) 5.513 ms 216.93 MiB (1%) 381099
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 49.996 ms (5%) 73.22 MiB (1%) 129848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 226.788 ms (5%) 6.381 ms 382.43 MiB (1%) 332471
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 573.833 ms (5%) 13.193 ms 805.29 MiB (1%) 585314
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.267 s (5%) 23.974 ms 1.62 GiB (1%) 1053045
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 177.969 ms (5%) 3.957 ms 237.06 MiB (1%) 260848
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 656.441 ms (5%) 12.286 ms 839.93 MiB (1%) 523161
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.443 ms (5%) 1.843 ms 100.20 MiB (1%) 86803
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 273.815 ms (5%) 4.982 ms 355.32 MiB (1%) 174371
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.932 ms (5%) 14.68 MiB (1%) 25901
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.354 s (5%) 20.219 ms 1.65 GiB (1%) 348615
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 24.583 ms (5%) 43.80 MiB (1%) 41115
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 130.898 ms (5%) 1.577 ms 159.60 MiB (1%) 73893
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.016 ms (5%) 65.86 MiB (1%) 86084
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.603 ms (5%) 6.443 ms 344.01 MiB (1%) 234051
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 528.451 ms (5%) 9.866 ms 755.62 MiB (1%) 413169
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.207 s (5%) 20.986 ms 1.55 GiB (1%) 742951
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.596 ms (5%) 3.492 ms 222.02 MiB (1%) 172802
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 629.733 ms (5%) 11.426 ms 805.99 MiB (1%) 346335
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 58.591 ms (5%) 89.26 MiB (1%) 50157
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 258.032 ms (5%) 4.490 ms 337.27 MiB (1%) 101034
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.190 ms (5%) 10.99 MiB (1%) 17244
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.307 s (5%) 18.264 ms 1.61 GiB (1%) 201912
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 21.957 ms (5%) 39.27 MiB (1%) 28451
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 124.791 ms (5%) 1.337 ms 153.44 MiB (1%) 53410
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.349 ms (5%) 67.92 MiB (1%) 101597
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.427 ms (5%) 6.350 ms 347.22 MiB (1%) 290805
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 532.368 ms (5%) 9.192 ms 771.50 MiB (1%) 517142
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.219 s (5%) 21.516 ms 1.59 GiB (1%) 922273
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 168.913 ms (5%) 3.334 ms 226.35 MiB (1%) 208459
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 633.379 ms (5%) 10.778 ms 815.61 MiB (1%) 424074
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.449 ms (5%) 93.34 MiB (1%) 84517
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 265.656 ms (5%) 4.442 ms 342.87 MiB (1%) 170115
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.614 ms (5%) 13.81 MiB (1%) 23773
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.334 s (5%) 19.615 ms 1.64 GiB (1%) 353290
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.772 ms (5%) 41.80 MiB (1%) 41075
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 125.932 ms (5%) 1.323 ms 155.88 MiB (1%) 78511
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 495.616 ms (5%) 27.004 ms 1.16 GiB (1%) 812710
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 253.133 ms (5%) 9.558 ms 438.91 MiB (1%) 529233
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 644.990 ms (5%) 18.227 ms 962.55 MiB (1%) 1213671
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.875 s (5%) 60.542 ms 2.97 GiB (1%) 3616991
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 1.100 s (5%) 56.404 ms 2.48 GiB (1%) 1667541
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.539 s (5%) 118.930 ms 5.40 GiB (1%) 3376710
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 145.969 ms (5%) 7.071 ms 250.50 MiB (1%) 738332
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 434.080 ms (5%) 14.479 ms 676.79 MiB (1%) 1540411
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 8.146 ms (5%) 17.84 MiB (1%) 23766
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.690 s (5%) 42.475 ms 2.29 GiB (1%) 3146949
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 27.027 ms (5%) 49.12 MiB (1%) 66644
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 138.573 ms (5%) 1.969 ms 177.22 MiB (1%) 193697
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 382.021 ms (5%) 20.548 ms 763.54 MiB (1%) 741595
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 687.602 ms (5%) 22.016 ms 683.87 MiB (1%) 1029079
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 1.399 s (5%) 32.558 ms 1.24 GiB (1%) 2067123
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 3.011 s (5%) 79.413 ms 2.82 GiB (1%) 4613108
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 920.578 ms (5%) 44.896 ms 1.60 GiB (1%) 1508307
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 2.459 s (5%) 103.085 ms 3.70 GiB (1%) 3059618
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 167.569 ms (5%) 10.196 ms 322.03 MiB (1%) 994710
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 494.309 ms (5%) 20.708 ms 837.11 MiB (1%) 2072995
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 20.115 ms (5%) 28.34 MiB (1%) 78738
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.929 s (5%) 58.974 ms 2.67 GiB (1%) 4267220
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 57.368 ms (5%) 65.23 MiB (1%) 160035
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 201.459 ms (5%) 6.063 ms 211.69 MiB (1%) 374483
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 49.847 ms (5%) 73.22 MiB (1%) 129849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 225.274 ms (5%) 6.012 ms 382.50 MiB (1%) 332473
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 570.942 ms (5%) 13.578 ms 805.37 MiB (1%) 585316
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.266 s (5%) 27.669 ms 1.62 GiB (1%) 1053047
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 177.248 ms (5%) 4.018 ms 237.07 MiB (1%) 260849
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 654.521 ms (5%) 12.649 ms 839.95 MiB (1%) 523163
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.273 ms (5%) 1.880 ms 99.58 MiB (1%) 87056
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 273.276 ms (5%) 4.837 ms 355.45 MiB (1%) 174881
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.178 ms (5%) 16.44 MiB (1%) 26608
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.344 s (5%) 18.850 ms 1.66 GiB (1%) 350309
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 25.112 ms (5%) 45.54 MiB (1%) 42024
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 130.831 ms (5%) 1.551 ms 161.23 MiB (1%) 74769
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.047 ms (5%) 65.86 MiB (1%) 86085
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 197.370 ms (5%) 6.089 ms 344.08 MiB (1%) 234053
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 4))] 529.110 ms (5%) 10.754 ms 755.70 MiB (1%) 413171
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 8))] 1.207 s (5%) 20.420 ms 1.55 GiB (1%) 742953
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 400), :(K = 16))] 166.415 ms (5%) 3.399 ms 222.03 MiB (1%) 172803
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 800), :(K = 16))] 628.388 ms (5%) 10.644 ms 806.01 MiB (1%) 346337
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 58.159 ms (5%) 85.88 MiB (1%) 50141
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 200), :(K = 32))] 258.726 ms (5%) 4.239 ms 334.95 MiB (1%) 101037
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.450 ms (5%) 12.37 MiB (1%) 18043
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 32))] 1.326 s (5%) 19.079 ms 1.61 GiB (1%) 202934
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 4))] 22.645 ms (5%) 42.56 MiB (1%) 29382
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 8))] 126.340 ms (5%) 1.337 ms 155.72 MiB (1%) 54218
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=100"] 474.145 ms (5%) 309.761 ms 743.21 MiB (1%) 1105746
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.465 ms (5%) 5.82 MiB (1%) 60501
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 138.247 μs (5%) 256.38 KiB (1%) 2927
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=100"] 40.043 ms (5%) 145.98 MiB (1%) 426018
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 949.086 μs (5%) 2.10 MiB (1%) 23418
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 51.276 μs (5%) 104.75 KiB (1%) 1254
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.294 s (5%) 393.708 ms 18.61 GiB (1%) 11525807
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 17.100 ms (5%) 63.36 MiB (1%) 416698
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.630 μs (5%) 15.19 KiB (1%) 189
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 61.955 μs (5%) 126.00 KiB (1%) 841
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 133.568 μs (5%) 297.02 KiB (1%) 2161
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 259.183 μs (5%) 541.27 KiB (1%) 6069
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=100"] 627.311 ms (5%) 59.911 ms 721.19 MiB (1%) 5001737
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.149 ms (5%) 41.98 MiB (1%) 288498
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.779 ms (5%) 2.64 MiB (1%) 18197
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=100"] 91.950 ms (5%) 97.19 MiB (1%) 961641
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.902 ms (5%) 5.66 MiB (1%) 55705
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 307.602 μs (5%) 368.44 KiB (1%) 3565
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.687 s (5%) 65.325 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 57.770 ms (5%) 41.54 MiB (1%) 175246
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.270 μs (5%) 10.02 KiB (1%) 91
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 2.385 ms (5%) 4.20 MiB (1%) 16761
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.574 ms (5%) 13.06 MiB (1%) 38219
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.139 ms (5%) 24.17 MiB (1%) 66855
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.594 s (5%) 85.724 ms 836.59 MiB (1%) 7560293
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 78.142 ms (5%) 48.60 MiB (1%) 435594
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.675 ms (5%) 3.05 MiB (1%) 27341
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=100"] 165.434 ms (5%) 22.369 ms 216.21 MiB (1%) 2380062
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 6.934 ms (5%) 12.49 MiB (1%) 137134
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 397.009 μs (5%) 800.31 KiB (1%) 8602
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 20.719 s (5%) 2.230 s 18.49 GiB (1%) 112017823
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 632.809 ms (5%) 41.012 ms 697.77 MiB (1%) 4174856
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 39.784 μs (5%) 129.88 KiB (1%) 1487
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 7.611 ms (5%) 5.39 MiB (1%) 28494
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 155.098 ms (5%) 15.24 MiB (1%) 61237
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 22.204 s (5%) 23.68 MiB (1%) 107516
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=100"] 298.002 ms (5%) 52.194 ms 330.04 MiB (1%) 2260161
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.429 ms (5%) 19.03 MiB (1%) 130314
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 643.175 μs (5%) 1.20 MiB (1%) 8261
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=100"] 42.520 ms (5%) 69.12 MiB (1%) 660060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.128 ms (5%) 4.01 MiB (1%) 38060
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 112.228 μs (5%) 258.02 KiB (1%) 2408
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.982 s (5%) 608.403 ms 3.69 GiB (1%) 24699841
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 87.805 ms (5%) 5.560 ms 144.42 MiB (1%) 928264
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.468 μs (5%) 32.31 KiB (1%) 319
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 330.815 μs (5%) 600.28 KiB (1%) 3076
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.202 ms (5%) 2.26 MiB (1%) 8020
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.117 ms (5%) 8.54 MiB (1%) 25338
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=100"] 32.133 ms (5%) 72.93 MiB (1%) 400153
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.775 ms (5%) 4.22 MiB (1%) 23170
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 127.297 μs (5%) 278.12 KiB (1%) 1557
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=100"] 10.069 ms (5%) 21.97 MiB (1%) 180057
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 561.195 μs (5%) 1.30 MiB (1%) 10409
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 36.669 μs (5%) 83.88 KiB (1%) 677
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 658.751 ms (5%) 89.323 ms 1.02 GiB (1%) 4711213
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.414 ms (5%) 41.69 MiB (1%) 177598
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 5.751 μs (5%) 13.91 KiB (1%) 144
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 64.720 μs (5%) 150.38 KiB (1%) 456
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 206.965 μs (5%) 670.25 KiB (1%) 1156
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 529.656 μs (5%) 1.93 MiB (1%) 2985
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=100"] 180.801 ms (5%) 36.731 ms 744.59 MiB (1%) 1105750
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.602 ms (5%) 5.90 MiB (1%) 60510
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 144.789 μs (5%) 261.62 KiB (1%) 2929
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=100"] 43.150 ms (5%) 146.74 MiB (1%) 426024
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 966.577 μs (5%) 2.14 MiB (1%) 23423
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 53.921 μs (5%) 107.84 KiB (1%) 1257
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.429 s (5%) 982.794 ms 18.62 GiB (1%) 11587323
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 18.922 ms (5%) 63.59 MiB (1%) 419014
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.113 μs (5%) 24.61 KiB (1%) 215
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 72.605 μs (5%) 144.70 KiB (1%) 971
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 135.943 μs (5%) 303.44 KiB (1%) 2169
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 264.371 μs (5%) 547.56 KiB (1%) 6045
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=100"] 678.383 ms (5%) 71.973 ms 722.56 MiB (1%) 5001741
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 29.398 ms (5%) 42.06 MiB (1%) 288507
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.807 ms (5%) 2.64 MiB (1%) 18199
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=100"] 92.478 ms (5%) 97.95 MiB (1%) 961647
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 4.964 ms (5%) 5.70 MiB (1%) 55710
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 312.421 μs (5%) 371.53 KiB (1%) 3568
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.711 s (5%) 70.888 ms 1.02 GiB (1%) 4692825
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 59.001 ms (5%) 41.70 MiB (1%) 176410
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.552 μs (5%) 18.78 KiB (1%) 106
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 1.831 ms (5%) 2.23 MiB (1%) 13840
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 6.460 ms (5%) 12.89 MiB (1%) 37942
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 12.278 ms (5%) 24.65 MiB (1%) 67893
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=100"] 1.650 s (5%) 100.011 ms 837.96 MiB (1%) 7560297
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 77.844 ms (5%) 48.68 MiB (1%) 435603
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 4.695 ms (5%) 3.05 MiB (1%) 27343
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=100"] 177.013 ms (5%) 25.446 ms 216.97 MiB (1%) 2380068
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 7.056 ms (5%) 12.53 MiB (1%) 137139
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 407.759 μs (5%) 803.41 KiB (1%) 8605
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 22.550 s (5%) 3.011 s 18.50 GiB (1%) 112202347
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 687.262 ms (5%) 52.214 ms 698.35 MiB (1%) 4181780
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 40.586 μs (5%) 137.33 KiB (1%) 1486
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 6.554 ms (5%) 3.91 MiB (1%) 24795
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 221.874 ms (5%) 16.11 MiB (1%) 65093
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 28.314 s (5%) 23.72 MiB (1%) 110065
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=100"] 297.205 ms (5%) 40.781 ms 331.41 MiB (1%) 2260165
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.592 ms (5%) 19.11 MiB (1%) 130323
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 656.061 μs (5%) 1.20 MiB (1%) 8263
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=100"] 43.796 ms (5%) 69.88 MiB (1%) 660066
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.150 ms (5%) 4.06 MiB (1%) 38065
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 114.824 μs (5%) 261.11 KiB (1%) 2411
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.684 s (5%) 297.050 ms 3.70 GiB (1%) 24822861
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 90.031 ms (5%) 6.124 ms 144.95 MiB (1%) 932884
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 11.141 μs (5%) 42.42 KiB (1%) 347
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 216.924 μs (5%) 441.45 KiB (1%) 2410
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 1.272 ms (5%) 2.40 MiB (1%) 8234
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.044 ms (5%) 8.37 MiB (1%) 25036
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=100"] 33.984 ms (5%) 74.30 MiB (1%) 400157
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.877 ms (5%) 4.30 MiB (1%) 23179
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 134.089 μs (5%) 283.38 KiB (1%) 1559
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=100"] 10.323 ms (5%) 22.73 MiB (1%) 180063
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 588.504 μs (5%) 1.34 MiB (1%) 10414
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 38.521 μs (5%) 86.97 KiB (1%) 680
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 705.190 ms (5%) 75.107 ms 1.03 GiB (1%) 4741977
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 20.503 ms (5%) 41.85 MiB (1%) 178762
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.251 μs (5%) 20.08 KiB (1%) 141
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.05), :(depth = 5))] 80.139 μs (5%) 184.89 KiB (1%) 519
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.1), :(depth = 5))] 210.912 μs (5%) 655.23 KiB (1%) 1157
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 557.807 μs (5%) 2.02 MiB (1%) 3110
["OptimizationProblems", "britgas", "Hessian"] 5.197 ms (5%) 10.42 MiB (1%) 35097
["OptimizationProblems", "britgas", "Jacobian"] 265.995 μs (5%) 477.91 KiB (1%) 6118

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz      15397 s          0 s        828 s      40740 s          0 s
       #2  2595 MHz      15922 s          0 s        971 s      40082 s          0 s
       #3  3243 MHz      14658 s          0 s       1067 s      41229 s          0 s
       #4  2445 MHz      11888 s          0 s        903 s      44169 s          0 s
  Memory: 15.606498718261719 GB (13205.71484375 MB free)
  Uptime: 5708.97 sec
  Load Avg:  1.02  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

This was referenced Jun 18, 2024
Merged
Open
Merged
@adrhill adrhill mentioned this pull request Jun 26, 2024
Merged
adrhill referenced this pull request Jul 30, 2024
@adrhill
SparseConnectivityTracer v0.6.0
ec44afc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gdalle gdalle gdalle requested changes

Assignees
No one assigned
Labels
run benchmark Run benchmarks in CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Generalize first- and second-order information in HessianTracer Add isempty flag to tracers
3 participants
@adrhill @codecov-commenter @gdalle