Skip to content

Latest commit

 

History

History
112 lines (91 loc) · 5.73 KB

report.md

File metadata and controls

112 lines (91 loc) · 5.73 KB

Benchmark Report

Job Properties

Commits: JuliaLang/julia@6ec1ef4bf1c412ad31a06ad2f1694871077facbe vs JuliaLang/julia@1600cb97d2e829f87b80295c0b01e6b1cf516906

Comparison Diff: link

Triggered By: link

Tag Predicate: "union"

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["union", "array", ("broadcast", "*", "Bool", "(false, true)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "BigFloat", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Int8", 1)] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "abs", "Bool", 1)] 1.19 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "BigFloat", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Int8", 1)] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Bool")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Bool", 1)] 1.29 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Int8", 1)] 1.27 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum", "Float32", 1)] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "Float64", 1)] 1.19 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum2", "Float64", 1)] 0.72 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "BigFloat", 0)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "BigFloat", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Float32", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Float64}", 1)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Int64}", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Nothing, BigFloat}", 0)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "BigFloat", 0)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "BigInt", 0)] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collection", "set operations"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.9.0-DEV.407
Commit 6ec1ef4bf1 (2022-04-18 08:13 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.3 LTS
  uname: Linux 5.4.0-94-generic #106-Ubuntu SMP Thu Jan 6 23:58:14 UTC 2022 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3671 MHz     299422 s        819 s      55968 s   81306242 s          0 s
       #2  3556 MHz    5073564 s        508 s     212182 s   76435723 s          0 s
       #3  3568 MHz     312331 s        484 s      43092 s   81357778 s          0 s
       #4  3555 MHz     208952 s        569 s      41689 s   81140956 s          0 s
  Memory: 31.32097625732422 GB (16306.76171875 MB free)
  Uptime: 8.17932728e6 sec
  Load Avg:  1.26  1.16  1.1
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, haswell)
  Threads: 1 on 4 virtual cores

Comparison Build

Julia Version 1.9.0-DEV.405
Commit 1600cb97d2 (2022-04-18 02:59 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.3 LTS
  uname: Linux 5.4.0-94-generic #106-Ubuntu SMP Thu Jan 6 23:58:14 UTC 2022 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3753 MHz     300084 s        819 s      56007 s   81317304 s          0 s
       #2  3522 MHz    5083170 s        508 s     212823 s   76437260 s          0 s
       #3  3508 MHz     312865 s        484 s      43112 s   81369004 s          0 s
       #4  3503 MHz     209374 s        569 s      41708 s   81152273 s          0 s
  Memory: 31.32097625732422 GB (16248.4453125 MB free)
  Uptime: 8.18050575e6 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, haswell)
  Threads: 1 on 4 virtual cores