Skip to content

Latest commit

 

History

History
439 lines (416 loc) · 28.4 KB

report.md

File metadata and controls

439 lines (416 loc) · 28.4 KB
Raw

Benchmark Report

Job Properties

Commits: JuliaLang/julia@03de024dcdaf8cf33f2cfa439bb465babd62e9e8 vs JuliaLang/julia@18109520d6e82e8d05022f4e6b39b2f82a2b28b4

Comparison Diff: link

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array", "accumulate", ("cumsum!", "Float64", "dim2")] 1.51 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("cumsum!", "Int")] 0.60 (5%) ✅ 1.00 (1%)
["array", "accumulate", ("cumsum", "Float64", "dim2")] 1.28 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("cumsum", "Int")] 0.74 (5%) ✅ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float64} generator")] 0.79 (5%) ✅ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float64}")] 0.79 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float32} generator")] 0.77 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float32}")] 1.30 (5%) ❌ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float64} generator")] 0.79 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float64}")] 0.79 (5%) ✅ 1.00 (1%)
["array", "bool", "bitarray_bool_load!"] 0.86 (5%) ✅ 1.00 (1%)
["array", "bool", "boolarray_true_fill!"] 1.07 (5%) ❌ 1.00 (1%)
["array", "bool", "boolarray_true_load!"] 0.37 (5%) ✅ 1.00 (1%)
["array", "convert", ("Complex{Float64}", "Int")] 1.23 (5%) ❌ 1.00 (1%)
["array", "equality", ("==", "Vector{Int64} == Vector{Float32}")] 0.77 (5%) ✅ 1.00 (1%)
["array", "equality", ("==", "Vector{Int64} == Vector{Float64}")] 0.77 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "BitArray")] 0.83 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Float32}")] 1.07 (5%) ❌ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int64}")] 1.10 (5%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32, 2}")] 1.77 (50%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}")] 1.85 (50%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "SubArray{Float32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] 1.73 (50%) ❌ 1.00 (1%)
["array", "index", ("sumelt_boundscheck", "BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32, 2}")] 1.78 (50%) ❌ 1.00 (1%)
["array", "subarray", ("gramschmidt!", 100)] 1.07 (5%) ❌ 1.00 (1%)
["array", "subarray", ("gramschmidt!", 1000)] 1.06 (5%) ❌ 1.00 (1%)
["array", "subarray", ("gramschmidt!", 500)] 1.06 (5%) ❌ 1.00 (1%)
["collection", "set operations", ("BitSet", "Int", "setdiff!", "Set")] 1.27 (25%) ❌ 1.00 (1%)
["collection", "set operations", ("BitSet", "Int", "symdiff", "BitSet", "BitSet")] 1.30 (25%) ❌ 1.00 (1%)
["collection", "set operations", ("BitSet", "Int", "⊆", "Set")] 1.29 (25%) ❌ 1.00 (1%)
["collection", "set operations", ("empty", "Int", "⊆", "Set")] 1.31 (25%) ❌ 1.00 (1%)
["dates", "accessor", "month"] 1.30 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Float32}")] 1.07 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Bool}")] 1.08 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Float32}")] 1.14 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Int8}")] 1.17 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{UInt64}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Bool}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Float32}")] 1.05 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Int8}")] 1.08 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Bool}")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "50-50")] 1.12 (5%) ❌ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "90-10")] 1.29 (5%) ❌ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{Bool}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{UInt8}")] 0.87 (5%) ✅ 1.00 (1%)
["find", "findprev", ("ispos", "Vector{Bool}")] 0.89 (5%) ✅ 1.00 (1%)
["misc", "23042", "Float32"] 0.90 (5%) ✅ 1.00 (1%)
["misc", "23042", "Float64"] 1.09 (5%) ❌ 1.00 (1%)
["misc", "bitshift", ("Int", "Int")] 1.14 (5%) ❌ 1.00 (1%)
["misc", "bitshift", ("Int", "UInt")] 1.16 (5%) ❌ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...))"] 0.86 (5%) ✅ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...); init = 0.0)"] 0.94 (5%) ✅ 1.00 (1%)
["misc", "issue 12165", "Float64"] 1.08 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1000, 1:1000, 1:1000)"] 0.90 (5%) ✅ 1.00 (1%)
["misc", "repeat", (200, 1, 24)] 1.06 (5%) ❌ 1.00 (1%)
["misc", "repeat", (200, 24, 1)] 1.22 (5%) ❌ 1.00 (1%)
["problem", "imdb", "centrality"] 1.05 (5%) ❌ 1.00 (1%)
["problem", "laplacian", "laplace_iter_devec"] 0.92 (5%) ✅ 1.00 (1%)
["problem", "monte carlo", "euro_option_vec"] 1.07 (5%) ❌ 1.00 (1%)
["problem", "simplex", "simplex"] 1.29 (5%) ❌ 1.00 (1%)
["problem", "ziggurat", "ziggurat"] 1.06 (5%) ❌ 1.00 (1%)
["random", "collections", ("rand!", "ImplicitRNG", "'a':'z'")] 0.65 (25%) ✅ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "Bool")] 1.32 (25%) ❌ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "negative argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "positive argument", "Float32")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("zero", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("zero", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "acosh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y negative", "x positive", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y positive", "x positive", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("x one", "Float32")] 1.26 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("very small", "negative argument", "Float32")] 1.30 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float32", "cos_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float32", "cos_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "negative argument", "Float32", "cos_kernel")] 0.79 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("no reduction", "positive argument", "Float32", "cos_kernel")] 0.82 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("no reduction", "positive argument", "Float64", "cos_kernel")] 0.90 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float32")] 0.80 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float64")] 0.80 (5%) ✅ 1.00 (1%)
["scalar", "expm1", ("zero", "Float64")] 0.90 (5%) ✅ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (easy) abs(x) < 2π/4", "negative argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "positive argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float32", "sin_kernel")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "negative argument", "Float32", "sin_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "negative argument", "Float64", "sin_kernel")] 0.79 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "positive argument", "Float32", "sin_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "positive argument", "Float64", "sin_kernel")] 0.79 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["shootout", "fannkuch"] 0.92 (5%) ✅ 1.00 (1%)
["simd", ("auto_axpy!", "Float32", 4095)] 1.20 (20%) ❌ 1.00 (1%)
["simd", ("auto_axpy!", "Float32", 4096)] 1.21 (20%) ❌ 1.00 (1%)
["simd", ("axpy!", "Float32", 4095)] 1.24 (20%) ❌ 1.00 (1%)
["simd", ("axpy!", "Float32", 4096)] 1.21 (20%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sort! forwards", "ascending")] 1.51 (30%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sort! reverse", "descending")] 0.67 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sortperm! reverse", "descending")] 1.38 (30%) ❌ 1.00 (1%)
["sort", "mergesort", ("sort forwards", "ones")] 1.42 (30%) ❌ 1.00 (1%)
["sort", "mergesort", ("sort! forwards", "ones")] 1.48 (30%) ❌ 1.00 (1%)
["sparse", "constructors", ("Bidiagonal", 10)] 2.98 (5%) ❌ 1.06 (1%) ❌
["sparse", "constructors", ("Bidiagonal", 100)] 1.57 (5%) ❌ 1.01 (1%)
["sparse", "constructors", ("Diagonal", 10)] 3.10 (5%) ❌ 1.07 (1%) ❌
["sparse", "constructors", ("Diagonal", 100)] 1.61 (5%) ❌ 1.01 (1%) ❌
["sparse", "constructors", ("IJV", 10)] 3.59 (5%) ❌ 1.17 (1%) ❌
["sparse", "constructors", ("IJV", 100)] 1.43 (5%) ❌ 1.02 (1%) ❌
["sparse", "constructors", ("SymTridiagonal", 10)] 2.73 (5%) ❌ 1.04 (1%) ❌
["sparse", "constructors", ("SymTridiagonal", 100)] 1.26 (5%) ❌ 1.01 (1%)
["sparse", "constructors", ("Tridiagonal", 10)] 2.85 (5%) ❌ 1.04 (1%) ❌
["sparse", "constructors", ("Tridiagonal", 100)] 1.23 (5%) ❌ 1.01 (1%)
["sparse", "index", ("spmat", "OneTo", 10)] 2.52 (30%) ❌ 1.05 (1%) ❌
["sparse", "index", ("spmat", "array", 10)] 1.22 (30%) 1.02 (1%) ❌
["sparse", "index", ("spmat", "col", "array", 10)] 1.48 (30%) ❌ 1.03 (1%) ❌
["sparse", "index", ("spmat", "col", "array", 1000)] 0.70 (30%) ✅ 1.00 (1%)
["sparse", "index", ("spmat", "col", "logical", 10)] 2.18 (30%) ❌ 1.06 (1%) ❌
["sparse", "index", ("spmat", "col", "logical", 100)] 1.69 (30%) ❌ 1.02 (1%) ❌
["sparse", "index", ("spmat", "logical", 10)] 1.95 (30%) ❌ 1.05 (1%) ❌
["sparse", "index", ("spmat", "range", 10)] 2.56 (30%) ❌ 1.05 (1%) ❌
["sparse", "index", ("spvec", "logical", 1000)] 1.23 (30%) 1.01 (1%) ❌
["sparse", "matmul", ("A_mul_Bc", "sparse 50x500, dense 5x500 -> dense 50x5")] 0.65 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("A_mul_Bt", "sparse 500x500, dense 5x500 -> dense 500x5")] 0.69 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("A_mul_Bt", "sparse 50x500, dense 5x500 -> dense 50x5")] 0.63 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B!", "sparse 400x4000, dense 400x40 -> dense 4000x40")] 0.66 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "dense 500x5, sparse 500x500 -> dense 5x500")] 0.54 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "dense 50x5, sparse 50x500 -> dense 5x500")] 0.51 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "dense 5x5, sparse 5x500 -> dense 5x500")] 0.58 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "sparse 500x500, dense 500x5 -> dense 500x5")] 1.46 (30%) ❌ 1.00 (1%)
["sparse", "sparse matvec", "adjoint"] 0.87 (5%) ✅ 1.00 (1%)
["sparse", "sparse solves", "square system (ldlt), matrix rhs"] 0.86 (5%) ✅ 1.00 (1%)
["sparse", "sparse solves", "square system (ldlt), vector rhs"] 0.90 (5%) ✅ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different length"] 1.09 (5%) ❌ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different"] 0.93 (5%) ✅ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "equal"] 1.09 (5%) ❌ 1.00 (1%)
["string", "==(::SubString, ::String)", "different"] 1.36 (5%) ❌ 1.00 (1%)
["string", "readuntil", "backtracking"] 1.05 (5%) ❌ 1.00 (1%)
["string", "readuntil", "barbarian backtrack"] 1.06 (5%) ❌ 1.00 (1%)
["string", "readuntil", "target length 1000"] 1.23 (5%) ❌ 1.00 (1%)
["string", "readuntil", "target length 50000"] 1.22 (5%) ❌ 1.00 (1%)
["string", "repeat", "repeat str len 16"] 0.87 (5%) ✅ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(4, 4)", "(4,)")] 1.30 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("minimum", "(4,)")] 1.10 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("minimum", "(8,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sum", "(16,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sum", "(8,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(16,)")] 1.08 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(2, 2)")] 1.12 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(4, 4)")] 1.08 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(4,)")] 1.12 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(8,)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(false, false)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "ComplexF64", "(false, false)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "ComplexF64", "(false, true)")] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "ComplexF64", "(true, true)")] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Float64", "(false, true)")] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int64", "(false, true)")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(false, false)")] 1.22 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Bool", 0)] 1.14 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int8", 1)] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigFloat", 0)] 0.85 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigInt", 0)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigInt", 1)] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Bool", 0)] 1.22 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Bool", 1)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Float64", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Int64", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Int64", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Bool", 1)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Float32", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Int8", 1)] 0.83 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "BigInt", 0)] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Bool", "(false, false)")] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Bool", "(false, true)")] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Bool", "(true, true)")] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "ComplexF64", "(false, true)")] 1.28 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "ComplexF64", "(true, true)")] 1.15 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float32", "(false, true)")] 1.17 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float32", "(true, true)")] 1.22 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(false, true)")] 1.23 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(true, true)")] 1.17 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Int64", "(true, true)")] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int8", "(true, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "abs", "Bool", 1)] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "abs", "Float32", 0)] 1.47 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "abs", "Int8", 1)] 0.85 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Bool", 1)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Float32", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Int8", 1)] 0.83 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(false, false)")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(false, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(true, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int64", "(false, false)")] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int64", "(false, true)")] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int64", "(true, true)")] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(false, false)")] 1.20 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(false, true)")] 1.22 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(true, true)")] 1.26 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "Bool")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "ComplexF64")] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Int64")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigFloat", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigInt", 0)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigInt", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Bool", 0)] 1.59 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Bool", 1)] 1.39 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Float32", 1)] 1.15 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "BigInt", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Int8", 0)] 1.15 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Nothing, Int64}", 0)] 1.13 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Float32", 0)] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Missing, Bool}", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("sort", "Union{Nothing, Bool}", 0)] 1.13 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Nothing, Float32}", 0)] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Nothing, Float64}", 0)] 1.16 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Nothing, Int64}", 0)] 0.90 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["array", "accumulate"]
  • ["array", "any/all"]
  • ["array", "bool"]
  • ["array", "cat"]
  • ["array", "comprehension"]
  • ["array", "convert"]
  • ["array", "equality"]
  • ["array", "growth"]
  • ["array", "index"]
  • ["array", "reductions"]
  • ["array", "reverse"]
  • ["array", "setindex!"]
  • ["array", "subarray"]
  • ["broadcast"]
  • ["broadcast", "dotop"]
  • ["broadcast", "fusion"]
  • ["broadcast", "mix_scalar_tuple"]
  • ["broadcast", "sparse"]
  • ["broadcast", "typeargs"]
  • ["collection", "deletion"]
  • ["collection", "initialization"]
  • ["collection", "iteration"]
  • ["collection", "optimizations"]
  • ["collection", "queries & updates"]
  • ["collection", "set operations"]
  • ["dates", "accessor"]
  • ["dates", "arithmetic"]
  • ["dates", "construction"]
  • ["dates", "conversion"]
  • ["dates", "parse"]
  • ["dates", "query"]
  • ["dates", "string"]
  • ["find", "findall"]
  • ["find", "findnext"]
  • ["find", "findprev"]
  • ["io", "array_limit"]
  • ["io", "read"]
  • ["io", "serialization"]
  • ["io"]
  • ["linalg", "arithmetic"]
  • ["linalg", "blas"]
  • ["linalg", "factorization"]
  • ["linalg"]
  • ["micro"]
  • ["misc"]
  • ["misc", "23042"]
  • ["misc", "afoldl"]
  • ["misc", "allocation elision view"]
  • ["misc", "bitshift"]
  • ["misc", "foldl"]
  • ["misc", "issue 12165"]
  • ["misc", "iterators"]
  • ["misc", "julia"]
  • ["misc", "parse"]
  • ["misc", "repeat"]
  • ["misc", "splatting"]
  • ["problem", "chaosgame"]
  • ["problem", "fem"]
  • ["problem", "go"]
  • ["problem", "grigoriadis khachiyan"]
  • ["problem", "imdb"]
  • ["problem", "json"]
  • ["problem", "laplacian"]
  • ["problem", "monte carlo"]
  • ["problem", "raytrace"]
  • ["problem", "seismic"]
  • ["problem", "simplex"]
  • ["problem", "spellcheck"]
  • ["problem", "stockcorr"]
  • ["problem", "ziggurat"]
  • ["random", "collections"]
  • ["random", "randstring"]
  • ["random", "ranges"]
  • ["random", "sequences"]
  • ["random", "types"]
  • ["scalar", "acos"]
  • ["scalar", "acosh"]
  • ["scalar", "arithmetic"]
  • ["scalar", "asin"]
  • ["scalar", "asinh"]
  • ["scalar", "atan"]
  • ["scalar", "atan2"]
  • ["scalar", "atanh"]
  • ["scalar", "cbrt"]
  • ["scalar", "cos"]
  • ["scalar", "cosh"]
  • ["scalar", "exp2"]
  • ["scalar", "expm1"]
  • ["scalar", "fastmath"]
  • ["scalar", "floatexp"]
  • ["scalar", "intfuncs"]
  • ["scalar", "iteration"]
  • ["scalar", "mod2pi"]
  • ["scalar", "predicate"]
  • ["scalar", "rem_pio2"]
  • ["scalar", "sin"]
  • ["scalar", "sincos"]
  • ["scalar", "sinh"]
  • ["scalar", "tan"]
  • ["scalar", "tanh"]
  • ["shootout"]
  • ["simd"]
  • ["sort", "insertionsort"]
  • ["sort", "issorted"]
  • ["sort", "mergesort"]
  • ["sort", "quicksort"]
  • ["sparse", "arithmetic"]
  • ["sparse", "constructors"]
  • ["sparse", "index"]
  • ["sparse", "matmul"]
  • ["sparse", "sparse matvec"]
  • ["sparse", "sparse solves"]
  • ["sparse", "transpose"]
  • ["string", "==(::AbstractString, ::AbstractString)"]
  • ["string", "==(::SubString, ::String)"]
  • ["string", "findfirst"]
  • ["string"]
  • ["string", "readuntil"]
  • ["string", "repeat"]
  • ["tuple", "index"]
  • ["tuple", "linear algebra"]
  • ["tuple", "misc"]
  • ["tuple", "reduction"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.8.0-DEV.123
Commit 03de024dcd (2021-07-01 19:35 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1037-aws #39-Ubuntu SMP Thu Jan 14 02:56:06 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  3416 MHz     321675 s       2661 s      33080 s  111231304 s          0 s
       #2  3400 MHz   12326718 s        904 s     656125 s   98608943 s          0 s
       #3  3404 MHz     205877 s        848 s      10412 s  111377566 s          0 s
       #4  3406 MHz     250754 s        858 s      11651 s  111330673 s          0 s
       #5  3407 MHz     138752 s        798 s       9930 s  111418633 s          0 s
       #6  3433 MHz     173901 s        828 s       9470 s  111410864 s          0 s
       #7  3424 MHz     146550 s        705 s       9983 s  111437915 s          0 s
       #8  3415 MHz     137738 s        933 s       9162 s  111437342 s          0 s
       
  Memory: 30.362831115722656 GB (7584.71875 MB free)
  Uptime: 1.1159758e7 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-12.0.0 (ORCJIT, skylake-avx512)

Comparison Build

Julia Version 1.8.0-DEV.116
Commit 18109520d6 (2021-07-01 16:43 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1037-aws #39-Ubuntu SMP Thu Jan 14 02:56:06 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  3405 MHz     322289 s       2701 s      33132 s  111339559 s          0 s
       #2  3400 MHz   12427254 s        904 s     662634 s   98610871 s          0 s
       #3  3403 MHz     206404 s        848 s      10427 s  111485996 s          0 s
       #4  3404 MHz     251210 s        858 s      11681 s  111439160 s          0 s
       #5  3407 MHz     138777 s        798 s       9942 s  111527568 s          0 s
       #6  3407 MHz     174271 s        828 s       9488 s  111519448 s          0 s
       #7  3411 MHz     146621 s        705 s       9994 s  111546806 s          0 s
       #8  3408 MHz     137819 s        933 s       9176 s  111546204 s          0 s
       
  Memory: 30.362831115722656 GB (7195.4296875 MB free)
  Uptime: 1.1170656e7 sec
  Load Avg:  1.02  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-12.0.0 (ORCJIT, skylake-avx512)