Skip to content

Latest commit

 

History

History
442 lines (419 loc) · 29.6 KB

File metadata and controls

442 lines (419 loc) · 29.6 KB

Benchmark Report

Job Properties

Commits: JuliaLang/julia@8e8564937be7078b5e4fe61b3c6dafb1928353fc vs JuliaLang/julia@0974dfa1bd2779cdd07283359236c5aa4b8536da

Comparison Diff: link

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array", "accumulate", ("cumsum!", "Int")] 0.94 (5%) ✅ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float64} generator")] 1.27 (5%) ❌ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float64}")] 1.27 (5%) ❌ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float32} generator")] 1.29 (5%) ❌ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float32}")] 0.77 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float64} generator")] 1.27 (5%) ❌ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float64}")] 1.27 (5%) ❌ 1.00 (1%)
["array", "bool", "bitarray_bool_load!"] 1.16 (5%) ❌ 1.00 (1%)
["array", "bool", "boolarray_true_load!"] 2.74 (5%) ❌ 1.00 (1%)
["array", "cat", ("catnd", 5)] 1.07 (5%) ❌ 1.00 (1%)
["array", "convert", ("Complex{Float64}", "Int")] 0.81 (5%) ✅ 1.00 (1%)
["array", "equality", ("==", "Vector{Int64} == Vector{Float32}")] 1.31 (5%) ❌ 1.00 (1%)
["array", "equality", ("==", "Vector{Int64} == Vector{Float64}")] 0.77 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "BitArray")] 1.20 (5%) ❌ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Float32}")] 1.06 (5%) ❌ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Float64}")] 0.86 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int64}")] 1.10 (5%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32, 2}")] 1.73 (50%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "SubArray{Float32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] 1.73 (50%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "SubArray{Int32, 2, Matrix{Int32}, Tuple{UnitRange{Int64}, UnitRange{Int64}}, false}")] 1.54 (50%) ❌ 1.00 (1%)
["array", "reductions", ("sum", "Int64")] 1.08 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (3, "scal_tup")] 1.52 (5%) ❌ 1.00 (1%)
["broadcast", "sparse", ("(1000, 1000)", 1)] 1.07 (5%) ❌ 1.00 (1%)
["collection", "deletion", ("Dict", "Int", "pop!")] 1.30 (25%) ❌ 1.00 (1%)
["collection", "set operations", ("Set", "Int", "⊆", "BitSet")] 1.30 (25%) ❌ 1.00 (1%)
["dates", "parse", "DateTime"] 0.94 (5%) ✅ 1.00 (1%)
["dates", "parse", ("DateTime", "DateFormat")] 1.06 (5%) ❌ 1.00 (1%)
["dates", "parse", ("DateTime", "ISODateTimeFormat")] 0.94 (5%) ✅ 1.00 (1%)
["dates", "query", ("firstdayofmonth", "Date")] 1.52 (25%) ❌ 1.00 (1%)
["dates", "query", ("isleapyear", "DateTime")] 1.52 (25%) ❌ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Float32}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Int8}")] 1.08 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Float32}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{UInt8}")] 1.07 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Int8}")] 1.11 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Int8}")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findall", ("BitVector", "10-90")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("BitVector", "50-50")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float32}")] 0.93 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float64}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Int64}")] 0.93 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Int8}")] 0.93 (5%) ✅ 1.00 (1%)
["find", "findnext", ("Vector{Bool}", "50-50")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{Int64}")] 0.87 (5%) ✅ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{UInt8}")] 1.07 (5%) ❌ 1.00 (1%)
["find", "findprev", ("BitVector", "10-90")] 0.92 (5%) ✅ 1.00 (1%)
["find", "findprev", ("Vector{Bool}", "50-50")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findprev", ("ispos", "Vector{UInt64}")] 1.15 (5%) ❌ 1.00 (1%)
["io", "read", "read"] 1.33 (5%) ❌ 1.00 (1%)
["misc", "18129"] 1.08 (5%) ❌ 1.00 (1%)
["misc", "23042", "Float32"] 1.10 (5%) ❌ 1.00 (1%)
["misc", "allocation elision view", "no conditional"] 1.18 (5%) ❌ 1.00 (1%)
["misc", "bitshift", ("Int", "Int")] 0.86 (5%) ✅ 1.00 (1%)
["misc", "bitshift", ("Int", "UInt")] 1.16 (5%) ❌ 1.00 (1%)
["misc", "bitshift", ("UInt", "UInt")] 1.14 (5%) ❌ 1.00 (1%)
["misc", "bitshift", ("UInt32", "UInt32")] 1.19 (5%) ❌ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...))"] 0.85 (5%) ✅ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...); init = 0.0)"] 2.68 (5%) ❌ 1.00 (1%)
["misc", "issue 12165", "Float16"] 1.12 (5%) ❌ 1.00 (1%)
["misc", "issue 12165", "Float32"] 0.94 (5%) ✅ 1.00 (1%)
["misc", "issue 12165", "Float64"] 0.86 (5%) ✅ 1.00 (1%)
["misc", "parse", "Int"] 1.16 (5%) ❌ 1.00 (1%)
["misc", "perf highdim generator"] 0.91 (5%) ✅ 1.00 (1%)
["problem", "laplacian", "laplace_iter_vec"] 0.81 (5%) ✅ 1.00 (1%)
["problem", "monte carlo", "euro_option_vec"] 1.14 (5%) ❌ 1.00 (1%)
["problem", "simplex", "simplex"] 1.27 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "positive argument", "Float64")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "arithmetic", ("div", "Complex{UInt64}", "ComplexF64")] 1.52 (50%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "Complex{UInt64}", "UInt64")] 1.52 (50%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "Float64", "ComplexF32")] 1.52 (50%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "Int64", "ComplexF64")] 1.52 (50%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "Int64", "Float32")] 1.52 (50%) ❌ 1.00 (1%)
["scalar", "asin", ("0.975 <= abs(x) < 1.0", "negative argument", "Float64")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "negative argument", "Float32")] 1.42 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "negative argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "positive argument", "Float32")] 1.41 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "positive argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("small", "negative argument", "Float64")] 0.86 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("small", "positive argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("small", "positive argument", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("zero", "Float32")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("zero", "Float64")] 0.86 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "negative argument", "Float32")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "positive argument", "Float32")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very small", "negative argument", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("very small", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "negative argument", "Float32")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "positive argument", "Float32")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "negative argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "positive argument", "Float32")] 0.81 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "negative argument", "Float32")] 0.77 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "positive argument", "Float32")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "negative argument", "Float32")] 0.82 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float32")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("zero", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y negative", "x positive", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y negative", "x negative", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y negative", "x positive", "Float32")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y positive", "x negative", "Float32")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y positive", "x positive", "Float32")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y negative", "x negative", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y negative", "x positive", "Float32")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y positive", "x negative", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y positive", "x positive", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("x one", "Float32")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x one", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float64", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2π/4", "negative argument", "Float64", "sin_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 4π/4", "negative argument", "Float64", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 5π/4", "positive argument", "Float32", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 6π/4", "negative argument", "Float64", "sin_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float32", "sin_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 7π/4", "negative argument", "Float32", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 8π/4", "negative argument", "Float64", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 9π/4", "positive argument", "Float32", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 9π/4", "positive argument", "Float64", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 4π/4", "negative argument", "Float64", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 4π/4", "positive argument", "Float32", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 6π/4", "negative argument", "Float64", "sin_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 8π/4", "positive argument", "Float64", "cos_kernel")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("small", "negative argument", "Float64")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("zero", "Float64")] 1.21 (5%) ❌ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "positive argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 5π/4", "negative argument", "Float32")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("zero", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("large", "positive argument", "Float64")] 1.52 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("small", "negative argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("small", "negative argument", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("small", "positive argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("small", "positive argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("very small", "negative argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("very small", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("very small", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("zero", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("zero", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["shootout", "fannkuch"] 0.91 (5%) ✅ 1.00 (1%)
["simd", ("manual_example!", "Float32", 4096)] 0.71 (20%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort forwards", "descending")] 1.30 (30%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sort forwards", "random")] 0.66 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort! forwards", "ascending")] 0.66 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort! forwards", "descending")] 1.30 (30%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sort! forwards", "random")] 0.66 (30%) ✅ 1.00 (1%)
["sparse", "constructors", ("Bidiagonal", 1000)] 1.10 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 100)] 1.11 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 1000)] 1.14 (5%) ❌ 1.00 (1%)
["sparse", "sparse matvec", "adjoint"] 0.94 (5%) ✅ 1.00 (1%)
["sparse", "sparse solves", "square system (ldlt), matrix rhs"] 1.07 (5%) ❌ 1.00 (1%)
["sparse", "transpose", ("transpose", "(600, 600)")] 1.54 (30%) ❌ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different length"] 0.92 (5%) ✅ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different"] 1.07 (5%) ❌ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "equal"] 0.92 (5%) ✅ 1.00 (1%)
["string", "==(::SubString, ::String)", "different"] 1.09 (5%) ❌ 1.00 (1%)
["string", "findfirst", "String"] 0.77 (5%) ✅ 1.00 (1%)
["string", "readuntil", "barbarian backtrack"] 0.94 (5%) ✅ 1.00 (1%)
["string", "readuntil", "target length 1000"] 0.81 (5%) ✅ 1.00 (1%)
["string", "readuntil", "target length 50000"] 0.79 (5%) ✅ 1.00 (1%)
["string", "repeat", "repeat str len 16"] 0.92 (5%) ✅ 1.00 (1%)
["string", "replace"] 0.85 (5%) ✅ 1.00 (1%)
["tuple", "linear algebra", ("matmat", "(8, 8)", "(8, 8)")] 1.24 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("minimum", "(16,)")] 1.06 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("minimum", "(8,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sum", "(4,)")] 1.08 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sum", "(8,)")] 1.27 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(16,)")] 1.11 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(2, 2)")] 1.12 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(4, 4)")] 1.08 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(8,)")] 1.14 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "ComplexF64", "(false, true)")] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "ComplexF64", "(true, true)")] 0.83 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(false, false)")] 0.82 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigFloat", 0)] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Int64", 1)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Int8", 1)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Bool", 1)] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "ComplexF64", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Float64", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Int8", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "filter", "Int64", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Bool", "(false, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Bool", "(true, true)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float32", "(true, true)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(false, false)")] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(true, true)")] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int8", "(false, true)")] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int8", "(true, true)")] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Bool", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "ComplexF64", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Float64", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Int8", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(false, false)")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(false, true)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(true, true)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(false, false)")] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(false, true)")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(true, true)")] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(false, true)")] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Bool")] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "ComplexF64")] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Int8")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigFloat", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigInt", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Bool", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "ComplexF64", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Float32", 1)] 1.15 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Bool", 0)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, BigFloat}", 1)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Nothing, Int64}", 0)] 1.24 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Nothing, BigFloat}", 0)] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["array", "accumulate"]
  • ["array", "any/all"]
  • ["array", "bool"]
  • ["array", "cat"]
  • ["array", "comprehension"]
  • ["array", "convert"]
  • ["array", "equality"]
  • ["array", "growth"]
  • ["array", "index"]
  • ["array", "reductions"]
  • ["array", "reverse"]
  • ["array", "setindex!"]
  • ["array", "subarray"]
  • ["broadcast"]
  • ["broadcast", "dotop"]
  • ["broadcast", "fusion"]
  • ["broadcast", "mix_scalar_tuple"]
  • ["broadcast", "sparse"]
  • ["broadcast", "typeargs"]
  • ["collection", "deletion"]
  • ["collection", "initialization"]
  • ["collection", "iteration"]
  • ["collection", "optimizations"]
  • ["collection", "queries & updates"]
  • ["collection", "set operations"]
  • ["dates", "accessor"]
  • ["dates", "arithmetic"]
  • ["dates", "construction"]
  • ["dates", "conversion"]
  • ["dates", "parse"]
  • ["dates", "query"]
  • ["dates", "string"]
  • ["find", "findall"]
  • ["find", "findnext"]
  • ["find", "findprev"]
  • ["io", "array_limit"]
  • ["io", "read"]
  • ["io", "serialization"]
  • ["io"]
  • ["linalg", "arithmetic"]
  • ["linalg", "blas"]
  • ["linalg", "factorization"]
  • ["linalg"]
  • ["micro"]
  • ["misc"]
  • ["misc", "23042"]
  • ["misc", "afoldl"]
  • ["misc", "allocation elision view"]
  • ["misc", "bitshift"]
  • ["misc", "foldl"]
  • ["misc", "issue 12165"]
  • ["misc", "iterators"]
  • ["misc", "julia"]
  • ["misc", "parse"]
  • ["misc", "repeat"]
  • ["misc", "splatting"]
  • ["problem", "chaosgame"]
  • ["problem", "fem"]
  • ["problem", "go"]
  • ["problem", "grigoriadis khachiyan"]
  • ["problem", "imdb"]
  • ["problem", "json"]
  • ["problem", "laplacian"]
  • ["problem", "monte carlo"]
  • ["problem", "raytrace"]
  • ["problem", "seismic"]
  • ["problem", "simplex"]
  • ["problem", "spellcheck"]
  • ["problem", "stockcorr"]
  • ["problem", "ziggurat"]
  • ["random", "collections"]
  • ["random", "randstring"]
  • ["random", "ranges"]
  • ["random", "sequences"]
  • ["random", "types"]
  • ["scalar", "acos"]
  • ["scalar", "acosh"]
  • ["scalar", "arithmetic"]
  • ["scalar", "asin"]
  • ["scalar", "asinh"]
  • ["scalar", "atan"]
  • ["scalar", "atan2"]
  • ["scalar", "atanh"]
  • ["scalar", "cbrt"]
  • ["scalar", "cos"]
  • ["scalar", "cosh"]
  • ["scalar", "exp2"]
  • ["scalar", "expm1"]
  • ["scalar", "fastmath"]
  • ["scalar", "floatexp"]
  • ["scalar", "intfuncs"]
  • ["scalar", "iteration"]
  • ["scalar", "mod2pi"]
  • ["scalar", "predicate"]
  • ["scalar", "rem_pio2"]
  • ["scalar", "sin"]
  • ["scalar", "sincos"]
  • ["scalar", "sinh"]
  • ["scalar", "tan"]
  • ["scalar", "tanh"]
  • ["shootout"]
  • ["simd"]
  • ["sort", "insertionsort"]
  • ["sort", "issorted"]
  • ["sort", "mergesort"]
  • ["sort", "quicksort"]
  • ["sparse", "arithmetic"]
  • ["sparse", "constructors"]
  • ["sparse", "index"]
  • ["sparse", "matmul"]
  • ["sparse", "sparse matvec"]
  • ["sparse", "sparse solves"]
  • ["sparse", "transpose"]
  • ["string", "==(::AbstractString, ::AbstractString)"]
  • ["string", "==(::SubString, ::String)"]
  • ["string", "findfirst"]
  • ["string"]
  • ["string", "readuntil"]
  • ["string", "repeat"]
  • ["tuple", "index"]
  • ["tuple", "linear algebra"]
  • ["tuple", "misc"]
  • ["tuple", "reduction"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.8.0-DEV.391
Commit 8e8564937b (2021-08-23 19:36 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1037-aws #39-Ubuntu SMP Thu Jan 14 02:56:06 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  3403 MHz     341663 s       3175 s      35154 s  156872269 s          0 s
       #2  3402 MHz   13846656 s       1285 s     753552 s  142655193 s          0 s
       #3  3403 MHz     238270 s       1201 s      12108 s  157007487 s          0 s
       #4  3405 MHz     283640 s       1206 s      13360 s  156960203 s          0 s
       #5  3412 MHz     163854 s       1161 s      11433 s  157056270 s          0 s
       #6  3421 MHz     190940 s       1148 s      10829 s  157056837 s          0 s
       #7  3423 MHz     158161 s       1069 s      11295 s  157089432 s          0 s
       #8  3399 MHz     152406 s       1234 s      10499 s  157081831 s          0 s
       
  Memory: 30.362831115722656 GB (9055.1875 MB free)
  Uptime: 1.572632497e7 sec
  Load Avg:  1.06  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Comparison Build

Julia Version 1.8.0-DEV.389
Commit 0974dfa1bd (2021-08-23 19:29 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1037-aws #39-Ubuntu SMP Thu Jan 14 02:56:06 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  3406 MHz     342273 s       3224 s      35208 s  156978860 s          0 s
       #2  3401 MHz   13945537 s       1285 s     760557 s  142656626 s          0 s
       #3  3403 MHz     238316 s       1201 s      12124 s  157114740 s          0 s
       #4  3427 MHz     284097 s       1206 s      13390 s  157067034 s          0 s
       #5  3424 MHz     163870 s       1161 s      11445 s  157163561 s          0 s
       #6  3405 MHz     190989 s       1148 s      10840 s  157164096 s          0 s
       #7  3438 MHz     158545 s       1069 s      11309 s  157196354 s          0 s
       #8  3433 MHz     152467 s       1234 s      10514 s  157189061 s          0 s
       
  Memory: 30.362831115722656 GB (9248.67578125 MB free)
  Uptime: 1.573705688e7 sec
  Load Avg:  1.02  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)