Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add miscellaneous benchmarks from various issues #33

Merged
merged 4 commits into from
Oct 18, 2016
Merged

add miscellaneous benchmarks from various issues #33

merged 4 commits into from
Oct 18, 2016

Conversation

stevengj
Copy link
Contributor

This adds benchmarks based on JuliaLang/julia#13359 (cc @timholy), JuliaLang/julia#13724, JuliaLang/julia#15553, JuliaLang/julia#18135, and JuliaLang/julia#18000.

I also created a "miscellaneous" benchmark suite to stick these into. The code can always be refactored later into different categories, but it is good to have a place to quickly add new benchmarks that don't clearly fit into one of the existing suites.

@jrevels jrevels mentioned this pull request Oct 18, 2016
return s
end

g[(3,3,3)] = @benchmarkable perf_splatting($(samerand(3,3,3)), 1000000, 1, 2, 3)
Copy link
Member

@jrevels jrevels Oct 18, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we decrease the 1000000 here to 100 for the sake of efficiency (i.e. more samples per second)?

g = addgroup!(SUITE, "afoldl", ["+", "getindex"])
g["Int"] = @benchmarkable perf_afoldl(1000000, $(zeros(Int, 20)))
g["Float64"] = @benchmarkable perf_afoldl(1000000, $(zeros(Float64, 20)))
g["Complex{Float64}"] = @benchmarkable perf_afoldl(1000000, $(zeros(Complex{Float64}, 20)))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These can also go from 1000000 to 100.

@stevengj
Copy link
Contributor Author

Okay, reduced the sample sizes.

end

g = addgroup!(SUITE, "parse", ["DateTime"])
datestr = map(string,range(DateTime("2016-02-19T12:34:56"),Dates.Millisecond(123),10_000))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This one should be dialed down as well (from 10_000 to 100 should be fine). If you're curious about the scale I'm using, the main idea is to keep most benchmarks from going over ~1ms/evaluation when possible (enabling us to gather on the order of hundreds of samples per benchmark).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok

@jrevels
Copy link
Member

jrevels commented Oct 18, 2016

Thanks, LGTM. Merge when ready.

@stevengj stevengj merged commit 065fc5c into master Oct 18, 2016
@stevengj stevengj deleted the misc branch October 18, 2016 23:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants