Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add support for daily benchmark jobs #3

Merged
merged 13 commits into from
Jun 9, 2016
Merged

add support for daily benchmark jobs #3

merged 13 commits into from
Jun 9, 2016

Conversation

jrevels
Copy link
Member

@jrevels jrevels commented Jun 6, 2016

This PR contains what I worked on this weekend to prepare @nanosoldier to run daily benchmark jobs (see JuliaLang/julia#13893).

Changes:

  • slightly improved job submission phrase validation/tests
  • raw benchmark data + logs are now uploaded as tarred JLD + text files
  • add isdaily keyword argument to submission phrase that modifies the job to...
    • format the report folder name as daily_YYYY_MM_DD, using the current day's date
    • compare the current day's results to the previous day's results (if the previous day's results exist; it'll look back up to 30 days).

TODO:

  • do a test deployment with these changes
  • set up a cron job that causes @nanosoldier to regularly submit CI jobs to itself using the isdaily keyword argument

cc @tkelman

@jrevels jrevels force-pushed the jr/daily branch 3 times, most recently from 2ca24ed to 0fc2d0f Compare June 7, 2016 02:31
@jrevels jrevels force-pushed the jr/daily branch 2 times, most recently from ff4c3a6 to 7a2f146 Compare June 7, 2016 04:28
@jrevels jrevels merged commit 250a382 into master Jun 9, 2016
@jrevels jrevels deleted the jr/daily branch June 9, 2016 19:25
@tkelman
Copy link
Contributor

tkelman commented Jun 9, 2016

can't wait

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants