Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added table of (wall-clock) stage durations when print_metrics is used #315

Merged
merged 1 commit into from
Jul 17, 2014
Merged

Added table of (wall-clock) stage durations when print_metrics is used #315

merged 1 commit into from
Jul 17, 2014

Commits on Jul 16, 2014

  1. Added table of (wall-clock) stage durations when the print_metrics op… 

    …tion is used

The ADAMMetricsListener now records the wall-clock duration of each Spark stage. Previously only the total time taken for all of the tasks in the stage was recorded, but this is different from the wall-clock time on a multiple node cluster.

Also changed the text of the print_metrics option to clarify that metrics are printed to the log (as opposed to stdout)
    @nfergu
    nfergu committed Jul 16, 2014
    Configuration menu
    Copy the full SHA
    6de645a View commit details
    Browse the repository at this point in the history