[SPARK-12895][SPARK-12896] Migrate TaskMetrics to accumulators#10835

Closed

andrewor14 wants to merge 45 commits intoapache:masterfrom

andrewor14:task-metrics-use-accums

Commits on Jan 18, 2016

Change types of some signatures
Andrew Or
committed
Boiler plate for all the new internal accums
Andrew Or
committed

Commits on Jan 19, 2016

Squashed commit of the following:
Andrew Or
committed
Implement TaskMetrics using Accumulators
Andrew Or
committed
Fix accums not set on the driver
Andrew Or
committed
Fix test compile
Andrew Or
committed
Make accum updates read from all registered accums
Andrew Or
committed
Fix metrics being double counted on driver
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Miscellaneous updates; make diff smaller
Andrew Or
committed
Fix JsonProtocolSuite
Andrew Or
committed
Fix SQLQuerySuite
Andrew Or
committed
Fix style
Andrew Or
committed
Fix MiMa
Andrew Or
committed
Add test on accum values being zero'ed out + cleanups
Andrew Or
committed
Add tests for TaskMetrics, which uncovered a bug
Andrew Or
committed
Minor test changes
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Fix style
Andrew Or
committed
Fix MiMa
Andrew Or
committed

Commits on Jan 20, 2016

Fix InputOutputMetricsSuite
Andrew Or
committed
Fix TaskContextSuite
Andrew Or
committed
Fix ReplayListenerSuite
Andrew Or
committed
Fix SparkListenerSuite
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Minor comment correction
Andrew Or
committed
Add test to verify internal accums are cleaned up
Andrew Or
committed
Add deprecated matching methods for Input/OutputMetrics
Andrew Or
committed

Commits on Jan 25, 2016

Address review comments
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Implement SPARK-12896 (squashed)
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed

Commits on Jan 26, 2016

Add test for setting result size
Andrew Or
committed
Fix JsonProtocolSuite
Andrew Or
committed
Address review comments (not quite done yet)
Andrew Or
committed
Address review comments (round 3)
Andrew Or
committed
Make AccumulableInfo#name an Option[String]
Andrew Or
committed
Fix style
Andrew Or
committed
Address review comments (still round 3)
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Add more tests for accums JSON de/serialization
Andrew Or
committed
Fix SparkListenerSuite
Andrew Or
committed
Fix some weird indentations
Andrew Or
committed

Commits on Jan 27, 2016

Fix InternalAccumulatorSuite
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed