[SPARK-7120][SPARK-7121] Closure cleaner nesting + documentation + tests#5685

Closed

andrewor14 wants to merge 27 commits intoapache:masterfrom

andrewor14:closure-cleaner

Commits on Apr 24, 2015

Implement transitive cleaning + add missing documentation
Andrew Or
committed
Feature flag this new behavior
Andrew Or
committed
Minor changes
Andrew Or
committed
Add tests (still WIP)
Andrew Or
committed
Make closure cleaning idempotent
Andrew Or
committed
Finalize tests
Andrew Or
committed

Commits on Apr 25, 2015

Merge branch 'master' of github.com:apache/spark into closure-cleaner
Andrew Or
committed
Fix closure cleaner visibility
Andrew Or
committed
Guard against potential infinite cycles in method visitor
Andrew Or
committed
Add more tests for individual closure cleaner operations
Andrew Or
committed
Use private method tester for a few things
Andrew Or
committed
Update a few comments
Andrew Or
committed
More minor updates (wording, renaming etc.)
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into closure-cleaner
Andrew Or
committed

Commits on Apr 26, 2015

Fix scala style?
Andrew Or
committed

Commits on Apr 28, 2015

Bypass SerializationDebugger for now (SPARK-7180)
Andrew Or
committed
Revert "Bypass SerializationDebugger for now (SPARK-7180)"
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into closure-cleaner
Andrew Or
committed

Commits on Apr 29, 2015

In sc.runJob, actually clean the inner closure
Andrew Or
committed
Guard against NPE if CC is used outside of an application
Andrew Or
committed
Revert "Guard against NPE if CC is used outside of an application"
Andrew Or
committed
Revert "In sc.runJob, actually clean the inner closure"
Andrew Or
committed

Commits on May 2, 2015

Merge branch 'master' of github.com:apache/spark into closure-cleaner
Andrew Or
committed
Address comments
Andrew Or
committed
Fix tests
Andrew Or
committed
Fix style
Andrew Or
committed
Revert a small change that affected streaming
Andrew Or
committed