[SPARK-5388] Provide a stable application submission gateway for standalone cluster mode#4216

Closed

andrewor14 wants to merge 59 commits intoapache:masterfrom

andrewor14:rest

Commits on Jan 17, 2015

Initial client, server, and all the messages
Andrew Or
committed

Commits on Jan 19, 2015

Integrate REST protocol in standalone mode
Andrew Or
committed

Commits on Jan 20, 2015

Rename classes to generalize REST protocol
Andrew Or
committed
Specify an ordering for fields in SubmitDriverRequestMessage
Andrew Or
committed
Supported nested values in messages
Andrew Or
committed

Commits on Jan 21, 2015

Major clean ups in code and comments
Andrew Or
committed
Support kill and request driver status through SparkSubmit
Andrew Or
committed

Commits on Jan 22, 2015

Implement status requests + fix validation behavior
Andrew Or
committed

Commits on Jan 23, 2015

Distinguish client and server side Spark versions
Andrew Or
committed
Action -> SparkSubmitAction (minor)
Andrew Or
committed
Remove MASTER as a field (minor)
Andrew Or
committed

Commits on Jan 27, 2015

Refactor and add tests for the REST protocol
Andrew Or
committed
Minor fixes
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Use a daemon thread pool for REST server
Andrew Or
committed
Show the REST port on the Master UI
Andrew Or
committed

Commits on Jan 28, 2015

Add end-to-end tests for standalone REST protocol
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Fix local cluster tests
Andrew Or
committed

Commits on Jan 29, 2015

Use Jackson for JSON de/serialization
Andrew Or
committed
Replace SubmitRestProtocolAction with class name
Andrew Or
committed
Fix comments and name fields for better error messages
Andrew Or
committed
stable -> rest
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed

Commits on Jan 30, 2015

Clean up uses of exceptions
Andrew Or
committed
Provide more safeguard against missing fields
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Add checks for enabling REST when using kill/status
Andrew Or
committed
Increase timeout in end-to-end tests
Andrew Or
committed
Abstract the success field to the general response
Andrew Or
committed

Commits on Feb 1, 2015

Clean up REST response output in Spark submit
Andrew Or
committed
Reduce duplicate naming in REST field
Andrew Or
committed

Commits on Feb 2, 2015

Use Jackson's DefaultScalaModule to simplify messages
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Move some classes around to reduce number of files (minor)
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed

Commits on Feb 4, 2015

Provide more REST-like interface for submit/kill/status
Andrew Or
committed
Version the protocol and include it in REST URL
Andrew Or
committed
Use specific HTTP response codes on error
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Fix style
Andrew Or
committed
Clean up server error handling behavior further
Andrew Or
committed
Fall back to Akka if endpoint was not REST
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Upgrade Jackson from 2.3.0 to 2.4.4
Andrew Or
committed
Fix style
Andrew Or
committed

Commits on Feb 5, 2015

Include server protocol version on mismatch
Andrew Or
committed
Include unknown fields, if any, in server response
Andrew Or
committed
Pass submit parameters through system properties
Andrew Or
committed
Report REST server response back to the user
Andrew Or
committed
Do not include appResource and mainClass as properties
Andrew Or
committed

Commits on Feb 6, 2015

Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Minor comment and wording updates
Andrew Or
committed
Comment changes + minor code refactoring across the board
Andrew Or
committed
Fix tests
Andrew Or
committed
Minor comments
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed
Use nullable fields for integer and boolean values
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into rest
Andrew Or
committed