-
Notifications
You must be signed in to change notification settings - Fork 2.8k
[ZEPPELIN-1279] Spark on Mesos Docker. #1389
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
|
||
|
|
||
| ## Spark on Mesos mode | ||
| You can simply set up [Spark on Mesos](http://spark.apache.org/docs/latest/running-on-mesos.html) docker environment with below steps. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is no number 1 :)
Maybe
1. Build Docker file
|
@AhyoungRyu Thank you for quick review. I fixed what you pointed out. |
| # limitations under the License. | ||
| FROM centos:centos6 | ||
|
|
||
| ENV SPARK_PROFILE 1.6 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
does this work with Spark 2.0?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes I tested it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should we update this script to point to 2.0 then?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sure. I fixed.
[ZEPPELIN-1279] Update zeppelin_mesos_conf.png
|
@AhyoungRyu Thank you!! 👍 |
|
Looks great to me, thank you @astroshim for your effort! And as usually, thank you @AhyoungRyu for great review. Merging to master, if there is no further discussion |
What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on mesos via Docker.
Related issue is #1227 and #1318 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.
What type of PR is it?
Documentation
What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1279
How should this be tested?
You can refer to https://github.com/apache/zeppelin/blob/master/docs/README.md#build-documentation.
Questions: