-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Mesos framework termination - not able to run the cells on mesos #330
Comments
Further logs : |
I think this is not working due to docker/for-mac#68 . Let us document this. |
Thanks for the report and pointer to possible underlying cause. We can add a note to the relevant READMEs. |
* Mesos issue for #330 * Remove jpeg pinning note (it was unpinned a while ago)
A long time in coming, but the note is now in the README. Thanks @sharmalalit . |
What docker image you are using?
pyspark-notebook
What complete docker command do you run to launch the container (omitting sensitive values)?
docker run -it --rm --net=host --pid=host -e TINI_SUBREAPER=true jupyter/pyspark-notebook
What steps do you take once the container is running to reproduce the issue?
I am creating a new notebook with code as given in docs to connect to Mesos master to run my pyspark code.
What do you expect to happen?
What actually happens?
Mesos framework registration is getting failed. pyspark task is not run.
Mesos logs :
I0118 11:40:41.720917 190119936 master.cpp:2231] Received SUBSCRIBE call for framework 'pyspark-shell' at scheduler-a65a47fc-34b6-4196-87a3-7e3d88e20ddd@172.17.0.2:43715
I0118 11:40:41.720995 190119936 master.cpp:2302] Subscribing framework pyspark-shell with checkpointing disabled and capabilities [ ]
I0118 11:40:41.721012 190119936 master.cpp:2312] Framework 43cefdcf-41be-42f2-9007-86bdfcb81df0-0000 (pyspark-shell) at scheduler-a65a47fc-34b6-4196-87a3-7e3d88e20ddd@172.17.0.2:43715 already subscribed, resending acknowledgement
E0118 11:40:41.721050 191193088 process.cpp:1958] Failed to shutdown socket with fd 15: Socket is not connected
I0118 11:40:44.429878 190656512 master.cpp:2231] Received SUBSCRIBE call for framework 'pyspark-shell' at scheduler-fe536603-7897-467f-ba49-8f725bd27083@172.17.0.2:43715
I0118 11:40:44.429954 190656512 master.cpp:2302] Subscribing framework pyspark-shell with checkpointing disabled and capabilities [ ]
I0118 11:40:44.429965 190656512 master.cpp:2312] Framework 43cefdcf-41be-42f2-9007-86bdfcb81df0-0001 (pyspark-shell) at scheduler-fe536603-7897-467f-ba49-8f725bd27083@172.17.0.2:43715 already subscribed, resending acknowledgement
The text was updated successfully, but these errors were encountered: