New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark application needs documentation on adding jars #514

Open

snowch opened this issue Sep 24, 2021 · 0 comments

Labels

Priority: High Project: Developer Support Project: Example Apps Type: Docs

Contributor

snowch commented Sep 24, 2021 •

edited

Loading

The docs page needs instructions for adding jars.

The method I used was:

On the livy, master and worker nodes
- kubectl exec --it NODE -- bash
- run spark_shell with --packages parameter
- copy libs from /root/.ivy2/jars to SPARK_HOME/jars
- restart spark or livy service

joel-bluedata added Priority: High Project: Developer Support Project: Example Apps Type: Docs labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment