Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setting env. variables like JULIA_NUM_THREADS for remote workers #18074

Closed
oschulz opened this issue Aug 17, 2016 · 3 comments
Closed

Setting env. variables like JULIA_NUM_THREADS for remote workers #18074

oschulz opened this issue Aug 17, 2016 · 3 comments
Labels
parallelism Parallel or distributed computation

Comments

@oschulz
Copy link
Contributor

oschulz commented Aug 17, 2016

There currently doesn't seem to be a method to control/set/forward environment variables for remote workers, e.g. workers started with

addprocs([host1, ...])

One important variable that users may want to set is JULIA_NUM_THREADS. But in more complex real-world situation, one may also need to set (resp. forward) things like PATH, LD_LIBRARY_PATH (for custom software packages) and other (site- and application-dependent) variables.

Maybe addprocs could get an env kwarg or so?

@ViralBShah
Copy link
Member

cc @amitmurthy

@xgdgsc
Copy link
Contributor

xgdgsc commented May 25, 2020

Also hoping this could be added so I only have one JULIA_DEPOT_PATH JULIA_PROJECT shared on nfs between nodes. For now I edit ~/.bashrc and add export JULIA_DEPOT_PATH=... on nodes. I' d like to add envs to machine file.

@mgkuhn
Copy link
Contributor

mgkuhn commented Jul 10, 2021

Julia 1.6 added a new env=["JULIA_DEPOT_PATH"=>"/depot", ...] keyword argument to Distributed.addprocs that solves this issue.

@mgkuhn mgkuhn closed this as completed Jul 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parallelism Parallel or distributed computation
Projects
None yet
Development

No branches or pull requests

4 participants