How to align each process before algo.compute()? #591
Answered
by
PetrovKP
bobjiang82
asked this question in
Q&A
-
I would like to measure the algo.compute() runtime in distributed computing. So I wonder if there's an API like mpi_barrier() to sync each process after data loading and before algo.compute(). Something like below,
|
Beta Was this translation helpful? Give feedback.
Answered by
PetrovKP
Mar 29, 2021
Replies: 1 comment 1 reply
-
We use mpi to run our algorithms for python. For synchronization across all group members, you can use the MPI functions. For example: import daal4py as d4p
d4p.daalinit() # for MPI init of daal4py
from mpi4py import MPI
comm = MPI.COMM_WORLD
data = read_csv()
comm.Barrier()
algo = d4p.algorithm()
algo.compute(data)
...
d4p.daalfini() # for MPI finilize of daal4py |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
SmirnovEgorRu
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We use mpi to run our algorithms for python. For synchronization across all group members, you can use the MPI functions. For example: