-
Notifications
You must be signed in to change notification settings - Fork 364
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cluster backend for shot parallelization #1298
Closed
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…o cluster_backend
hitomitak
requested review from
chriseclectic,
mtreinish and
vvilpas
as code owners
July 29, 2021 01:54
hitomitak
force-pushed
the
cluster_backend_shot
branch
2 times, most recently
from
August 2, 2021 01:53
c62c63d
to
5fd0ffb
Compare
hitomitak
force-pushed
the
cluster_backend_shot
branch
from
August 2, 2021 05:01
5fd0ffb
to
652224d
Compare
hitomitak
force-pushed
the
cluster_backend_shot
branch
from
August 6, 2021 02:42
5dffac2
to
3f2c9d6
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Enhancement of #1281
Enhance the execution option to enable shot parallelization.
When a user gives dask client as executor, Aer can execute a simulation by a shot on the distributed machines like HPC clusters.
When the noise simulator executes with the executor option, AerJobSet object copies Qobj or circuits and distributes them to the workers. After simulations, AerJobSet collects each result, sums up with each count, and combines them into one result object.
Example Usage:
Threadpool execution:
Dask execution (Local only):
Dask execution (Multiple Nodes):
After setup dask environment in all nodes, set up a cluster in a master node as a following command.
And simulation executes.
Details and comments
I executed QV (10 depth, 100 shots ) with a noise model and measured the execution time on 3VMs with Dask executor.
Env: 3VMs, OS: CentOS8.0, Memory 64 GB, CPU: 32 x 2.0 GHz or higher Cores.
1 Node : a normal Aer simulator
1 Node (DASK) : only one node with dask executor
2 Node (DASK) : two nodes with dask executor
3 Node (DASK) : three nodes with dask executor