-
Notifications
You must be signed in to change notification settings - Fork 754
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dev nd nccl send recv boxing #8467
Merged
Yipeng1994
merged 40 commits into
feat-general_basic_communication
from
dev_nd_nccl_send_recv_boxing
Jun 23, 2022
Merged
Changes from all commits
Commits
Show all changes
40 commits
Select commit
Hold shift + click to select a range
d428484
nd nccl_send_recv_boxing
guo-ran c1b5498
rm print
guo-ran 816f45a
support num_axes > 2
guo-ran 2817305
Add distributed optional run (#8372)
jackalcooper c07f587
autoprof supports bandwidth (#8367)
daquexian f237503
remove tmp buffer of cumprod cpu backward kernel (#8369)
liufengwei0103 7feedc4
Move tensor api to cpython part3 (#8342)
marigoold e224be4
Add nn_functor Check (#7910)
MARD1NO c83fcaa
Add FusedMatmulBiasAddReluDropout [OneEmbedding] (#8222)
MARD1NO 0fd888c
fix gather 0-dim tensor bug (#8376)
BBuf 33634a2
add api to apply external job pass (#8370)
hjchen2 a8576ad
Add condition to find-test-cache-distributed (#8387)
jackalcooper b6abc62
warp dim util (#8382)
Flowingsun007 c10a30c
fix_bug_in_broadcast_min_max_grad_and_broadcast_like (#8379)
clackhan 2e17cc3
fix bug about index (#8388)
liufengwei0103 469f72d
LogicalSliceAssign support full slice sbp (#8344)
wyg1997 d98132e
fix_tensor_from_numpy_mem_leak_bug (#8391)
clackhan 82f4af5
Make of_pyext_obj static only to make sure only a python ext so has p…
jackalcooper 813ffa7
Adjust tolerance setting in embedding_renorm unit test (#8394)
EsdeathYZH 6aa2416
support front end compile for job to iree (#8249)
howin98 95240c2
Feat/zero mix with mp (#8036)
strint b3be1da
Revert embedding normal path and fix amp list (#8374)
EsdeathYZH 5686581
replace fixed_vector with small_vector and make Shape inherit from it…
daquexian 994c0f8
Light plan for debug (#8396)
chengtbf 39a2d45
disable terminfo to fix missing terminfo symbols (#8400)
daquexian 15eef18
fix bug of ZeRO MP in complex case (#8404)
chengtbf 384b5a2
merge master
guo-ran e6e864c
Remove redundant output_lbns in ir (#8409)
jackalcooper 3b42b2f
Dev FusedCrossInteraction[OneEmbedding] (#8335)
MARD1NO ba56c84
add exe graph physical shape check msg (#8002)
strint f704b49
add batch_matmul sbp (#8385)
guo-ran c289645
suppress gcc11 false positive warning (#8401)
daquexian e8547b4
fix variable op conversion to tosa error in ninja c1 (#8412)
howin98 bcde424
nccl send/recv support different placement
guo-ran 8ea068c
refine
guo-ran f873826
Merge branch 'master' into dev_nd_nccl_send_recv_boxing
guo-ran 69f9a42
auto format by CI
oneflow-ci-bot 384c621
rm out ctrl
guo-ran 491e69c
Merge branch 'dev_nd_nccl_send_recv_boxing' of https://github.com/One…
guo-ran 66f11ba
auto format by CI
oneflow-ci-bot File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
diff 好大,base 分支可以先合并下master?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
也阔以
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
哎,我先把他们合一下,一个分支是传输功能相关的,另一个分支是对应的cost相关的