-
Notifications
You must be signed in to change notification settings - Fork 5.6k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* add allreduce and broadcast without test (#31024) add allreduce and broadcast without test * Refactor HCCLCommContext to be compatible with Paddle (#31359) Refactor HCCLCommContext to be compatible with Paddle (#31359) * [NPU] add npu kernel for communication op (#31437) * add allreduce and broadcast without test * add c_broadcast_test case * build c_comm_init and c_create_group operators * make the whole thing compile * add broadcast and init op test case but run failed * make unit test compile * fix broadcast test bug and change into hcom for ccl * change c_comm_init and c_create_group ops accordingly * make tests compile * transfer code to 27 * compiled successfully in 28, but run failed * test broadcast in 28, but failed * make hcom primitives work * change hccl data type for base.h * fix broadcast bug * make attributes work * fix group name bug * add allreduce but test failed * allreduce bug for qiuliang * allreduce finished * add allgather and reducescatter * merge all op code * add allgather test * finish run all ccl op test exclude send/recv * all all op and test exclude send/recv * send_v2_npu.cc recv_v2_npiu.cc compiled * fix ccl core dump bug and test allgather, reducescatter, broadcast op * fix allreduce bug just for test * hcom send&recv test pass, without hcom_destroy * for qiuliang test * Ascend Send&Recv Test Pass * all op (ex send/recv) ok * fix bug * merge all ccl op * style merge to PaddlePaddle * merge style * new merge style * merge style 2 * insert an empty at the end * disable ctest for hcom to pass ci Co-authored-by: void-main <voidmain1313113@gmail.com> Co-authored-by: f2hkop <f2huestc@outlook.com> * Add auto-increasing tag id for Hcom OPs (#31702) * add c_reduce_sum op (#31793) add c_reduce_sum op * update Ascendrc hccl to 20.3 (#32126) update Ascendrc hccl to 20.3 (#32126) * fix merge code * change cmake.txt1 * [NPU] Support npu kernel for c sync stream op (#31386) * sync stream npu op * add with_ascend_acl * update c++ unittest * compile all failed * try to pre commit * after pre commit * merge&compile&test hccl successfully! * fix code style * fix code style * fix bugs about hccl * fix some bugs * fix code style * fix style * fix style * fix * fixed * merge develop Co-authored-by: lw921014 <liuwei921014@yeah.net> Co-authored-by: Void Main <voidmain1313113@gmail.com> Co-authored-by: f2hkop <f2huestc@outlook.com> Co-authored-by: xiayanming <41795079@qq.com>
- Loading branch information
5 people
authored
Apr 21, 2021
1 parent
bc90916
commit c315852
Showing
68 changed files
with
4,476 additions
and
119 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,83 @@ | ||
| /* Copyright (c) 2021 PaddlePaddle Authors. All Rights Reserved. | ||
| Licensed under the Apache License, Version 2.0 (the "License"); | ||
| you may not use this file except in compliance with the License. | ||
| You may obtain a copy of the License at | ||
| http://www.apache.org/licenses/LICENSE-2.0 | ||
| Unless required by applicable law or agreed to in writing, software | ||
| distributed under the License is distributed on an "AS IS" BASIS, | ||
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
| See the License for the specific language governing permissions and | ||
| limitations under the License. */ | ||
|
|
||
| #include "paddle/fluid/operators/collective/c_allgather_op.h" | ||
|
|
||
| #include <memory> | ||
|
|
||
| #if defined(PADDLE_WITH_ASCEND_CL) | ||
| #include "paddle/fluid/platform/collective_helper.h" | ||
| #include "paddle/fluid/platform/hccl_helper.h" | ||
| #endif | ||
|
|
||
| namespace paddle { | ||
| namespace operators { | ||
|
|
||
| template <typename T> | ||
| class CAllGatherOpASCENDKernel : public framework::OpKernel<T> { | ||
| public: | ||
| void Compute(const framework::ExecutionContext &ctx) const override { | ||
| #if defined(PADDLE_WITH_ASCEND_CL) | ||
| auto in = ctx.Input<framework::Tensor>("X"); | ||
| auto out = ctx.Output<framework::Tensor>("Out"); | ||
| HcclDataType dtype = platform::ToHCCLDataType(in->type()); | ||
|
|
||
| int ring_id = ctx.Attr<int>("ring_id"); | ||
| std::string group = | ||
| std::string(HCOM_GROUP_PREFIX) + std::to_string(ring_id); | ||
| auto place = ctx.GetPlace(); | ||
| auto comm = platform::HCCLCommContext::Instance().Get(ring_id, place); | ||
| int nranks = comm->nranks(); | ||
|
|
||
| framework::DDim out_dims = in->dims(); | ||
| out_dims[0] *= nranks; | ||
| out->mutable_data<T>(out_dims, place); | ||
|
|
||
| uint64_t send_numel = in->numel(); | ||
| void *send_buff = reinterpret_cast<void *>(const_cast<T *>(in->data<T>())); | ||
| void *recv_buff = reinterpret_cast<void *>(out->data<T>()); | ||
|
|
||
| aclrtStream stream = nullptr; | ||
| if (ctx.Attr<bool>("use_calc_stream")) { | ||
| auto dev_ctx = platform::DeviceContextPool::Instance().Get(place); | ||
| stream = static_cast<platform::NPUDeviceContext *>(dev_ctx)->stream(); | ||
| } else { | ||
| stream = comm->stream(); | ||
| } | ||
|
|
||
| VLOG(3) << "begin hccl allgather, parameter is: " | ||
| << ", group is " << group << ", ring_id is " << ring_id | ||
| << ", nranks is " << nranks; | ||
|
|
||
| PADDLE_ENFORCE_NPU_SUCCESS(platform::dynload::HcclAllGather( | ||
| send_buff, recv_buff, send_numel, dtype, comm->comm(), | ||
| reinterpret_cast<void *>(stream))); | ||
|
|
||
| #else | ||
| PADDLE_THROW(platform::errors::PreconditionNotMet( | ||
| "PaddlePaddle should compile with NPU.")); | ||
| #endif | ||
| } | ||
| }; | ||
|
|
||
| } // namespace operators | ||
| } // namespace paddle | ||
|
|
||
| namespace ops = paddle::operators; | ||
| namespace plat = paddle::platform; | ||
|
|
||
| REGISTER_OP_NPU_KERNEL(c_allgather, ops::CAllGatherOpASCENDKernel<int8_t>, | ||
| ops::CAllGatherOpASCENDKernel<int>, | ||
| ops::CAllGatherOpASCENDKernel<float>, | ||
| ops::CAllGatherOpASCENDKernel<plat::float16>); |
Oops, something went wrong.