Backward C++ API Code-Generation #39057

zyfncg · 2022-01-19T15:07:12Z

PR types

New features

PR changes

APIs

Describe

反向C++ API接口自动生成，在#37668的基础上增加了反向C++ API接口。

反向C++ API的自动生成同样采用yaml文件进行配置，配置格式如下(以matmul_grad和scale_grad为例)：

- backward_api : matmul_grad
  forward : matmul (const Tensor& x, const Tensor& y, bool transpose_x, bool transpose_y) -> Tensor(out)
  args : (const Tensor& x, const Tensor& y, const Tensor& out_grad, bool transpose_x=false, bool transpose_y=false)
  output : Tensor(x_grad), Tensor(y_grad)
  infer_meta :
    func : MatmulGradInferMeta
  kernel : 
    func : matmul_grad

- backward_api : scale_grad
  forward : scale (const Tensor& x, const Scalar& scale, float bias, bool bias_after_scale) -> Tensor(out)
  args : (const Tensor& out_grad, const Scalar& scale, float bias=0.0, bool bias_after_scale=true)
  output : Tensor(x_grad)
  invoke : scale(out_grad, scale, bias, bias_after_scale)

其中各项配置参数的含义：
backward_api : 反向C++ API的函数名
forward ：对应的前向API（包括API名称，输入以及输出参数）
args : 反向API的输入参数，参数名需要与前向API对应
output : 返回参数类型，支持返回单个或多个Tensor与vector<Tensor>
infer_meta : 生成返回Tensor的Meta信息
    func : 调用的InferMeta函数
kernel :  kernel配置
    func : 调用的kernel函数（使用kernel注册名）
invoke : 复用前向C++ API，传入对应参数进行调用

注意：当前yaml配置格式非最终形态，后续仍会迭代调整。

… backward_code_gen

paddle-bot-old · 2022-01-19T15:07:17Z

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

chenwhql · 2022-01-20T06:14:52Z

paddle/pten/api/lib/CMakeLists.txt

+# backward api file
+set(bw_api_gen_file ${CMAKE_SOURCE_DIR}/python/paddle/utils/code_gen/backward_api_gen.py)
+set(bw_api_yaml_file ${CMAKE_SOURCE_DIR}/python/paddle/utils/code_gen/backward.yaml)
+set(bw_api_header_file ${CMAKE_SOURCE_DIR}/paddle/pten/api/include/backward_api.h)


反向API是不是暂时不要一并暴露给用户

建议不要一并放到api/include目录下，可以新创建一个子目录，比如api/backward

chenwhql · 2022-01-20T06:15:53Z

paddle/pten/api/lib/tensor_adapt.h

@@ -0,0 +1,74 @@
+/* Copyright (c) 2021 PaddlePaddle Authors. All Rights Reserved.


chenwhql · 2022-01-20T06:27:54Z

paddle/pten/infermeta/grad_infermeta.cc

+See the License for the specific language governing permissions and
+limitations under the License. */
+
+#include "paddle/pten/infermeta/grad_infermeta.h"


命名重复了，可以简短一些，grad.h或者backward.h，inferMeta有目录就可以了

chenwhql · 2022-01-20T06:29:59Z

python/paddle/utils/code_gen/backward.yaml

@@ -0,0 +1,34 @@
+- grad_api : matmul_grad


是不是上下命名一致好一些，如果文件或目录是backward api的话，里面建议也是backward_api，或者就文件和目录也用grad

Done, 目前修改为backward_api

… backward_code_gen

jim19930609 · 2022-01-24T02:54:00Z

.gitignore

@@ -4,7 +4,8 @@ paddle/fluid/API_DEV.spec
 paddle/fluid/API_PR.spec
 paddle/fluid/op_use_default_grad_maker_DEV.spec
 paddle/fluid/op_use_default_grad_maker_PR.spec
-paddle/pten/api/*/api*
+paddle/pten/api/*/api.*
+paddle/pten/api/*/backward*


Let's put specific filenames (api.yaml, backward.yaml) in .gitignore.

Thanks! This will be done in another PR

DannyIsFunny · 2022-01-25T02:47:07Z

这个PR似乎导致Paddle 编译失败
编译命令：

cd Paddle && mkdir build && cd build
cmake .. -DWITH_PYTHON=ON -DWITH_GPU=OFF -DPYTHON_EXECUTABLE=`which python3`
make -j8

错误信息：

zyfncg added 3 commits January 12, 2022 12:45

add config of backward-api auto-gene

b4af9e2

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

bfe6488

… backward_code_gen

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

d9fbfa5

… backward_code_gen

zyfncg added 2 commits January 19, 2022 15:50

fix compile bug

8ad183b

remove wrong header

aa638c3

chenwhql reviewed Jan 20, 2022

View reviewed changes

zyfncg added 3 commits January 21, 2022 07:49

rename grad_api to backward_api

80cf5b3

modify .gitignore

d625b51

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

3bd9a76

… backward_code_gen

chenwhql approved these changes Jan 23, 2022

View reviewed changes

jim19930609 approved these changes Jan 24, 2022

View reviewed changes

zyfncg merged commit f83d1c0 into PaddlePaddle:develop Jan 24, 2022

zyfncg mentioned this pull request Jan 25, 2022

Fix compile error caused by api code_gen #39199

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Backward C++ API Code-Generation #39057

Backward C++ API Code-Generation #39057

zyfncg commented Jan 19, 2022 •

edited

Loading

paddle-bot-old bot commented Jan 19, 2022

chenwhql Jan 20, 2022

chenwhql Jan 20, 2022

zyfncg Jan 24, 2022

chenwhql Jan 20, 2022

zyfncg Jan 24, 2022

chenwhql Jan 20, 2022

zyfncg Jan 24, 2022

chenwhql Jan 20, 2022

zyfncg Jan 24, 2022

jim19930609 Jan 24, 2022

zyfncg Jan 24, 2022

DannyIsFunny commented Jan 25, 2022 •

edited

Loading

		@@ -0,0 +1,74 @@
		/* Copyright (c) 2021 PaddlePaddle Authors. All Rights Reserved.

Backward C++ API Code-Generation #39057

Backward C++ API Code-Generation #39057

Conversation

zyfncg commented Jan 19, 2022 • edited Loading

PR types

PR changes

Describe

paddle-bot-old bot commented Jan 19, 2022

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

DannyIsFunny commented Jan 25, 2022 • edited Loading

zyfncg commented Jan 19, 2022 •

edited

Loading

DannyIsFunny commented Jan 25, 2022 •

edited

Loading