…34337)

This PR add some primitives api related files. Those files are almost empty for the moment, but will be filled later.

When Graph has sub-graph, apply pass to it and all sub-graph. And add single test script .

* [NPU] add NPU ops&uts of compare, test=develop

* testing

* try style-format

* [NPU] update compare_op_npu uts

* [NPU] fix code sytle of test_compare_op_npu.py

This PR added optional boolean is_parameter and stop_gradient in the VarDesc proto, and remove them during save_inference_model

…e and sparse table name in config_fleet.py (#34441)

See #33949 for details

* trt buildEngineWithConfig is deprecated

* add trt version control

* support ScaleTensor for scale npu kernel

* add more tests for adam npu

* fix compile

* fix unittest

* refine adam optimizer

* Support C++ import python on windows for paddle

* Support C++ import python on windows for paddle

* Add build_strategy in @to_static to support open pass

* fix os.environ

* add timeout

* disable test_build_strategy on openblas

* tile op

* more uts

* disable tile if trt6.0

* typo

* fix timeout issue

* opteller

* opteller remove duplicate code

* comments.	test=document_fix

* modify PADDLE_ENFORCE.

* fix reduce_mean issue

* add input option in model.summary

* add persistent_workers. test=develop

As the title

* fix paddle.summary's bug when output contains non-tensor

* graph engine demo

* upload unsaved changes

* fix dependency error

* fix shard_num problem

* py client

* remove lock and graph-type

* add load direct graph

* add load direct graph

* add load direct graph

* batch random_sample

* batch_sample_k

* fix num_nodes size

* batch brpc

* batch brpc

* add test

* add test

* add load_nodes; change add_node function

* change sample return type to pair

* resolve conflict

* resolved conflict

* resolved conflict

* separate server and client

* merge pair type

* fix

* resolved conflict

* fixed segment fault; high-level VLOG for load edges and load nodes

* random_sample return 0

* rm useless loop

* test:load edge

* fix ret -1

* test: rm sample

* rm sample

* random_sample return future

* random_sample return int

* test fake node

* fixed here

* memory leak

* remove test code

* fix return problem

* add common_graph_table

* random sample node &test & change data-structure from linkedList to vector

* add common_graph_table

* sample with srand

* add node_types

* optimize nodes sample

* recover test

* random sample

* destruct weighted sampler

* GraphEdgeBlob

* WeightedGraphEdgeBlob to GraphEdgeBlob

* WeightedGraphEdgeBlob to GraphEdgeBlob

* pybind sample nodes api

* pull nodes with step

* fixed pull_graph_list bug; add test for pull_graph_list by step

* add graph table;name

* add graph table;name

* add pybind

* add pybind

* add FeatureNode

* add FeatureNode

* add FeatureNode Serialize

* add FeatureNode Serialize

* get_feat_node

* avoid local rpc

* fix get_node_feat

* fix get_node_feat

* remove log

* get_node_feat return  py:bytes

* merge develop with graph_engine

* fix threadpool.h head

* fix

* fix typo

* resolve conflict

* fix conflict

* recover lost content

* fix pybind of FeatureNode

* recover cmake

* recover tools

* resolve conflict

* resolve linking problem

* code style

* change test_server port

* fix code problems

* remove shard_num config

* remove redundent threads

* optimize start server

* remove logs

* fix code problems by reviewers' suggestions

* move graph files into a folder

* code style change

* remove graph operations from base table

* optimize get_feat function of graph engine

* fix long long count problem

* remove redandunt graph files

* remove unused shell

* recover dropout_op_pass.h

* fix potential stack overflow when request number is too large & node add & node clear & node remove

* when sample k is larger than neigbor num, return directly

* using random seed generator of paddle to speed up

* fix bug of random sample k

* fix code style

* fix code style

* fix blocking_queue problem

* fix style

* fix

* recover capacity check

Co-authored-by: Huang Zhengjie <270018958@qq.com>
Co-authored-by: Weiyue Su <weiyue.su@gmail.com>
Co-authored-by: suweiyue <suweiyue@baidu.com>
Co-authored-by: luobin06 <luobin06@baidu.com>
Co-authored-by: liweibin02 <liweibin02@baidu.com>
Co-authored-by: tangwei12 <tangwei12@baidu.com>

* add fix op run order pass

* add ut for fix_op_run_order

* fix ci error

* improve coverage

* improve coverge again and fix cpu test case

* follow some comments

* fix lr in param group

* add unittest for adamw

* Support setitem by None index

* remove unreachable code

* Add Checkpoint for set_value_op because add a new attribute

* fix force kill for elastic

* [NPU] add clip and clip_grad on NPU, test=develop

* address review comments, test=develop

* update, test=develop

* added expand_v2 bf16/fp32 kernel

* minor change

* CI fix

* added missing test file

* added formatting

* reduced binary size

* CI fix

* add trainer desc config to distributed strategy

* code style modified

…ls (#34219)

* test version of matmul_v2

* added matmul_v2 grad kernel

* minor changes

* minor changes

* minor change for CI approval

* CI fix

* CI fix

* added squeeze and squeeze2 kernels

* CI fix

* CI fix

* CI fix

* disabled tests when compiled with cuda

* added setting format_tag by strides

* added sigmoid BF16 FWD/BWD and gelu BF16 BWD

* changes after review

* Revert "added sigmoid BF16 FWD/BWD and gelu BF16 BWD"

This reverts commit 6e3f767.

* Revert "Merge branch 'matmul_v2_grad' into squeeze2_op"

This reverts commit 06fcf67, reversing
changes made to 6e3f767.

* minor change

* added reshape1/2 kernels

* moved some functions into private block

* CI fix

* CI fix

* CI fix

* test version of matmul_v2

* added matmul_v2 grad kernel

* minor changes

* minor changes

* minor change for CI approval

* CI fix

* CI fix

* trigger CI

* changes after review, not working yet

* moved ops to anonymous namespaces

* changes after review

* add resnet50 trt test in pr-ci-inference test

The comment background message is too long, see details at #34521

* [NPU] add reduce_max

* [NPU] delete skipIf

* [NPU] add atrrs support or check

* [NPU] add attr out_dtype

* [NPU] delete debug codes

* notest;test=cpu-benchmark

* benchmark-cpu

* notest;test=cpu-benchmark

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* fix

* fix

* add test_ci_model_benchmark.sh

* test=develop

* update identity

* add unittest

* notest,test=mac_py3

* modify comment & testname

* test=document_fix

* update comment

* test=document_fix

* activate all of the CI

… ReduceAny (#34436)

* add basic APIs

* add attr_types

* follow comments

* change pass attr types

* add set pass attribute codes

* refine PADDLE_THROW

* fix paddle.optimizer test=document_fix

* fix paddle.optimizer test=document_fix

* support 1f1b for pipeline

* add utest

* add send_partial/recv_partial

* support amp for pp

* fix logger

* support more dim for mul op npu

* update unit test according to reviewer's comment.

* support Kunlun2

* support KL2

* support KL2

* delete install_trt in release docker

* fix whl package path

* add layer segment

* add segement for transformer

* add utest

* supplement the function of slice

* edit unittest

* strided_slice_op support .

* polish error message.

* polish error message.

* polish code.

* polish unittest.

* polish code.

* polish code

* polish error message.

* fix backward bug

* format code style

* add test case for grad tensor accumulator

* add crop npu op

* code style check

* update code to remove usless headers

* add testcase and upsate code

* [NPU] Support npu kernel for assign_value op

* move test_assign_value_op_npu.py into unittests/npu folder

* correce copyright year; add TestAssignApi class using NPUplace in test files

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* notest;benchmark-cpu

* fix

* add gradients_with_optimizer api

* modify gradients_with_optimizer

* add gradients_with_optimizer api into paddle.auto.backward_mode

* add gradients_with_optimizer test case

* add doc for gradients_with_optimizer

* add doc for gradients_with_optimizer

* fix paddle.optimizer test=document_fix

* fix paddle.optimizer test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* revert commit id 34212

* fix bug of p2p for partial

* fix error

* add not_equal NPU op

* add not_equal NPU op

* add not_equal NPU op

* add not_equal NPU op

…elop (#34625)

* add NPU support for zero_copy_tensor.

* revert unnesessary codes.

* revert unnesessary codes.

…34519)

…st apis (#34310)

* replace boost::algorithm::ends_with with self define ends_with function

* remove BOOST macro in certain operators

* remove boost::lexical_cast

* add test for string_helper

* add more test case for string_helper

* modify join_string func and test case

* fix build_strategy_test failed bug

* remove string_helper_test from parallel_UT_rule.py

* Support Mixed Precision training in @to_static

* fix block.vars logic

* fix GPU training loss diff

* remove unused code

* support bool dtype for paddle.sum

…ly (#34556)

* integrated gast library

* integrated gast library

* fix unittest and remove ast2.py

* remove 'gast' from __all__ in __init__.py

* add copyright in other files

* fix copyright