Failed to build test_benchmark in Release/2.6 (8189a99) #60092

jeng1220 · 2023-12-17T17:22:21Z

问题描述 Issue Description

Build release/2.6 branch but triggers following error if -DWITH_TESTING=ON:

[44/320] Linking CXX executable paddle/fluid/inference/utils/test_benchmark
FAILED: paddle/fluid/inference/utils/test_benchmark
: && /usr/local/bin/ccache /usr/bin/c++ -march=sandybridge -mtune=broadwell -Wno-error=range-loop-construct -Wno-error=maybe-uninitialized -Wno-error=switch -faligned-new=32 -Wno-error=uninitialized -Wno-error=deprecated-declarations -Wno-deprecated-declarations -std=c++17 -m64 -fPIC -fno-omit-frame-pointer -pipe -ffunction-sections -fdata-sections -Werror -Wall -Wextra -Wno-unused-parameter -Wno-unused-function -Wno-error=array-bounds -Wno-error=ignored-attributes -Wno-error=int-in-bool-context -Wimplicit-fallthrough=0 -Wno-sign-compare -Wno-non-virtual-dtor -Wno-ignored-qualifiers -Wno-ignored-attributes -Wno-parentheses -msse3 -O3 -DNDEBUG  paddle/fluid/inference/utils/CMakeFiles/test_benchmark.dir/benchmark_tester.cc.o -o paddle/fluid/inference/utils/test_benchmark  -Wl,-rpath,/workspace/paddle/build/paddle/fluid/pybind:/workspace/paddle/build/paddle/phi:/workspace/paddle/build/paddle/common  third_party/install/glog/lib/libglog.a  paddle/fluid/pybind/libpaddle.so  paddle/fluid/inference/utils/libbenchmark.a  paddle/testing/libpaddle_gtest_main_new.a  paddle/phi/libphi.so  /usr/lib/x86_64-linux-gnu/libpython3.10.so  paddle/fluid/platform/libenforce.a  paddle/phi/libphi.so  paddle/common/libcommon.so  paddle/phi/api/profiler/libphi_profiler_proto.a  paddle/phi/core/distributed/auto_parallel/libauto_parallel_proto.a  paddle/utils/libpaddle_flags.a  libcblas.a  third_party/install/openblas/lib/libopenblas.a  third_party/install/utf8proc/lib/libutf8proc.a  third_party/install/gloo/lib/libgloo.a  third_party/install/dgc/lib/libdgc.a  paddle/phi/core/libexternal_error_proto.a  third_party/install/gtest/lib/libgtest.a  third_party/install/xxhash/lib/libxxhash.a  paddle/fluid/framework/libframework_proto.a  third_party/install/glog/lib/libglog.a  third_party/install/protobuf/lib/libprotobuf.a -pthread -ldl -lrt -lz -lssl -lcrypto -pthread -Wl,--no-as-needed -ldl -lrt -lz && :
/usr/bin/ld: paddle/testing/libpaddle_gtest_main_new.a(paddle_gtest_main.cc.o): in function `main':
paddle_gtest_main.cc:(.text.startup.main+0x31): undefined reference to `paddle::memory::allocation::UseAllocatorStrategyGFlag()'
/usr/bin/ld: paddle_gtest_main.cc:(.text.startup.main+0x5e1): undefined reference to `paddle_flags::FLAGS_enable_gpu_memory_usage_log'
/usr/bin/ld: paddle_gtest_main.cc:(.text.startup.main+0x623): undefined reference to `paddle::framework::InitMemoryMethod()'
/usr/bin/ld: paddle_gtest_main.cc:(.text.startup.main+0x628): undefined reference to `paddle::framework::InitDevices()'
/usr/bin/ld: paddle_gtest_main.cc:(.text.startup.main+0x62d): undefined reference to `paddle::framework::InitDefaultKernelSignatureMap()'

版本&环境信息 Version & Environment Information

CCACHE_DIR=/workspace/ccache_storage
ARCH_FLAGS="-march=sandybridge -mtune=broadwell"
CXX_FLAGS="$ARCH_FLAGS -Wno-error=range-loop-construct -Wno-error=maybe-uninitialized -Wno-error=switch -faligned-new=32"
CUDA_FLAGS="-t2 --forward-unknown-to-host-compiler -Xfatbin=-compress-all $ARCH_FLAGS -lineinfo"

SKIP_DOWNLOAD_INFERENCE_DATA=ON cmake -Bpaddle/build -Spaddle \
    -GNinja \
    -DINFERENCE_DEMO_INSTALL_DIR=/home/scratch.rjeng_sw/baidu/paddle/test_data \
    -DCMAKE_CXX_FLAGS="$CXX_FLAGS" \
    -DCMAKE_EXPORT_COMPILE_COMMANDS=ON \
    -DCMAKE_BUILD_TYPE=Release \
    -DCMAKE_CUDA_FLAGS="$CUDA_FLAGS" \
    -DCUDA_ARCH_NAME=Manual \
    -DCUDA_ARCH_BIN="80" \
    -DWITH_INCREMENTAL_COVERAGE=OFF \
    -DWITH_INFERENCE_API_TEST=OFF \
    -DWITH_DISTRIBUTE=ON \
    -DWITH_COVERAGE=OFF \
    -DWITH_TENSORRT=OFF \
    -DWITH_TESTING=ON \
    -DWITH_CONTRIB=ON \
    -DWITH_ROCM=OFF \
    -DWITH_RCCL=OFF \
    -DWITH_STRIP=ON \
    -DWITH_MKL=OFF \
    -DWITH_AVX=OFF \
    -DWITH_GPU=ON \
    -DWITH_PYTHON=ON \
    -DWITH_CUDNN_FRONTEND=ON \
    -DPY_VERSION=$PYVER \
    -Wno-dev

cmake --build paddle/build -j$((`nproc`))

GCC 11.4.0

The text was updated successfully, but these errors were encountered:

jeng1220 · 2023-12-17T17:23:34Z

cc @onecatcn for vis

jeng1220 · 2023-12-25T07:30:40Z

@Wangzheee ,
This bug is as same as #60091.
Manually moving shared libraries behind static libraries can address the error.
Before:

/usr/bin/c++ \
-march=sandybridge -mtune=broadwell -Wno-error=range-loop-construct -Wno-error=maybe-uninitialized -Wno-error=switch -faligned-new=32 -Wno-error=uninitialized -Wno-error=deprecated-declarations -Wno-deprecated-declarations -std=c++17 -m64 -fPIC -fno-omit-frame-pointer -pipe -ffunction-sections -fdata-sections -Werror -Wall -Wextra -Wno-unused-parameter -Wno-unused-function -Wno-error=array-bounds -Wno-error=ignored-attributes -Wno-error=int-in-bool-context -Wimplicit-fallthrough=0 -Wno-sign-compare -Wno-non-virtual-dtor -Wno-ignored-qualifiers -Wno-ignored-attributes -Wno-parentheses -msse3 -O3 -DNDEBUG  \
paddle/fluid/inference/utils/CMakeFiles/test_benchmark.dir/benchmark_tester.cc.o \
-o paddle/fluid/inference/utils/test_benchmark  \
-Wl,-rpath,/home/scratch.rjeng_sw/baidu/paddle/paddle/build/paddle/fluid/pybind:/home/scratch.rjeng_sw/baidu/paddle/paddle/build/paddle/phi:/home/scratch.rjeng_sw/baidu/paddle/paddle/build/paddle/common  \
third_party/install/glog/lib/libglog.a  \
paddle/fluid/pybind/libpaddle.so  \
paddle/fluid/inference/utils/libbenchmark.a  \
paddle/testing/libpaddle_gtest_main_new.a  \
paddle/phi/libphi.so  \
/usr/lib/x86_64-linux-gnu/libpython3.10.so  \
paddle/fluid/platform/libenforce.a  \
paddle/phi/libphi.so  \
paddle/common/libcommon.so  \
paddle/phi/api/profiler/libphi_profiler_proto.a  \
paddle/phi/core/distributed/auto_parallel/libauto_parallel_proto.a  \
paddle/utils/libpaddle_flags.a  \
libcblas.a  \
third_party/install/openblas/lib/libopenblas.a  \
third_party/install/utf8proc/lib/libutf8proc.a  \
third_party/install/gloo/lib/libgloo.a  \
third_party/install/dgc/lib/libdgc.a  \
paddle/phi/core/libexternal_error_proto.a  \
third_party/install/gtest/lib/libgtest.a  \
third_party/install/xxhash/lib/libxxhash.a  \
paddle/fluid/framework/libframework_proto.a  \
third_party/install/glog/lib/libglog.a  \
third_party/install/protobuf/lib/libprotobuf.a \
-pthread -ldl -lrt -lz -lssl -lcrypto -pthread -Wl,--no-as-needed -ldl -lrt -lz

After:

/usr/bin/c++ \
-march=sandybridge -mtune=broadwell -Wno-error=range-loop-construct -Wno-error=maybe-uninitialized -Wno-error=switch -faligned-new=32 -Wno-error=uninitialized -Wno-error=deprecated-declarations -Wno-deprecated-declarations -std=c++17 -m64 -fPIC -fno-omit-frame-pointer -pipe -ffunction-sections -fdata-sections -Werror -Wall -Wextra -Wno-unused-parameter -Wno-unused-function -Wno-error=array-bounds -Wno-error=ignored-attributes -Wno-error=int-in-bool-context -Wimplicit-fallthrough=0 -Wno-sign-compare -Wno-non-virtual-dtor -Wno-ignored-qualifiers -Wno-ignored-attributes -Wno-parentheses -msse3 -O3 -DNDEBUG  \
paddle/fluid/inference/utils/CMakeFiles/test_benchmark.dir/benchmark_tester.cc.o \
-o paddle/fluid/inference/utils/test_benchmark  \
-Wl,-rpath,/home/scratch.rjeng_sw/baidu/paddle/paddle/build/paddle/fluid/pybind:/home/scratch.rjeng_sw/baidu/paddle/paddle/build/paddle/phi:/home/scratch.rjeng_sw/baidu/paddle/paddle/build/paddle/common  \
third_party/install/glog/lib/libglog.a  \
paddle/fluid/inference/utils/libbenchmark.a  \
paddle/testing/libpaddle_gtest_main_new.a  \
paddle/fluid/platform/libenforce.a  \
paddle/phi/api/profiler/libphi_profiler_proto.a  \
paddle/phi/core/distributed/auto_parallel/libauto_parallel_proto.a  \
paddle/utils/libpaddle_flags.a  \
libcblas.a  \
third_party/install/openblas/lib/libopenblas.a  \
third_party/install/utf8proc/lib/libutf8proc.a  \
third_party/install/gloo/lib/libgloo.a  \
third_party/install/dgc/lib/libdgc.a  \
paddle/phi/core/libexternal_error_proto.a  \
third_party/install/gtest/lib/libgtest.a  \
third_party/install/xxhash/lib/libxxhash.a  \
paddle/fluid/framework/libframework_proto.a  \
third_party/install/glog/lib/libglog.a  \
third_party/install/protobuf/lib/libprotobuf.a \
paddle/fluid/pybind/libpaddle.so  \
paddle/phi/libphi.so  \
/usr/lib/x86_64-linux-gnu/libpython3.10.so  \
paddle/phi/libphi.so  \
paddle/common/libcommon.so  \
-pthread -ldl -lrt -lz -lssl -lcrypto -pthread -Wl,--no-as-needed -ldl -lrt -lz

The CMakeLists.txt still needs a fix.

jeng1220 · 2023-12-26T10:10:50Z

@Wangzheee ,
The paddle/testing/libpaddle_gtest_main_new.a depends on paddle/fluid/pybind/libpaddle.so.
Thus, the correct link order should be:

third_party/install/glog/lib/libglog.a  \
paddle/fluid/pybind/libpaddle.so  \
paddle/fluid/inference/utils/libbenchmark.a  \
paddle/testing/libpaddle_gtest_main_new.a  \
+paddle/fluid/pybind/libpaddle.so  \
paddle/phi/libphi.so  \
/usr/lib/x86_64-linux-gnu/libpython3.10.so  \
paddle/fluid/platform/libenforce.a  \
paddle/phi/libphi.so  \
paddle/common/libcommon.so  \
paddle/phi/api/profiler/libphi_profiler_proto.a  \
paddle/phi/core/distributed/auto_parallel/libauto_parallel_proto.a  \
paddle/utils/libpaddle_flags.a  \
libcblas.a  \
third_party/install/openblas/lib/libopenblas.a  \
third_party/install/utf8proc/lib/libutf8proc.a  \
third_party/install/gloo/lib/libgloo.a  \
third_party/install/dgc/lib/libdgc.a  \
paddle/phi/core/libexternal_error_proto.a  \
third_party/install/gtest/lib/libgtest.a  \
third_party/install/xxhash/lib/libxxhash.a  \
paddle/fluid/framework/libframework_proto.a  \
third_party/install/glog/lib/libglog.a  \
third_party/install/protobuf/lib/libprotobuf.a \

vivienfanghuagood · 2024-01-04T07:17:36Z

We will follow up on this issue, thank you!

vivienfanghuagood · 2024-01-15T07:28:48Z

Hi, please verify this PR: #60767.

jeng1220 · 2024-01-22T07:24:28Z

@vivienfanghuagood ,
I tried the #60767. It works. Please cherry-pick it to release/2.6.
Thanks.

yuanlehome · 2024-02-01T06:55:02Z

@vivienfanghuagood , I tried the #60767. It works. Please cherry-pick it to release/2.6. Thanks.

#61427

jeng1220 added NVIDIA status/new-issue 新建 type/build 编译/安装问题 labels Dec 17, 2023

paddle-bot bot assigned winter-wang Dec 17, 2023

winter-wang added the status/following-up 跟进中 label Dec 18, 2023

paddle-bot bot removed the status/new-issue 新建 label Dec 18, 2023

winter-wang added the 预测原名Inference，包含Capi预测问题等 label Dec 18, 2023

yuanlehome mentioned this issue Feb 1, 2024

[CherryPick] Fix issue 60092 #61427

Merged

vivienfanghuagood closed this as completed Feb 5, 2024

paddle-bot bot added status/close 已关闭 and removed status/following-up 跟进中 labels Feb 5, 2024

vivienfanghuagood mentioned this issue Feb 5, 2024

Failed to build infer_io_utils_tester in Release/2.6 (8189a99) #60091

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Failed to build test_benchmark in Release/2.6 (8189a99) #60092

Failed to build test_benchmark in Release/2.6 (8189a99) #60092

jeng1220 commented Dec 17, 2023

jeng1220 commented Dec 17, 2023

jeng1220 commented Dec 25, 2023

jeng1220 commented Dec 26, 2023

vivienfanghuagood commented Jan 4, 2024

vivienfanghuagood commented Jan 15, 2024

jeng1220 commented Jan 22, 2024

yuanlehome commented Feb 1, 2024

Failed to build test_benchmark in Release/2.6 (8189a99) #60092

Failed to build test_benchmark in Release/2.6 (8189a99) #60092

Comments

jeng1220 commented Dec 17, 2023

问题描述 Issue Description

版本&环境信息 Version & Environment Information

jeng1220 commented Dec 17, 2023

jeng1220 commented Dec 25, 2023

jeng1220 commented Dec 26, 2023

vivienfanghuagood commented Jan 4, 2024

vivienfanghuagood commented Jan 15, 2024

jeng1220 commented Jan 22, 2024

yuanlehome commented Feb 1, 2024