INSTALL ERROR #237

TianhaoFu · 2021-12-22T11:29:47Z

Hi,
Thanks for your code.
When I was building environment following INSTALL.md[Cuda Extensions], I came across such error:

bash setup.sh 
running build_ext
building 'deform_conv_cuda' extension
Emitting ninja build file /root/centerpoint/det3d/ops/dcn/build/temp.linux-x86_64-3.6/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/1] c++ -MMD -MF /root/centerpoint/det3d/ops/dcn/build/temp.linux-x86_64-3.6/src/deform_conv_cuda.o.d -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c -c /root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp -o /root/centerpoint/det3d/ops/dcn/build/temp.linux-x86_64-3.6/src/deform_conv_cuda.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deform_conv_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
FAILED: /root/centerpoint/det3d/ops/dcn/build/temp.linux-x86_64-3.6/src/deform_conv_cuda.o 
c++ -MMD -MF /root/centerpoint/det3d/ops/dcn/build/temp.linux-x86_64-3.6/src/deform_conv_cuda.o.d -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c -c /root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp -o /root/centerpoint/det3d/ops/dcn/build/temp.linux-x86_64-3.6/src/deform_conv_cuda.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deform_conv_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
In file included from /opt/conda/lib/python3.6/site-packages/torch/include/ATen/Parallel.h:149:0,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:12,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                 from /root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:4:
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/ParallelOpenMP.h:84:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
 #pragma omp parallel for if ((end - begin) >= grain_size)
 ^
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp: In function ‘void shape_check(at::Tensor, at::Tensor, at::Tensor*, at::Tensor, int, int, int, int, int, int, int, int, int, int)’:
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:69:31: error: ‘AT_CHECK’ was not declared in this scope
            weight.ndimension());
                               ^
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp: In function ‘int deform_conv_forward_cuda(at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, int, int, int, int, int, int, int, int, int, int, int)’:
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:194:73: error: ‘AT_CHECK’ was not declared in this scope
   AT_CHECK((offset.size(0) == batchSize), "invalid batch size of offset");
                                                                         ^
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp: In function ‘int deform_conv_backward_input_cuda(at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, int, int, int, int, int, int, int, int, int, int, int)’:
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:301:76: error: ‘AT_CHECK’ was not declared in this scope
   AT_CHECK((offset.size(0) == batchSize), 3, "invalid batch size of offset");
                                                                            ^
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp: In function ‘int deform_conv_backward_parameters_cuda(at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, int, int, int, int, int, int, int, int, int, int, float, int)’:
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:417:73: error: ‘AT_CHECK’ was not declared in this scope
   AT_CHECK((offset.size(0) == batchSize), "invalid batch size of offset");
                                                                         ^
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp: In function ‘void modulated_deform_conv_cuda_forward(at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, int, int, int, int, int, int, int, int, int, int, bool)’:
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:497:70: error: ‘AT_CHECK’ was not declared in this scope
   AT_CHECK(input.is_contiguous(), "input tensor has to be contiguous");
                                                                      ^
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp: In function ‘void modulated_deform_conv_cuda_backward(at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor, int, int, int, int, int, int, int, int, int, int, bool)’:
/root/centerpoint/det3d/ops/dcn/src/deform_conv_cuda.cpp:579:70: error: ‘AT_CHECK’ was not declared in this scope
   AT_CHECK(input.is_contiguous(), "input tensor has to be contiguous");
                                                                      ^
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/opt/conda/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 1522, in _run_ninja_build
    env=env)
  File "/opt/conda/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "setup.py", line 19, in <module>
    cmdclass={'build_ext': BuildExtension})
  File "/opt/conda/lib/python3.6/site-packages/setuptools/__init__.py", line 153, in setup
    return distutils.core.setup(**attrs)
  File "/opt/conda/lib/python3.6/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/opt/conda/lib/python3.6/distutils/dist.py", line 955, in run_commands
    self.run_command(cmd)
  File "/opt/conda/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/opt/conda/lib/python3.6/site-packages/setuptools/command/build_ext.py", line 79, in run
    _build_ext.run(self)
  File "/opt/conda/lib/python3.6/distutils/command/build_ext.py", line 339, in run
    self.build_extensions()
  File "/opt/conda/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 653, in build_extensions
    build_ext.build_extensions(self)
  File "/opt/conda/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
    self._build_extensions_serial()
  File "/opt/conda/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
    self.build_extension(ext)
  File "/opt/conda/lib/python3.6/site-packages/setuptools/command/build_ext.py", line 196, in build_extension
    _build_ext.build_extension(self, ext)
  File "/opt/conda/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
    depends=ext.depends)
  File "/opt/conda/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 482, in unix_wrap_ninja_compile
    with_cuda=with_cuda)
  File "/opt/conda/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 1238, in _write_ninja_file_and_compile_objects
    error_prefix='Error compiling objects for extension')
  File "/opt/conda/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 1538, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
running build_ext
building 'iou3d_nms_cuda' extension
Emitting ninja build file /root/centerpoint/det3d/ops/iou3d_nms/build/temp.linux-x86_64-3.6/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
g++ -pthread -shared -B /opt/conda/compiler_compat -L/opt/conda/lib -Wl,-rpath=/opt/conda/lib -Wl,--no-as-needed -Wl,--sysroot=/ /root/centerpoint/det3d/ops/iou3d_nms/build/temp.linux-x86_64-3.6/src/iou3d_cpu.o /root/centerpoint/det3d/ops/iou3d_nms/build/temp.linux-x86_64-3.6/src/iou3d_nms_api.o /root/centerpoint/det3d/ops/iou3d_nms/build/temp.linux-x86_64-3.6/src/iou3d_nms.o /root/centerpoint/det3d/ops/iou3d_nms/build/temp.linux-x86_64-3.6/src/iou3d_nms_kernel.o -L/opt/conda/lib/python3.6/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.6/iou3d_nms_cuda.cpython-36m-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.6/iou3d_nms_cuda.cpython-36m-x86_64-linux-gnu.so ->

I don't know how to deal with it. Could you give me some ideas? Thanks!

The text was updated successfully, but these errors were encountered:

tianweiy · 2021-12-22T20:24:36Z

hi, compiling dcn is optional (we don't use dcn in the most recent version). And it seems to only work with old torch version (e.g. 1.1).

I updated the install guide, you only need to compile the nms

https://github.com/tianweiy/CenterPoint/blob/master/docs/INSTALL.md#cuda-extensions

TianhaoFu · 2021-12-24T08:02:25Z

hi, compiling dcn is optional (we don't use dcn in the most recent version). And it seems to only work with old torch version (e.g. 1.1).

I updated the install guide, you only need to compile the nms

https://github.com/tianweiy/CenterPoint/blob/master/docs/INSTALL.md#cuda-extensions

ok, thanks!

testpku · 2022-10-19T08:39:00Z

Hi, thx for sharing your works.
If I skip installing DeformConv, the above error ocurrs:

NameError: name 'DeformConv' is not defined

what should I do to skip installing DeformConv?

tianweiy · 2022-10-19T13:30:47Z

at which line of code and which config are you using?

testpku · 2022-10-20T01:58:33Z

Thanks for your prompt reply
when I run commands:

cd det3d/ops/dcn
python setup.py build_ext --inplace

It returns:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1717, in _run_ninja_build
subprocess.run(
File "/root/miniconda3/envs/centerpoint/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "setup.py", line 4, in
setup(
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/init.py", line 87, in setup
return distutils.core.setup(**attrs)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 973, in run_commands
self.run_command(cmd)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
super().run_command(command)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
cmd_obj.run()
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 79, in run
_build_ext.run(self)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
self.build_extensions()
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 735, in build_extensions
build_ext.build_extensions(self)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 466, in build_extensions
self._build_extensions_serial()
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 492, in _build_extensions_serial
self.build_extension(ext)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 202, in build_extension
_build_ext.build_extension(self, ext)
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 547, in build_extension
objects = self.compiler.compile(
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 556, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1399, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/root/miniconda3/envs/centerpoint/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1733, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension

When I run the following commands according to the https://github.com/tianweiy/CenterPoint/blob/master/docs/GETTING_START.md:

python tools/dist_test.py configs/nusc/voxelnet/nusc_centerpoint_voxelnet_0075voxel_dcn_flip.py --work_dir work_dirs/nusc_centerpoint_voxelnet_dcn_0075voxel_flip_testset --checkpoint work_dirs/nusc_0075_dcn_flip_track/voxelnet_converted.pth --testset --speed_test

It returns:

Use Deformable Convolution in the CenterHead!
Traceback (most recent call last):
File "tools/dist_test.py", line 211, in
main()
File "tools/dist_test.py", line 106, in main
model = build_detector(cfg.model, train_cfg=None, test_cfg=cfg.test_cfg)
File "/root/autodl-tmp/project/CenterPoint/det3d/models/builder.py", line 50, in build_detector
return build(cfg, DETECTORS, dict(train_cfg=train_cfg, test_cfg=test_cfg))
File "/root/autodl-tmp/project/CenterPoint/det3d/models/builder.py", line 21, in build
return build_from_cfg(cfg, registry, default_args)
File "/root/autodl-tmp/project/CenterPoint/det3d/utils/registry.py", line 78, in build_from_cfg
return obj_cls(**args)
File "/root/autodl-tmp/project/CenterPoint/det3d/models/detectors/voxelnet.py", line 19, in init
super(VoxelNet, self).init(
File "/root/autodl-tmp/project/CenterPoint/det3d/models/detectors/single_stage.py", line 27, in init
self.bbox_head = builder.build_head(bbox_head)
File "/root/autodl-tmp/project/CenterPoint/det3d/models/builder.py", line 42, in build_head
return build(cfg, HEADS)
File "/root/autodl-tmp/project/CenterPoint/det3d/models/builder.py", line 21, in build
return build_from_cfg(cfg, registry, default_args)
File "/root/autodl-tmp/project/CenterPoint/det3d/utils/registry.py", line 78, in build_from_cfg
return obj_cls(**args)
File "/root/autodl-tmp/project/CenterPoint/det3d/models/bbox_heads/center_head.py", line 231, in init
DCNSepHead(share_conv_channel, num_cls, heads, bn=True, init_bias=init_bias, final_kernel=3)
File "/root/autodl-tmp/project/CenterPoint/det3d/models/bbox_heads/center_head.py", line 128, in init
self.feature_adapt_cls = FeatureAdaption(
File "/root/autodl-tmp/project/CenterPoint/det3d/models/bbox_heads/center_head.py", line 48, in init
self.conv_adaption = DeformConv(
NameError: name 'DeformConv' is not defined

tianweiy · 2022-10-20T02:03:34Z

hi, please see my reply here #362 (comment)

basically, dcn doesn't work with latest torch version so I suggest you to switch to non-dcn configs (which actually gets better performance). If you just need the detection file, you can refer to #249

otherwise, just change the config name and checkpoint path to https://github.com/tianweiy/CenterPoint/tree/master/configs/nusc#voxelnet

Thanks

testpku · 2022-10-20T07:53:57Z

Good suggestions!
Now I can run the eval code.
Thx.

TianhaoFu closed this as completed Dec 24, 2021

tianweiy mentioned this issue Oct 19, 2022

RuntimeError #362

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

INSTALL ERROR #237

INSTALL ERROR #237

TianhaoFu commented Dec 22, 2021

tianweiy commented Dec 22, 2021 •

edited

Loading

TianhaoFu commented Dec 24, 2021

testpku commented Oct 19, 2022

tianweiy commented Oct 19, 2022

testpku commented Oct 20, 2022

tianweiy commented Oct 20, 2022

testpku commented Oct 20, 2022

INSTALL ERROR #237

INSTALL ERROR #237

Comments

TianhaoFu commented Dec 22, 2021

tianweiy commented Dec 22, 2021 • edited Loading

TianhaoFu commented Dec 24, 2021

testpku commented Oct 19, 2022

tianweiy commented Oct 19, 2022

testpku commented Oct 20, 2022

tianweiy commented Oct 20, 2022

testpku commented Oct 20, 2022

tianweiy commented Dec 22, 2021 •

edited

Loading