Fall back to libibverbs.so.1

[372046933]

What problem does this PR solve?

Issue Number:

Problem Summary:

What is changed and the side effects?

Changed:

Side effects:

• Performance effects(性能影响):

• Breaking backward compatibility(向后兼容性):

---

Check List:

• Please make sure your changes are compilable(请确保你的更改可以通过编译).
• When providing us with a new feature, it is best to add related tests(如果你向我们增加一个新的功能, 请添加相关测试).
• Please follow Contributor Covenant Code of Conduct.(请遵循贡献者准则).

libibverbs.so is provided by libibverbs-dev and it is a symbol link to libibverbs.so.1 which is provided by libibverbs1.
We do not need -dev package in production environment. So linking to libibverbs.so.1 is a better solution.

lrwxrwxrwx 1 root root   15 Jan 28  2022 /usr/lib/x86_64-linux-gnu/libibverbs.so -> libibverbs.so.1
lrwxrwxrwx 1 root root   23 Jan 28  2022 /usr/lib/x86_64-linux-gnu/libibverbs.so.1 -> libibverbs.so.1.14.39.0
-rw-r--r-- 1 root root 139K Jan 28  2022 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0

Here is NCCL usage
https://github.com/NVIDIA/nccl/blob/2f4cb874ba461f67adbd78b6f19fc5bc7c458ab7/src/misc/ibvwrap.cc#L52-L59

Other differs on rdma.md is necessary to enable RDMA on libbrpc

[Tuvie]

Could you please share how you install libibverbs? At all my servers, libibverbs.so and libibverbs.so.1 exist at the same time and the former one is a symbol link to the latter one. The latter one is also a symbol link to the real so, just like the figure you pasted above.

[372046933]

Could you please share how you install libibverbs? At all my servers, libibverbs.so and libibverbs.so.1 exist at the same time and the former one is a symbol link to the latter one. The latter one is also a symbol link to the real so, just like the figure you pasted above.

On Ubuntu 22.04 , libibverbs1 provides libibverbs.so.1 and the real so.

# dpkg -L libibverbs1
/.
/usr
/usr/lib
/usr/lib/x86_64-linux-gnu
/usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0
/usr/share
/usr/share/doc
/usr/share/doc/libibverbs1
/usr/share/doc/libibverbs1/changelog.Debian.gz
/usr/share/doc/libibverbs1/copyright
/usr/share/doc/libibverbs1/libibverbs.md
/usr/lib/x86_64-linux-gnu/libibverbs.so.1

This is enough to use ibverbs in production environment(libibverbs-dev is not necessary).
In development environment, libibverbs-dev provides header files and libibverbs.so as a symbol link.

[Tuvie]

Could you please share how you install libibverbs? At all my servers, libibverbs.so and libibverbs.so.1 exist at the same time and the former one is a symbol link to the latter one. The latter one is also a symbol link to the real so, just like the figure you pasted above.

On Ubuntu 22.04 , libibverbs1 provides libibverbs.so.1 and the real so.

# dpkg -L libibverbs1
/.
/usr
/usr/lib
/usr/lib/x86_64-linux-gnu
/usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0
/usr/share
/usr/share/doc
/usr/share/doc/libibverbs1
/usr/share/doc/libibverbs1/changelog.Debian.gz
/usr/share/doc/libibverbs1/copyright
/usr/share/doc/libibverbs1/libibverbs.md
/usr/lib/x86_64-linux-gnu/libibverbs.so.1

This is enough to use ibverbs in production environment(libibverbs-dev is not necessary). In development environment, libibverbs-dev provides header files and libibverbs.so as a symbol link.

Thanks for your feedback.