CPP build failed with errors

[chauhang]

🐛 Describe the bug

Testing the cpp build on AWS g5.8xlarge failed with error while building Sentencepiece dependecy: make: *** No rule to make target '32'. Stop.

Further it installed CPU version of the libtorch even after using the install steps:

python ts_scripts/install_dependencies.py --cpp --cuda=cu118
cd cpp
./build.sh

Error logs

Full details here

Installation instructions

Install steps

python ts_scripts/install_dependencies.py --cpp --cuda=cu118
cd cpp
./build.sh

Model Packaing

Failed before reaching this step

config.properties

No response

Versions

---

Environment headers

Torchserve branch:

**Warning: torchserve not installed ..
**Warning: torch-model-archiver not installed ..

Python version: 3.8 (64-bit runtime)
Python executable: /usr/bin/python3

Versions of relevant python libraries:
captum==0.6.0
numpy==1.24.3
nvgpu==0.10.0
pillow==10.2.0
psutil==5.9.5
requests==2.31.0
requests-unixsocket==0.2.0
torch==2.2.0+cu118
torchaudio==2.2.0+cu118
torchdata==0.7.1
torchtext==0.17.0+cpu
torchvision==0.17.0+cu118
wheel==0.42.0
torch==2.2.0+cu118
torchtext==0.17.0+cpu
torchvision==0.17.0+cu118
torchaudio==2.2.0+cu118

Java Version:

OS: Ubuntu 20.04.6 LTS
GCC version: (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
Clang version: N/A
CMake version: version 3.26.3

Is CUDA available: Yes
CUDA runtime version: 11.8.89
GPU models and configuration:
GPU 0: NVIDIA A10G
Nvidia driver version: 525.85.12
cuDNN version: None

Repro instructions

Failed during build of cpp

python ts_scripts/install_dependencies.py --cpp --cuda=cu118
cd cpp
./build.sh

Possible Solution

No response