Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Running build.py to generate .whl for Jetson, no LAPACK lib found #12736

Open
rev-KevinBenham opened this issue Oct 4, 2018 · 1 comment
Open

Comments

@rev-KevinBenham
Copy link

Description

liblapack not found when trying to build mxnet wheel from ci/build.py for the jetson framework on a host computer. Installed wheel on Jetson to see what would happen and lapack supported functions returned errors, did not build correctly, as expected.

Environment info (Required)

Running the build.py on Ubuntu 16.04 (more info below)
Docker version 18.06.1-ce

What to do:

  1. Download the diagnosis script from https://raw.githubusercontent.com/apache/incubator-mxnet/master/tools/diagnose.py
  2. Run the script using python diagnose.py and paste its output here.

$ sudo python diagnose.py
----------Python Info----------
('Version :', '2.7.12')
('Compiler :', 'GCC 5.4.0 20160609')
('Build :', ('default', 'Dec 4 2017 14:50:18'))
('Arch :', ('64bit', 'ELF'))
------------Pip Info-----------
('Version :', '18.0')
('Directory :', '/usr/local/lib/python2.7/dist-packages/pip')
----------MXNet Info-----------
No MXNet installed.
----------System Info----------
('Platform :', 'Linux-4.15.0-34-generic-x86_64-with-Ubuntu-16.04-xenial')
('system :', 'Linux')
('node :', 'cfa-System-Product-Name')
('release :', '4.15.0-34-generic')
('version :', '#37~16.04.1-Ubuntu SMP Tue Aug 28 10:44:06 UTC 2018')
----------Hardware Info----------
('machine :', 'x86_64')
('processor :', 'x86_64')
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 8
On-line CPU(s) list: 0-7
Thread(s) per core: 2
Core(s) per socket: 4
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 158
Model name: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
Stepping: 9
CPU MHz: 4297.817
CPU max MHz: 4500.0000
CPU min MHz: 800.0000
BogoMIPS: 8400.00
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 8192K
NUMA node0 CPU(s): 0-7
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp flush_l1d
----------Network Test----------
Setting timeout: 10
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0063 sec, LOAD: 0.4813 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0086 sec, LOAD: 0.3699 sec.
Timing for FashionMNIST: https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.1589 sec, LOAD: 0.9135 sec.
Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0258 sec, LOAD: 0.0875 sec.
Timing for Gluon Tutorial(en): http://gluon.mxnet.io, DNS: 0.0778 sec, LOAD: 0.6933 sec.
Timing for Gluon Tutorial(cn): https://zh.gluon.ai, DNS: 0.1163 sec, LOAD: 0.6141 sec.

Package used (Python/R/Scala/Julia):
Python 2 (Listed above)

Build info (Required if built from source)

Cloned the repository 10/3/2018

MXNet commit hash:
bcd24f8

Build config:
Standard config.mk, copied from the crosscompile.jetson.mk

Error Message: (Including some of preceding output)

build.py: 2018-10-04 13:04:06,562 Executing the equivalent of:
docker
run
--cap-add
SYS_PTRACE
--rm
--shm-size=500m
-v
/home/cfa/mxnet-1.3:/work/mxnet
-v
/home/cfa/mxnet-1.3/build:/work/build
-v
/tmp/ci_ccache:/work/ccache
-u
0:0
-e
CCACHE_MAXSIZE=500G
-e
CCACHE_TEMPDIR=/tmp/ccache
-e
CCACHE_DIR=/work/ccache
-e
CCACHE_LOGFILE=/tmp/ccache.log
-ti
mxnetci/build.jetson
/work/mxnet/ci/docker/runtime_functions.sh
build_jetson

build.py: 2018-10-04 13:04:07,016 Started container: f3dad0aa9232

  • NOSE_COVERAGE_ARGUMENTS='--with-coverage --cover-inclusive --cover-xml --cover-branches --cover-package=mxnet'
  • set +x
  • pushd .
    /work/mxnet /work/mxnet
  • cp make/crosscompile.jetson.mk ./config.mk
    ++ nproc
  • make -j8
    Makefile:180: "USE_LAPACK disabled because libraries were not found"

Minimum reproducible example

(If you are using your own code, please provide a short script that reproduces the error. Otherwise, please provide link to the existing example.)

Steps to reproduce

  1. cloned the repo to mxnet-1.3
  2. $ cd mxnet-1.3
  3. $ sudo time ci/build.py -p jetson

What have you tried to solve it?

  1. Tried symbolically linking the liblapack.so and liblapack.a files to the main mxnet-1.3 folder on my host computer, tried hard copying as well.

How do I enable lapack for the ci/build.py method to make the .whl file to install on a Jetson TX2?

@vrakesh
Copy link
Contributor

vrakesh commented Oct 4, 2018

@rev-KevinBenham Thank you for reporting the issue.

@mxnet-label-bot [Build, ARM]

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants