Skip to content
This repository has been archived by the owner on Nov 16, 2019. It is now read-only.

failure in make build complaining about undefined symbol to python #5

Closed
nhe150 opened this issue Feb 25, 2016 · 10 comments
Closed

failure in make build complaining about undefined symbol to python #5

nhe150 opened this issue Feb 25, 2016 · 10 comments

Comments

@nhe150
Copy link

nhe150 commented Feb 25, 2016

[exec] /usr/bin/ld: .build_release/src/main/cpp/tools/caffe_mini_cluster.o: undefined reference to symbol '_ZN5boost6python17error_already_setD1Ev'
[exec] //usr/lib/x86_64-linux-gnu/libboost_python-py27.so.1.54.0: error adding symbols: DSO missing from command line
[exec] collect2: error: ld returned 1 exit status
[exec] make[1]: *** [.build_release/src/main/cpp/tools/caffe_mini_cluster.bin] Error 1
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] caffe ............................................. SUCCESS [0.003s]
[INFO] caffe-distri ...................................... FAILURE [47.767s]
[INFO] caffe-grid
@junshi15
Copy link
Collaborator

Can you check your boost version? BVLC caffe requires boost >= 1.55,
http://caffe.berkeleyvision.org/installation.html,
We have been using boost 1.57 for the entire CaffeOnSpark compilation.

@nhe150
Copy link
Author

nhe150 commented Feb 26, 2016

Thank you. Upgrading to boost 1.57 now.

@nhe150 nhe150 closed this as completed Feb 26, 2016
@nhe150
Copy link
Author

nhe150 commented Feb 26, 2016

[exec] CXX src/main/cpp/tools/caffe_mini_cluster.cpp
[exec] /usr/bin/ld: .build_release/src/main/cpp/tools/caffe_mini_cluster.o: undefined reference to symbol '_ZN5boost6python17error_already_setD1Ev'
[exec] //usr/lib/x86_64-linux-gnu/libboost_python.so.1.57.0: error adding symbols: DSO missing from command line
[exec] collect2: error: ld returned 1 exit status
[exec] make[1]: *** [.build_release/src/main/cpp/tools/caffe_mini_cluster.bin] Error 1
[exec] CXX/LD -o .build_release/src/main/cpp/tools/caffe_mini_cluster.bin
[exec] make[1]: Leaving directory `/home/bda-master/nhe/CaffeOnSpark/caffe-distri'

@nhe150 nhe150 reopened this Feb 26, 2016
@nhe150
Copy link
Author

nhe150 commented Feb 26, 2016

After upgrade to boost 1.57 similiar error happened.

@mriduljain
Copy link
Contributor

Looks like this comes in due to the option WITH_PYTHON_LAYER in caffe-public/Makefile.config.
You can either:

  1. Comment out this option in caffe-public/Makefile.config
  2. If you really need it then you can install boost_python and in caffe-distri/Makefile specify LIBRARIES += boost_python. We will either remove this dependency from caffe_mini_cluster or link to boost_python (will file this as a request)

@junshi15
Copy link
Collaborator

It looks like a library setting issue. Since we don't use src/main/cpp/tools/caffe_mini_cluster.cpp for spark operation (it is for debugging only), you can just delete it for now and see if the compilation passes.

@melody-rain
Copy link

I got the same error with libboost_python-py27.so.1.55.0...

@mriduljain
Copy link
Contributor

I will send a patch for this soon. Till then you can follow whatever Jun or I comment earlier in this thread.

@mriduljain
Copy link
Contributor

This should be solved by the latest merge. Closing it for now. Please reopen if you continue to have problems.

@nhe150
Copy link
Author

nhe150 commented Feb 26, 2016

rm src/main/cpp/tools/caffe_mini_cluster.cpp worked

@gnosisyuw gnosisyuw mentioned this issue Jun 24, 2016
Closed
@heliumsun heliumsun mentioned this issue Apr 6, 2017
Open
dillonfzw added a commit to bluemindor/CaffeOnSpark that referenced this issue Dec 3, 2017
@dillonfzw
merge to dli 1.0 GA, 523b72e
15003da 
* 523b72e support build in mixed protobuf env
*   2a83f82 Merge branch 'bluemind' into trlcaffe_merge
|\
| * 16ec96f enhance makefile, no functional diff
| * 27edffa fix a bug
| * 379b673 add parameters for lmdbjni, spark, scala versions
| * aa54efe fix a makefile bug which break the build
| * 5f9f1ee build with new dli container image with protobuf and liblmdbjni version flexible
| *   8356ad4 Merge pull request yahoo#5 from degaochu/bluemind
| |\
| | * 316a1bc CaffeOnSpark copy weight file from Caffe is not real copy but move action . Change move file to copy file so that the file can inherit new diretory's acl attibutes
| |/
* | 24c7ab2 support migrated BVLC caffe
* | 8d26850 ankun's change about supporting NCCL enabled caffe
* | 63ecedd switch multigpu to nccl
* | f622620 update caffe-public submodule commit to trlmerge_yahoo2
* | 8c8b448 switch caffe-public to trlmerge_yahoo2
|/
* f8143cd pick up last bluemind caffe with fabric changes; switch caffe-public branch to "bluemind"
*   2d9b8f0 Merge pull request yahoo#4 from sunweisw/bluemind_v0.3
|\
| * dc4d26f Fix hang issue with multiple gpu
|/
*   2627390 Merge pull request yahoo#2 from fuzhiwen/dev
|\
| * 224c7a8 S.138410: lmdb enhancement for CaffeOnSpark, migrated to bluemind v0.3
| * effdcff support build CoS with protobuf v3.2
|/
* ef28f91 formally moved to latest community version of caffeOnSpark 19df500
*   2ccaa1d Merge pull request yahoo#1 from sunweisw/merge-hist
|\
| * 5d69279 Change for ppc64 env Disable test
|/
*   19df500 Merge pull request yahoo#208 from arundasan91/patch-3
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@mriduljain @melody-rain @nhe150 @junshi15