Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

--start-group not supported for macOS #8513

Closed
lightingghost opened this issue Nov 2, 2017 · 9 comments
Closed

--start-group not supported for macOS #8513

lightingghost opened this issue Nov 2, 2017 · 9 comments

Comments

@lightingghost
Copy link
Contributor

The Error I had when building from source

with MKL2018

cd /Users/odin/local/mxnet/dmlc-core; /Library/Developer/CommandLineTools/usr/bin/make libdmlc.a USE_SSE=1 config=/Users/odin/local/mxnet/config.mk; cd /Users/odin/local/mxnet
make[1]: `libdmlc.a' is up to date.
g++ -DMSHADOW_FORCE_STREAM -Wall -Wsign-compare -O3 -DNDEBUG=1 -I/Users/odin/local/mxnet/mshadow/ -I/Users/odin/local/mxnet/dmlc-core/include -fPIC -I/Users/odin/local/mxnet/nnvm/include -I/Users/odin/local/mxnet/dlpack/include -Iinclude -funroll-loops -Wno-unused-variable -Wno-unused-parameter -Wno-unknown-pragmas -Wno-unused-local-typedefs -msse3 -I/usr/local/cuda/include -I/opt/intel/mkl/include -DMSHADOW_RABIT_PS=0 -DMSHADOW_DIST_PS=0 -DMSHADOW_USE_PASCAL=0 -DMXNET_USE_OPENCV=1 -I/opt/local/include/opencv -I/opt/local/include -DMXNET_USE_LAPACK -DMSHADOW_USE_CUDNN=1 -I/opt/local/include -I/Users/odin/local/mxnet/cub -DMXNET_USE_NVRTC=1 -shared -o lib/libmxnet.so build/src/operator/contrib/count_sketch.o build/src/operator/contrib/ctc_loss.o build/src/operator/contrib/deformable_convolution.o build/src/operator/contrib/deformable_psroi_pooling.o build/src/operator/contrib/dequantize.o build/src/operator/contrib/fft.o build/src/operator/contrib/ifft.o build/src/operator/contrib/multi_proposal.o build/src/operator/contrib/multibox_detection.o build/src/operator/contrib/multibox_prior.o build/src/operator/contrib/multibox_target.o build/src/operator/contrib/proposal.o build/src/operator/contrib/psroi_pooling.o build/src/operator/contrib/quantize.o build/src/operator/custom/custom.o build/src/operator/custom/native_op.o build/src/operator/custom/ndarray_op.o build/src/operator/mkl/mkl_cppwrapper.o build/src/operator/mkl/mkl_memory.o build/src/operator/nn/softmax.o build/src/operator/nnpack/nnpack_util.o build/src/operator/random/multisample_op.o build/src/operator/random/sample_multinomial_op.o build/src/operator/random/sample_op.o build/src/operator/tensor/broadcast_reduce_op_index.o build/src/operator/tensor/broadcast_reduce_op_value.o build/src/operator/tensor/control_flow_op.o build/src/operator/tensor/elemwise_binary_broadcast_op_basic.o build/src/operator/tensor/elemwise_binary_broadcast_op_extended.o build/src/operator/tensor/elemwise_binary_broadcast_op_logic.o build/src/operator/tensor/elemwise_binary_op_basic.o build/src/operator/tensor/elemwise_binary_op_extended.o build/src/operator/tensor/elemwise_binary_op_logic.o build/src/operator/tensor/elemwise_binary_scalar_op_basic.o build/src/operator/tensor/elemwise_binary_scalar_op_extended.o build/src/operator/tensor/elemwise_binary_scalar_op_logic.o build/src/operator/tensor/elemwise_sum.o build/src/operator/tensor/elemwise_unary_op.o build/src/operator/tensor/indexing_op.o build/src/operator/tensor/init_op.o build/src/operator/tensor/la_op.o build/src/operator/tensor/matrix_op.o build/src/operator/tensor/ordering_op.o build/src/c_api/c_api.o build/src/c_api/c_api_error.o build/src/c_api/c_api_executor.o build/src/c_api/c_api_function.o build/src/c_api/c_api_ndarray.o build/src/c_api/c_api_symbolic.o build/src/c_api/c_predict_api.o build/src/common/mxrtc.o build/src/engine/engine.o build/src/engine/naive_engine.o build/src/engine/profiler.o build/src/engine/threaded_engine.o build/src/engine/threaded_engine_perdevice.o build/src/engine/threaded_engine_pooled.o build/src/executor/attach_op_execs_pass.o build/src/executor/attach_op_resource_pass.o build/src/executor/graph_executor.o build/src/executor/inplace_addto_detect_pass.o build/src/io/image_aug_default.o build/src/io/image_det_aug_default.o build/src/io/image_io.o build/src/io/io.o build/src/io/iter_csv.o build/src/io/iter_image_det_recordio.o build/src/io/iter_image_recordio.o build/src/io/iter_image_recordio_2.o build/src/io/iter_mnist.o build/src/kvstore/kvstore.o build/src/ndarray/autograd.o build/src/ndarray/ndarray.o build/src/ndarray/ndarray_function.o build/src/nnvm/legacy_json_util.o build/src/nnvm/legacy_op_util.o build/src/operator/activation.o build/src/operator/batch_norm.o build/src/operator/batch_norm_v1.o build/src/operator/bilinear_sampler.o build/src/operator/concat.o build/src/operator/convolution.o build/src/operator/convolution_v1.o build/src/operator/correlation.o build/src/operator/crop.o build/src/operator/cross_device_copy.o build/src/operator/cudnn_algoreg.o build/src/operator/cudnn_batch_norm.o build/src/operator/deconvolution.o build/src/operator/dropout.o build/src/operator/fully_connected.o build/src/operator/grid_generator.o build/src/operator/identity_attach_KL_sparse_reg.o build/src/operator/instance_norm.o build/src/operator/l2_normalization.o build/src/operator/leaky_relu.o build/src/operator/loss_binary_op.o build/src/operator/lrn.o build/src/operator/make_loss.o build/src/operator/operator.o build/src/operator/operator_util.o build/src/operator/optimizer_op.o build/src/operator/pad.o build/src/operator/pooling.o build/src/operator/pooling_v1.o build/src/operator/regression_output.o build/src/operator/rnn.o build/src/operator/roi_pooling.o build/src/operator/sequence_last.o build/src/operator/sequence_mask.o build/src/operator/sequence_reverse.o build/src/operator/slice_channel.o build/src/operator/softmax_activation.o build/src/operator/softmax_output.o build/src/operator/spatial_transformer.o build/src/operator/svm_output.o build/src/operator/swapaxis.o build/src/operator/upsampling.o build/src/storage/storage.o build/src/initialize.o build/src/resource.o /Users/odin/local/mxnet/dmlc-core/libdmlc.a build/src/operator/contrib/count_sketch_gpu.o build/src/operator/contrib/ctc_loss_gpu.o build/src/operator/contrib/deformable_convolution_gpu.o build/src/operator/contrib/deformable_psroi_pooling_gpu.o build/src/operator/contrib/dequantize_gpu.o build/src/operator/contrib/fft_gpu.o build/src/operator/contrib/ifft_gpu.o build/src/operator/contrib/multi_proposal_gpu.o build/src/operator/contrib/multibox_detection_gpu.o build/src/operator/contrib/multibox_prior_gpu.o build/src/operator/contrib/multibox_target_gpu.o build/src/operator/contrib/proposal_gpu.o build/src/operator/contrib/psroi_pooling_gpu.o build/src/operator/contrib/quantize_gpu.o build/src/operator/custom/native_op_gpu.o build/src/operator/nn/softmax_gpu.o build/src/operator/random/sample_multinomial_op_gpu.o build/src/operator/random/sample_op_gpu.o build/src/operator/tensor/broadcast_reduce_op_index_gpu.o build/src/operator/tensor/broadcast_reduce_op_value_gpu.o build/src/operator/tensor/control_flow_op_gpu.o build/src/operator/tensor/elemwise_binary_broadcast_op_basic_gpu.o build/src/operator/tensor/elemwise_binary_broadcast_op_extended_gpu.o build/src/operator/tensor/elemwise_binary_broadcast_op_logic_gpu.o build/src/operator/tensor/elemwise_binary_op_basic_gpu.o build/src/operator/tensor/elemwise_binary_op_extended_gpu.o build/src/operator/tensor/elemwise_binary_op_logic_gpu.o build/src/operator/tensor/elemwise_binary_scalar_op_basic_gpu.o build/src/operator/tensor/elemwise_binary_scalar_op_extended_gpu.o build/src/operator/tensor/elemwise_binary_scalar_op_logic_gpu.o build/src/operator/tensor/elemwise_sum_gpu.o build/src/operator/tensor/elemwise_unary_op_gpu.o build/src/operator/tensor/indexing_op_gpu.o build/src/operator/tensor/init_op_gpu.o build/src/operator/tensor/la_op_gpu.o build/src/operator/tensor/matrix_op_gpu.o build/src/operator/tensor/ordering_op_gpu.o build/src/ndarray/ndarray_function_gpu.o build/src/operator/activation_gpu.o build/src/operator/batch_norm_gpu.o build/src/operator/batch_norm_v1_gpu.o build/src/operator/bilinear_sampler_gpu.o build/src/operator/concat_gpu.o build/src/operator/convolution_gpu.o build/src/operator/convolution_v1_gpu.o build/src/operator/correlation_gpu.o build/src/operator/crop_gpu.o build/src/operator/cudnn_batch_norm_gpu.o build/src/operator/deconvolution_gpu.o build/src/operator/dropout_gpu.o build/src/operator/fully_connected_gpu.o build/src/operator/grid_generator_gpu.o build/src/operator/identity_attach_KL_sparse_reg_gpu.o build/src/operator/instance_norm_gpu.o build/src/operator/l2_normalization_gpu.o build/src/operator/leaky_relu_gpu.o build/src/operator/loss_binary_op_gpu.o build/src/operator/lrn_gpu.o build/src/operator/make_loss_gpu.o build/src/operator/optimizer_op_gpu.o build/src/operator/pad_gpu.o build/src/operator/pooling_gpu.o build/src/operator/pooling_v1_gpu.o build/src/operator/regression_output_gpu.o build/src/operator/rnn_gpu.o build/src/operator/roi_pooling_gpu.o build/src/operator/sequence_last_gpu.o build/src/operator/sequence_mask_gpu.o build/src/operator/sequence_reverse_gpu.o build/src/operator/slice_channel_gpu.o build/src/operator/softmax_activation_gpu.o build/src/operator/softmax_output_gpu.o build/src/operator/spatial_transformer_gpu.o build/src/operator/svm_output_gpu.o build/src/operator/swapaxis_gpu.o build/src/operator/upsampling_gpu.o -pthread -lm -lcudart -lcublas -lcurand -lcusolver -L/usr/local/cuda/lib64 -L/usr/local/cuda/lib -L/opt/intel/mkl/lib -L/opt/intel/lib -L/opt/intel/mkl/../compiler/lib/intel64 -Wl,--start-group /opt/intel/mkl/lib/intel64/libmkl_intel_lp64.a /opt/intel/mkl/lib/intel64/libmkl_core.a /opt/intel/mkl/lib/intel64/libmkl_intel_thread.a -Wl,--end-group -liomp5 -ldl -lpthread -lm  -L/opt/local/lib -lopencv_shape -lopencv_stitching -lopencv_objdetect -lopencv_superres -lopencv_videostab -lopencv_calib3d -lopencv_features2d -lopencv_highgui -lopencv_videoio -lopencv_imgcodecs -lopencv_video -lopencv_photo -lopencv_ml -lopencv_imgproc -lopencv_flann -lopencv_core -lcudnn -L/opt/local/lib -lcuda -lcufft -lnvrtc \
	 -Wl,-all_load /Users/odin/local/mxnet/nnvm/lib/libnnvm.a -Wl,-noall_load
clang: warning: argument unused during compilation: '-pthread' [-Wunused-command-line-argument]
ld: warning: directory not found for option '-L/usr/local/cuda/lib64'
ld: warning: directory not found for option '-L/opt/intel/mkl/../compiler/lib/intel64'
ld: unknown option: --start-group
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [lib/libmxnet.so] Error 1

ld: unknown option: --start-group was supposed to come from ld in apple clang do not support this option.

@szha
Copy link
Member

szha commented Nov 6, 2017

Did you set USE_BLAS to mkl? USE_BLAS=mkl would introduce this linker flag in mshadow here. On mac, you can set USE_BLAS=apple instead as a workaround.

@szha
Copy link
Member

szha commented Feb 5, 2018

@apache/mxnet-committers: This issue has been inactive for the past 90 days. It has no label and needs triage.

For general "how-to" questions, our user forum (and Chinese version) is a good place to get help.

@lightingghost
Copy link
Contributor Author

@szha Sorry I missed your response. I have already submitted a pull request to mshadow, adding os check to allow mkl be used on macOS

@azai91
Copy link
Contributor

azai91 commented Jul 9, 2018

@lightingghost is this issue resolved? if so, we can close this issue.

@lightingghost
Copy link
Contributor Author

lightingghost commented Jul 9, 2018

@azai91 I have submitted a pull request to solve this problem to mshadow. But the request has not been accepted.

@azai91
Copy link
Contributor

azai91 commented Jul 9, 2018

I see that there's s merge conflict with the PR. can you resolve that and then message @tqchen or @piiswrong about merging.

@lightingghost
Copy link
Contributor Author

@azai91 I have updated that PR. @tqchen @piiswrong, would you please take a look?

@bgawrych
Copy link
Contributor

bgawrych commented Jul 6, 2021

@lightingghost Would you like to open PR in this repository? I still can reproduce issue, however currently cmake is main build tool - in case of no response I will ask someone to close this issue

@szha
Copy link
Member

szha commented Jul 7, 2021

@bgawrych we moved away from makefiles and I don't think the change would be required anymore.

@szha szha closed this as completed Jul 7, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

4 participants