Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

nd.pick core dumps on large array #9314

Closed
eric-haibin-lin opened this issue Jan 4, 2018 · 2 comments · Fixed by #14082
Closed

nd.pick core dumps on large array #9314

eric-haibin-lin opened this issue Jan 4, 2018 · 2 comments · Fixed by #14082

Comments

@eric-haibin-lin
Copy link
Member

ubuntu@ip-172-31-13-31:~/mxnet$ python
Python 2.7.12 (default, Nov 20 2017, 18:23:56)
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import mxnet as mx
>>> a = mx.nd.ones((256*35, 1024*1024))
>>> b = mx.nd.ones((256*35,))
>>> mx.nd.pick(a,b)
Segmentation fault (core dumped)

Usually large array complains about shape mismatch, this one core dumps immediately.

@piyushghai
Copy link
Contributor

@eric-haibin-lin I tried reproducing the issue on MXNet v1.3.0 and I could not see the same error :

Python 2.7.15 |Anaconda custom (64-bit)| (default, May  1 2018, 18:37:05) 
[GCC 4.2.1 Compatible Clang 4.0.1 (tags/RELEASE_401/final)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import mxnet as mx
/anaconda2/lib/python2.7/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
>>> mx.__version__
'1.3.0'
>>> 
>>> 
>>> a = mx.nd.ones((256*35, 1024*1024))
>>> b = mx.nd.ones((256*35,))
>>> mx.nd.pick(a,b)

[1. 1. 1. ... 1. 1. 1.]
<NDArray 8960 @cpu(0)>
>>> 

Can you try to see if you still get this issue ?

@eric-haibin-lin
Copy link
Member Author

How many times did you try? I'm still getting this error. Another attempt on Mac:

➜  Documents python
Python 2.7.13 (default, Dec 18 2016, 07:03:39)
[GCC 4.2.1 Compatible Apple LLVM 8.0.0 (clang-800.0.42.1)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import mxnet as mx

>>> a = mx.nd.ones((256*35, 1024*1024))
>>> b = mx.nd.ones((256*35,))
>>>
>>> mx.nd.pick(a,b)

Segmentation fault: 11

Stack trace returned 10 entries:
[bt] (0) 0   libmxnet.so                         0x0000000116231c90 libmxnet.so + 15504
[bt] (1) 1   libmxnet.so                         0x0000000117da3956 MXTVMBridge + 4726662
[bt] (2) 2   libsystem_platform.dylib            0x00007fffbc8c6b3a _sigtramp + 26
[bt] (3) 3   ???                                 0x0000000000000000 0x0 + 0
[bt] (4) 4   libmxnet.so                         0x000000011665782e libmxnet.so + 4364334
[bt] (5) 5   libmxnet.so                         0x00000001177ebfed MXNDListFree + 620189
[bt] (6) 6   libmxnet.so                         0x00000001177658e4 MXNDListFree + 69524
[bt] (7) 7   libmxnet.so                         0x0000000117767e68 MXNDListFree + 79128
[bt] (8) 8   libmxnet.so                         0x000000011776b021 MXNDListFree + 91857
[bt] (9) 9   libmxnet.so                         0x000000011776af3f MXNDListFree + 91631
libc++abi.dylib: terminating
[1]    22838 abort      python
➜  Documents pip2 list | grep mx

mxnet (1.3.1b20181012)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants