-
Notifications
You must be signed in to change notification settings - Fork 23k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Invalid free in binaries on error message #5400
Comments
@li-roy, can you take a look at this? |
@jatentaki I couldn't reproduce this. I get an invalid argument error. Were you using different numbers initially?
|
No, re-cloning the repo reproduces the bug for me. Also, I've just upgraded 3.0post4 to 3.1 and it also reproduces. Aren't you using a source-build master?
EDIT: Nvm the above, I confused it with a different layer. This snippet is definitely a bug on my side and should indeed be caught with invalid argument exception. EDIT2: I am running the no-cuda wheel. Perhaps that makes the difference? |
So, the invalid free is a bit of a side-effect of the wheel binaries that we have.
He couldn't reproduce it probably because of using conda binaries or source installs. the rabbit-hole is deep, but the happens roughly because of this:
So what actually is happening is
In the next binary release, I'll figure out a solution for this. Thanks a lot for the issue and the repro. |
Hey, I got the same error, not sure if it's useful but here's a simpler reproducing code: import torch
from torch import nn
from torch.autograd import Variable
m = nn.Sequential(
nn.Conv1d(1, 8, kernel_size=10, stride=1),
nn.MaxPool1d(2496)
)
a = torch.randn(256, 1, 2500)
m(Variable(a)) I also get
etc. Can confirm this works on the latest master '0.4.0a0+533beab', but not on stable 0.3.1 (wheel) |
fixed in 0.4 |
In version I am on Arch Linux by the way. |
I've built v1.0.0 branch from source and I get this issue as well. And I found a solution here. user iammohitchhabra wrote that
fixes the error, and it indeed works on Ubuntu 16.04. |
Are these crashes in |
do we know what is causing the issue? @soumith I have a higher version
and I get that error...
|
I faced a similar issue. It turned out that I had a different CUDA loaded through the module system on the server; it got fixed once i removed it. Hope this helps. |
To reproduce, clone this repo and execute
python3 run_cnn.py
. On my machine it results in the following stack trace.I believe the script is self-explanatory, I was trying to maxpool a 3d convolved tensor :)
The text was updated successfully, but these errors were encountered: