Jupyter PySpark notebook / Uploading "big" file fails silently

[tkumpumaki]

In the tab "Files" of Jupyter PySpark notebook. Trying to upload datafile of size 17MB fails silently. File of the size of 12 MB uploads properly.

Maybe there is a some limit on file size, but failing without any notice isn't very informative.

[tourunen]

Thanks for reporting this! The same seems to happen with RStudio, so this is maybe a size limit in our ssl-terminating proxy.

[tourunen]

There is indeed 20M limit in frontend nginx config. Changing that to 128M makes RStudio uploads up to at least 100MB succeed. There is probably another limit in Jupyter itself, 48 MB upload is ok but 64MB is not.

edit: Related issues: jupyter/notebook#623 jupyter/notebook#96

[tourunen]

With PR #468, PB proxy now accepts 1G uploads. Uploads in RStudio work now for large uploads with the latest master, but Jupyter Notebook still has the internal limits mentioned above. I'm closing this, reopen if necessary.