oc-104 - WebDAV issues

[msrex]

From http://bugs.owncloud.org/thebuggenie/owncloud/issues/oc-104

Reporters are actively waiting on this.

Original report plus a few comments:

Description:

1. Server: Owncloud 2.x and 3RC1 on QNAP NAS TS110 (ARM CPU; PHP 5.3.9), Client: MAC OS X 10.6.8 and 10.7.2

a) File Upload via Finder/WebDAV: VERY slow! A file copy of ONE(!) file takes about 1 minute, independent from filesize -> seems to run in several timeouts/loops

By using another Web DAV Client like Cyberduck or Transmit on the same OS X instance, it's much faster but not as fast as connecting e.g. to the demo.owncloud.org server.

By accessing the same server from a virtual Ubuntu 11.04 instance running in VBox on the same MAC as Web DAV client, speed is pretty fast! By accessing the NAS's built-in Web DAV implementation from OSX Finder, everything works pretty fast and reliable

=> So, a hardware bottleneck can be excluded for sure!

If Quota wasn't set in ownCloud, file upload will be done anyway, but results in empty file (until Web DAV reconnect)

c) After Quota being set, ownCloud 3RC1 uploads sporadically result in Zero Byte filsize (more large files than small files). No problems again with Cyberduck!

1. Server: Own Cloud 2.x and 3RC1 on Ubuntu 11.04 in Vbox on MAC OS X 10.6 (quad core i7), Client: MAC OS X 10.6.8 and 10.7.2

a) File Upload via Finder/WebDAV: File copy pretty fast, but reproductively results in empty files (even if Quota is correctly set in Owncloud, independent from filesize)

By accessing from the (local) Ubuntu Web DAV client, copy works appropriately w/correct filesizes

Maybe OSX/Finder behaves quite fussy in terms of DAV specs and so is running into various problems...?!??

Reproduction steps:
setting up system configurations as described above

Comment posted by rgr101 Jan 24, 14:44
In the meantime, I have investigated a bit deeper:

Seems indeed to be a Finder issue (see e.g.http://code.google.com/p/sabredav/wiki/Finder) -

Found an alternative for Finder on the Mac, called Fork Lift: Own Cloud and non-ownCloud Web DAV connections are pretty fast and work without any Zerobyte issues (But be aware of the "mounting" option using Mac Fuse -- nice feature but doesn't work since forcing massive CPU load and hanging...)

Nevertheless, this Finder related issue redounds upon ownCloud anyway, since these problems seem to appear only that massively in conjunction with an ownCloud Web DAV connection...
#6 Comment posted by SideshowRalphWiggum Mar 02, 19:05

Commenting out line 586 as below:

// throw new Sabre_DAV_Exception_PreconditionFailed('The tokens provided in the if header did not match','If');

in owncloud/3rdparty/Sabre/DAV/Locks/Plugin.php stops the zero-size issue.

It's still slow to copy files from a Mac, but at least the files get across.

I really hope Owncloud looks into this Sabre problem soon. How I wish they would have just used Apache's Web Dav. It's proven, and doesn't name the share "webdav.php."
#7 Comment posted by DaveQB Apr 24, 03:00

I have the same issue here.

Thanks for the fix Guest #3
#8 Comment posted by pheraph May 27, 13:18

Same here, uploading is broken in Lion. Tried the suggested fix, but upload is still broken.
#9 Comment posted by oberling May 29, 20:54

thanks Sideshow Ralph Wiggum - although it's on Line 539 for me (stable 4.0.0). Fixed the issue for me but left me with a "not-so-good-feeling" commenting out some error-reporting line... but ok ;) .
#10 Comment posted by pheraph Jun 06, 08:34

As written commenting out the given line (3rdparty/Sabre/DAV/Locks/Plugin.php:539) doesn't fix the 0-byte issue for me with the Finder on OSX 10.7.4, ownCloud 4.0.1 (I noticed the iWork-Apps on iOS are able to connect through Web DAV.)
#12 Comment posted by Tim Oct 01, 10:37

I still see the same issue(s) with ownCloud 4.0.7 and OS X 10.8.2. Is there any solution in sight? Is anyone working on this?
#13 Comment posted by pheraph Oct 10, 11:43

Doesn't seem to be high priority. smileys/4.png
#14 Comment posted by Sergi Almacellas Abellana Nov 06, 16:20

Same problem in owncloud 4.5, Mac OS X.

Works fine from linux webdav client.
#15 Comment posted by fenris Nov 26, 17:02

Same problem. Owncloud 4.5.2. OS X 10.7.5 and various OS X 10.6

Exceptionally slow file transfers.

[ehrenfeu]

Can confirm this behaviour with ownCloud 4.5.5 trying to connect from Ubuntu 11.10 using fusedav 0.2

[davidak]

On OS X 10.6.8 i have also the problem, that uploaded Files via Webdav in Finder have 0 KB.

[chriskoch]

If I use Webdav with a ownCloud Server 4.5.6. (Ubuntu 12.04) and a OSX 10.8.2 Client the files have 0 KB, too

But if I rename the file over webdav the size is set correctly

[vBoxx]

Same here, multiple servers running with ownCloud all latest 4.5.6 version, but still the MacOS X 10.8.2 finder gives slow performance. If you save office files into the ownCloud mount there is no problem so it is really related to the drag to WebDAV Finder mount, first I though it had to do with copying to a Shared folder but it's also inside the user his own folder.

[tanghus]

What I read from http://code.google.com/p/sabredav/wiki/Finder is that anything else than Apache + mod_php is a no-go with Finder. We should add that to the users guide.
I wouldn't say this was an OC5 showstopper (then we would never be able to release), but we should mark it as Attention instead.
My € 0.02 ;)

[karlitschek]

I agree with @tanghus
@Raydiation Can you add this to the documentation?

[BernhardPosselt]

@karlitschek done: https://github.com/owncloud/documentation/blob/master/user_manual/files/files.rst

[karlitschek]

Awesome :-)

[vBoxx]

tanghus, do you mean that if you have any other apache modules enabled it goes wrong?
Yesterday I installed a new server with CentOS, Apache, MySQL and mod_php but still having major finder issues. What apache modules are you running if you check the phpinfo file?

[tanghus]

@vBoxx I just wrote the essence of http://code.google.com/p/sabredav/wiki/Finder

Finder uses Transfer-Encoding: Chunked in PUT request bodies. This is a little used HTTP feature, and therefore not implemented in a bunch of webservers. The only server I've seen so far that handles this reasonably well is Apache + mod_php. Nginx and Lighttpd respond with 411 Length Required, which is completely ignored by Finder. This was seen on nginx 0.7.63. It was recently reported that a development release (1.3.8) no longer had this issue.

When using this with Apache + FastCGI PHP completely drops the request body, so it will seem as if the PUT request was succesful, but the file will end up empty.

I don't have MacOS myself, so I can't test it.

[vBoxx]

tanghus how can I get in touch with you so I can show you the problem, maybe you have time to see if we can solve this issue.

[tanghus]

@vBoxx Better describe it here, if it's related to this issue, or create a new issue if it's not. I don't know much about webdav. My first comment was simply to point out that this specific issue shouldn't be considered a show-stopper for ownCloud 5, as Finder apparently has many issues that we're maybe not able to solve.

[vBoxx]

@tanghus My problems are still related to issue of this bug.

Some new information: on MacOS X 10.6.8 here there is no delay or upload problems with MacOS X 10.8.2 same server there are 0 bytes problems and long upload times.

[BernhardPosselt]

#968

[Pazu]

I have a Charles trace of such a write failing from OS X 10.8.2.

[scho]

I can confirm the same behaviour with OS X 10.8.3 and owncloud 5.0 on Apache with mod_php.

[lisanet]

I completely fixed the Finder-0-byte issue on my system (owncloud 4.5.8 with nginx 1.2.1, php 5.4.4) by enabling nginx's module 'chunkin'.

http://wiki.nginx.org/HttpChunkinModule.

Uploading files with Finder (OS X 10.8.3) works correctly, although it's still slow.

[Pazu]

@tanghus would you like the Charles trace?

[tanghus]

@Pazu I most likely can't get anything out of it, but if you add it to pastebin.com or something similar, and add the link here, maybe someone else can.

[Pazu]

@tanghus (or anyone else), here’s the trace.

[jancborchardt]

I’m closing this issue because it has been inactive for a few months. This probably means that the issue is not reproducible or it has been fixed in a newer version.

Please reopen if you still encounter this issue with the latest stable version (currently ownCloud 5.0.9) and then please use the issue template. You an also contribute directly by providing a patch – see the developer manual. :)

Thank you!

[ZinkDifferent]

Please reopen this issue - the exact same issue is still in place, with OC 5.0.10 and OS X 10.8.4.

Please do not assume that just because something has been inactive that it has been fixed. ;-)

Clearly, though, I am bewildered how/why something as glaring as a problem using an OS' own functionality would would receive such low priority.

In particular issues that were registered that specifically mentioned this, would be closed and referenced to this thread, which also was closed. No surprise stuff slips through the cracks.

Please re-open this issue.

[jancborchardt]

@ZinkDifferent thank you for confirming the issue is still there. I was just cleaning up issues, and if an issue has had no activity for 4 months, it’s very likely to not be an issue anymore. Reopening.

[ZinkDifferent]

Fair enough - thank you.

I suspect that earlier participants got disillusioned from there having been zero traction towards a resolution since the initiation of this report, and hence stopped participating when they figured there is no interest from the development team.

The problem has to do with Sabre DAV being used, or rather Sabre DAV having acknowledged issues with Apple's Finder.

__
ceci n'est pas un iPad

On Aug 30, 2013, at 2:56 AM, Jan-Christoph Borchardt notifications@github.com wrote:

@ZinkDifferent thank you for confirming the issue is still there. I was just cleaning up issues, and if an issue has had no activity for 4 months, it’s very likely to not be an issue anymore. Reopening.

—
Reply to this email directly or view it on GitHub.

[ZinkDifferent]

This might point debs in the right direction:

https://groups.google.com/forum/m/#!topic/sabredav-discuss/qkjX2iEZ8aI

Here's the solution - integrate this into SabreDAV :

http://code.google.com/p/sabredav/wiki/TemporaryFileFilter

[ZinkDifferent]

Plus, integrate a garbage cleanup of the temporary files after completion.

[markjhood]

Just wanted to chime in here. I have what appears to be the same issue with ownCloud 5.0.11 on Mac OS X 10.7.5. Looking at the network monitor it seems that all the data is transferred pretty quickly, but then the transfer stops with 5 seconds or less remaining.

Sampling the webdavfs_agent process in this state shows that there are threads blocked in HTTPNetStreamInfo::streamRead(). After about 5 minutes or so the copy finishes, but then the file seems to get deleted.

[stephane-martin]

These problems disappeared for me after migrating from apache/fastcgi to
nginx/fastcgi. So i guess the problem is indeed related to how apache badly
handles chunked http requests. I think streamread has problems because of
that.

What kind of php model do you use?

[jancborchardt]

Hm, I’m closing this since it seems to be an upstream issue.

[canepan]

I'm sorry to post on this thread again, but if:

• the supported web server for OwnCloud is Apache + mod_php
• the problem is not present with nginx + php in fast-cgi mode

How can this bug be closed?
I'm facing the very same issue on OSX 10.7.5 with OwnCloud 7.0.2, Apache 2.2 or Apache 2.4, with mod_php or PHP and mod_fcgid.
Maybe nginx with fastcgi is supported?

[jancborchardt]

@canepan please open a new issue, and provide all the info asked about in the issue template. Thank you! :)

[ZinkDifferent]

I'm running owncloud instances under Ngnix configurations, with php-fpm. I found this to be the only reliable way of running it if you have Apple users connecting go it, and you need chunked transfers.

__
ceci n'est pas un iPad

On Sep 22, 2014, at 8:14 AM, canepan notifications@github.com wrote:

I'm sorry to post on this thread again, but if:

the supported web server for OwnCloud is Apache + mod_php
the problem is not present with nginx + php in fast-cgi mode
How can this bug be closed?
I'm facing the very same issue on OSX 10.7.5 with OwnCloud 7.0.2, Apache 2.2 or Apache 2.4, with mod_php or PHP and mod_fcgid.
Maybe nginx with fastcgi is supported?

—
Reply to this email directly or view it on GitHub.

[canepan]

Added issue #11291