Media - "rescan collection" app freezes in the middle

[MorrisJobke]

For a detailed description see this forum thread: http://forum.owncloud.org/viewtopic.php?f=4&t=4260.

In short, media app, when running a "Rescan collection", the progress bar freezes somwhere in the middle - it doesn't finish (nor does the progress bar change anymore), even if I leave it open for hours.

---

Originally reported by @RandolfCarter at owncloud-archive/apps#27

[MorrisJobke]

I relly can't reproduce the pbm ...
maybe there is a special setting ? or maybe the scanner is stuck on 1 file ? then it would be interesting to test with this file

---

Original comment by @eMerzh at owncloud-archive/apps#27 (comment)

[MorrisJobke]

Are there any settings for the media app? If so, I didn't find them yet ;)
Yes, maybe the scanner did get stuck on one file, but if so, I currently have no means to find out - there's nothing in the log file... I have set the log level to debug, so I guess there is no scanning progress output to the log currently even in debug mode? Anybody having an idea where to start instrumenting the code to get such feedback? I'd be willing to do this, and I feel confident I have enough php knowledge to do so, a starting hint would be nice though ;)

---

Original comment by @RandolfCarter at owncloud-archive/apps#27 (comment)

[MorrisJobke]

@RandolfCarter please ping me back if this issue is still reproducible.

---

Original comment by @VicDeo at owncloud-archive/apps#27 (comment)

[MorrisJobke]

Just trying it on 4.5.8 - now the scan doesn't even seem to start properly; the progress indicator doesn't show any progress, even after half an hour, and pressing the "Pause" button has no effect (I would expect it to change to "Resume" or something, but really nothing happens).

Not sure about the server activity - there sometimes are smaller apache2&mysql CPU spikes, but not continously...
There is one possibly related error message in the apache error log:

[Fri Mar 29 20:30:37 2013] [error] [client a.b.c.d] request failed: error reading the headers

Edit: The error message doesn't seem to be related, at least it didn't show up on a second try.
Edit 2: In the second try now something seems to be happening (although I pressed the Pause button multiple times already), there is some progress (about 1px of it ;)). Also seeing high mysqld activity. Will report later how it continues.

---

Original comment by @RandolfCarter at owncloud-archive/apps#27 (comment)

[MorrisJobke]

@RandolfCarter are there any js errors in browser console?

---

Original comment by @VicDeo at owncloud-archive/apps#27 (comment)

[MorrisJobke]

@VicDeo didn't check that yet, did so now; yes there is an error, when I press the "Pause" button, it shows

TypeError: Scanner.toggle is not a function @ https://myowncloud/owncloud/apps/media/js/collection.js:364

Have now also seen two different ones when starting the rescan:

The connection to https://myowncloud/owncloud/?app=media&getfile=ajax/api.php&action=scan&requesttoken=d295ad493ca796ff1a63 was interrupted while the page was loading. @ https://myowncloud/owncloud/remote.php/core.js:319

Firefox can't establish a connection to the server at https://myowncloud/owncloud/?app=media&getfile=ajax/api.php&action=scan&requesttoken=c306b1e2b52f8883cf50. @ https://myowncloud/owncloud/remote.php/core.js:319

And something is happening now, the progress bar is advancing, and the mysqld load is high. Will wait now and see how far it gets, keeping the JS console open.

---

Original comment by @RandolfCarter at owncloud-archive/apps#27 (comment)

[MorrisJobke]

After 10 hours the rescanning is still not finished, and the progress indicator doesn't seem to have advanced in comparison to where it was after approximately 4 hours; there is no more continuous mysql load as it was before (basically there's no load at the moment).
What I noticed was that at some point, requests like this started to happening every ~5 seconds:

GET https://myowncloud/owncloud/?app=media&getfile=ajax/api.php&action=scan&requesttoken=56599defd6ab6183dd1e [HTTP/1.1 200 OK 36ms]

There are no errors from ownCloud in apache error log; there are a few errors in the ownCloud log from the rescan like this:

Warning  media   error reading album tag in 'mediafile.mp3'

but the last one is from approx. 2 hours after rescan start...

So it seems the issue is still appearing exactly as described, and furthermore the Pause doesn't work anymore :(
WIll check on OC5/master as well.

Any other info I can provide to help resolve this?

---

Original comment by @RandolfCarter at owncloud-archive/apps#27 (comment)

[MorrisJobke]

@VicDeo Just tested on OC5. The scanning is MUCH faster there (only takes about 10 minutes, and also finishes) - but it doesn't seem to find all my music... at least there's a huge difference between what OC5 shows and what OC4.5 shows (OC4.5 shows approx. 8 times more artists than OC5...).

The Music files are exactly the same, and linked into owncloud exactly the same way (via a local custom mount).

On a quick glance I didn't find any errors in the apache error log or owncloud log; and only one thing in the javascript console - the Pause button doesn't work the same way as in OC4.5, and the JS error is:

TypeError: Scanner.toggle is not a function @ https://myowncloud/owncloud5/apps/media/js/collection.js:364

Should I report a new issue for the problem that OC5 music app doesn't find all music?

---

Original comment by @RandolfCarter at owncloud-archive/apps#27 (comment)