Memory Exceeded after refreshing file cache

[todestoast]

I tried to refresh my files today. This crashed my owncloud. I set the memory limit in the .htaccess File of my owncloud dir up to 2 GB - no change (the increase is recognized by the log file, though).

Steps to reproduce

1. Try to refresh the filecache with
   $ su www-data
$ /usr/bin/php /var/www/owncloud/console.php files:scan --all
2. Error: "Memory Exceeded"
3. Trying to load owncloud in your Browser results in blank page or 404.

Expected behaviour

Refresh should finish

Actual behaviour

See above

Server configuration

Operating system: Debian 7

Web server: Apache2

Database: mysql

PHP version: 5

ownCloud version: 9.1 (latest)

Updated from an older ownCloud or fresh install: updated

Where did you install ownCloud from: owncloud.org zip file

Signing status (ownCloud 9.0 and above):

List of activated apps:

Enabled:
  - activity: 2.3.2
  - comments: 0.3.0
  - dav: 0.2.5
  - federatedfilesharing: 0.3.0
  - federation: 0.1.0
  - files: 1.5.1
  - files_pdfviewer: 0.8.1
  - files_sharing: 0.10.0
  - files_texteditor: 2.1
  - files_trashbin: 0.9.0
  - files_versions: 1.3.0
  - files_videoplayer: 0.9.8
  - firstrunwizard: 1.1
  - gallery: 15.0.0
  - notifications: 0.3.0
  - provisioning_api: 0.5.0
  - systemtags: 0.3.0
  - templateeditor: 0.1
  - updatenotification: 0.2.1
Disabled:
  - encryption
  - external
  - files_antivirus
  - files_external
  - user_external
  - user_ldap

The content of config/config.php:

{
    "system": {
        "instanceid": "oc6dlau3o1xa",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "owncloud.tuximail.de"
        ],
        "datadirectory": "\/var\/www\/owncloud\/data",
        "overwrite.cli.url": "https:\/\/owncloud.tuximail.de",
        "dbtype": "mysql",
        "version": "9.1.0.15",
        "dbname": "owncloud",
        "dbhost": "localhost",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "theme": "",
        "maintenance": false,
        "appstore.experimental.enabled": true,
        "loglevel": 3,
        "trashbin_retention_obligation": "auto"
    }
}

Are you using encryption: no

Client configuration

Browser: Palemoon 25.5

Operating system: Arch Linux

Logs

Web server error log

[Sun Aug 21 17:27:02 2016] [error] [client xx.xxx.xxx.xx] PHP Fatal error: Allowed memory size of 2141192192 bytes exhausted (tried to allocate 130968 bytes) in /var/www/owncloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php on line 55

ownCloud log (data/owncloud.log)

{"reqId":"Y+e\/bmc5kn8DLYAXb+SL","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1997312 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:46:08+00:00","method":"GET","url":"\/index.php\/apps\/files\/?dir=\/&fileid=3750","user":"sebi"}
{"reqId":"mKMzi87mf\/+Wi\/CFmHfU","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1997312 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:46:31+00:00","method":"GET","url":"\/index.php\/apps\/files\/?dir=\/&fileid=3750","user":"sebi"}
{"reqId":"j1U\/waB2alzsyYq8Yp2x","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:46:57+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"OsG3\/t\/SjJFYrQ5l3\/Ln","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:47:54+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"AjKcouZ4LggAfjNRLisZ","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:48:03+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"yR46g4yr505+chbJ0rpz","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:48:26+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"2EEJpmyOVqtqPaM2byCc","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:51:50+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"ajhpH0WoXZX4OgvQbxxC","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:52:13+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"oM3eI04zEBWUh+Xgjddf","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:54:33+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"M7Ub8gMuX8gWIKk3w5NO","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T14:54:55+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"cPK3fYYSTbb\/y1a86siW","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:00:13+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"c9tErmvwBZOSKtlM8hzH","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:00:35+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"nwWzO8Z7hrER36qQej9t","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:01:36+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"kpWbnuTFL9bgf8ct5P6j","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1997312 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:02:30+00:00","method":"GET","url":"\/index.php\/apps\/files\/?dir=\/&fileid=3750","user":"sebi"}
{"reqId":"xyLcmvKOkJCc2bOyWKe6","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:02:37+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"oIY7evnQ3rMaUrid6TX+","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1980928 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:03:00+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"WLt6MS9w8jGY6JPPM5E9","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1678336 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:04:23+00:00","method":"PROPFIND","url":"\/remote.php\/webdav\/","user":"sebi"}
{"reqId":"CIAb7tTS2D95ufgSO2T4","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1678336 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:05:02+00:00","method":"PROPFIND","url":"\/remote.php\/webdav\/","user":"sebi"}
{"reqId":"SUR9tZONcUP04yTVDU5e","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1678336 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:05:14+00:00","method":"PROPFIND","url":"\/remote.php\/webdav\/","user":"sebi"}
{"reqId":"DzVlJbVl4MHfcW461BGh","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1678336 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:05:27+00:00","method":"PROPFIND","url":"\/remote.php\/webdav\/","user":"sebi"}
{"reqId":"FnzZ59p8Mli\/jhVxCPmK","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 1678336 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:05:39+00:00","method":"PROPFIND","url":"\/remote.php\/webdav\/","user":"sebi"}
{"reqId":"4bvfJ1NDi75qR\/UAs9Ef","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 1585446912 bytes exhausted (tried to allocate 6129664 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:23:11+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}
{"reqId":"KrtV5CxAGMuBJKZwXE56","remoteAddr":"xx.xxx.xxx.xx","app":"PHP","message":"Allowed memory size of 1585446912 bytes exhausted (tried to allocate 6129664 bytes) at \/var\/www\/owncloud\/apps\/files_sharing\/lib\/sharedstorage.php#82","level":3,"time":"2016-08-21T15:24:02+00:00","method":"GET","url":"\/index.php\/apps\/files\/","user":"sebi"}```

[ghost]

Might be possible that this got fixed in the upcoming oC 9.1.1 (#25557, fix: #25789)

For now you can help testing the RC1 of 9.1.1 until the final version is out in a few days: #25557 (comment)

[todestoast]

Thx for the fast reply. The RC seems to has this issue fixed.

[ghost]

Feel free to close then on your own. You could also post a short note at #25789 that this is also fixing memory issues on command line rescans via occ.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.