[Bug]: OCA\DAV\BackgroundJob\RefreshWebcalJob takes way too long in cronjob and huge binlogs #40814
Open
5 of 8 tasks
Labels
0. Needs triage
Pending check for reproducibility or if it fits our roadmap
25-feedback
bug
feature: caldav
Related to CalDAV internals
performance 🚀
Comments
MiningPickaxe
added
0. Needs triage
|
Are you the only user or do you have other users on your server? The biggest variable that plays a role probably in this job run is driven by your environment's users' external calendar subscriptions: https://docs.nextcloud.com/server/latest/user_manual/en/groupware/calendar.html#subscribe-to-a-calendar Do you Nextcloud logs contain any notable entries during the period of these job runs? |
8 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Bug description
During the cronjob run there is excessive load on the database, the cron run takes about 10 minutes. I also generate 100-200mb of binlogs per minute.
When checking the oc_jobs table to see what takes so long this is the output:
The time needed for the RefreshWebcalJob seems to be extremly high.
There are also constantly high writes to the mariadb binlogs:
I needed to set up a cronjob that purges the old bin logs regularly to keep up with the amount of logs generated and not make the system explode instantly.
Steps to reproduce
I don't really know how to reproduce this, it just happens on my server when running the
sudo -u www-data php -f /var/www/nextcloud/cron.phpExpected behavior
I would expect the cron to run in a reasonable amount of time (which it did when first setting it up, I don't know when it got worse).
Installation method
None
Nextcloud Server version
25
Operating system
None
PHP engine version
None
Web server
None
Database engine version
None
Is this bug present after an update or on a fresh install?
None
Are you using the Nextcloud Server Encryption module?
None
What user-backends are you using?
Configuration report
{ "system": { "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "localhost", "nc.SomeDomainICensored.com" ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "dbtype": "mysql", "version": "25.0.12.0", "overwrite.cli.url": "https:\/\/nc.SomeDomainICensored.com\/", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "mysql.utf8mb4": true, "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "instanceid": "***REMOVED SENSITIVE VALUE***", "htaccess.RewriteBase": "\/", "activity_expire_days": 14, "auth.bruteforce.protection.enabled": true, "blacklisted_files": [ ".htaccess", "Thumbs.db", "thumbs.db" ], "cron_log": true, "default_phone_region": "DE", "default_locale": "de", "default_language": "de", "enable_previews": true, "enabledPreviewProviders": [ "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap", "OC\\Preview\\Movie", "OC\\Preview\\MP3", "OC\\Preview\\TXT", "OC\\Preview\\MarkDown", "OC\\Preview\\OpenDocument", "OC\\Preview\\Krita", "OC\\Preview\\HEIC", "OC\\Preview\\TIFF" ], "preview_max_memory": 128, "filesystem_check_changes": 0, "filelocking.enabled": "true", "integrity.check.disabled": false, "knowledgebaseenabled": true, "logfile": "\/mnt\/storagebox_sshfs\/nextcloud_data\/nextcloud.log", "logtimezone": "Europe\/Berlin", "log_rotate_size": 104857600, "maintenance": false, "memcache.local": "\\OC\\Memcache\\APCu", "memcache.locking": "\\OC\\Memcache\\Redis", "overwriteprotocol": "https", "preview_max_x": 1920, "preview_max_y": 1200, "preview_max_scale_factor": 1, "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 0, "dbindex": 0, "timeout": 1.5 }, "trashbin_retention_obligation": "auto, 14", "updater.release.channel": "stable", "trusted_proxies": "***REMOVED SENSITIVE VALUE***", "remember_login_cookie_lifetime": "1800", "simpleSignUpLink.shown": false, "versions_retention_obligation": "auto, 365", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_smtpmode": "smtp", "mail_sendmailmode": "smtp", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "25", "loglevel": 1, "theme": "", "app_install_overwrite": [ "camerarawpreviews" ], "updater.secret": "***REMOVED SENSITIVE VALUE***" } }List of activated Apps
Nextcloud Signing status
Nextcloud Logs
No response
Additional info
No response
The text was updated successfully, but these errors were encountered: