Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Sync or resync crashes with "UTF-32 code point size too small" #2842

Closed
arampp opened this issue Sep 22, 2024 · 3 comments
Closed

Bug: Sync or resync crashes with "UTF-32 code point size too small" #2842

arampp opened this issue Sep 22, 2024 · 3 comments
Labels
Bug Something isn't working Duplicate This issue or pull request already exists Fixed

Comments

@arampp
Copy link

arampp commented Sep 22, 2024

Describe the bug

After update to 2.5.0, a sync or resync crashes with the following error:

std.uri.URIException@/usr/include/dlang/dmd/std/uri.d(246): UTF-32 code point size too small
----------------
??:? pure @safe immutable(dchar)[] std.uri.URI_Decode!(char).URI_Decode(scope const(char)[], uint) [0x55ffa41b66c3]
??:? pure @safe immutable(char)[] std.uri.decodeComponent!(char).decodeComponent(scope const(char)[]) [0x55ffa41b628a]
??:? bool syncEngine.SyncEngine.checkJSONAgainstClientSideFiltering(std.json.JSONValue) [0x55ffa41de499]
??:? void syncEngine.SyncEngine.processDeltaJSONItem(std.json.JSONValue, ulong, int, ulong, bool) [0x55ffa41cded2]
??:? void syncEngine.SyncEngine.fetchOneDriveDeltaAPIResponse(immutable(char)[], immutable(char)[], immutable(char)[]) [0x55ffa41cb943]
??:? void syncEngine.SyncEngine.syncOneDriveAccountToLocalDisk() [0x55ffa41c9644]
??:? void main.performStandardSyncProcess(immutable(char)[], monitor.Monitor) [0x55ffa40850bf]
??:? _Dmain [0x55ffa4083328]

Operating System Details

$ uname -a
Linux Saturn 6.7.12-1-MANJARO #1 SMP PREEMPT_DYNAMIC Thu Apr  4 04:31:03 UTC 2024 x86_64 GNU/Linux

Client Installation Method

From Distribution Package

OneDrive Account Type

Personal

What is your OneDrive Application Version

2.5.0

What is your OneDrive Application Configuration

D-Bus message bus daemon is available; GUI notifications are now enabled
Reading configuration file: /home/alex/.config/onedrive/config
Configuration file successfully loaded
Application version                          = onedrive v2.5.0
Compiled with                                = DMD 2109
User Application Config path                 = /home/alex/.config/onedrive
System Application Config path               = /etc/onedrive
Applicable Application 'config' location     = /home/alex/.config/onedrive/config
Configuration file found in config location  = true - using 'config' file values to override application defaults
Applicable 'sync_list' location              = /home/alex/.config/onedrive/sync_list
Applicable 'items.sqlite3' location          = /home/alex/.config/onedrive/items.sqlite3
Config option 'drive_id'                     = 
Config option 'sync_dir'                     = ~/OneDrive
Config option 'enable_logging'               = false
Config option 'log_dir'                      = /var/log/onedrive
Config option 'disable_notifications'        = false
Config option 'skip_dir'                     = 
Config option 'skip_dir_strict_match'        = false
Config option 'skip_file'                    = ~*|.~*|*.tmp|*.swp|*.partial
Config option 'skip_dotfiles'                = false
Config option 'skip_symlinks'                = false
Config option 'monitor_interval'             = 300
Config option 'monitor_log_frequency'        = 12
Config option 'monitor_fullscan_frequency'   = 12
Config option 'read_only_auth_scope'         = false
Config option 'dry_run'                      = false
Config option 'upload_only'                  = false
Config option 'download_only'                = false
Config option 'local_first'                  = false
Config option 'check_nosync'                 = false
Config option 'check_nomount'                = false
Config option 'resync'                       = false
Config option 'resync_auth'                  = false
Config option 'cleanup_local_files'          = false
Config option 'classify_as_big_delete'       = 1000
Config option 'disable_upload_validation'    = false
Config option 'disable_download_validation'  = false
Config option 'bypass_data_preservation'     = false
Config option 'no_remote_delete'             = false
Config option 'remove_source_files'          = false
Config option 'sync_dir_permissions'         = 700
Config option 'sync_file_permissions'        = 600
Config option 'space_reservation'            = 52428800
Config option 'application_id'               = d50ca740-c83f-4d1b-b616-12c519384f0c
Config option 'azure_ad_endpoint'            = 
Config option 'azure_tenant_id'              = 
Config option 'user_agent'                   = ISV|abraunegg|OneDrive Client for Linux/v2.5.0
Config option 'force_http_11'                = false
Config option 'debug_https'                  = false
Config option 'rate_limit'                   = 0
Config option 'operation_timeout'            = 3600
Config option 'dns_timeout'                  = 60
Config option 'connect_timeout'              = 10
Config option 'data_timeout'                 = 60
Config option 'ip_protocol_version'          = 0
Config option 'threads'                      = 8
Environment var 'XDG_RUNTIME_DIR'            = true
Environment var 'DBUS_SESSION_BUS_ADDRESS'   = true
Config option 'notify_file_actions'          = false

Selective sync 'sync_list' configured        = true
sync_list config option 'sync_root_files'    = false
sync_list contents:
# documentation see https://github.com/abraunegg/onedrive/blob/master/docs/usage.md#performing-a-selective-synchronisation-via-sync_list-file

/Obsidian/
/1 PARA/3 Resources/Lesen/Calibre Bibliothek/

Config option 'sync_business_shared_items'   = false

Config option 'webhook_enabled'              = false

What is your 'curl' version

curl 8.9.1 (x86_64-pc-linux-gnu) libcurl/8.9.1 OpenSSL/3.3.1 zlib/1.3.1 brotli/1.1.0 zstd/1.5.6 libidn2/2.3.7 libpsl/0.21.5 libssh2/1.11.0 nghttp2/1.62.1 nghttp3/1.4.0
Release-Date: 2024-07-31
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns mqtt pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS brotli GSS-API HSTS HTTP2 HTTP3 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM PSL SPNEGO SSL threadsafe TLS-SRP UnixSockets zstd

Where is your 'sync_dir' located

Local

What are all your system 'mount points'

proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sys on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
dev on /dev type devtmpfs (rw,nosuid,relatime,size=8005628k,nr_inodes=2001407,mode=755,inode64)
run on /run type tmpfs (rw,nosuid,nodev,relatime,mode=755,inode64)
/dev/sdb1 on / type ext4 (rw,noatime)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2250)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,nosuid,nodev,relatime,pagesize=2M)
tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /run/credentials/systemd-udev-load-credentials.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
tmpfs on /run/credentials/systemd-sysctl.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime)
tmpfs on /run/credentials/systemd-tmpfiles-setup-dev-early.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
tmpfs on /run/credentials/systemd-sysusers.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
tmpfs on /run/credentials/systemd-tmpfiles-setup-dev.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
tmpfs on /run/credentials/systemd-journald.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
tmpfs on /run/credentials/systemd-vconsole-setup.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev,nr_inodes=1048576,inode64)
/var/lib/snapd/snaps/bare_5.snap on /var/lib/snapd/snap/bare/5 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/core20_2379.snap on /var/lib/snapd/snap/core20/2379 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/core18_2823.snap on /var/lib/snapd/snap/core18/2823 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/core_17200.snap on /var/lib/snapd/snap/core/17200 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/core_16928.snap on /var/lib/snapd/snap/core/16928 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/core20_2318.snap on /var/lib/snapd/snap/core20/2318 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/core18_2829.snap on /var/lib/snapd/snap/core18/2829 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/gnome-3-28-1804_161.snap on /var/lib/snapd/snap/gnome-3-28-1804/161 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/gnome-3-28-1804_198.snap on /var/lib/snapd/snap/gnome-3-28-1804/198 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/gnome-3-38-2004_140.snap on /var/lib/snapd/snap/gnome-3-38-2004/140 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/gnome-3-38-2004_143.snap on /var/lib/snapd/snap/gnome-3-38-2004/143 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/gtk-common-themes_1534.snap on /var/lib/snapd/snap/gtk-common-themes/1534 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/gtk-common-themes_1535.snap on /var/lib/snapd/snap/gtk-common-themes/1535 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/snapd_21465.snap on /var/lib/snapd/snap/snapd/21465 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/snapd_21759.snap on /var/lib/snapd/snap/snapd/21759 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/spotify_77.snap on /var/lib/snapd/snap/spotify/77 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/var/lib/snapd/snaps/spotify_78.snap on /var/lib/snapd/snap/spotify/78 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/dev/sdc2 on /run/media/daten type ntfs3 (rw,nosuid,nodev,noexec,noatime,uid=1000,gid=3,iocharset=utf8,prealloc)
tmpfs on /run/credentials/systemd-tmpfiles-setup.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=1604008k,nr_inodes=401002,mode=700,uid=1000,gid=1000,inode64)
portal on /run/user/1000/doc type fuse.portal (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
OneDrive: on /home/alex/mnt/OneDrive type fuse.rclone (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)

What are all your local file system partition types

NAME   FSTYPE FSVER LABEL             UUID                                 FSAVAIL FSUSE% MOUNTPOINTS
loop0                                                                            0   100% /var/lib/snapd/snap/bare/5
loop1                                                                            0   100% /var/lib/snapd/snap/core/16928
loop2                                                                            0   100% /var/lib/snapd/snap/core/17200
loop3                                                                            0   100% /var/lib/snapd/snap/core18/2823
loop4                                                                            0   100% /var/lib/snapd/snap/core18/2829
loop5                                                                            0   100% /var/lib/snapd/snap/core20/2318
loop6                                                                            0   100% /var/lib/snapd/snap/core20/2379
loop7                                                                            0   100% /var/lib/snapd/snap/gnome-3-28-1804/161
loop8                                                                            0   100% /var/lib/snapd/snap/gnome-3-28-1804/198
loop9                                                                            0   100% /var/lib/snapd/snap/gnome-3-38-2004/140
loop10                                                                           0   100% /var/lib/snapd/snap/gtk-common-themes/1534
loop11                                                                           0   100% /var/lib/snapd/snap/gnome-3-38-2004/143
loop12                                                                           0   100% /var/lib/snapd/snap/gtk-common-themes/1535
loop13                                                                           0   100% /var/lib/snapd/snap/snapd/21465
loop14                                                                           0   100% /var/lib/snapd/snap/snapd/21759
loop15                                                                           0   100% /var/lib/snapd/snap/spotify/77
loop16                                                                           0   100% /var/lib/snapd/snap/spotify/78
sda                                                                                       
├─sda1 ntfs         System-reserviert 8AE88E20E88E0B21                                    
└─sda2 ntfs         windows           FE9A90D29A9088B3                                    
sdb                                                                                       
├─sdb1 ext4   1.0                     9f5859ca-9158-4d2f-b3fd-dd250600767d   30,3G    81% /
└─sdb2 swap   1                       f533ed85-a8c9-4acc-a59c-6b5012973fb5                [SWAP]
sdc                                                                                       
├─sdc1                                                                                    
└─sdc2 ntfs         Daten             E80EF6AC0EF67344                      386,1G    79% /run/media/daten
sr0

How do you use 'onedrive'

Onedrive Account is shared with:

  • 1 Windows installation using Microsoft's official sync client
  • 1 Android device using Microsoft's official sync client
  • 1 Android device using the OneSync app (reason: to sync with the Obsidian app which does not have an offical integration)
  • 1 Linux client using this software

Steps to reproduce the behaviour

  • onedrive starts as systemd service, during startup the error occurs
  • running onedrive --resync --sync also reproduces the error

Complete Verbose Log Output

DEBUG: CurlEngine cleanup() called on instance id: IQXk8vBMSjhOadwb
DEBUG: CurlEngine curlEnginePool size after release: 2
DEBUG: Application Version:  onedrive v2.5.0
DEBUG: Account Type:         personal
DEBUG: Default Drive ID:     f0ab89a8ab9545a8
DEBUG: Default Root ID:      F0AB89A8AB9545A8!101
DEBUG: Remaining Free Space: 500.70 GB (537622531276 bytes)
DEBUG: Sync Engine Initialised with new Onedrive API instance
DEBUG: OneDrive API releaseCurlEngine() Called
DEBUG: CurlEngine releaseEngine() called on instance id: qzKAVMI7LgiS3xyj
DEBUG: CurlEngine curlEnginePool size before release: 2
DEBUG: CurlEngine cleanup() called on instance id: qzKAVMI7LgiS3xyj
DEBUG: CurlEngine curlEnginePool size after release: 3
DEBUG: All application operations will be performed in the configured local 'sync_dir' directory: /home/alex/OneDrive
DEBUG: Perform a Full Scan True-Up: false
DEBUG: driveIdToQuery was empty, setting to appConfig.defaultDriveId
DEBUG: driveIdToQuery: f0ab89a8ab9545a8
DEBUG: itemIdToQuery was empty, setting to appConfig.defaultRootId
DEBUG: itemIdToQuery: F0AB89A8AB9545A8!101
DEBUG: DeltaLink Query (driveId): f0ab89a8ab9545a8
DEBUG: DeltaLink Query (id):      F0AB89A8AB9545A8!101
DEBUG: Zero deltaLink available for use, we will be performing a full online scan
DEBUG: Fetching /delta response from the OneDrive API for Drive ID: f0ab89a8ab9545a8
DEBUG: CurlEngine getCurlInstance() called
DEBUG: CurlEngine curlEnginePool current size: 3
DEBUG: CurlEngine was in a valid state - returning existing CurlEngine instance
DEBUG: CurlEngine instance ID: qzKAVMI7LgiS3xyj
DEBUG: Read token from appConfig
DEBUG: Authorised State: true
DEBUG: ------------------------------------------------------------------
DEBUG: selectedDriveId:   f0ab89a8ab9545a8
DEBUG: selectedItemId:    F0AB89A8AB9545A8!101
DEBUG: providedDeltaLink: 
DEBUG: ------------------------------------------------------------------
DEBUG: Request URL = https://graph.microsoft.com/v1.0/drives/f0ab89a8ab9545a8/items/F0AB89A8AB9545A8!101/delta?select=id,name,eTag,cTag,deleted,file,folder,root,fileSystemInfo,remoteItem,parentReference,size
DEBUG: Existing Microsoft OneDrive Access Token Expires: 2024-Sep-22 12:02:47.2590999
DEBUG: HTTP Response Headers: ["strict-transport-security":"max-age=31536000", "x-ms-ags-diagnostic":"{\"ServerInfo\":{\"DataCenter\":\"Germany West Central\",\"Slice\":\"E\",\"Ring\":\"4\",\"ScaleUnit\":\"005\",\"RoleInstance\":\"FR3PEPF00000538\"}}", "odata-version":"4.0", "date":"Sun, 22 Sep 2024 09:02:47 GMT", "client-request-id":"58d60f75-38f4-4c7c-96bd-e97f09e19a45", "request-id":"58d60f75-38f4-4c7c-96bd-e97f09e19a45", "cache-control":"no-store", "content-type":"application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8"]
DEBUG: HTTP Status Line: 200  (2.0)
DEBUG: CurlEngine cleanup() called on instance id: qzKAVMI7LgiS3xyj
DEBUG: Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 216
DEBUG: Setting currentDeltaLink to @odata.nextLink: https://graph.microsoft.com/v1.0/drives/f0ab89a8ab9545a8/items/F0AB89A8AB9545A8!101/delta?select=id%2cname%2ceTag%2ccTag%2cdeleted%2cfile%2cfolder%2croot%2cfileSystemInfo%2cremoteItem%2cparentReference%2csize&token=aTE09NjM4NjI1OTA0ODI3NTM7SUQ9RjBBQjg5QThBQjk1NDVBOCExMDE7TFI9NjM4NjI1OTI1Njc5MDA7RVA9MjA7U0k9NDU7RExFUD0wO0xJRD0zMzcxODY7RkQ9VHJ1ZTtCVT1UcnVlO1NHPTE7U089MjtQST0z
DEBUG: ------------------------------------------------------------------
DEBUG: Processing OneDrive Item 1 of 216 from API Response Bundle 1
DEBUG: Raw JSON OneDrive Item: {"cTag":"adDpGMEFCODlBOEFCOTU0NUE4ITEwMS42Mzg2MjU5MDQ4Mjc1MzAwMDA","eTag":"aRjBBQjg5QThBQjk1NDVBOCExMDEuODU","fileSystemInfo":{"createdDateTime":"2014-10-26T14:23:07.413Z","lastModifiedDateTime":"2023-12-20T16:03:54.21Z"},"folder":{"childCount":0,"view":{"sortBy":"name","sortOrder":"ascending","viewType":"thumbnails"}},"id":"F0AB89A8AB9545A8!101","name":"root","parentReference":{"driveId":"f0ab89a8ab9545a8","driveType":"personal","id":"F0AB89A8AB9545A8!0","path":"\/drive\/root:"},"root":{},"size":594184535097}
DEBUG: This item is not a OneDrive deletion change
DEBUG: defaultRootId                                        = F0AB89A8AB9545A8!101
DEBUG: 'search id'                                          = F0AB89A8AB9545A8!101
DEBUG: id == defaultRootId                                  = true
DEBUG: isItemRoot(onedriveJSONItem)                         = true
DEBUG: onedriveJSONItem['name'].str == 'root'               = true
DEBUG: itemHasParentReferenceId                             = true
DEBUG: JSON item will flagged as a 'root' item
DEBUG: objectParentDriveId                                  = f0ab89a8ab9545a8
DEBUG: handleItemAsRootObject                               = true
DEBUG: itemHasParentReferenceId                             = true
DEBUG: itemIsDeletedOnline                                  = false
DEBUG: Handling change immediately as 'root item', or has no parent reference id or is a deleted item
DEBUG: Handing JSON object as OneDrive 'root' object
DEBUG: Initial JSON item processing time: 236 μs and 7 hnsecs
DEBUG: ------------------------------------------------------------------
DEBUG: Processing OneDrive Item 2 of 216 from API Response Bundle 1
DEBUG: Raw JSON OneDrive Item: {"cTag":"adDpGMEFCODlBOEFCOTU0NUE4ITExMDMwLjYzODYyNTEwMjY1OTk3MDAwMA","eTag":"aRjBBQjg5QThBQjk1NDVBOCExMTAzMC4w","fileSystemInfo":{"createdDateTime":"2016-12-29T09:24:31Z","lastModifiedDateTime":"2016-12-29T09:24:31Z"},"folder":{"childCount":0,"view":{"sortBy":"name","sortOrder":"ascending","viewType":"thumbnails"}},"id":"F0AB89A8AB9545A8!11030","name":"Backup","parentReference":{"driveId":"f0ab89a8ab9545a8","driveType":"personal","id":"F0AB89A8AB9545A8!101","name":"root:","path":"\/drive\/root:"},"size":282765580452}
DEBUG: This item is not a OneDrive deletion change
DEBUG: defaultRootId                                        = F0AB89A8AB9545A8!101
DEBUG: 'search id'                                          = F0AB89A8AB9545A8!11030
DEBUG: id == defaultRootId                                  = false
DEBUG: isItemRoot(onedriveJSONItem)                         = false
DEBUG: onedriveJSONItem['name'].str == 'root'               = false
DEBUG: itemHasParentReferenceId                             = true
DEBUG: Attempting to calculate local filesystem path for f0ab89a8ab9545a8 and F0AB89A8AB9545A8!101
DEBUG: path to check against 'sync_list' entries: ./Backup
DEBUG: Evaluation against 'sync_list' rules for this input path: /Backup
DEBUG: [S]exclude                = false
DEBUG: [S]exludeDirectMatch      = false
DEBUG: [S]excludeAnywhereMatched = false
DEBUG: [S]excludeWildcardMatched = false
DEBUG: [S]excludeMatched         = false
DEBUG: Evaluation against INCLUSION 'sync_list' rule: /Obsidian
DEBUG: Evaluation against INCLUSION 'sync_list' rule: /1 PARA/3 Resources/Lesen/Calibre Bibliothek
DEBUG: [F]exclude                = false
DEBUG: [F]exludeDirectMatch      = false
DEBUG: [F]excludeAnywhereMatched = false
DEBUG: [F]excludeWildcardMatched = false
DEBUG: [F]excludeMatched         = false
DEBUG: Evaluation against 'sync_list' final result: EXCLUDED
DEBUG: Skipping path - excluded by sync_list config: ./Backup
DEBUG: Initial JSON item processing time: 371 μs and 4 hnsecs

... skipped unnecessary parts since the log file has > 600 MB

DEBUG: Processing OneDrive Item 30 of 224 from API Response Bundle 1210
DEBUG: Raw JSON OneDrive Item: {"cTag":"aYzpGMEFCODlBOEFCOTU0NUE4ITM0MDM4LjI1Nw","eTag":"aRjBBQjg5QThBQjk1NDVBOCEzNDAzOC4w","file":{"hashes":{"quickXorHash":"XGpdny6nouRoJVtUhnPwXo7awwg=","sha1Hash":"834C535C047D48456D9E3F843D583205BDCB52F7","sha256Hash":""},"mimeType":"application\/octet-stream"},"fileSystemInfo":{"createdDateTime":"2016-01-02T16:43:42Z","lastModifiedDateTime":"2014-03-27T00:07:52Z"},"id":"F0AB89A8AB9545A8!34038","name":".org-id-locations.gze","parentReference":{"driveId":"f0ab89a8ab9545a8","driveType":"personal","id":"F0AB89A8AB9545A8!26751","name":".emacs.d","path":"\/drive\/root:\/Backup\/backup_old\/Jupiter_Windows\/LwC\/Users\/alex\/AppData\/Roaming\/.emacs.d"},"size":4342}
DEBUG: This item is not a OneDrive deletion change
DEBUG: defaultRootId                                        = F0AB89A8AB9545A8!101
DEBUG: 'search id'                                          = F0AB89A8AB9545A8!34038
DEBUG: id == defaultRootId                                  = false
DEBUG: isItemRoot(onedriveJSONItem)                         = false
DEBUG: onedriveJSONItem['name'].str == 'root'               = false
DEBUG: itemHasParentReferenceId                             = true
DEBUG: skip_file item to check (file name only - parent path not in database): /.org-id-locations.gze
DEBUG: skip_file evaluation for: /.org-id-locations.gze
DEBUG: skip_file evaluation for: /.org-id-locations.gze
DEBUG: Result: false
DEBUG: path to check against 'sync_list' entries: Backup/backup_old/Jupiter_Windows/LwC/Users/alex/AppData/Roaming/.emacs.d/.org-id-locations.gze
DEBUG: Evaluation against 'sync_list' rules for this input path: /Backup/backup_old/Jupiter_Windows/LwC/Users/alex/AppData/Roaming/.emacs.d/.org-id-locations.gze
DEBUG: [S]exclude                = false
DEBUG: [S]exludeDirectMatch      = false
DEBUG: [S]excludeAnywhereMatched = false
DEBUG: [S]excludeWildcardMatched = false
DEBUG: [S]excludeMatched         = false
DEBUG: Evaluation against INCLUSION 'sync_list' rule: /Obsidian
DEBUG: Evaluation against INCLUSION 'sync_list' rule: /1 PARA/3 Resources/Lesen/Calibre Bibliothek
DEBUG: [F]exclude                = false
DEBUG: [F]exludeDirectMatch      = false
DEBUG: [F]excludeAnywhereMatched = false
DEBUG: [F]excludeWildcardMatched = false
DEBUG: [F]excludeMatched         = false
DEBUG: Evaluation against 'sync_list' final result: EXCLUDED
DEBUG: Initial JSON item processing time: 804 μs and 2 hnsecs
DEBUG: ------------------------------------------------------------------
DEBUG: Processing OneDrive Item 31 of 224 from API Response Bundle 1210
DEBUG: Raw JSON OneDrive Item: {"cTag":"aYzpGMEFCODlBOEFCOTU0NUE4ITM0MDM5LjI1Nw","eTag":"aRjBBQjg5QThBQjk1NDVBOCEzNDAzOS4w","file":{"hashes":{"quickXorHash":"FAQEU+f5nyShuJsSo0R2SqqMBCo=","sha1Hash":"B24E6F9CE8DA9FC1F3B8D56C5A4BC32A216A428A","sha256Hash":""},"mimeType":"application\/octet-stream"},"fileSystemInfo":{"createdDateTime":"2016-01-02T16:43:42Z","lastModifiedDateTime":"2014-06-14T19:14:38Z"},"id":"F0AB89A8AB9545A8!34039","name":"%backup%~.gze","parentReference":{"driveId":"f0ab89a8ab9545a8","driveType":"personal","id":"F0AB89A8AB9545A8!26751","name":".emacs.d","path":"\/drive\/root:\/Backup\/backup_old\/Jupiter_Windows\/LwC\/Users\/alex\/AppData\/Roaming\/.emacs.d"},"size":1828}
DEBUG: This item is not a OneDrive deletion change
DEBUG: defaultRootId                                        = F0AB89A8AB9545A8!101
DEBUG: 'search id'                                          = F0AB89A8AB9545A8!34039
DEBUG: id == defaultRootId                                  = false
DEBUG: isItemRoot(onedriveJSONItem)                         = false
DEBUG: onedriveJSONItem['name'].str == 'root'               = false
DEBUG: itemHasParentReferenceId                             = true
DEBUG: skip_file item to check (file name only - parent path not in database): /%backup%~.gze
DEBUG: skip_file evaluation for: /%backup%~.gze
DEBUG: skip_file evaluation for: /%backup%~.gze
DEBUG: Result: false
DEBUG: selfBuiltPath for sync_list check needs decoding: /Backup/backup_old/Jupiter_Windows/LwC/Users/alex/AppData/Roaming/.emacs.d/%backup%~.gze
DEBUG: Failure scope was called
DEBUG: performSynchronisedExitProcess called by: failureScope
DEBUG: Shutting down Sync Engine instance
DEBUG: SyncEngine: Waiting for all internal threads to complete
DEBUG: Shutting down processPool in a thread blocking manner
DEBUG: Shutdown Sync Engine instance is complete
DEBUG: CurlEngine releaseAllCurlInstances() called
DEBUG: CurlEngine curlEnginePool size to release: 2
DEBUG: CurlEngine cleanup() called on instance id: WFwPG3aTQ7xyOJjo
DEBUG: CurlEngine shutdownCurlHTTPInstance() called on instance id: WFwPG3aTQ7xyOJjo
DEBUG: HTTP instance still active: WFwPG3aTQ7xyOJjo
DEBUG: HTTP instance isStopped state before http.shutdown(): false
DEBUG: HTTP instance isStopped state post http.shutdown(): true
DEBUG: HTTP instance shutdown and destroyed: WFwPG3aTQ7xyOJjo
DEBUG: CurlEngine released
DEBUG: CurlEngine cleanup() called on instance id: IQXk8vBMSjhOadwb
DEBUG: CurlEngine shutdownCurlHTTPInstance() called on instance id: IQXk8vBMSjhOadwb
DEBUG: HTTP instance still active: IQXk8vBMSjhOadwb
DEBUG: HTTP instance isStopped state before http.shutdown(): false
DEBUG: HTTP instance isStopped state post http.shutdown(): true
DEBUG: HTTP instance shutdown and destroyed: IQXk8vBMSjhOadwb
DEBUG: CurlEngine released
DEBUG: CurlEngine releaseAllCurlInstances() completed
DEBUG: Shutting down Client Side Filtering instance
DEBUG: Shutdown of Client Side Filtering instance is complete
DEBUG: Shutting down Database instance
DEBUG: Attempting to perform a database vacuum to optimise database
DEBUG: Counting open SQL statements
DEBUG: Database vacuum is complete
DEBUG: Shutdown of Database instance is complete
DEBUG: Shutting down Application Configuration instance
DEBUG: Shutdown of Application Configuration instance is complete
DEBUG: Application is exiting
DEBUG: Shutting down Application Logging instance
std.uri.URIException@/usr/include/dlang/dmd/std/uri.d(246): UTF-32 code point size too small
----------------
??:? pure @safe immutable(dchar)[] std.uri.URI_Decode!(char).URI_Decode(scope const(char)[], uint) [0x58b6ca3486c3]
??:? pure @safe immutable(char)[] std.uri.decodeComponent!(char).decodeComponent(scope const(char)[]) [0x58b6ca34828a]
??:? bool syncEngine.SyncEngine.checkJSONAgainstClientSideFiltering(std.json.JSONValue) [0x58b6ca370499]
??:? void syncEngine.SyncEngine.processDeltaJSONItem(std.json.JSONValue, ulong, int, ulong, bool) [0x58b6ca35fed2]
??:? void syncEngine.SyncEngine.fetchOneDriveDeltaAPIResponse(immutable(char)[], immutable(char)[], immutable(char)[]) [0x58b6ca35d943]
??:? void syncEngine.SyncEngine.syncOneDriveAccountToLocalDisk() [0x58b6ca35b644]
??:? void main.performStandardSyncProcess(immutable(char)[], monitor.Monitor) [0x58b6ca2170bf]
??:? _Dmain [0x58b6ca2142dd]

Screenshots

No response

Other Log Information or Details

Systemd log from `journalctl -b -u onedrive@alex`:


Sep 22 06:39:34 Saturn systemd[1]: Started OneDrive Client for Linux running for alex.
Sep 22 06:39:34 Saturn onedrive[1319]: WARNING: Required environment variables required to enable GUI Notifications are not present
Sep 22 06:39:34 Saturn onedrive[1319]: WARNING: The required environment variables to enable GUI Notifications are not available; GUI notifications are disabled
Sep 22 06:39:34 Saturn onedrive[1319]: Reading configuration file: /home/alex/.config/onedrive/config
Sep 22 06:39:34 Saturn onedrive[1319]: Configuration file successfully loaded
Sep 22 06:39:34 Saturn onedrive[1319]: Using IPv4 and IPv6 (if configured) for all network operations
Sep 22 06:39:34 Saturn onedrive[1319]: Attempting to contact Microsoft OneDrive Login Service
Sep 22 06:39:34 Saturn onedrive[1319]: Successfully reached Microsoft OneDrive Login Service
Sep 22 06:39:34 Saturn onedrive[1319]: Configuring Global Azure AD Endpoints
Sep 22 06:39:35 Saturn onedrive[1319]: OneDrive synchronisation interval (seconds): 300
Sep 22 06:39:35 Saturn onedrive[1319]: Initialising filesystem inotify monitoring ...
Sep 22 06:39:35 Saturn onedrive[1319]: Performing initial synchronisation to ensure consistent local state ...
Sep 22 06:39:35 Saturn onedrive[1319]: Attempting to contact Microsoft OneDrive Login Service
Sep 22 06:39:35 Saturn onedrive[1319]: Successfully reached Microsoft OneDrive Login Service
Sep 22 06:39:35 Saturn onedrive[1319]: Starting a sync with Microsoft OneDrive
Sep 22 06:53:28 Saturn onedrive[1319]: Fetching items from the OneDrive API for Drive ID: f0ab89a8ab9545a8 ......................................................................................................>
Sep 22 06:53:28 Saturn onedrive[1319]: Database vacuum is complete
Sep 22 06:53:29 Saturn onedrive[1319]: std.uri.URIException@/usr/include/dlang/dmd/std/uri.d(246): UTF-32 code point size too small
Sep 22 06:53:29 Saturn onedrive[1319]: ----------------
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? pure @safe immutable(dchar)[] std.uri.URI_Decode!(char).URI_Decode(scope const(char)[], uint) [0x56077c73a6c3]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? pure @safe immutable(char)[] std.uri.decodeComponent!(char).decodeComponent(scope const(char)[]) [0x56077c73a28a]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? bool syncEngine.SyncEngine.checkJSONAgainstClientSideFiltering(std.json.JSONValue) [0x56077c762499]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? void syncEngine.SyncEngine.processDeltaJSONItem(std.json.JSONValue, ulong, int, ulong, bool) [0x56077c751ed2]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? void syncEngine.SyncEngine.fetchOneDriveDeltaAPIResponse(immutable(char)[], immutable(char)[], immutable(char)[]) [0x56077c74f943]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? void syncEngine.SyncEngine.syncOneDriveAccountToLocalDisk() [0x56077c74d644]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? void main.performStandardSyncProcess(immutable(char)[], monitor.Monitor) [0x56077c6090bf]
Sep 22 06:53:29 Saturn onedrive[1319]: ??:? _Dmain [0x56077c607328]
Sep 22 06:53:29 Saturn systemd[1]: onedrive@alex.service: Main process exited, code=exited, status=1/FAILURE
Sep 22 06:53:29 Saturn systemd[1]: onedrive@alex.service: Failed with result 'exit-code'.
Sep 22 06:53:29 Saturn systemd[1]: onedrive@alex.service: Consumed 4min 31.086s CPU time, 58.8M memory peak.

Additional context

No response

@arampp arampp added the Bug Something isn't working label Sep 22, 2024
@abraunegg abraunegg added Duplicate This issue or pull request already exists Fixed labels Sep 22, 2024
@abraunegg
Copy link
Owner

abraunegg commented Sep 22, 2024

@arampp
This appears to be a duplicate of #2815

To build 'master', please follow the steps to prepare your system to build the client as detailed here: https://github.com/abraunegg/onedrive/blob/master/docs/install.md#building-from-source---high-level-requirements

To clone 'master':

git clone https://github.com/abraunegg/onedrive.git
cd onedrive

When building the client, please use the following:

./configure --enable-debug; make clean; make;

To run 'master', you need to run the client directly from the build directory:

./onedrive <any other options needed>

To install 'master', you will need to perform sudo make install to install the 'master' version to your system.

When running the PR, your version should be: onedrive v2.5.0-8-g88e2493 or greater to have this issue fixed.

The fix will identify the offending file online that needs to be renamed.

@arampp
Copy link
Author

arampp commented Sep 22, 2024

That solved it.

Thank you very much for your support and your awesome piece of software :-).

@arampp arampp closed this as completed Sep 22, 2024
@abraunegg
Copy link
Owner

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

Repository owner locked as resolved and limited conversation to collaborators Sep 30, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Bug Something isn't working Duplicate This issue or pull request already exists Fixed
Projects
None yet
Development

No branches or pull requests

2 participants