IOS Syncronization issue, keeps trying to upload the same files over and over again

[mjh2901]

The bug

I have Go Pro files that fail to upload, but the system retries them every day, so instead of moving through the library and uploading other smaller files it attempts to reupoad the same movie files every day which takes hours, then after failing it move on to other stuff but the next day when I launch the app it starts the entire process over again. I checked the logs and there are a ton of "Failed to Hash FIle" erros

The OS that Immich Server is running on

IOS 17

Version of Immich Server

V1.101.0

Version of Immich Mobile App

V1.101.0 Build 147

Platform with the issue

• Server
• Web
• Mobile

Your docker-compose.yml content

#
# WARNING: Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
#

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: ['start.sh', 'immich']
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
#      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/hardware-transcoding
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    command: ['start.sh', 'microservices']
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
#      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    depends_on:
      - redis
      - database
    restart: always

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  redis:
    container_name: immich_redis
    image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:51d6c56749a4243096327e3fb964a48ed92254357108449cb6e23999c37773c5
    restart: always

  database:
    container_name: immich_postgres
    image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

volumes:
  pgdata:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/docker/immich-library

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
DB_PASSWORD=postgres

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

Reproduction steps

1.
2.
3.
...

Relevant log output

2024-04-19 06:49:39.978838	LogLevel.WARNING	HashService	Failed to hash file /private/var/mobile/Containers/Data/Application/3B61B0D3-C65C-4DE9-BF8D-B1EFB33FCD78/tmp/.image/4829B0BB-182E-4A3E-A5DD-F859EA957765_L0_001_1700944653.287143_o_IMG_0559.JPG, skipping

Additional information

No response

[alextran1502]

Are you using a reverse proxy, DNS? Have you try with local IP?

[jianglai]

The new release seems to have fixed this issue for me. Thanks!

[DeviousM]

Same, new release made it possible to sync photos in the end! iOS app still crashes every couple of hundreds of photos for some reason, but at least now it doesn't have to start over every single time 😅
Thanks @alextran1502!

[alextran1502]

@DeviousM crashing on iOS is a known issue when uploading iCloud photos. It is due to the library we use to retrieved the assets. There is no fix for it currently 😅

[levifig]

All latest versions of both server and apps, and my phone is still trying to upload older stuff that I know is already uploaded, which means it'll never finish syncing (I have over 1TB of assets across > 45k items)... :(

[levifig]

@levifig can you help with your entire timeline?

Was the initial 40k upload coming from a different device...etc?

Yes: initial upload via macOS, backup turned on from my iPhone 15PM.

[ITSecUK]

I have very similar behaviour in server v1.108.0. But it seems to only affect relatively large video files from apple photos. iOS app uploads the video file 600MB+ gets nearly to the end like 97% or so and then goes onto the next file. When reopening the app, it would then retry the same set of video files. No errors in either server docker logs or iOS app logs.

I was using traefik for reverse proxy for TLS. Reading this thread I noticed about not using a reverse proxy, so I used http direct to the exposed port, and the upload is for somer eason slower (5MB rather than 10MB).

Now it is getting to 100% and appears to have completed! Would love to get to the bottom of this, keen to hear ideas from anyone on possible causes, could be traefik or my config is not good, but hope that solution can help others who might have the same issue!

[dukeside]

I was having the same error for 10 files in the last couple weeks (iCloud Photo Library from iOS). Changing to my local IP fixed the issue.

[rahulpsd18]

Same error on uploading files from android app. ~30 files, sizes varied from 50MB to 80MB with 1 outlier of 650MB.
App version: 1.119.0 build.164
Server Version: 1.119.1

Changing the server URL in the app to local IP fixed the issue.
After I switched to local IP, I saw Failed backup alert with all 30 images saying Invalid user token. Not sure if token was actually invalid because the app was working fine otherwise - searching and downloading old files worked fine in that session.