Can't mount data (share_path)

[dasmehdix]

Hi. I am newbie about docker usage. I have a dataset with lots of photos. I want to label them into CVAT. As mentioned in doc, I should mount my dataset into docker. I tried multiple things. I edit and rebuilded docker-compose.yml and docker-composo.override.yml but still docker can't acces my dataset. My OS is Windows 10 with WSL2. In the example share_path, the path is /mnt/share. Do I need to give path of my dataset like C:/Users/Desktop/.../ or do I need to give path of WSL2 for windows?

[jackneil]

Hi @dasmehdix. Here's how I got it to work in docker-compose.override.yml:

version: "2.3"
services:
cvat:
environment:
CVAT_SHARE_URL: "Mounted from the e:\VoTT host directory"
volumes:
- type: bind
source: "e:\VoTT"
target: /home/django/share

just replace with your source location. and make sure your indentation is right since github is flattening them

[dasmehdix]

Hi @dasmehdix. Here's how I got it to work in docker-compose.override.yml:

version: "2.3"
services:
cvat:
environment:
CVAT_SHARE_URL: "Mounted from the e:\VoTT host directory"
volumes:

• type: bind
  source: "e:\VoTT"
  target: /home/django/share

just replace with your source location. and make sure your indentation is right since github is flattening them

Let's say my dataset is in path C:\Users\XX\Desktop\YY in windows enviroment.

version: "2.3"
services:
cvat:
environment:
CVAT_SHARE_URL: "Mounted from the C:\Users\XX\Desktop\YY host directory"
volumes:

• type: bind
  source: "C:\Users\XX\Desktop\YY"
  target: /home/django/share

So, is this configuration true for my enviroment?
BTW, thanks for answer.

Edit:
ERROR: create cvat_cvat_share: invalid option: "source"
This problem appers when I run that .yml file.

[bsekachev]

do I need to give path of WSL2 for windows

I suppose, yes. Since you run docker under WSL, you need to provide path in WSL.
BTW, we updated docker-compose version to 3.3 in develop branch, just for your information.

[veer5551]

Hello,

Using CVAT directly in Windows 10 (without WSL).
Tried mounting data and encountered the following errors.

ERROR: for cvat Cannot create container for service cvat: failed to mount local volume: mount E:\e\cvat_data:/var/lib/docker/volumes/cvat_cvat_share/_data, flags: 0x1000: no such file or directory

My docker-compose.override.yml file

version: "2.3"
services:
  cvat_proxy:
    environment:
      CVAT_HOST: "localhost"

  cvat:
    environment:
      CVAT_SHARE_URL: "Mounted from /e/cvat_data host directory"
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    driver_opts:
      type: none
      device: /e/cvat_data
      o: bind

Tried all possible combinations for the paths representations, but still can't mount the storage!
Could you please have a look?

Thanks a lot!

[jackneil]

If you’re doing it with hyperv you need to go into docker and share that directory with the docker instance Jack Neil CEO / Hank AI, Inc. jack.neil@hank.ai (w) +1.904.GET.HANK (m) +1.803.466.7551 Sent via Superhuman iOS ( https://sprh.mn/?vip=jack.neil@hank.ai )

…

On Thu, Oct 22 2020 at 9:55 AM, veer5551 < ***@***.*** > wrote: Hello, Using CVAT directly in Windows 10 (without WSL). Tried mounting data and encountered the following errors. ERROR: for cvat Cannot create container for service cvat: failed to mount local volume: mount E:\e\cvat_data:/var/lib/docker/volumes/cvat_cvat_share/_data, flags: 0x1000: no such file or directory My docker-compose.override.yml file version: "2.3" services: cvat_proxy: environment: CVAT_HOST: "localhost" cvat: environment: CVAT_SHARE_URL: "Mounted from /e/cvat_data host directory" volumes: - cvat_share:/home/django/share:ro volumes: cvat_share: driver_opts: type: none device: /e/cvat_data o: bind Tried all possible combinations for the paths representations, but still can't mount the storage! Could you please have a look? Thanks a lot! — You are receiving this because you commented. Reply to this email directly, view it on GitHub ( #2263 (comment) ) , or unsubscribe ( https://github.com/notifications/unsubscribe-auth/AGFRM5SBP5S4UFISGMJAW4TSMA2VZANCNFSM4SF2PDRA ).

[veer5551]

Yes @jackneil, that was the first thing I did.
I wonder, I was able to successfully mount Data with same override file with previous version of CVAT.

Need to look a little deeper into the issue I guess!
Thanks!

[veer5551]

Hello,

Having hard time figuring it out!
Below is the Image showing Error + File Sharing enabled in Docker Desktop + compose.override file

Has any one figured it out?
Am missing something ?

Thanks a lot!

[ChrisCurrin]

this seemed to work for me:

1. create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

2. tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

[veer5551]

Hey @ChrisCurrin,
Thanks a lot!! That worked Effortlessly!
Saved me!

Thanks!

[tralfamadude]

I tried what is documented in https://github.com/openvinotoolkit/cvat/blob/master/cvat/apps/documentation/installation.md#share-path
and got "no data" in the Web UI when I picked the Connected File Share tab.

After excessive staring, head scratching, and ruling out other possible issues, I got the documented method to work. I simply had a service mixup (cvat vs cvat_proxy)... no error gets generated if you put a def in the wrong service, it just fails to work.

One thing that would be helpful is that
https://github.com/openvinotoolkit/cvat/blob/master/cvat/apps/documentation/installation.md#share-path
should mention that there must be some files in order for it to appear in the web UI.

[ipesanz]

In adition to @ChrisCurrin answer: Keep the cvat_share:/home/django/share:ro line as it is.... as it's referring to django and not your shared path

[c00lcoder]

this seemed to work for me:

1. create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

1. tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

What is the cbc in the path /home/cbc/my_shared_folder? I have a folder called "share" located at /c/share but can't get it to work...so troubleshooting

[ChrisCurrin]

"cbc" is just my linux username. If you're on windows, it may be "device=/mnt/c/share"

…

On Thu, 7 Oct 2021 at 11:59, c00lcoder ***@***.***> wrote: this seemed to work for me: 1. create a volume docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind 1. tell docker to search for a volume created externally # docker-compose.override.yml version: "3.3" services: cvat: environment: CVAT_SHARE_URL: "" volumes: - cvat_share:/home/django/share:ro volumes: cvat_share: external: true What is the cbc in the path /home/cbc/my_shared_folder? I have a folder called "share" located at /c/share but can't get it to work...so troubleshooting — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2263 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AB6RZ7RNCI3EO3WQLAY34YTUFVVPBANCNFSM4SF2PDRA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[c00lcoder]

Thank you! This helped me figure out how to get it set up (switched to MAC) On Sun, Oct 10, 2021 at 6:27 AM Christopher ***@***.***> wrote:

…

"cbc" is just my linux username. If you're on windows, it may be "device=/mnt/c/share" On Thu, 7 Oct 2021 at 11:59, c00lcoder ***@***.***> wrote: > this seemed to work for me: > > 1. create a volume > > docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind > > 1. tell docker to search for a volume created externally > > # docker-compose.override.yml > version: "3.3" > > services: > cvat: > environment: > CVAT_SHARE_URL: "" > volumes: > - cvat_share:/home/django/share:ro > > volumes: > cvat_share: > external: true > > What is the cbc in the path /home/cbc/my_shared_folder? I have a folder > called "share" located at /c/share but can't get it to work...so > troubleshooting > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > < #2263 (comment) >, > or unsubscribe > < https://github.com/notifications/unsubscribe-auth/AB6RZ7RNCI3EO3WQLAY34YTUFVVPBANCNFSM4SF2PDRA > > . > Triage notifications on the go with GitHub Mobile for iOS > < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 > > or Android > < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub >. > > — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2263 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AVPH7PCSVIESKB44HBJM47LUGFTBJANCNFSM4SF2PDRA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[isudos]

I did this:

this seemed to work for me:

1. create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

2. tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

and got
ERROR: for 4925b50df6a1_cvat Cannot create container for service cvat: open /var/lib/docker/volumes/cvat_share/_data: permission denied

I tried to make it 777 and still got same error.
What can cause this?

EDIT: the directory I try to mount is s3 mounted to the system using fuse. It works fine with any other directory.

[gamingflexer]

This seemed to work for me on Mac M1:

In docker-compose.yml file i made the following changes and also thanks to @c00lcoder for the commands

In services & cvat_utils

    volumes:
      - cvat_data:/home/django/data
      - cvat_keys:/home/django/keys
      - cvat_logs:/home/django/logs
      - cvat_share:/home/django/share:ro

& added this

volumes:
  cvat_db:
  cvat_data:
  cvat_keys:
  cvat_logs:
  cvat_share:
    external: true

On terminal

docker volume create --name cvat_share --opt type=none --opt device=/Users/cosmos/Desktop/Projects/Resume Parser/img_annotations --opt o=bind

docker-compose up -d

Delete the container, prune other volumes if needed and restart docker if this fails

[terancejiang]

this seemed to work for me:

1. create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

2. tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

work like a charm

[aerdos]

For some reason none of the above, or the official docs worked for me. Instead I had to use a combination.

1. Create a docker-compose.override.yml file in the cvat directory. Note that my definition of the volumes:cvat_share section differs from the official docs.

# docker-compose.override.yml
services:
    cvat_server:
        volumes:
            - cvat_share:/home/django/share:ro
    cvat_worker_import:
        volumes:
            - cvat_share:/home/django/share:ro
    cvat_worker_export:
        volumes:
            - cvat_share:/home/django/share:ro
    cvat_worker_annotation:
        volumes:
            - cvat_share:/home/django/share:ro

volumes:
    cvat_share:
        # this differs from the official docs
        external: true

2. Create a C:\work_share directory (modify as necessary) and create a Docker volume from it.

docker volume create --name cvat_share --opt type=none --opt device=C:\work_share --opt o=bind

3. Build

docker compose -f .\docker-compose.yml -f .\docker-compose.override.yml up -d --build

Not sure why the other ideas didn't work for me 🤷, insight appreciated.

[SaeedAID]

For everyone's benefit, this solution worked perfectly for me:

• Ubuntu Version: 22.04
• CVAT Server Version: 2.19.1

In the docker-compose.yml, near the end, you will find the following volume declarations:

volumes:
  cvat_db:
  cvat_data:
  cvat_keys:
  cvat_logs:
  cvat_inmem_db:
  cvat_events_db:
  cvat_cache_db:

Additionally, I have a shared folder mounted at /mnt/volume_cvat_01. To store the CVAT volumes, I created a directory named cvat_volumes and set up subdirectories for each volume as follows:

mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_db
mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_data
mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_keys
mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_logs
mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_inmem_db
mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_events_db
mkdir -p /mnt/volume_cvat_01/cvat_volumes/cvat_cache_db

I then updated the docker-compose.yml file with the following volume configurations:

volumes:
  cvat_db:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_db
      o: bind
  cvat_data:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_data
      o: bind
  cvat_keys:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_keys
      o: bind
  cvat_logs:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_logs
      o: bind
  cvat_inmem_db:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_inmem_db
      o: bind
  cvat_events_db:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_events_db
      o: bind
  cvat_cache_db:
    driver: local
    driver_opts:
      type: none
      device: /mnt/volume_cvat_01/cvat_volumes/cvat_cache_db
      o: bind

Finally, set the CVAT host environment variable and start the container:

export CVAT_HOST=FQDN_or_YOUR-IP-ADDRESS
docker compose -f docker-compose.yml up -d

After that, you can access CVAT using your specified CVAT_HOST. Create a project, and navigate to /mnt/volume_cvat_01/cvat_volumes/cvat_data/projects to see the created project number.