Can't mount data (share_path) #2263

dasmehdix · 2020-10-06T10:24:49Z

Hi. I am newbie about docker usage. I have a dataset with lots of photos. I want to label them into CVAT. As mentioned in doc, I should mount my dataset into docker. I tried multiple things. I edit and rebuilded docker-compose.yml and docker-composo.override.yml but still docker can't acces my dataset. My OS is Windows 10 with WSL2. In the example share_path, the path is /mnt/share. Do I need to give path of my dataset like C:/Users/Desktop/.../ or do I need to give path of WSL2 for windows?

The text was updated successfully, but these errors were encountered:

jackneil · 2020-10-07T11:42:21Z

Hi @dasmehdix. Here's how I got it to work in docker-compose.override.yml:

version: "2.3"
services:
cvat:
environment:
CVAT_SHARE_URL: "Mounted from the e:\VoTT host directory"
volumes:
- type: bind
source: "e:\VoTT"
target: /home/django/share

just replace with your source location. and make sure your indentation is right since github is flattening them

dasmehdix · 2020-10-08T08:22:11Z

Hi @dasmehdix. Here's how I got it to work in docker-compose.override.yml:

version: "2.3"
services:
cvat:
environment:
CVAT_SHARE_URL: "Mounted from the e:\VoTT host directory"
volumes:

type: bind
source: "e:\VoTT"
target: /home/django/share

just replace with your source location. and make sure your indentation is right since github is flattening them

Let's say my dataset is in path C:\Users\XX\Desktop\YY in windows enviroment.

version: "2.3"
services:
cvat:
environment:
CVAT_SHARE_URL: "Mounted from the C:\Users\XX\Desktop\YY host directory"
volumes:

type: bind
source: "C:\Users\XX\Desktop\YY"
target: /home/django/share

So, is this configuration true for my enviroment?
BTW, thanks for answer.

Edit:
ERROR: create cvat_cvat_share: invalid option: "source"
This problem appers when I run that .yml file.

bsekachev · 2020-10-09T08:07:13Z

do I need to give path of WSL2 for windows

I suppose, yes. Since you run docker under WSL, you need to provide path in WSL.
BTW, we updated docker-compose version to 3.3 in develop branch, just for your information.

veer5551 · 2020-10-22T13:55:06Z

Hello,

Using CVAT directly in Windows 10 (without WSL).
Tried mounting data and encountered the following errors.

ERROR: for cvat Cannot create container for service cvat: failed to mount local volume: mount E:\e\cvat_data:/var/lib/docker/volumes/cvat_cvat_share/_data, flags: 0x1000: no such file or directory

My docker-compose.override.yml file

version: "2.3"
services:
  cvat_proxy:
    environment:
      CVAT_HOST: "localhost"

  cvat:
    environment:
      CVAT_SHARE_URL: "Mounted from /e/cvat_data host directory"
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    driver_opts:
      type: none
      device: /e/cvat_data
      o: bind

Tried all possible combinations for the paths representations, but still can't mount the storage!
Could you please have a look?

Thanks a lot!

jackneil · 2020-10-23T00:25:10Z

If you’re doing it with hyperv you need to go into docker and share that directory with the docker instance Jack Neil CEO / Hank AI, Inc. jack.neil@hank.ai (w) +1.904.GET.HANK (m) +1.803.466.7551 Sent via Superhuman iOS ( https://sprh.mn/?vip=jack.neil@hank.ai )

…

On Thu, Oct 22 2020 at 9:55 AM, veer5551 < ***@***.*** > wrote: Hello, Using CVAT directly in Windows 10 (without WSL). Tried mounting data and encountered the following errors. ERROR: for cvat Cannot create container for service cvat: failed to mount local volume: mount E:\e\cvat_data:/var/lib/docker/volumes/cvat_cvat_share/_data, flags: 0x1000: no such file or directory My docker-compose.override.yml file version: "2.3" services: cvat_proxy: environment: CVAT_HOST: "localhost" cvat: environment: CVAT_SHARE_URL: "Mounted from /e/cvat_data host directory" volumes: - cvat_share:/home/django/share:ro volumes: cvat_share: driver_opts: type: none device: /e/cvat_data o: bind Tried all possible combinations for the paths representations, but still can't mount the storage! Could you please have a look? Thanks a lot! — You are receiving this because you commented. Reply to this email directly, view it on GitHub ( #2263 (comment) ) , or unsubscribe ( https://github.com/notifications/unsubscribe-auth/AGFRM5SBP5S4UFISGMJAW4TSMA2VZANCNFSM4SF2PDRA ).

veer5551 · 2020-10-23T04:00:49Z

Yes @jackneil, that was the first thing I did.
I wonder, I was able to successfully mount Data with same override file with previous version of CVAT.

Need to look a little deeper into the issue I guess!
Thanks!

veer5551 · 2020-10-27T13:33:39Z

Hello,

Having hard time figuring it out!
Below is the Image showing Error + File Sharing enabled in Docker Desktop + compose.override file

Has any one figured it out?
Am missing something ?

Thanks a lot!

ChrisCurrin · 2020-10-29T21:41:38Z

this seemed to work for me:

create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

veer5551 · 2020-10-30T04:12:29Z

Hey @ChrisCurrin,
Thanks a lot!! That worked Effortlessly!
Saved me!

Thanks!

tralfamadude · 2021-02-24T21:06:11Z

I tried what is documented in https://github.com/openvinotoolkit/cvat/blob/master/cvat/apps/documentation/installation.md#share-path
and got "no data" in the Web UI when I picked the Connected File Share tab.

After excessive staring, head scratching, and ruling out other possible issues, I got the documented method to work. I simply had a service mixup (cvat vs cvat_proxy)... no error gets generated if you put a def in the wrong service, it just fails to work.

One thing that would be helpful is that
https://github.com/openvinotoolkit/cvat/blob/master/cvat/apps/documentation/installation.md#share-path
should mention that there must be some files in order for it to appear in the web UI.

ipesanz · 2021-06-09T00:29:04Z

In adition to @ChrisCurrin answer: Keep the cvat_share:/home/django/share:ro line as it is.... as it's referring to django and not your shared path

c00lcoder · 2021-10-07T09:59:02Z

this seemed to work for me:

1. create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

1. tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

What is the cbc in the path /home/cbc/my_shared_folder? I have a folder called "share" located at /c/share but can't get it to work...so troubleshooting

ChrisCurrin · 2021-10-10T10:27:19Z

"cbc" is just my linux username. If you're on windows, it may be "device=/mnt/c/share"

…

On Thu, 7 Oct 2021 at 11:59, c00lcoder ***@***.***> wrote: this seemed to work for me: 1. create a volume docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind 1. tell docker to search for a volume created externally # docker-compose.override.yml version: "3.3" services: cvat: environment: CVAT_SHARE_URL: "" volumes: - cvat_share:/home/django/share:ro volumes: cvat_share: external: true What is the cbc in the path /home/cbc/my_shared_folder? I have a folder called "share" located at /c/share but can't get it to work...so troubleshooting — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2263 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AB6RZ7RNCI3EO3WQLAY34YTUFVVPBANCNFSM4SF2PDRA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

c00lcoder · 2021-10-12T18:52:34Z

Thank you! This helped me figure out how to get it set up (switched to MAC) On Sun, Oct 10, 2021 at 6:27 AM Christopher ***@***.***> wrote:

…

"cbc" is just my linux username. If you're on windows, it may be "device=/mnt/c/share" On Thu, 7 Oct 2021 at 11:59, c00lcoder ***@***.***> wrote: > this seemed to work for me: > > 1. create a volume > > docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind > > 1. tell docker to search for a volume created externally > > # docker-compose.override.yml > version: "3.3" > > services: > cvat: > environment: > CVAT_SHARE_URL: "" > volumes: > - cvat_share:/home/django/share:ro > > volumes: > cvat_share: > external: true > > What is the cbc in the path /home/cbc/my_shared_folder? I have a folder > called "share" located at /c/share but can't get it to work...so > troubleshooting > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > < #2263 (comment) >, > or unsubscribe > < https://github.com/notifications/unsubscribe-auth/AB6RZ7RNCI3EO3WQLAY34YTUFVVPBANCNFSM4SF2PDRA > > . > Triage notifications on the go with GitHub Mobile for iOS > < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 > > or Android > < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub >. > > — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2263 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AVPH7PCSVIESKB44HBJM47LUGFTBJANCNFSM4SF2PDRA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

isudos · 2021-11-22T00:21:44Z

I did this:

this seemed to work for me:

create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

and got
ERROR: for 4925b50df6a1_cvat Cannot create container for service cvat: open /var/lib/docker/volumes/cvat_share/_data: permission denied

I tried to make it 777 and still got same error.
What can cause this?

EDIT: the directory I try to mount is s3 mounted to the system using fuse. It works fine with any other directory.

gamingflexer · 2022-11-27T06:37:16Z

This seemed to work for me on Mac M1:

In docker-compose.yml file i made the following changes and also thanks to @c00lcoder for the commands

In services & cvat_utils

    volumes:
      - cvat_data:/home/django/data
      - cvat_keys:/home/django/keys
      - cvat_logs:/home/django/logs
      - cvat_share:/home/django/share:ro

& added this

volumes:
  cvat_db:
  cvat_data:
  cvat_keys:
  cvat_logs:
  cvat_share:
    external: true

On terminal

docker volume create --name cvat_share --opt type=none --opt device=/Users/cosmos/Desktop/Projects/Resume Parser/img_annotations --opt o=bind

docker-compose up -d

Delete the container, prune other volumes if needed and restart docker if this fails

terancejiang · 2023-01-09T07:19:39Z

this seemed to work for me:

create a volume

docker volume create --name cvat_share --opt type=none --opt device=/home/cbc/my_shared_folder --opt o=bind

tell docker to search for a volume created externally

# docker-compose.override.yml
version: "3.3"

services:
  cvat:
    environment:
      CVAT_SHARE_URL: ""
    volumes:
      - cvat_share:/home/django/share:ro

volumes:
  cvat_share:
    external: true

work like a charm

aerdos · 2024-03-14T22:50:39Z

For some reason none of the above, or the official docs worked for me. Instead I had to use a combination.

Create a docker-compose.override.yml file in the cvat directory. Note that my definition of the volumes:cvat_share section differs from the official docs.

# docker-compose.override.yml
services:
    cvat_server:
        volumes:
            - cvat_share:/home/django/share:ro
    cvat_worker_import:
        volumes:
            - cvat_share:/home/django/share:ro
    cvat_worker_export:
        volumes:
            - cvat_share:/home/django/share:ro
    cvat_worker_annotation:
        volumes:
            - cvat_share:/home/django/share:ro

volumes:
    cvat_share:
        # this differs from the official docs
        external: true

Create a C:\work_share directory (modify as necessary) and create a Docker volume from it.

docker volume create --name cvat_share --opt type=none --opt device=C:\work_share --opt o=bind

Build

docker compose -f .\docker-compose.yml -f .\docker-compose.override.yml up -d --build

Not sure why the other ideas didn't work for me 🤷, insight appreciated.

azhavoro added the documentation Documentation should be updated label Oct 6, 2020

isudos mentioned this issue Nov 22, 2021

Can't mount shared folder if it is mounted s3 filesystem #3935

Closed

lschaupp mentioned this issue Dec 13, 2021

how to mount a share path for the big dataset in windows os. #1472

Open

kimlia545 mentioned this issue May 15, 2022

Error: Request failed with status code 500. "UnboundLocalError: local variable 'logger' referenced before assignment\n" #4555

Closed

himanshudw mentioned this issue Sep 17, 2022

Mounting connected file share issue #4965

Closed

omar-ogm mentioned this issue Oct 13, 2022

Cannot use mounted volume with s3fs (S3 bucket) with cvat #5110

Closed

2 tasks

bsekachev closed this as completed May 24, 2023

TKluwe mentioned this issue Jun 26, 2023

Cannot connect mounted share file #6378

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Can't mount data (share_path) #2263

Can't mount data (share_path) #2263

dasmehdix commented Oct 6, 2020

jackneil commented Oct 7, 2020 •

edited

Loading

dasmehdix commented Oct 8, 2020 •

edited

Loading

bsekachev commented Oct 9, 2020

veer5551 commented Oct 22, 2020

jackneil commented Oct 23, 2020 via email

veer5551 commented Oct 23, 2020

veer5551 commented Oct 27, 2020

ChrisCurrin commented Oct 29, 2020

veer5551 commented Oct 30, 2020

tralfamadude commented Feb 24, 2021 •

edited

Loading

ipesanz commented Jun 9, 2021

c00lcoder commented Oct 7, 2021

ChrisCurrin commented Oct 10, 2021 via email

c00lcoder commented Oct 12, 2021 via email

isudos commented Nov 22, 2021 •

edited

Loading

gamingflexer commented Nov 27, 2022

terancejiang commented Jan 9, 2023

aerdos commented Mar 14, 2024 •

edited

Loading

Can't mount data (share_path) #2263

Can't mount data (share_path) #2263

Comments

dasmehdix commented Oct 6, 2020

jackneil commented Oct 7, 2020 • edited Loading

dasmehdix commented Oct 8, 2020 • edited Loading

bsekachev commented Oct 9, 2020

veer5551 commented Oct 22, 2020

jackneil commented Oct 23, 2020 via email

veer5551 commented Oct 23, 2020

veer5551 commented Oct 27, 2020

ChrisCurrin commented Oct 29, 2020

veer5551 commented Oct 30, 2020

tralfamadude commented Feb 24, 2021 • edited Loading

ipesanz commented Jun 9, 2021

c00lcoder commented Oct 7, 2021

ChrisCurrin commented Oct 10, 2021 via email

c00lcoder commented Oct 12, 2021 via email

isudos commented Nov 22, 2021 • edited Loading

gamingflexer commented Nov 27, 2022

terancejiang commented Jan 9, 2023

aerdos commented Mar 14, 2024 • edited Loading

jackneil commented Oct 7, 2020 •

edited

Loading

dasmehdix commented Oct 8, 2020 •

edited

Loading

tralfamadude commented Feb 24, 2021 •

edited

Loading

isudos commented Nov 22, 2021 •

edited

Loading

aerdos commented Mar 14, 2024 •

edited

Loading