Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changed the conda tool used in the dockerfile #497

Merged
merged 1 commit into from
Dec 9, 2024

Conversation

itutu-tienday
Copy link
Collaborator

Content

Changed the conda tool used in the dockerfile from miniconda to miniforge

  • Purpose:
    • Countermeasure for caiman's conda environment construction error
    • Speed up conda command operation

Testcase

  • docker on macos (15)
    • build docker image
    • run workflow
      • caiman
      • suite2p
  • docker on ubuntu (22)
    • build docker image
    • run workflow
      • caiman
      • suite2p

@itutu-tienday itutu-tienday linked an issue Dec 3, 2024 that may be closed by this pull request
@milesAraya
Copy link
Collaborator

milesAraya commented Dec 5, 2024

docker on macos

  • build docker image
    run workflow
    • caiman
    • suite2p
 git checkout feature/dockerfile-conda-tool-update
  docker compose -f docker-compose.dev.yml up  

WARN[0000] /Users/milesd/GitRepos/barebone-studio/docker-compose.dev.yml: the attribute version is obsolete, it will be ignored, please remove it to avoid potential confusion
[+] Running 5/5
✔ studio-dev-fe Pulled 28.5s
✔ 579b34f0a95b Download complete 1.6s
✔ 4927cb899c33 Download complete 1.6s
✔ 2a2799ae89a2 Download complete 3.5s
✔ 7b3f8039e3c4 Download complete 18.5s
[+] Building 590.2s (18/18) FINISHED docker-container:amd64-builder
=> [studio-dev-be internal] load build definition from Dockerfile.dev 0.0s
=> => transferring dockerfile: 1.52kB 0.0s
=> WARN: FromPlatformFlagConstDisallowed: FROM --platform flag should not use constant value "linux/amd64" (line 1) 0.0s
=> [studio-dev-be internal] load metadata for docker.io/library/python:3.8.20-slim 3.1s
=> [studio-dev-be internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [studio-dev-be 1/11] FROM docker.io/library/python:3.8.20-slim@sha256:1d52838af602b4b5a831beb13a0e4d073280665ea7be7f69ce2382f29c5a613f 0.0s
=> => resolve docker.io/library/python:3.8.20-slim@sha256:1d52838af602b4b5a831beb13a0e4d073280665ea7be7f69ce2382f29c5a613f 0.0s
=> [studio-dev-be internal] load build context 0.2s
=> => transferring context: 282.52kB 0.2s
=> CACHED [studio-dev-be 2/11] WORKDIR /app 0.0s
=> CACHED [studio-dev-be 3/11] RUN apt-get --allow-releaseinfo-change update && apt-get install --no-install-recommends -y sudo procps iproute2 iputils 0.0s
=> [studio-dev-be 4/11] RUN apt-get install --no-install-recommends -y gcc g++ libgl1 libgl1-mesa-dev libopencv-dev && apt-get autoremove -y && apt-g 202.5s
=> [studio-dev-be 5/11] RUN mkdir -p /opt/miniforge && curl -L "https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-$(uname) 101.3s
=> [studio-dev-be 6/11] RUN echo 'alias ll="ls -la --color=auto"' >> /root/.bashrc && echo 'set nu ic hls nowrap ts=4 sw=4 | syntax on' >> /root/.vimrc 0.4s
=> [studio-dev-be 7/11] COPY pyproject.toml poetry.lock ./ 0.0s
=> [studio-dev-be 8/11] RUN pip3 install --no-cache-dir --upgrade pip && pip3 install poetry && poetry config virtualenvs.create false 41.9s
=> [studio-dev-be 9/11] RUN poetry install --no-root --with dev 85.9s
=> [studio-dev-be 10/11] COPY studio/app/optinist/wrappers/caiman/run_download_model_files.sh ./ 0.3s
=> [studio-dev-be 11/11] RUN bash run_download_model_files.sh && rm run_download_model_files.sh 49.9s
=> [studio-dev-be] exporting to oci image format 104.5s
=> => exporting layers 69.7s
=> => exporting manifest sha256:cad3614d2f4a4ef4d243f4588a99d9472b38800f60485d353df09284aa996bdd 0.0s
=> => exporting config sha256:e84b05eb8b00b9656185cf8d01efae95a168294b63c4d86aab844efbd3d12f41 0.0s
=> => sending tarball 34.8s
=> [studio-dev-be] importing to docker 0.0s
=> [studio-dev-be] resolving provenance for metadata file 0.0s
[+] Running 3/3
✔ Network barebone-studio_default Created0.1s iner barebone-studio-studio-dev-be-1 Creating 42.4s
⠼ Container barebone-studio-studio-dev-be-1 Crea[+] Running 4/4
✔ Network barebone-studio_default Created0.1s
✔ Container barebone-studio-studio-dev-be-1 Created42.5s
✔ Container barebone-studio-studio-dev-fe-1 Created0.2s
! studio-dev-be The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested 0.0s
Attaching to studio-dev-be-1, studio-dev-fe-1
studio-dev-fe-1 | yarn install v1.22.19
studio-dev-fe-1 | [1/5] Validating package.json...
studio-dev-fe-1 | [2/5] Resolving packages...
studio-dev-fe-1 | [3/5] Fetching packages...
studio-dev-be-1 | Skipping virtualenv creation, as specified in config file.
studio-dev-be-1 | 2024-12-05 14:04:08,833 INFO: [uvicorn.error] init():339 - Will watch for changes in these directories: ['/app/studio']
studio-dev-be-1 | 2024-12-05 14:04:08,890 INFO: [uvicorn.error] bind_socket():571 - Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
studio-dev-be-1 | 2024-12-05 14:04:08,893 INFO: [uvicorn.error] startup():77 - Started reloader process [1] using StatReload
studio-dev-be-1 | 2024-12-05 14:04:28,514 INFO: [uvicorn.error] serve():76 - Started server process [27]
studio-dev-be-1 | 2024-12-05 14:04:28,517 INFO: [uvicorn.error] startup():46 - Waiting for application startup.
studio-dev-be-1 | 2024-12-05 14:04:28,560 INFO: [optinist] lifespan():44 - "Studio" application startup complete. [mode: multiuser]
studio-dev-be-1 | 2024-12-05 14:04:28,563 INFO: [uvicorn.error] startup():60 - Application startup complete.
studio-dev-fe-1 | [4/5] Linking dependencies...
studio-dev-fe-1 | warning " > @mui/x-data-grid@6.20.4" has unmet peer dependency "@mui/system@^5.4.1".
studio-dev-fe-1 | warning " > @mui/x-tree-view@6.17.0" has unmet peer dependency "@mui/system@^5.8.0".
studio-dev-fe-1 | warning " > @testing-library/user-event@14.5.2" has unmet peer dependency "@testing-library/dom@>=7.21.4".
studio-dev-fe-1 | warning "notistack > goober@2.1.16" has unmet peer dependency "csstype@^3.0.10".
studio-dev-fe-1 | warning "plotly.js > style-loader@4.0.0" has unmet peer dependency "webpack@^5.27.0".
studio-dev-fe-1 | warning "plotly.js > @plotly/mapbox-gl > @mapbox/mapbox-gl-supported@1.5.0" has unmet peer dependency "mapbox-gl@>=0.32.1 <2.0.0".
studio-dev-fe-1 | warning " > react-plotlyjs-ts@2.2.2" has incorrect peer dependency "plotly.js@^1.31.2".
studio-dev-fe-1 | warning " > react-plotlyjs-ts@2.2.2" has incorrect peer dependency "react@^16.0.0".
studio-dev-fe-1 | warning " > react-plotlyjs-ts@2.2.2" has incorrect peer dependency "react-dom@^16.0.0".
studio-dev-fe-1 | warning " > react-plotlyjs-ts@2.2.2" has incorrect peer dependency "typescript@^2.5.3".
studio-dev-fe-1 | warning "react-scripts > eslint-config-react-app > eslint-plugin-flowtype@8.0.3" has unmet peer dependency "@babel/plugin-syntax-flow@^7.14.5".
studio-dev-fe-1 | warning "react-scripts > eslint-config-react-app > eslint-plugin-flowtype@8.0.3" has unmet peer dependency "@babel/plugin-transform-react-jsx@^7.14.9".
studio-dev-fe-1 | warning " > redux-mock-store@1.5.5" has unmet peer dependency "redux@*".
studio-dev-fe-1 | [5/5] Building fresh packages...
studio-dev-fe-1 | $ cd .. && husky install frontend/.husky && chmod ug+x frontend/.husky/pre-commit
studio-dev-fe-1 | husky - git command not found, skipping install
studio-dev-fe-1 | Done in 520.23s.
studio-dev-fe-1 | yarn run v1.22.19
studio-dev-fe-1 | $ node export-versions.js
studio-dev-fe-1 | $ react-app-rewired start --scripts-version react-scripts
studio-dev-fe-1 | (node:1617) [DEP_WEBPACK_DEV_SERVER_ON_AFTER_SETUP_MIDDLEWARE] DeprecationWarning: 'onAfterSetupMiddleware' option is deprecated. Please use the 'setupMiddlewares' option.
studio-dev-fe-1 | (Use node --trace-deprecation ... to show where the warning was created)
studio-dev-fe-1 | (node:1617) [DEP_WEBPACK_DEV_SERVER_ON_BEFORE_SETUP_MIDDLEWARE] DeprecationWarning: 'onBeforeSetupMiddleware' option is deprecated. Please use the 'setupMiddlewares' option.
studio-dev-fe-1 | Starting the development server...
studio-dev-fe-1 |
studio-dev-fe-1 | Compiled with warnings.
studio-dev-fe-1 |
studio-dev-fe-1 | Failed to parse source map from '/app/frontend/node_modules/@plotly/mapbox-gl/dist/mapbox-gl-unminified.js.map' file: Error: ENOENT: no such file or directory, open '/app/frontend/node_modules/@plotly/mapbox-gl/dist/mapbox-gl-unminified.js.map'
studio-dev-fe-1 |
studio-dev-fe-1 | Search for the keywords to learn more about each warning.
studio-dev-fe-1 | To ignore, add // eslint-disable-next-line to the line before.
studio-dev-fe-1 |
studio-dev-fe-1 | WARNING in ./node_modules/@plotly/mapbox-gl/dist/mapbox-gl-unminified.js
studio-dev-fe-1 | Module Warning (from ./node_modules/source-map-loader/dist/cjs.js):
studio-dev-fe-1 | Failed to parse source map from '/app/frontend/node_modules/@plotly/mapbox-gl/dist/mapbox-gl-unminified.js.map' file: Error: ENOENT: no such file or directory, open '/app/frontend/node_modules/@plotly/mapbox-gl/dist/mapbox-gl-unminified.js.map'
studio-dev-fe-1 |
studio-dev-fe-1 | webpack compiled with 1 warning
studio-dev-fe-1 | No issues found.

Screenshot 2024-12-05 at 14 33 51 image

@milesAraya milesAraya merged commit a9cd9af into develop-main Dec 9, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cannot Run Caiman Workflow Because of Dependencies Problem.
2 participants