Skip to content
This repository has been archived by the owner on May 20, 2022. It is now read-only.

DB Docker building error #463

Open
allanesquina opened this issue Apr 8, 2020 · 8 comments
Open

DB Docker building error #463

allanesquina opened this issue Apr 8, 2020 · 8 comments

Comments

@allanesquina
Copy link

Hi folks,
I'm getting a package error when installing Wal-e on DB Docker.
Good job btw, thanks.

NAME="Ubuntu"
VERSION="18.04.3 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.3 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic

Executing busybox-1.31.1-r9.trigger                                                                                                                                                                                
Executing ca-certificates-20191127-r1.trigger                                                                                                                                                                      OK: 349 MiB in 77 packages                                                                                                                                                                                         Collecting wal-e<1.0.0                                                                                                                                                                                               Downloading https://files.pythonhosted.org/packages/7a/67/4da340652303e3adb26f6e9aa97b2118dbe5cd17be87e8a21dff9e9bc507/wal-e-0.9.2.tar.gz (100kB)                                                                Collecting envdir                                                                                                                                                                                                    Downloading https://files.pythonhosted.org/packages/75/dd/817dc77edf4807fc2c29e28046ab83aa7ccfe27e79d24ca37d7aaa1e36bb/envdir-1.0.1-py2.py3-none-any.whl                                                         Collecting gevent>=1.0.2 (from wal-e<1.0.0)                                                                                                                                                                          Downloading https://files.pythonhosted.org/packages/ed/27/6c49b70808f569b66ec7fac2e78f076e9b204db9cf5768740cff3d5a07ae/gevent-1.4.0.tar.gz (5.2MB)                                                               Collecting boto>=2.24.0 (from wal-e<1.0.0)                                                                                                                                                                           Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB)                                                  Collecting azure>=0.7.0 (from wal-e<1.0.0)                                                                                                                                                                           Downloading https://files.pythonhosted.org/packages/e8/48/ef73d5e71ecb84cacaeaf533f519be81825ad6198acc41bd821f440e7f7c/azure-5.0.0.zip                                                                               Complete output from command python setup.py egg_info:                                                                                                                                                             Traceback (most recent call last):                                                                                                                                                                                   File "<string>", line 1, in <module>                                                                                                                                                                               File "/tmp/pip-install-w__KHv/azure/setup.py", line 60, in <module>                                                                                                                                                  raise RuntimeError(message)                                                                                                                                                                                    RuntimeError:                                                                                                                                                                                                                                                                                                                                                                                                                         Starting with v5.0.0, the 'azure' meta-package is deprecated and cannot be installed anymore.                                                                                                                      Please install the service specific packages prefixed by `azure` needed for your application.                                                                                                                                                                                                                                                                                                                                         The complete list of available packages can be found at:                                                                                                                                                           https://aka.ms/azsdk/python/all                                                                                                                                                                                                                                                                                                                                                                                                       Here's a non-exhaustive list of common packages:                                                                                                                                                               
                                                                                                                                                                                                                   
    -  azure-mgmt-compute (https://pypi.python.org/pypi/azure-mgmt-compute) : Management of Virtual Machines, etc.                                                                                                 
    -  azure-mgmt-storage (https://pypi.python.org/pypi/azure-mgmt-storage) : Management of storage accounts.                                                                                                      
    -  azure-mgmt-resource (https://pypi.python.org/pypi/azure-mgmt-resource) : Generic package about Azure Resource Management (ARM)                                                                              
    -  azure-keyvault-secrets (https://pypi.python.org/pypi/azure-keyvault-secrets) : Access to secrets in Key Vault                                                                                               
    -  azure-storage-blob (https://pypi.python.org/pypi/azure-storage-blob) : Access to blobs in storage accounts                                                                                                  

    A more comprehensive discussion of the rationale for this decision can be found in the following issue:
    https://github.com/Azure/azure-sdk-for-python/issues/10646



    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-w__KHv/azure/
ERROR: Service 'db' failed to build: The command '/bin/sh -c apk add --no-cache       build-base       curl       libc6-compat       libffi-dev       linux-headers       python-dev       py-pip       py-cryptogr
aphy       pv       libressl-dev     && pip --no-cache-dir install 'wal-e<1.0.0' envdir     && rm -rf /var/cache/apk/* /tmp/* /var/tmp/*' returned a non-zero code: 1
@nvjacobo
Copy link
Contributor

nvjacobo commented Apr 9, 2020

hi @allanesquina

I have experienced the same issue

My setup

  • Debian 10
  • Docker version 19.03.8, build afacb8b7f0
  • docker-compose version 1.21.0
Collecting wal-e<1.0.0
  Downloading https://files.pythonhosted.org/packages/7a/67/4da340652303e3adb26f6e9aa97b2118dbe5cd17be87e8a21dff9e9bc507/wal-e-0.9.2.tar.gz (100kB)
Collecting envdir
  Downloading https://files.pythonhosted.org/packages/75/dd/817dc77edf4807fc2c29e28046ab83aa7ccfe27e79d24ca37d7aaa1e36bb/envdir-1.0.1-py2.py3-none-any.whl
Collecting gevent>=1.0.2 (from wal-e<1.0.0)
  Downloading https://files.pythonhosted.org/packages/ed/27/6c49b70808f569b66ec7fac2e78f076e9b204db9cf5768740cff3d5a07ae/gevent-1.4.0.tar.gz (5.2MB)
Collecting boto>=2.24.0 (from wal-e<1.0.0)
  Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB)
Collecting azure>=0.7.0 (from wal-e<1.0.0)
  Downloading https://files.pythonhosted.org/packages/e8/48/ef73d5e71ecb84cacaeaf533f519be81825ad6198acc41bd821f440e7f7c/azure-5.0.0.zip
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-_AUrmA/azure/setup.py", line 60, in <module>
        raise RuntimeError(message)
    RuntimeError:
    
    Starting with v5.0.0, the 'azure' meta-package is deprecated and cannot be installed anymore.
    Please install the service specific packages prefixed by `azure` needed for your application.
    
    The complete list of available packages can be found at:
    https://aka.ms/azsdk/python/all
    
    Here's a non-exhaustive list of common packages:
    
    -  azure-mgmt-compute (https://pypi.python.org/pypi/azure-mgmt-compute) : Management of Virtual Machines, etc.
    -  azure-mgmt-storage (https://pypi.python.org/pypi/azure-mgmt-storage) : Management of storage accounts.
    -  azure-mgmt-resource (https://pypi.python.org/pypi/azure-mgmt-resource) : Generic package about Azure Resource Management (ARM)
    -  azure-keyvault-secrets (https://pypi.python.org/pypi/azure-keyvault-secrets) : Access to secrets in Key Vault
    -  azure-storage-blob (https://pypi.python.org/pypi/azure-storage-blob) : Access to blobs in storage accounts
    
    A more comprehensive discussion of the rationale for this decision can be found in the following issue:
    https://github.com/Azure/azure-sdk-for-python/issues/10646
    
    
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-_AUrmA/azure/
ERROR: Service 'db' failed to build: The command '/bin/sh -c apk add --no-cache       build-base       curl       libc6-compat       libffi-dev       linux-headers       python-dev       py-pip       py-cryptography       pv       libressl-dev     && pip --no-cache-dir install 'wal-e<1.0.0' envdir     && rm -rf /var/cache/apk/* /tmp/* /var/tmp/*' returned a non-zero code: 1

@swagner74
Copy link

+1, same issue.

@yannhowe
Copy link

yannhowe commented Apr 9, 2020

+1, same issue.
ubuntu 18.04
docker 19.03.8
docker-compose version 1.25.4, build 8d51620a

Looks like something to do with wal-e 1.0.0 which relies on azure

@salsudais
Copy link

salsudais commented Apr 9, 2020 •
edited
Loading

Same issue here, as workaround we had to update the db Dockerfile to:

RUN echo "azure<5.0.0" > pip-constraints.txt
RUN pip --no-cache-dir install -c pip-constraints.txt 'wal-e<1.0.0' envdir \
     && rm -rf /var/cache/apk/* /tmp/* /var/tmp/*

@ahmaddanialmohd
Copy link

Hi, everyone.

I am also running into the same issue based on the output that I am getting here:

Ahmad-Danials-MacBook-Pro:mattermost-docker ahmaddanialmohammad$ docker-compose build
Building db
Step 1/9 : FROM postgres:9.4-alpine
 ---> 60692ae58e72
Step 2/9 : ENV DEFAULT_TIMEZONE UTC
 ---> Using cache
 ---> 5c822e3114e0
Step 3/9 : RUN apk add --no-cache       build-base       curl       libc6-compat       libffi-dev       linux-headers       python-dev       py-pip       py-cryptography       pv       libressl-dev     && pip --no-cache-dir install 'wal-e<1.0.0' envdir     && rm -rf /var/cache/apk/* /tmp/* /var/tmp/*
 ---> Running in 6e49c295fb20
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz
(1/56) Upgrading musl (1.1.20-r4 -> 1.1.20-r5)
(2/56) Installing binutils (2.31.1-r2)
(3/56) Installing libmagic (5.36-r1)
(4/56) Installing file (5.36-r1)
(5/56) Installing gmp (6.1.2-r1)
(6/56) Installing isl (0.18-r0)
(7/56) Installing libgomp (8.3.0-r0)
(8/56) Installing libatomic (8.3.0-r0)
(9/56) Installing libgcc (8.3.0-r0)
(10/56) Installing mpfr3 (3.1.5-r1)
(11/56) Installing mpc1 (1.0.3-r1)
(12/56) Installing libstdc++ (8.3.0-r0)
(13/56) Installing gcc (8.3.0-r0)
(14/56) Installing musl-dev (1.1.20-r5)
(15/56) Installing libc-dev (0.7.1-r0)
(16/56) Installing g++ (8.3.0-r0)
(17/56) Installing make (4.2.1-r2)
(18/56) Installing fortify-headers (1.0-r0)
(19/56) Installing build-base (0.5-r1)
(20/56) Installing ca-certificates (20190108-r0)
(21/56) Installing nghttp2-libs (1.35.1-r1)
(22/56) Installing libssh2 (1.9.0-r1)
(23/56) Installing libcurl (7.64.0-r3)
(24/56) Installing curl (7.64.0-r3)
(25/56) Upgrading musl-utils (1.1.20-r4 -> 1.1.20-r5)
(26/56) Installing libc6-compat (1.1.20-r5)
(27/56) Installing linux-headers (4.18.13-r1)
(28/56) Installing libffi (3.2.1-r6)
(29/56) Installing pkgconf (1.6.0-r0)
(30/56) Installing libffi-dev (3.2.1-r6)
(31/56) Installing libressl2.7-libcrypto (2.7.5-r0)
(32/56) Installing libressl2.7-libssl (2.7.5-r0)
(33/56) Installing libressl2.7-libtls (2.7.5-r0)
(34/56) Installing libressl-dev (2.7.5-r0)
(35/56) Installing pv (1.6.6-r1)
(36/56) Installing py-cffi (1.11.5-r0)
(37/56) Installing py-idna (2.7-r0)
(38/56) Installing py-asn1crypto (0.24.0-r0)
(39/56) Installing py-six (1.12.0-r0)
(40/56) Installing py-cryptography (2.4.2-r2)
(41/56) Installing libbz2 (1.0.6-r7)
(42/56) Installing expat (2.2.8-r0)
(43/56) Installing gdbm (1.13-r1)
(44/56) Installing sqlite-libs (3.28.0-r2)
(45/56) Installing python2 (2.7.16-r2)
(46/56) Installing py2-idna (2.7-r0)
(47/56) Installing py2-six (1.12.0-r0)
(48/56) Installing py2-asn1crypto (0.24.0-r0)
(49/56) Installing py2-cparser (2.19-r0)
(50/56) Installing py2-cffi (1.11.5-r0)
(51/56) Installing py2-ipaddress (1.0.22-r0)
(52/56) Installing py-enum34 (1.1.6-r2)
(53/56) Installing py2-cryptography (2.4.2-r2)
(54/56) Installing py-setuptools (40.6.3-r0)
(55/56) Installing py2-pip (18.1-r0)
(56/56) Installing python2-dev (2.7.16-r2)
Executing busybox-1.29.3-r10.trigger
Executing ca-certificates-20190108-r0.trigger
OK: 274 MiB in 82 packages
Collecting wal-e<1.0.0
  Downloading https://files.pythonhosted.org/packages/7a/67/4da340652303e3adb26f6e9aa97b2118dbe5cd17be87e8a21dff9e9bc507/wal-e-0.9.2.tar.gz (100kB)
Collecting envdir
  Downloading https://files.pythonhosted.org/packages/75/dd/817dc77edf4807fc2c29e28046ab83aa7ccfe27e79d24ca37d7aaa1e36bb/envdir-1.0.1-py2.py3-none-any.whl
Collecting gevent>=1.0.2 (from wal-e<1.0.0)
  Downloading https://files.pythonhosted.org/packages/5a/79/2c63d385d017b5dd7d70983a463dfd25befae70c824fedb857df6e72eff2/gevent-1.5.0.tar.gz (5.3MB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
Collecting boto>=2.24.0 (from wal-e<1.0.0)
  Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB)
Collecting azure>=0.7.0 (from wal-e<1.0.0)
  Downloading https://files.pythonhosted.org/packages/e8/48/ef73d5e71ecb84cacaeaf533f519be81825ad6198acc41bd821f440e7f7c/azure-5.0.0.zip
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-lHA6Cd/azure/setup.py", line 60, in <module>
        raise RuntimeError(message)
    RuntimeError:

    Starting with v5.0.0, the 'azure' meta-package is deprecated and cannot be installed anymore.
    Please install the service specific packages prefixed by `azure` needed for your application.

    The complete list of available packages can be found at:
    https://aka.ms/azsdk/python/all

    Here's a non-exhaustive list of common packages:

    -  azure-mgmt-compute (https://pypi.python.org/pypi/azure-mgmt-compute) : Management of Virtual Machines, etc.
    -  azure-mgmt-storage (https://pypi.python.org/pypi/azure-mgmt-storage) : Management of storage accounts.
    -  azure-mgmt-resource (https://pypi.python.org/pypi/azure-mgmt-resource) : Generic package about Azure Resource Management (ARM)
    -  azure-keyvault-secrets (https://pypi.python.org/pypi/azure-keyvault-secrets) : Access to secrets in Key Vault
    -  azure-storage-blob (https://pypi.python.org/pypi/azure-storage-blob) : Access to blobs in storage accounts

    A more comprehensive discussion of the rationale for this decision can be found in the following issue:
    https://github.com/Azure/azure-sdk-for-python/issues/10646



    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-lHA6Cd/azure/
ERROR: Service 'db' failed to build: The command '/bin/sh -c apk add --no-cache       build-base       curl       libc6-compat       libffi-dev       linux-headers       python-dev       py-pip       py-cryptography       pv       libressl-dev     && pip --no-cache-dir install 'wal-e<1.0.0' envdir     && rm -rf /var/cache/apk/* /tmp/* /var/tmp/*' returned a non-zero code: 1

These are the details of my Docker running on Mac 10.15.4:

Ahmad-Danials-MacBook-Pro:mattermost-docker ahmaddanialmohammad$ docker version
Client: Docker Engine - Community
 Version:           19.03.8
 API version:       1.40
 Go version:        go1.12.17
 Git commit:        afacb8b
 Built:             Wed Mar 11 01:21:11 2020
 OS/Arch:           darwin/amd64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          19.03.8
  API version:      1.40 (minimum version 1.12)
  Go version:       go1.12.17
  Git commit:       afacb8b
  Built:            Wed Mar 11 01:29:16 2020
  OS/Arch:          linux/amd64
  Experimental:     true
 containerd:
  Version:          v1.2.13
  GitCommit:        7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc:
  Version:          1.0.0-rc10
  GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
 docker-init:
  Version:          0.18.0
  GitCommit:        fec3683

@nin0-0
Copy link

nin0-0 commented Apr 13, 2020 •
edited
Loading

I've commented all Wal-e lines in my db/Dockerfile and so it builds, but the db container keeps restarting

This is in the db container logs, though seems irrelevant?

WALE_S3_PREFIX is required for Wal-E but not set. Skipping Wal-E setup.
AWS_REGION is required for Wal-E but not set. Skipping Wal-E setup.

I run on azure VM.

This was my specific error upon building:

  Downloading https://files.pythonhosted.org/packages/e8/48/ef73d5e71ecb84cacaeaf533f519be81825ad6198acc41bd821f440e7f7c/azure-5.0.0.zip
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-W3qAB_/azure/setup.py", line 60, in <module>
        raise RuntimeError(message)
    RuntimeError:

   Starting with v5.0.0, the 'azure' meta-package is deprecated and cannot be installed anymore.
    Please install the service specific packages prefixed by azure needed for your application.

  The complete list of available packages can be found at:
    https://aka.ms/azsdk/python/all
    
Here's a non-exhaustive list of common packages:
    
azure-mgmt-compute (https://pypi.python.org/pypi/azure-mgmt-compute) : Management of Virtual Machines, etc.
azure-mgmt-storage (https://pypi.python.org/pypi/azure-mgmt-storage) : Management of storage accounts.
azure-mgmt-resource (https://pypi.python.org/pypi/azure-mgmt-resource) : Generic package about Azure Resource Management (ARM)
azure-keyvault-secrets (https://pypi.python.org/pypi/azure-keyvault-secrets) : Access to secrets in Key Vault
azure-storage-blob (https://pypi.python.org/pypi/azure-storage-blob) : Access to blobs in storage accounts A more comprehensive discussion of the rationale for this decision can be found in the following issue:
https://github.com/Azure/azure-sdk-for-python/issues/10646

Also have to add libressl-dev in the Dockerfile manually since some time.

I updated the certs in web/cert/ just before, but when I run docker-compose without -d it seems to accept the certs.

For completeness, my current db/Dockerfile

$ cat db/Dockerfile 
FROM postgres:9.4-alpine

ENV DEFAULT_TIMEZONE UTC

# Install some packages to use WAL
RUN apk add --no-cache \
      build-base \
      curl \
      libc6-compat \
      libressl-dev \
      libffi-dev \
      linux-headers \
      python-dev \
      py-pip \
      py-cryptography \
      pv \
    #&& pip --no-cache-dir install 'wal-e<1.0.0' envdir \
    && rm -rf /var/cache/apk/* /tmp/* /var/tmp/*

# Add wale script
#COPY setup-wale.sh /docker-entrypoint-initdb.d/

#Healthcheck to make sure container is ready
HEALTHCHECK CMD pg_isready -U $POSTGRES_USER -d $POSTGRES_DB || exit 1

# Add and configure entrypoint and command
COPY entrypoint.sh /
ENTRYPOINT ["/entrypoint.sh"]
CMD ["postgres"]

VOLUME ["/var/run/postgresql", "/usr/share/postgresql/", "/var/lib/postgresql/data", "/tmp"]

@nin0-0
Copy link

nin0-0 commented Apr 13, 2020 

app_1  | Configure database connection...OK
app_1  | Starting mattermost
app_1  | {"level":"error","ts":1586784277.797079,"caller":"sqlstore/supplier.go:236","msg":"Failed to ping DB retrying in 10 seconds err=dial tcp: lookup db on 127.0.0.11:53: no such host"}
app_1  | {"level":"error","ts":1586784287.854749,"caller":"sqlstore/supplier.go:236","msg":"Failed to ping DB retrying in 10 seconds err=dial tcp: lookup db on 127.0.0.11:53: no such host"}
app_1  | {"level":"error","ts":1586784297.8858087,"caller":"sqlstore/supplier.go:236","msg":"Failed to ping DB retrying in 10 seconds err=dial tcp: lookup db on 127.0.0.11:53: no such host"}
web_1  | found certificate and key, linking ssl config
web_1  | 2020/04/13 13:24:36 [warn] 1#1: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /etc/nginx/conf.d/mattermost.conf:15
web_1  | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /etc/nginx/conf.d/mattermost.conf:15

is that sqlstore/supplier.go a bug, bc am using pgsql?

@meizenga
Copy link

Add this line in db/Dockerfile
&& pip --no-cache-dir install 'azure==4.0.0' envdir \

so the file looks like this:

&& pip --no-cache-dir install 'azure==4.0.0' envdir \
&& pip --no-cache-dir install 'wal-e<1.0.0' envdir \

After that it build fine

cpanato pushed a commit that referenced this issue Apr 15, 2020
@nvjacobo
docker-compose: fix DB Docker building error #463 related wal-e 1.0.0…
7fd2eb4 
… and azure (#464)
@ahmaddanialmohd ahmaddanialmohd mentioned this issue Apr 16, 2020
Open
nickygerritsen added a commit to Lets-Talk-NL/mattermost-docker that referenced this issue Jun 29, 2020
@nickygerritsen
Merge remote-tracking branch 'upstream/master'
c6ec708 
* upstream/master: (54 commits)
  bump to 5.24.2
  bump MM to 5.24.1
  bump MM to 5.24.0
  Update Dockerfile (mattermost#476)
  Add ?src=docker-app query parameter to identify download source (mattermost#475)
  bump docker app to 5.23.0
  Fix : certificate signed by unknown authority refs : mattermost/mattermost#13059 (mattermost#474)
  bump app dockerfile to 5.22.3
  Fixing docker-compose build process (mattermost#471)
  bump mm to 5.22.1
  Update Dockerfile (mattermost#467)
  docker-compose: fix DB Docker building error  mattermost#463 related wal-e 1.0.0 and azure (mattermost#464)
  allow uncommenting for team edition (mattermost#433)
  Fix the linking of the nginx configuration file (mattermost#458)
  docker-compose: remove unused ENV variable (mattermost#456)
  bump mm prod app to 5.21.0
  bump mm prod app to 5.20.2
  web entrypoint: forcefully link existing config (mattermost#454)
  Remove deprecated nginx ssl directive (mattermost#451) (mattermost#452)
  bump mm prod app to 5.20.1
  ...
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@nvjacobo @allanesquina @nin0-0 @yannhowe @meizenga @ahmaddanialmohd @salsudais @swagner74