Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rewrite ./site.sh to Python #2

Closed
4 of 7 tasks
j143 opened this issue Apr 21, 2021 · 1 comment
Closed
4 of 7 tasks

Rewrite ./site.sh to Python #2

j143 opened this issue Apr 21, 2021 · 1 comment
Milestone
sh-to-python script

Comments

@j143
Copy link
Owner

j143 commented Apr 21, 2021 •
edited
Loading

Tasks

  • 1. Create a python template for the script
  • 2. Run a basic setup of docker
  • 3. Implement logging
  • 4. Interaction between docker container and script
  • 5. Run commands inside the docker container
  • 6. How to check whether a command exists

setup tasks
@j143
Copy link
Owner Author

j143 commented Nov 18, 2021

logs:

gitpod /workspace/airflow-site $ python site.py build-image
Executing: docker build -t airflow-site .

Sending build context to Docker daemon  5.632kB
Step 1/9 : FROM debian:stretch-slim
stretch-slim: Pulling from library/debian
89166b5eeae4: Pull complete 
Digest: sha256:d8566545bd3750e270b8aaf703d0a048fda080cd287a249823a5a11b7c95adbf
Status: Downloaded newer image for debian:stretch-slim
 ---> a692eb442a03
Step 2/9 : SHELL ["/bin/bash", "-o", "pipefail", "-e", "-u", "-x", "-c"]
 ---> Running in fadc3eb16811
Removing intermediate container fadc3eb16811
 ---> 5b77461a2f0e
Step 3/9 : ENV DEBIAN_FRONTEND=noninteractive     LANGUAGE=C.UTF-8     LANG=C.UTF-8     LC_ALL=C.UTF-8     LC_CTYPE=C.UTF-8     LC_MESSAGES=C.UTF-8
 ---> Running in 6ba45be738c7
Removing intermediate container 6ba45be738c7
 ---> c2133eb6d64d
Step 4/9 : RUN apt-get update     && apt-get install -y --no-install-recommends         ca-certificates         curl         git         gnupg2         gosu         lynx     && apt-get autoremove -yqq --purge     && apt-get clean     && rm -rf /var/lib/apt/lists/*
 ---> Running in 3fb098fffe03
+ apt-get update
Ign:1 http://deb.debian.org/debian stretch InRelease
Get:2 http://security.debian.org/debian-security stretch/updates InRelease [53.0 kB]
Get:3 http://deb.debian.org/debian stretch-updates InRelease [93.6 kB]
Get:4 http://deb.debian.org/debian stretch Release [118 kB]
Get:5 http://deb.debian.org/debian stretch Release.gpg [3177 B]
Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [743 kB]
Get:7 http://deb.debian.org/debian stretch/main amd64 Packages [7080 kB]
Fetched 8090 kB in 1s (5835 kB/s)
Reading package lists...
+ apt-get install -y --no-install-recommends ca-certificates curl git gnupg2 gosu lynx
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  git-man gnupg gnupg-agent libassuan0 libbsd0 libcurl3 libcurl3-gnutls
  liberror-perl libexpat1 libffi6 libgdbm3 libgmp10 libgnutls30
  libgssapi-krb5-2 libhogweed4 libidn11 libidn2-0 libk5crypto3 libkeyutils1
  libkrb5-3 libkrb5support0 libksba8 libldap-2.4-2 libldap-common libnettle6
  libnghttp2-14 libnpth0 libp11-kit0 libperl5.24 libpsl5 libreadline7 librtmp1
  libsasl2-2 libsasl2-modules-db libsqlite3-0 libssh2-1 libssl1.0.2 libssl1.1
  libtasn1-6 libunistring0 lynx-common openssl perl perl-modules-5.24
  pinentry-curses readline-common
Suggested packages:
  gettext-base git-daemon-run | git-daemon-sysvinit git-doc git-el git-email
  git-gui gitk gitweb git-arch git-cvs git-mediawiki git-svn parcimonie
  xloadimage dbus-user-session libpam-systemd pinentry-gnome3 scdaemon
  gnutls-bin krb5-doc krb5-user perl-doc libterm-readline-gnu-perl
  | libterm-readline-perl-perl make pinentry-doc readline-doc
Recommended packages:
  patch less rsync ssh-client dirmngr gnupg-l10n krb5-locales publicsuffix
  libsasl2-modules mime-support netbase rename
The following NEW packages will be installed:
  ca-certificates curl git git-man gnupg gnupg-agent gnupg2 gosu libassuan0
  libbsd0 libcurl3 libcurl3-gnutls liberror-perl libexpat1 libffi6 libgdbm3
  libgmp10 libgnutls30 libgssapi-krb5-2 libhogweed4 libidn11 libidn2-0
  libk5crypto3 libkeyutils1 libkrb5-3 libkrb5support0 libksba8 libldap-2.4-2
  libldap-common libnettle6 libnghttp2-14 libnpth0 libp11-kit0 libperl5.24
  libpsl5 libreadline7 librtmp1 libsasl2-2 libsasl2-modules-db libsqlite3-0
  libssh2-1 libssl1.0.2 libssl1.1 libtasn1-6 libunistring0 lynx lynx-common
  openssl perl perl-modules-5.24 pinentry-curses readline-common
0 upgraded, 52 newly installed, 0 to remove and 0 not upgraded.
Need to get 25.4 MB of archives.
After this operation, 106 MB of additional disk space will be used.
Get:1 http://security.debian.org/debian-security stretch/updates/main amd64 libnettle6 amd64 3.3-1+deb9u1 [192 kB]
Get:2 http://security.debian.org/debian-security stretch/updates/main amd64 libhogweed4 amd64 3.3-1+deb9u1 [136 kB]
Get:3 http://security.debian.org/debian-security stretch/updates/main amd64 libp11-kit0 amd64 0.23.3-2+deb9u1 [112 kB]
Get:4 http://deb.debian.org/debian stretch/main amd64 perl-modules-5.24 all 5.24.1-3+deb9u7 [2723 kB]
Get:5 http://security.debian.org/debian-security stretch/updates/main amd64 libgnutls30 amd64 3.5.8-5+deb9u6 [897 kB]
Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 libkrb5support0 amd64 1.15-1+deb9u3 [62.3 kB]
Get:7 http://security.debian.org/debian-security stretch/updates/main amd64 libk5crypto3 amd64 1.15-1+deb9u3 [120 kB]
Get:8 http://security.debian.org/debian-security stretch/updates/main amd64 libkrb5-3 amd64 1.15-1+deb9u3 [312 kB]
Get:9 http://security.debian.org/debian-security stretch/updates/main amd64 libgssapi-krb5-2 amd64 1.15-1+deb9u3 [155 kB]
Get:10 http://security.debian.org/debian-security stretch/updates/main amd64 libldap-common all 2.4.44+dfsg-5+deb9u8 [86.2 kB]
Get:11 http://security.debian.org/debian-security stretch/updates/main amd64 libldap-2.4-2 amd64 2.4.44+dfsg-5+deb9u8 [220 kB]
Get:12 http://security.debian.org/debian-security stretch/updates/main amd64 libnghttp2-14 amd64 1.18.1-1+deb9u2 [79.4 kB]
Get:13 http://security.debian.org/debian-security stretch/updates/main amd64 libcurl3-gnutls amd64 7.52.1-5+deb9u16 [296 kB]
Get:14 http://security.debian.org/debian-security stretch/updates/main amd64 libsqlite3-0 amd64 3.16.2-5+deb9u3 [574 kB]
Get:15 http://security.debian.org/debian-security stretch/updates/main amd64 libssl1.0.2 amd64 1.0.2u-1~deb9u6 [1306 kB]
Get:16 http://security.debian.org/debian-security stretch/updates/main amd64 libssl1.1 amd64 1.1.0l-1~deb9u4 [1359 kB]
Get:17 http://security.debian.org/debian-security stretch/updates/main amd64 openssl amd64 1.1.0l-1~deb9u4 [750 kB]
Get:18 http://deb.debian.org/debian stretch/main amd64 libgdbm3 amd64 1.8.3-14 [30.0 kB]
Get:19 http://deb.debian.org/debian stretch/main amd64 libperl5.24 amd64 5.24.1-3+deb9u7 [3527 kB]
Get:20 http://security.debian.org/debian-security stretch/updates/main amd64 ca-certificates all 20200601~deb9u2 [168 kB]
Get:21 http://security.debian.org/debian-security stretch/updates/main amd64 libcurl3 amd64 7.52.1-5+deb9u16 [298 kB]
Get:22 http://security.debian.org/debian-security stretch/updates/main amd64 curl amd64 7.52.1-5+deb9u16 [229 kB]
Get:23 http://security.debian.org/debian-security stretch/updates/main amd64 libbsd0 amd64 0.8.3-1+deb9u1 [82.9 kB]
Get:24 http://security.debian.org/debian-security stretch/updates/main amd64 lynx-common all 2.8.9dev11-1+deb9u1 [1098 kB]
Get:25 http://security.debian.org/debian-security stretch/updates/main amd64 lynx amd64 2.8.9dev11-1+deb9u1 [632 kB]
Get:26 http://deb.debian.org/debian stretch/main amd64 perl amd64 5.24.1-3+deb9u7 [218 kB]
Get:27 http://deb.debian.org/debian stretch/main amd64 libgmp10 amd64 2:6.1.2+dfsg-1 [253 kB]
Get:28 http://deb.debian.org/debian stretch/main amd64 libidn11 amd64 1.33-1+deb9u1 [115 kB]
Get:29 http://deb.debian.org/debian stretch/main amd64 libffi6 amd64 3.2.1-6 [20.4 kB]
Get:30 http://deb.debian.org/debian stretch/main amd64 libtasn1-6 amd64 4.10-1.1+deb9u1 [50.6 kB]
Get:31 http://deb.debian.org/debian stretch/main amd64 libkeyutils1 amd64 1.5.9-9 [12.4 kB]
Get:32 http://deb.debian.org/debian stretch/main amd64 libunistring0 amd64 0.9.6+really0.9.3-0.1 [279 kB]
Get:33 http://deb.debian.org/debian stretch/main amd64 libidn2-0 amd64 0.16-1+deb9u1 [60.7 kB]
Get:34 http://deb.debian.org/debian stretch/main amd64 libsasl2-modules-db amd64 2.1.27~101-g0780600+dfsg-3+deb9u1 [68.4 kB]
Get:35 http://deb.debian.org/debian stretch/main amd64 libsasl2-2 amd64 2.1.27~101-g0780600+dfsg-3+deb9u1 [105 kB]
Get:36 http://deb.debian.org/debian stretch/main amd64 libpsl5 amd64 0.17.0-3 [41.8 kB]
Get:37 http://deb.debian.org/debian stretch/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-1+b1 [60.4 kB]
Get:38 http://deb.debian.org/debian stretch/main amd64 libssh2-1 amd64 1.7.0-1+deb9u1 [139 kB]
Get:39 http://deb.debian.org/debian stretch/main amd64 libexpat1 amd64 2.2.0-2+deb9u3 [83.7 kB]
Get:40 http://deb.debian.org/debian stretch/main amd64 liberror-perl all 0.17024-1 [26.9 kB]
Get:41 http://deb.debian.org/debian stretch/main amd64 git-man all 1:2.11.0-3+deb9u7 [1436 kB]
Get:42 http://deb.debian.org/debian stretch/main amd64 git amd64 1:2.11.0-3+deb9u7 [4170 kB]
Get:43 http://deb.debian.org/debian stretch/main amd64 libassuan0 amd64 2.4.3-2 [42.5 kB]
Get:44 http://deb.debian.org/debian stretch/main amd64 pinentry-curses amd64 1.0.0-2 [50.5 kB]
Get:45 http://deb.debian.org/debian stretch/main amd64 libnpth0 amd64 1.3-1 [14.6 kB]
Get:46 http://deb.debian.org/debian stretch/main amd64 readline-common all 7.0-3 [70.4 kB]
Get:47 http://deb.debian.org/debian stretch/main amd64 libreadline7 amd64 7.0-3 [151 kB]
Get:48 http://deb.debian.org/debian stretch/main amd64 gnupg-agent amd64 2.1.18-8~deb9u4 [554 kB]
Get:49 http://deb.debian.org/debian stretch/main amd64 libksba8 amd64 1.3.5-2 [99.7 kB]
Get:50 http://deb.debian.org/debian stretch/main amd64 gnupg amd64 2.1.18-8~deb9u4 [1128 kB]
Get:51 http://deb.debian.org/debian stretch/main amd64 gnupg2 all 2.1.18-8~deb9u4 [299 kB]
Get:52 http://deb.debian.org/debian stretch/main amd64 gosu amd64 1.10-1+b2 [433 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 25.4 MB in 0s (104 MB/s)
Selecting previously unselected package perl-modules-5.24.
(Reading database ... 6319 files and directories currently installed.)
Preparing to unpack .../00-perl-modules-5.24_5.24.1-3+deb9u7_all.deb ...
Unpacking perl-modules-5.24 (5.24.1-3+deb9u7) ...
Selecting previously unselected package libgdbm3:amd64.
Preparing to unpack .../01-libgdbm3_1.8.3-14_amd64.deb ...
Unpacking libgdbm3:amd64 (1.8.3-14) ...
Selecting previously unselected package libperl5.24:amd64.
Preparing to unpack .../02-libperl5.24_5.24.1-3+deb9u7_amd64.deb ...
Unpacking libperl5.24:amd64 (5.24.1-3+deb9u7) ...
Selecting previously unselected package perl.
Preparing to unpack .../03-perl_5.24.1-3+deb9u7_amd64.deb ...
Unpacking perl (5.24.1-3+deb9u7) ...
Selecting previously unselected package libgmp10:amd64.
Preparing to unpack .../04-libgmp10_2%3a6.1.2+dfsg-1_amd64.deb ...
Unpacking libgmp10:amd64 (2:6.1.2+dfsg-1) ...
Selecting previously unselected package libnettle6:amd64.
Preparing to unpack .../05-libnettle6_3.3-1+deb9u1_amd64.deb ...
Unpacking libnettle6:amd64 (3.3-1+deb9u1) ...
Selecting previously unselected package libhogweed4:amd64.
Preparing to unpack .../06-libhogweed4_3.3-1+deb9u1_amd64.deb ...
Unpacking libhogweed4:amd64 (3.3-1+deb9u1) ...
Selecting previously unselected package libidn11:amd64.
Preparing to unpack .../07-libidn11_1.33-1+deb9u1_amd64.deb ...
Unpacking libidn11:amd64 (1.33-1+deb9u1) ...
Selecting previously unselected package libffi6:amd64.
Preparing to unpack .../08-libffi6_3.2.1-6_amd64.deb ...
Unpacking libffi6:amd64 (3.2.1-6) ...
Selecting previously unselected package libp11-kit0:amd64.
Preparing to unpack .../09-libp11-kit0_0.23.3-2+deb9u1_amd64.deb ...
Unpacking libp11-kit0:amd64 (0.23.3-2+deb9u1) ...
Selecting previously unselected package libtasn1-6:amd64.
Preparing to unpack .../10-libtasn1-6_4.10-1.1+deb9u1_amd64.deb ...
Unpacking libtasn1-6:amd64 (4.10-1.1+deb9u1) ...
Selecting previously unselected package libgnutls30:amd64.
Preparing to unpack .../11-libgnutls30_3.5.8-5+deb9u6_amd64.deb ...
Unpacking libgnutls30:amd64 (3.5.8-5+deb9u6) ...
Selecting previously unselected package libkeyutils1:amd64.
Preparing to unpack .../12-libkeyutils1_1.5.9-9_amd64.deb ...
Unpacking libkeyutils1:amd64 (1.5.9-9) ...
Selecting previously unselected package libkrb5support0:amd64.
Preparing to unpack .../13-libkrb5support0_1.15-1+deb9u3_amd64.deb ...
Unpacking libkrb5support0:amd64 (1.15-1+deb9u3) ...
Selecting previously unselected package libk5crypto3:amd64.
Preparing to unpack .../14-libk5crypto3_1.15-1+deb9u3_amd64.deb ...
Unpacking libk5crypto3:amd64 (1.15-1+deb9u3) ...
Selecting previously unselected package libkrb5-3:amd64.
Preparing to unpack .../15-libkrb5-3_1.15-1+deb9u3_amd64.deb ...
Unpacking libkrb5-3:amd64 (1.15-1+deb9u3) ...
Selecting previously unselected package libgssapi-krb5-2:amd64.
Preparing to unpack .../16-libgssapi-krb5-2_1.15-1+deb9u3_amd64.deb ...
Unpacking libgssapi-krb5-2:amd64 (1.15-1+deb9u3) ...
Selecting previously unselected package libunistring0:amd64.
Preparing to unpack .../17-libunistring0_0.9.6+really0.9.3-0.1_amd64.deb ...
Unpacking libunistring0:amd64 (0.9.6+really0.9.3-0.1) ...
Selecting previously unselected package libidn2-0:amd64.
Preparing to unpack .../18-libidn2-0_0.16-1+deb9u1_amd64.deb ...
Unpacking libidn2-0:amd64 (0.16-1+deb9u1) ...
Selecting previously unselected package libsasl2-modules-db:amd64.
Preparing to unpack .../19-libsasl2-modules-db_2.1.27~101-g0780600+dfsg-3+deb9u1_amd64.deb ...
Unpacking libsasl2-modules-db:amd64 (2.1.27~101-g0780600+dfsg-3+deb9u1) ...
Selecting previously unselected package libsasl2-2:amd64.
Preparing to unpack .../20-libsasl2-2_2.1.27~101-g0780600+dfsg-3+deb9u1_amd64.deb ...
Unpacking libsasl2-2:amd64 (2.1.27~101-g0780600+dfsg-3+deb9u1) ...
Selecting previously unselected package libldap-common.
Preparing to unpack .../21-libldap-common_2.4.44+dfsg-5+deb9u8_all.deb ...
Unpacking libldap-common (2.4.44+dfsg-5+deb9u8) ...
Selecting previously unselected package libldap-2.4-2:amd64.
Preparing to unpack .../22-libldap-2.4-2_2.4.44+dfsg-5+deb9u8_amd64.deb ...
Unpacking libldap-2.4-2:amd64 (2.4.44+dfsg-5+deb9u8) ...
Selecting previously unselected package libnghttp2-14:amd64.
Preparing to unpack .../23-libnghttp2-14_1.18.1-1+deb9u2_amd64.deb ...
Unpacking libnghttp2-14:amd64 (1.18.1-1+deb9u2) ...
Selecting previously unselected package libpsl5:amd64.
Preparing to unpack .../24-libpsl5_0.17.0-3_amd64.deb ...
Unpacking libpsl5:amd64 (0.17.0-3) ...
Selecting previously unselected package librtmp1:amd64.
Preparing to unpack .../25-librtmp1_2.4+20151223.gitfa8646d.1-1+b1_amd64.deb ...
Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-1+b1) ...
Selecting previously unselected package libssh2-1:amd64.
Preparing to unpack .../26-libssh2-1_1.7.0-1+deb9u1_amd64.deb ...
Unpacking libssh2-1:amd64 (1.7.0-1+deb9u1) ...
Selecting previously unselected package libcurl3-gnutls:amd64.
Preparing to unpack .../27-libcurl3-gnutls_7.52.1-5+deb9u16_amd64.deb ...
Unpacking libcurl3-gnutls:amd64 (7.52.1-5+deb9u16) ...
Selecting previously unselected package libexpat1:amd64.
Preparing to unpack .../28-libexpat1_2.2.0-2+deb9u3_amd64.deb ...
Unpacking libexpat1:amd64 (2.2.0-2+deb9u3) ...
Selecting previously unselected package liberror-perl.
Preparing to unpack .../29-liberror-perl_0.17024-1_all.deb ...
Unpacking liberror-perl (0.17024-1) ...
Selecting previously unselected package git-man.
Preparing to unpack .../30-git-man_1%3a2.11.0-3+deb9u7_all.deb ...
Unpacking git-man (1:2.11.0-3+deb9u7) ...
Selecting previously unselected package git.
Preparing to unpack .../31-git_1%3a2.11.0-3+deb9u7_amd64.deb ...
Unpacking git (1:2.11.0-3+deb9u7) ...
Selecting previously unselected package libassuan0:amd64.
Preparing to unpack .../32-libassuan0_2.4.3-2_amd64.deb ...
Unpacking libassuan0:amd64 (2.4.3-2) ...
Selecting previously unselected package pinentry-curses.
Preparing to unpack .../33-pinentry-curses_1.0.0-2_amd64.deb ...
Unpacking pinentry-curses (1.0.0-2) ...
Selecting previously unselected package libnpth0:amd64.
Preparing to unpack .../34-libnpth0_1.3-1_amd64.deb ...
Unpacking libnpth0:amd64 (1.3-1) ...
Selecting previously unselected package readline-common.
Preparing to unpack .../35-readline-common_7.0-3_all.deb ...
Unpacking readline-common (7.0-3) ...
Selecting previously unselected package libreadline7:amd64.
Preparing to unpack .../36-libreadline7_7.0-3_amd64.deb ...
Unpacking libreadline7:amd64 (7.0-3) ...
Selecting previously unselected package gnupg-agent.
Preparing to unpack .../37-gnupg-agent_2.1.18-8~deb9u4_amd64.deb ...
Unpacking gnupg-agent (2.1.18-8~deb9u4) ...
Selecting previously unselected package libksba8:amd64.
Preparing to unpack .../38-libksba8_1.3.5-2_amd64.deb ...
Unpacking libksba8:amd64 (1.3.5-2) ...
Selecting previously unselected package libsqlite3-0:amd64.
Preparing to unpack .../39-libsqlite3-0_3.16.2-5+deb9u3_amd64.deb ...
Unpacking libsqlite3-0:amd64 (3.16.2-5+deb9u3) ...
Selecting previously unselected package gnupg.
Preparing to unpack .../40-gnupg_2.1.18-8~deb9u4_amd64.deb ...
Unpacking gnupg (2.1.18-8~deb9u4) ...
Selecting previously unselected package libssl1.0.2:amd64.
Preparing to unpack .../41-libssl1.0.2_1.0.2u-1~deb9u6_amd64.deb ...
Unpacking libssl1.0.2:amd64 (1.0.2u-1~deb9u6) ...
Selecting previously unselected package libssl1.1:amd64.
Preparing to unpack .../42-libssl1.1_1.1.0l-1~deb9u4_amd64.deb ...
Unpacking libssl1.1:amd64 (1.1.0l-1~deb9u4) ...
Selecting previously unselected package openssl.
Preparing to unpack .../43-openssl_1.1.0l-1~deb9u4_amd64.deb ...
Unpacking openssl (1.1.0l-1~deb9u4) ...
Selecting previously unselected package ca-certificates.
Preparing to unpack .../44-ca-certificates_20200601~deb9u2_all.deb ...
Unpacking ca-certificates (20200601~deb9u2) ...
Selecting previously unselected package libcurl3:amd64.
Preparing to unpack .../45-libcurl3_7.52.1-5+deb9u16_amd64.deb ...
Unpacking libcurl3:amd64 (7.52.1-5+deb9u16) ...
Selecting previously unselected package curl.
Preparing to unpack .../46-curl_7.52.1-5+deb9u16_amd64.deb ...
Unpacking curl (7.52.1-5+deb9u16) ...
Selecting previously unselected package gnupg2.
Preparing to unpack .../47-gnupg2_2.1.18-8~deb9u4_all.deb ...
Unpacking gnupg2 (2.1.18-8~deb9u4) ...
Selecting previously unselected package libbsd0:amd64.
Preparing to unpack .../48-libbsd0_0.8.3-1+deb9u1_amd64.deb ...
Unpacking libbsd0:amd64 (0.8.3-1+deb9u1) ...
Selecting previously unselected package lynx-common.
Preparing to unpack .../49-lynx-common_2.8.9dev11-1+deb9u1_all.deb ...
Unpacking lynx-common (2.8.9dev11-1+deb9u1) ...
Selecting previously unselected package gosu.
Preparing to unpack .../50-gosu_1.10-1+b2_amd64.deb ...
Unpacking gosu (1.10-1+b2) ...
Selecting previously unselected package lynx.
Preparing to unpack .../51-lynx_2.8.9dev11-1+deb9u1_amd64.deb ...
Unpacking lynx (2.8.9dev11-1+deb9u1) ...
Setting up libnpth0:amd64 (1.3-1) ...
Setting up readline-common (7.0-3) ...
Setting up perl-modules-5.24 (5.24.1-3+deb9u7) ...
Setting up libgdbm3:amd64 (1.8.3-14) ...
Setting up libperl5.24:amd64 (5.24.1-3+deb9u7) ...
Setting up libnettle6:amd64 (3.3-1+deb9u1) ...
Setting up git-man (1:2.11.0-3+deb9u7) ...
Setting up libexpat1:amd64 (2.2.0-2+deb9u3) ...
Setting up libnghttp2-14:amd64 (1.18.1-1+deb9u2) ...
Setting up gosu (1.10-1+b2) ...
Setting up libldap-common (2.4.44+dfsg-5+deb9u8) ...
Setting up libreadline7:amd64 (7.0-3) ...
Setting up libsasl2-modules-db:amd64 (2.1.27~101-g0780600+dfsg-3+deb9u1) ...
Setting up libsasl2-2:amd64 (2.1.27~101-g0780600+dfsg-3+deb9u1) ...
Setting up libksba8:amd64 (1.3.5-2) ...
Setting up libbsd0:amd64 (0.8.3-1+deb9u1) ...
Setting up libtasn1-6:amd64 (4.10-1.1+deb9u1) ...
Setting up perl (5.24.1-3+deb9u7) ...
update-alternatives: using /usr/bin/prename to provide /usr/bin/rename (rename) in auto mode
update-alternatives: warning: skip creation of /usr/share/man/man1/rename.1.gz because associated file /usr/share/man/man1/prename.1.gz (of link group rename) doesn't exist
Setting up libssl1.0.2:amd64 (1.0.2u-1~deb9u6) ...
Setting up libgmp10:amd64 (2:6.1.2+dfsg-1) ...
Setting up libssh2-1:amd64 (1.7.0-1+deb9u1) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
Setting up libunistring0:amd64 (0.9.6+really0.9.3-0.1) ...
Setting up libssl1.1:amd64 (1.1.0l-1~deb9u4) ...
Setting up openssl (1.1.0l-1~deb9u4) ...
Setting up libsqlite3-0:amd64 (3.16.2-5+deb9u3) ...
Setting up libffi6:amd64 (3.2.1-6) ...
Setting up libkeyutils1:amd64 (1.5.9-9) ...
Setting up lynx-common (2.8.9dev11-1+deb9u1) ...
Setting up ca-certificates (20200601~deb9u2) ...
Updating certificates in /etc/ssl/certs...
137 added, 0 removed; done.
Setting up libassuan0:amd64 (2.4.3-2) ...
Setting up libidn11:amd64 (1.33-1+deb9u1) ...
Setting up libidn2-0:amd64 (0.16-1+deb9u1) ...
Setting up liberror-perl (0.17024-1) ...
Setting up libpsl5:amd64 (0.17.0-3) ...
Setting up libkrb5support0:amd64 (1.15-1+deb9u3) ...
Setting up libhogweed4:amd64 (3.3-1+deb9u1) ...
Setting up libp11-kit0:amd64 (0.23.3-2+deb9u1) ...
Setting up pinentry-curses (1.0.0-2) ...
Setting up gnupg-agent (2.1.18-8~deb9u4) ...
Setting up libk5crypto3:amd64 (1.15-1+deb9u3) ...
Setting up gnupg (2.1.18-8~deb9u4) ...
Setting up libgnutls30:amd64 (3.5.8-5+deb9u6) ...
Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-1+b1) ...
Setting up gnupg2 (2.1.18-8~deb9u4) ...
Setting up libldap-2.4-2:amd64 (2.4.44+dfsg-5+deb9u8) ...
Setting up libkrb5-3:amd64 (1.15-1+deb9u3) ...
Setting up lynx (2.8.9dev11-1+deb9u1) ...
update-alternatives: using /usr/bin/lynx to provide /usr/bin/www-browser (www-browser) in auto mode
update-alternatives: warning: skip creation of /usr/share/man/man1/www-browser.1.gz because associated file /usr/share/man/man1/lynx.1.gz (of link group www-browser) doesn't exist
Setting up libgssapi-krb5-2:amd64 (1.15-1+deb9u3) ...
Setting up libcurl3:amd64 (7.52.1-5+deb9u16) ...
Setting up libcurl3-gnutls:amd64 (7.52.1-5+deb9u16) ...
Setting up git (1:2.11.0-3+deb9u7) ...
Setting up curl (7.52.1-5+deb9u16) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
Processing triggers for ca-certificates (20200601~deb9u2) ...
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
+ apt-get autoremove -yqq --purge
+ apt-get clean
+ rm -rf /var/lib/apt/lists/deb.debian.org_debian_dists_stretch-updates_InRelease /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_Release /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_Release.gpg /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_main_binary-amd64_Packages.lz4 /var/lib/apt/lists/lock /var/lib/apt/lists/partial /var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_InRelease /var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_main_binary-amd64_Packages.lz4
Removing intermediate container 3fb098fffe03
 ---> ed708b2c153b
Step 5/9 : RUN curl -sL https://deb.nodesource.com/setup_10.x | bash -     && apt-get update     && apt-get install -y --no-install-recommends         nodejs     && apt-get autoremove -yqq --purge     && apt-get clean     && rm -rf /var/lib/apt/lists/*
 ---> Running in 57f233d54379
+ curl -sL https://deb.nodesource.com/setup_10.x
+ bash -

================================================================================
================================================================================

                              DEPRECATION WARNING                            

  Node.js 10.x is no longer actively supported!

  You will not receive security or critical stability updates for this version.

  You should migrate to a supported version of Node.js as soon as possible.
  Use the installation script that corresponds to the version of Node.js you
  wish to install. e.g.

   * https://deb.nodesource.com/setup_12.x — Node.js 12 LTS "Erbium"
   * https://deb.nodesource.com/setup_14.x — Node.js 14 LTS "Fermium" (recommended)
   * https://deb.nodesource.com/setup_16.x — Node.js 16 "Gallium"

  Please see https://github.com/nodejs/Release for details about which
  version may be appropriate for you.

  The NodeSource Node.js distributions repository contains
  information both about supported versions of Node.js and supported Linux
  distributions. To learn more about usage, see the repository:
    https://github.com/nodesource/distributions

================================================================================
================================================================================

Continuing in 20 seconds ...


## Installing the NodeSource Node.js 10.x repo...


## Populating apt-get cache...

+ apt-get update
Get:1 http://security.debian.org/debian-security stretch/updates InRelease [53.0 kB]
Ign:2 http://deb.debian.org/debian stretch InRelease
Get:3 http://deb.debian.org/debian stretch-updates InRelease [93.6 kB]
Get:4 http://deb.debian.org/debian stretch Release [118 kB]
Get:5 http://deb.debian.org/debian stretch Release.gpg [3177 B]
Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [743 kB]
Get:7 http://deb.debian.org/debian stretch/main amd64 Packages [7080 kB]
Fetched 8090 kB in 1s (5547 kB/s)
Reading package lists...

## Installing packages required for setup: apt-transport-https lsb-release...

+ apt-get install -y apt-transport-https lsb-release > /dev/null 2>&1

## Confirming "stretch" is supported...

+ curl -sLf -o /dev/null 'https://deb.nodesource.com/node_10.x/dists/stretch/Release'

## Adding the NodeSource signing key to your keyring...

+ curl -s https://deb.nodesource.com/gpgkey/nodesource.gpg.key | gpg --dearmor | tee /usr/share/keyrings/nodesource.gpg >/dev/null

## Creating apt sources list file for the NodeSource Node.js 10.x repo...

+ echo 'deb [signed-by=/usr/share/keyrings/nodesource.gpg] https://deb.nodesource.com/node_10.x stretch main' > /etc/apt/sources.list.d/nodesource.list
+ echo 'deb-src [signed-by=/usr/share/keyrings/nodesource.gpg] https://deb.nodesource.com/node_10.x stretch main' >> /etc/apt/sources.list.d/nodesource.list

## Running `apt-get update` for you...

+ apt-get update
Hit:1 http://security.debian.org/debian-security stretch/updates InRelease
Ign:2 http://deb.debian.org/debian stretch InRelease
Hit:3 http://deb.debian.org/debian stretch-updates InRelease
Hit:4 http://deb.debian.org/debian stretch Release
Get:6 https://deb.nodesource.com/node_10.x stretch InRelease [4585 B]
Get:7 https://deb.nodesource.com/node_10.x stretch/main amd64 Packages [767 B]
Fetched 5352 B in 0s (12.1 kB/s)
Reading package lists...

## Run `sudo apt-get install -y nodejs` to install Node.js 10.x and npm
## You may also need development tools to build native addons:
     sudo apt-get install gcc g++ make
## To install the Yarn package manager, run:
     curl -sL https://dl.yarnpkg.com/debian/pubkey.gpg | gpg --dearmor | sudo tee /usr/share/keyrings/yarnkey.gpg >/dev/null
     echo "deb [signed-by=/usr/share/keyrings/yarnkey.gpg] https://dl.yarnpkg.com/debian stable main" | sudo tee /etc/apt/sources.list.d/yarn.list
     sudo apt-get update && sudo apt-get install yarn


+ apt-get update
Hit:1 http://security.debian.org/debian-security stretch/updates InRelease
Ign:2 http://deb.debian.org/debian stretch InRelease
Hit:3 http://deb.debian.org/debian stretch-updates InRelease
Hit:4 http://deb.debian.org/debian stretch Release
Hit:5 https://deb.nodesource.com/node_10.x stretch InRelease
Reading package lists...
+ apt-get install -y --no-install-recommends nodejs
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libpython2.7-minimal python-minimal python2.7-minimal
Suggested packages:
  binfmt-support
Recommended packages:
  libpython2.7-stdlib python python2.7
The following NEW packages will be installed:
  libpython2.7-minimal nodejs python-minimal python2.7-minimal
0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.
Need to get 17.8 MB of archives.
After this operation, 87.4 MB of additional disk space will be used.
Get:1 http://security.debian.org/debian-security stretch/updates/main amd64 libpython2.7-minimal amd64 2.7.13-2+deb9u5 [390 kB]
Get:2 http://deb.debian.org/debian stretch/main amd64 python-minimal amd64 2.7.13-2 [40.5 kB]
Get:3 http://security.debian.org/debian-security stretch/updates/main amd64 python2.7-minimal amd64 2.7.13-2+deb9u5 [1382 kB]
Get:4 https://deb.nodesource.com/node_10.x stretch/main amd64 nodejs amd64 10.24.1-1nodesource1 [15.9 MB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 17.8 MB in 0s (53.9 MB/s)
Selecting previously unselected package libpython2.7-minimal:amd64.
(Reading database ... 10954 files and directories currently installed.)
Preparing to unpack .../libpython2.7-minimal_2.7.13-2+deb9u5_amd64.deb ...
Unpacking libpython2.7-minimal:amd64 (2.7.13-2+deb9u5) ...
Selecting previously unselected package python2.7-minimal.
Preparing to unpack .../python2.7-minimal_2.7.13-2+deb9u5_amd64.deb ...
Unpacking python2.7-minimal (2.7.13-2+deb9u5) ...
Selecting previously unselected package python-minimal.
Preparing to unpack .../python-minimal_2.7.13-2_amd64.deb ...
Unpacking python-minimal (2.7.13-2) ...
Selecting previously unselected package nodejs.
Preparing to unpack .../nodejs_10.24.1-1nodesource1_amd64.deb ...
Unpacking nodejs (10.24.1-1nodesource1) ...
Setting up libpython2.7-minimal:amd64 (2.7.13-2+deb9u5) ...
Setting up python2.7-minimal (2.7.13-2+deb9u5) ...
Setting up python-minimal (2.7.13-2) ...
Setting up nodejs (10.24.1-1nodesource1) ...
+ apt-get autoremove -yqq --purge
+ apt-get clean
+ rm -rf /var/lib/apt/lists/deb.debian.org_debian_dists_stretch-updates_InRelease /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_Release /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_Release.gpg /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_main_binary-amd64_Packages.lz4 /var/lib/apt/lists/deb.nodesource.com_node%5f10.x_dists_stretch_InRelease /var/lib/apt/lists/deb.nodesource.com_node%5f10.x_dists_stretch_main_binary-amd64_Packages.lz4 /var/lib/apt/lists/lock /var/lib/apt/lists/partial /var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_InRelease /var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_main_binary-amd64_Packages.lz4
Removing intermediate container 57f233d54379
 ---> 4a8ffc53bbc7
Step 6/9 : RUN curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add -     && echo "deb https://dl.yarnpkg.com/debian/ stable main" | tee /etc/apt/sources.list.d/yarn.list     && apt-get update     && apt-get install -y --no-install-recommends yarn     && apt-get autoremove -yqq --purge     && apt-get clean     && rm -rf /var/lib/apt/lists/*
 ---> Running in 67712cb3a1e4
+ curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg
+ apt-key add -
Warning: apt-key output should not be parsed (stdout is not a terminal)
OK
+ echo 'deb https://dl.yarnpkg.com/debian/ stable main'
+ tee /etc/apt/sources.list.d/yarn.list
deb https://dl.yarnpkg.com/debian/ stable main
+ apt-get update
Get:1 http://security.debian.org/debian-security stretch/updates InRelease [53.0 kB]
Ign:2 http://deb.debian.org/debian stretch InRelease
Get:3 http://deb.debian.org/debian stretch-updates InRelease [93.6 kB]
Get:4 http://deb.debian.org/debian stretch Release [118 kB]
Get:5 http://deb.debian.org/debian stretch Release.gpg [3177 B]
Get:6 https://deb.nodesource.com/node_10.x stretch InRelease [4585 B]
Get:7 https://dl.yarnpkg.com/debian stable InRelease [17.1 kB]
Get:8 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [743 kB]
Get:9 http://deb.debian.org/debian stretch/main amd64 Packages [7080 kB]
Get:10 https://deb.nodesource.com/node_10.x stretch/main amd64 Packages [767 B]
Get:11 https://dl.yarnpkg.com/debian stable/main amd64 Packages [10.4 kB]
Get:12 https://dl.yarnpkg.com/debian stable/main all Packages [10.4 kB]
Fetched 8133 kB in 1s (5644 kB/s)
Reading package lists...
+ apt-get install -y --no-install-recommends yarn
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  yarn
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 893 kB of archives.
After this operation, 5366 kB of additional disk space will be used.
Get:1 https://dl.yarnpkg.com/debian stable/main amd64 yarn all 1.22.15-1 [893 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 893 kB in 0s (5590 kB/s)
Selecting previously unselected package yarn.
(Reading database ... 15947 files and directories currently installed.)
Preparing to unpack .../yarn_1.22.15-1_all.deb ...
Unpacking yarn (1.22.15-1) ...
Setting up yarn (1.22.15-1) ...
+ apt-get autoremove -yqq --purge
+ apt-get clean
+ rm -rf /var/lib/apt/lists/deb.debian.org_debian_dists_stretch-updates_InRelease /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_Release /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_Release.gpg /var/lib/apt/lists/deb.debian.org_debian_dists_stretch_main_binary-amd64_Packages.lz4 /var/lib/apt/lists/deb.nodesource.com_node%5f10.x_dists_stretch_InRelease /var/lib/apt/lists/deb.nodesource.com_node%5f10.x_dists_stretch_main_binary-amd64_Packages.lz4 /var/lib/apt/lists/dl.yarnpkg.com_debian_dists_stable_InRelease /var/lib/apt/lists/dl.yarnpkg.com_debian_dists_stable_main_binary-all_Packages.lz4 /var/lib/apt/lists/dl.yarnpkg.com_debian_dists_stable_main_binary-amd64_Packages.lz4 /var/lib/apt/lists/lock /var/lib/apt/lists/partial /var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_InRelease /var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_main_binary-amd64_Packages.lz4
Removing intermediate container 67712cb3a1e4
 ---> 10b3a163de7d
Step 7/9 : RUN curl -sL "https://github.com/stedolan/jq/releases/download/jq-1.6/jq-linux64" > /usr/local/bin/jq     && chmod +x /usr/local/bin/jq
 ---> Running in 6d405ec6b0b4
+ curl -sL https://github.com/stedolan/jq/releases/download/jq-1.6/jq-linux64
+ chmod +x /usr/local/bin/jq
Removing intermediate container 6d405ec6b0b4
 ---> d147243e020d
Step 8/9 : RUN HUGOHOME="$(mktemp -d)"     && export HUGOHOME     && curl -sL https://github.com/gohugoio/hugo/releases/download/v0.58.3/hugo_extended_0.58.3_Linux-64bit.tar.gz > "${HUGOHOME}/hugo.tar.gz"     && tar -xzvf "${HUGOHOME}/hugo.tar.gz" hugo     && mv hugo /usr/local/bin/hugo     && chmod +x /usr/local/bin/hugo     && rm -r "${HUGOHOME}"
 ---> Running in 07d63aef2fa2
++ mktemp -d
+ HUGOHOME=/tmp/tmp.uKTxdxnRfy
+ export HUGOHOME
+ curl -sL https://github.com/gohugoio/hugo/releases/download/v0.58.3/hugo_extended_0.58.3_Linux-64bit.tar.gz
+ tar -xzvf /tmp/tmp.uKTxdxnRfy/hugo.tar.gz hugo
hugo
+ mv hugo /usr/local/bin/hugo
+ chmod +x /usr/local/bin/hugo
+ rm -r /tmp/tmp.uKTxdxnRfy
Removing intermediate container 07d63aef2fa2
 ---> 01a8e08a5648
Step 9/9 : WORKDIR /opt/site/
 ---> Running in 482fbeaec45a
Removing intermediate container 482fbeaec45a
 ---> 3a21cc89a11d
Successfully built 3a21cc89a11d
Successfully tagged airflow-site:latest

@j143 j143 changed the title .. Rewrite ./site.sh to Python Nov 19, 2021
@j143 j143 added this to the sh-to-python script milestone Nov 19, 2021
@j143 j143 pinned this issue Nov 19, 2021
@j143 j143 closed this as completed Jan 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
sh-to-python script
Development

No branches or pull requests
1 participant
@j143