Github actions fails after new VMs deployed #9733

eenagy · 2024-04-24T08:54:49Z

Description

When running github actions when the VMs are in active deployment the github actions fail.
Taken from workflow actions log.
Please disable action running, while VM is deploying or only allow queuing.

 Get:1 file:/etc/apt/apt-mirrors.txt Mirrorlist [142 B]
Hit:2 http://azure.archive.ubuntu.com/ubuntu jammy InRelease
Get:3 http://azure.archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB]
Get:4 http://azure.archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB]
Get:5 http://azure.archive.ubuntu.com/ubuntu jammy-security InRelease [110 kB]
Get:6 https://packages.microsoft.com/ubuntu/22.04/prod jammy InRelease
Err:6 https://packages.microsoft.com/ubuntu/22.04/prod jammy InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Get:7 http://azure.archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1610 kB]
Get:8 http://azure.archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB]
Get:9 http://azure.archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1830 kB]
Get:10 http://azure.archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB]
Get:11 http://azure.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1070 kB]
Get:12 http://azure.archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB]
Get:13 http://azure.archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB]
Get:14 http://azure.archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB]
Hit:15 https://ppa.launchpadcontent.net/ubuntu-toolchain-r/test/ubuntu jammy InRelease
Get:16 http://azure.archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1392 kB]
Get:17 http://azure.archive.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB]
Get:18 http://azure.archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1768 kB]
Get:19 http://azure.archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB]
Get:20 http://azure.archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB]
Get:21 http://azure.archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB]
Reading package lists...
E: Failed to fetch https://packages.microsoft.com/ubuntu/22.04/prod/dists/jammy/InRelease  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: The repository 'https://packages.microsoft.com/ubuntu/22.04/prod jammy InRelease' is no longer signed.

Platforms affected

Azure DevOps
GitHub Actions - Standard Runners
GitHub Actions - Larger Runners

Runner images affected

Image version and build link

Ubuntu LTS

Is it regression?

Not sure

Expected behavior

Either do not run the GitHub workflow or make it queue.

Actual behavior

Workflows fail.

Repro steps

Create a workflow actions
Use Ubuntu LTS
run apt update as workflow step

Temporary Workaround

Actually

sudo apt-get update || true

won't help because apt index would be incomplete and the error to be ignored.

The problem is not in the image itself but in the Microsoft's apt repo, we are reaching them out.

the better workaround would be the following snippet of code:

    run: |
     sudo rm /etc/apt/sources.list.d/microsoft-prod.list
     sudo apt-get update

Update 13:10 UTC issue has been reported fixed

We are keeping an eye

The text was updated successfully, but these errors were encountered:

greenstatic · 2024-04-24T09:00:56Z

Can confirm, I am getting the same error on my workflow runs.

n-thumann · 2024-04-24T09:04:40Z

Seems to be the same as reported in microsoft/linux-package-repositories#130.

jserpapinto · 2024-04-24T09:37:20Z

We are getting this as well on all our repos.

Antse · 2024-04-24T09:39:03Z

same for us

mihaTrajbaric · 2024-04-24T09:39:56Z

Same issue on our repos.

roharon · 2024-04-24T09:47:07Z

We got same issues in Github Actions that using ubuntu-latest.

reachlin · 2024-04-24T09:51:52Z

content-length: 0

(base) lincai@Charles-Cai-MBP16 makomo % curl -v https://packages.microsoft.com/ubuntu/22.04/prod/dists/jammy/InRelease
*   Trying 13.107.213.74:443...
* Connected to packages.microsoft.com (13.107.213.74) port 443
* ALPN: curl offers h2,http/1.1
* (304) (OUT), TLS handshake, Client hello (1):
*  CAfile: /etc/ssl/cert.pem
*  CApath: none
* (304) (IN), TLS handshake, Server hello (2):
* (304) (OUT), TLS handshake, Client hello (1):
* (304) (IN), TLS handshake, Server hello (2):
* (304) (IN), TLS handshake, Unknown (8):
* (304) (IN), TLS handshake, Certificate (11):
* (304) (IN), TLS handshake, CERT verify (15):
* (304) (IN), TLS handshake, Finished (20):
* (304) (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / AEAD-AES256-GCM-SHA384
* ALPN: server accepted h2
* Server certificate:
*  subject: C=US; ST=WA; L=Redmond; O=Microsoft Corporation; CN=packages.microsoft.com
*  start date: Feb 20 15:27:19 2024 GMT
*  expire date: Feb 14 15:27:19 2025 GMT
*  subjectAltName: host "packages.microsoft.com" matched cert's "packages.microsoft.com"
*  issuer: C=US; O=Microsoft Corporation; CN=Microsoft Azure RSA TLS Issuing CA 08
*  SSL certificate verify ok.
* using HTTP/2
* [HTTP/2] [1] OPENED stream for https://packages.microsoft.com/ubuntu/22.04/prod/dists/jammy/InRelease
* [HTTP/2] [1] [:method: GET]
* [HTTP/2] [1] [:scheme: https]
* [HTTP/2] [1] [:authority: packages.microsoft.com]
* [HTTP/2] [1] [:path: /ubuntu/22.04/prod/dists/jammy/InRelease]
* [HTTP/2] [1] [user-agent: curl/8.4.0]
* [HTTP/2] [1] [accept: */*]
> GET /ubuntu/22.04/prod/dists/jammy/InRelease HTTP/2
> Host: packages.microsoft.com
> User-Agent: curl/8.4.0
> Accept: */*
> 
< HTTP/2 200 
< date: Wed, 24 Apr 2024 09:47:50 GMT
< content-length: 0
< x-ms-request-id: 7d5ed39a-501e-0024-4d26-963923000000
< x-ms-version: 2021-08-06
< x-ms-error-code: InvalidRange
< strict-transport-security: max-age=31536000; includeSubDomains
< x-azure-ref: 20240424T094750Z-1656cf4dd4dfpwdca5zpavt7c4000000087g000000000pn9
< cache-control: public, max-age=31536000
< x-fd-int-roxy-purgeid: 66945124
< x-cache: TCP_HIT
< accept-ranges: bytes
< 
* Connection #0 to host packages.microsoft.com left intact

sciutand · 2024-04-24T09:53:07Z

same here on ubuntu latest

zviryatko · 2024-04-24T09:55:51Z

For myself added sudo rm /etc/apt/sources.list.d/microsoft-prod.list before the sudo apt-get update
I don't care for ms repos in my pipelines, so should work.

JesusPoderoso · 2024-04-24T09:59:22Z

Some workarounds we've seen are adding || true to the apt update command:
sudo apt-get update || true
Hope it helps

yongsk0066 · 2024-04-24T10:01:55Z

same here too 🥹

pavanm-huma · 2024-04-24T10:07:18Z

Same issue for us too. Changing 'runs-on: latest' to 'runs-on: ubuntu-20.04' helped.

mikhailkoliada · 2024-04-24T10:07:54Z

Actually

sudo apt-get update || true

won't help because apt index would be incomplete and the error to be ignored.

The problem is not in the image itself but in the Microsoft's apt repo, we are reaching them out.

the better workaround would be the following snippet of code:

        run: |
         sudo rm /etc/apt/sources.list.d/microsoft-prod.list
         sudo apt-get update

Failure being related to a broken Microsoft repository we don't need, we just needed to implement work-around from: actions/runner-images#9733 (comment)

sciutand · 2024-04-24T10:20:39Z

strange my browser can fetch https://packages.microsoft.com/ubuntu/22.04/prod/dists/jammy/InRelease no problem, but with curl it fails. Even when using copy with curl to ensure the headers are the same.
... wget https://packages.microsoft.com/ubuntu/22.04/prod/dists/jammy/InRelease works as well.

…ction ece2ffc ci: Workaround Microsoft mirror issue for GitHub Action (Hennadii Stepanov) Pull request description: Upstream: - issue -- actions/runner-images#9733 - code snippet -- actions/runner-images#9733 (comment) Top commit has no ACKs. Tree-SHA512: e2ce211de020fb1f22fba79d2f8d3ea8831d5543eb24ed3e0e6b88ea9eb09ad695edc2c360c68f46b6b5b4cd52446f9d8beb9eb4378b28b8f4e1c0b13ce1b438

until actions/runner-images#9733 is fixed.

Running `playwright install --with-deps` fails because it executes `apt update` in the background, which is failing on the `latest ubuntu-22.04` image release. Related to [Issue #9733](actions/runner-images#9733). Thanks to the temporary fix provided [here](actions/runner-images#9733 (comment)) 🙌.

Upgrade Playwright to 1.43.1 and apply temporary fix to the global GitHub issue (actions/runner-images#9733)

workaround

It's a workaround for GHA issue. Ref. actions/runner-images#9733

mikhailkoliada · 2024-04-24T13:12:57Z

Update 13:10 UTC issue has been reported fixed

We are keeping an eye

rvecmanis · 2024-04-24T13:14:23Z

Seems to be fixed, our runners work as intended.

It's a workaround for GHA issue. Ref. actions/runner-images#9733

workaround

pntgoswami18 · 2024-04-24T13:32:06Z

Our github actions are now working as intended, the issue seems fixed for us

This reverts commit 04a395c.

mikhailkoliada · 2024-04-24T13:44:40Z

We got confirmation that the issue has been fully addressed, closing now!

This reverts commit 0e22a5e.

* [misc]: Add TWError, TWResult, TWErrorKind, and traits * Use `TWError` in `tw_coin_entry` * [misc]: Return SigningError, SigningResult back, make TWError<E> generic * [misc]: Add `tw_aptos` error contexts * [misc]: Add `tw_sui` error contexts * [misc]: Simplify `TWError` casts, add tests * [misc]: Add contexts in `tw_cosmos_sdk` * [misc]: Add contexts in `tw_evm` * [misc]: Fix compilation of `tw_ethereum`, `tw_ronin`, `tw_bitcoin`, `tw_native_evmos`, `tw_native_injective`, `tw_thorchain` * [misc]: Add error contexts in `tw_solana` * [misc]: Fix `tw_bitcoin` compilation errors * [misc]: Add error contexts to `tw_greenfield` * [misc]: Fix other compilation errors * [CI] Trigger CI * [codegen-v2]: Fix Rust codegen templates * [misc]: Add `TWError` doc comments * [CI]: Apply a workaround * [CI]: Apply a work around actions/runner-images#9733 * [CI]: Try to disable workaround * [CI]: Try to disable workaround * [CI]: Fix broken dependencies cache * [CI]: Apply the changes for linux-sampleapp-ci.yml

This reverts commit d82b682.

Upstream: - issue -- actions/runner-images#9733 - code snippet -- actions/runner-images#9733 (comment)

* [misc]: Add TWError, TWResult, TWErrorKind, and traits * Use `TWError` in `tw_coin_entry` * [misc]: Return SigningError, SigningResult back, make TWError<E> generic * [misc]: Add `tw_aptos` error contexts * [misc]: Add `tw_sui` error contexts * [misc]: Simplify `TWError` casts, add tests * [misc]: Add contexts in `tw_cosmos_sdk` * [misc]: Add contexts in `tw_evm` * [misc]: Fix compilation of `tw_ethereum`, `tw_ronin`, `tw_bitcoin`, `tw_native_evmos`, `tw_native_injective`, `tw_thorchain` * [misc]: Add error contexts in `tw_solana` * [misc]: Fix `tw_bitcoin` compilation errors * [misc]: Add error contexts to `tw_greenfield` * [misc]: Fix other compilation errors * [CI] Trigger CI * [codegen-v2]: Fix Rust codegen templates * [misc]: Add `TWError` doc comments * [CI]: Apply a workaround * [CI]: Apply a work around actions/runner-images#9733 * [CI]: Try to disable workaround * [CI]: Try to disable workaround * [CI]: Fix broken dependencies cache * [CI]: Apply the changes for linux-sampleapp-ci.yml

eenagy added bug report needs triage labels Apr 24, 2024

eenagy mentioned this issue Apr 24, 2024

Can't use github actions, as it is broken, wait until it gets fixed eth-pkg/eth-nodes#61

Closed

bdraco mentioned this issue Apr 24, 2024

Bump CI to ubuntu-22.10 home-assistant/core#116087

Closed

20 tasks

koddsson mentioned this issue Apr 24, 2024

publish built typescript open-wc/context-protocol#21

Merged

Ghislain89 mentioned this issue Apr 24, 2024

fix: temp workaround for apt-get update failures kadena-community/kadena.js#2002

Merged

mikhailkoliada mentioned this issue Apr 24, 2024

ubuntu22.04 install llvm faild #9735

Closed

13 tasks

mikhailkoliada self-assigned this Apr 24, 2024

mikhailkoliada added OS: Ubuntu and removed needs triage labels Apr 24, 2024

licy183 referenced this issue in termux/termux-packages Apr 24, 2024

bump(libllvm): 18.1.3 to 18.1.4

16b0e14

AdriVanHoudt mentioned this issue Apr 24, 2024

apt update failed due to signing issue actions/runner#3253

Closed

mikhailkoliada mentioned this issue Apr 24, 2024

apt-get update failed on the latest ubuntu-22.04 image #9736

Closed

13 tasks

jwillemsen mentioned this issue Apr 24, 2024

C++17 is the minimum required C++ level to compile ACE/TAO after this PR DOCGroup/ACE_TAO#2224

Merged

g-bougard added a commit to glpi-project/glpi-agent that referenced this issue Apr 24, 2024

build: Fix linux packaging builds

ed0c5ad

Failure being related to a broken Microsoft repository we don't need, we just needed to implement work-around from: actions/runner-images#9733 (comment)

mjankowski mentioned this issue Apr 24, 2024

Change default ruby version to 3.3.1 mastodon/mastodon#28013

Merged

skirpichev added a commit to skirpichev/mpmath that referenced this issue Apr 24, 2024

Workaround actions/runner-images#9733

eeb0354

rhardjo mentioned this issue Apr 24, 2024

[Bug]: Failed to install browsers on ubuntu 22.04 microsoft/playwright#30503

Closed

Maxython mentioned this issue Apr 24, 2024

Test improvements termux-pacman/pacman-tool-repo#3

Merged

didrocks added a commit to ubuntu/WSL that referenced this issue Apr 24, 2024

Workaround to build image

80b09bc

until actions/runner-images#9733 is fixed.

qicosmos mentioned this issue Apr 24, 2024

fix ci alibaba/yalantinglibs#667

Merged

Luthaf mentioned this issue Apr 24, 2024

Implement faster ASE neighbor list metatensor/metatrain#172

Merged

siarheiyelin added a commit to epam/UUI that referenced this issue Apr 24, 2024

Upgrade Playwright to 1.43.1 (#2200)

3460998

Upgrade Playwright to 1.43.1 and apply temporary fix to the global GitHub issue (actions/runner-images#9733)

satoshiotomakan added a commit to trustwallet/wallet-core that referenced this issue Apr 24, 2024

[CI]: Apply a work around actions/runner-images#9733

83c77be

skirpichev added a commit to diofant/diofant that referenced this issue Apr 24, 2024

Workaround actions/runner-images#9733

d82b682

ediardi added a commit to ediardi/poo-151-2024 that referenced this issue Apr 24, 2024

https://github.com/actions/runner-images/issues/9733

86de2ea

workaround

lukaszstolarczuk added a commit to lukaszstolarczuk/unified-memory-framework that referenced this issue Apr 24, 2024

[CI] skip one repo on apt update

436b770

It's a workaround for GHA issue. Ref. actions/runner-images#9733

lukaszstolarczuk mentioned this issue Apr 24, 2024

[CI] Workaround for GHA issue oneapi-src/unified-memory-framework#456

Closed

lukaszstolarczuk added a commit to lukaszstolarczuk/unified-memory-framework that referenced this issue Apr 24, 2024

[CI] skip one repo on apt update

6e5a369

It's a workaround for GHA issue. Ref. actions/runner-images#9733

ediardi added a commit to ediardi/poo-151-2024 that referenced this issue Apr 24, 2024

https://github.com/actions/runner-images/issues/9733

04a395c

workaround

ediardi added a commit to ediardi/poo-151-2024 that referenced this issue Apr 24, 2024

Revert "actions/runner-images#9733"

ad8e3f6

This reverts commit 04a395c.

furkansahin mentioned this issue Apr 24, 2024

Switch self-hosted runners to ubicloud github runners frequency-chain/frequency#1877

Merged

9 tasks

mikhailkoliada closed this as completed Apr 24, 2024

skirpichev added a commit to skirpichev/mpmath that referenced this issue Apr 24, 2024

Workaround actions/runner-images#9733

0e22a5e

skirpichev added a commit to skirpichev/mpmath that referenced this issue Apr 24, 2024

Revert "Workaround actions/runner-images#9733"

996a33f

This reverts commit 0e22a5e.

kamiazya mentioned this issue Apr 24, 2024

Remove apt-get cache clear scripts from GraphvizInstaller ts-graphviz/setup-graphviz#610

Merged

skirpichev added a commit to diofant/diofant that referenced this issue Apr 24, 2024

Revert "Workaround actions/runner-images#9733"

2b62c99

This reverts commit d82b682.

vasild pushed a commit to vasild/bitcoin that referenced this issue Apr 30, 2024

ci: Workaround Microsoft mirror issue for GitHub Action

ded129a

Upstream: - issue -- actions/runner-images#9733 - code snippet -- actions/runner-images#9733 (comment)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Github actions fails after new VMs deployed #9733

Github actions fails after new VMs deployed #9733

eenagy commented Apr 24, 2024 •

edited by mikhailkoliada

Loading

greenstatic commented Apr 24, 2024

n-thumann commented Apr 24, 2024 •

edited

Loading

jserpapinto commented Apr 24, 2024

Antse commented Apr 24, 2024

mihaTrajbaric commented Apr 24, 2024

roharon commented Apr 24, 2024

reachlin commented Apr 24, 2024 •

edited

Loading

sciutand commented Apr 24, 2024

zviryatko commented Apr 24, 2024

JesusPoderoso commented Apr 24, 2024

yongsk0066 commented Apr 24, 2024

pavanm-huma commented Apr 24, 2024

mikhailkoliada commented Apr 24, 2024

sciutand commented Apr 24, 2024

mikhailkoliada commented Apr 24, 2024

rvecmanis commented Apr 24, 2024

pntgoswami18 commented Apr 24, 2024

mikhailkoliada commented Apr 24, 2024

Github actions fails after new VMs deployed #9733

Github actions fails after new VMs deployed #9733

Comments

eenagy commented Apr 24, 2024 • edited by mikhailkoliada Loading

Description

Platforms affected

Runner images affected

Image version and build link

Is it regression?

Expected behavior

Actual behavior

Repro steps

Temporary Workaround

Update 13:10 UTC issue has been reported fixed

greenstatic commented Apr 24, 2024

n-thumann commented Apr 24, 2024 • edited Loading

jserpapinto commented Apr 24, 2024

Antse commented Apr 24, 2024

mihaTrajbaric commented Apr 24, 2024

roharon commented Apr 24, 2024

reachlin commented Apr 24, 2024 • edited Loading

sciutand commented Apr 24, 2024

zviryatko commented Apr 24, 2024

JesusPoderoso commented Apr 24, 2024

yongsk0066 commented Apr 24, 2024

pavanm-huma commented Apr 24, 2024

mikhailkoliada commented Apr 24, 2024

sciutand commented Apr 24, 2024

mikhailkoliada commented Apr 24, 2024

Update 13:10 UTC issue has been reported fixed

rvecmanis commented Apr 24, 2024

pntgoswami18 commented Apr 24, 2024

mikhailkoliada commented Apr 24, 2024

eenagy commented Apr 24, 2024 •

edited by mikhailkoliada

Loading

n-thumann commented Apr 24, 2024 •

edited

Loading

reachlin commented Apr 24, 2024 •

edited

Loading