Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NethVoice: Docker Rate Limit Error Causes "create-module" Action to Fail #7169

Closed
Amygos opened this issue Nov 20, 2024 · 1 comment
Closed
Labels
nethvoice Bug or features releted to the NethVoice project
Milestone

Comments

@Amygos
Copy link
Member

Amygos commented Nov 20, 2024

The create-module action fails during the "05pullimages" step due to a rate limit error when pulling the redis:7.0.10-alpine image from Docker Hub. The error message indicates the rate limit has been exceeded.

Relevant logs:

  • The pull attempt results in multiple retries, eventually failing with a CalledProcessError in podman-pull-missing.
  • The overall status of the action is marked as "aborted."

Steps to reproduce

  • Attempt to execute add-module nethvoice

Expected behavior

The create-module action completes successfully without encountering rate limit errors.

Actual behavior

The create-module action fails during the "05pullimages" step. The Redis image pull triggers a Docker Hub rate limit error (toomanyrequests), causing multiple retries. After exhausting retries, the process aborts with a CalledProcessError.

Nov 20 13:48:49 node.example.com agent@nethvoice1[66826]: Trying to pull docker.io/library/redis:7.0.10-alpine...
Nov 20 13:49:52 node.example.com agent@nethvoice1[66826]: time="2024-11-20T13:49:52Z" level=warning msg="Failed, retrying in 1s ... (1/3). Error: copying system image from manifest list: determining manifest MIME type for docker://redis:7.0.10-alpine: reading manifest sha256:98f4ea44e912d0941d29015a4e2448151b94411109c896b5627d94d79306eea7 in docker.io/library/redis: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"
Nov 20 13:50:25 node.example.com agent@nethvoice1[66826]: time="2024-11-20T13:50:25Z" level=warning msg="Failed, retrying in 1s ... (2/3). Error: initializing source docker://redis:7.0.10-alpine: reading manifest 7.0.10-alpine in docker.io/library/redis: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"
Nov 20 13:50:58 node.example.com agent@nethvoice1[66826]: time="2024-11-20T13:50:58Z" level=warning msg="Failed, retrying in 1s ... (3/3). Error: initializing source docker://redis:7.0.10-alpine: reading manifest 7.0.10-alpine in docker.io/library/redis: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]: Error: copying system image from manifest list: determining manifest MIME type for docker://redis:7.0.10-alpine: reading manifest sha256:98f4ea44e912d0941d29015a4e2448151b94411109c896b5627d94d79306eea7 in docker.io/library/redis: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]: Traceback (most recent call last):
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:   File "/usr/local/agent/bin/podman-pull-missing", line 35, in <module>
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:     subprocess.run(['podman', 'pull', image_url]).check_returncode()
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:   File "/usr/lib64/python3.11/subprocess.py", line 502, in check_returncode
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:     raise CalledProcessError(self.returncode, self.args, self.stdout,
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]: subprocess.CalledProcessError: Command '['podman', 'pull', 'docker.io/library/redis:7.0.10-alpine']' returned non-zero exit status 125.
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]: Traceback (most recent call last):
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:   File "/usr/local/agent/actions/create-module/05pullimages", line 48, in <module>
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:     agent.run_helper('podman-pull-missing', *images).check_returncode()
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:   File "/usr/lib64/python3.11/subprocess.py", line 502, in check_returncode
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]:     raise CalledProcessError(self.returncode, self.args, self.stdout,
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]: subprocess.CalledProcessError: Command '('podman-pull-missing', 'ghcr.io/nethesis/nethvoice-mariadb:1.1.0', 'ghcr.io/nethesis/nethvoice-freepbx:1.1.0', 'ghcr.io/nethesis/nethvoice-cti-server:1.1.0', 'ghcr.io/nethesis/nethvoice-cti-ui:1.1.0', 'ghcr.io/nethesis/nethvoice-tancredi:1.1.0', 'ghcr.io/nethesis/nethvoice-janus:1.1.0', 'ghcr.io/nethesis/nethvoice-phonebook:1.1.0', 'docker.io/library/redis:7.0.10-alpine', 'ghcr.io/nethesis/nethvoice-reports-ui:1.1.0', 'ghcr.io/nethesis/nethvoice-reports-api:1.1.0')' returned non-zero exit status 1.
Nov 20 13:51:45 node.example.com agent@nethvoice1[66826]: task/module/nethvoice1/824facd1-54ce-444e-b126-9f21f76df6f3: action "create-module" status is "aborted" (1) at step 05pullimages
@Amygos Amygos added the nethvoice Bug or features releted to the NethVoice project label Nov 20, 2024
@Amygos Amygos added this to the NethVoice 1.1 milestone Nov 20, 2024
@Amygos Amygos self-assigned this Nov 20, 2024
@Amygos Amygos removed this from NethServer Nov 20, 2024
@Amygos Amygos moved this from Todo to In Progress in NethVoice Nov 20, 2024
@Amygos Amygos changed the title NethVocie: Docker Rate Limit Error Causes "create-module" Action to Fail NethVoice: Docker Rate Limit Error Causes "create-module" Action to Fail Nov 20, 2024
@Amygos
Copy link
Member Author

Amygos commented Nov 22, 2024

Solution implemented into the ns8-core: #7160

@Amygos Amygos closed this as not planned Won't fix, can't repro, duplicate, stale Nov 22, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in NethVoice Nov 22, 2024
@Amygos Amygos removed their assignment Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
nethvoice Bug or features releted to the NethVoice project
Projects
Status: Done
Development

No branches or pull requests

1 participant