Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correct "Max retries exceeded with url .." error #9

Open
edvard-munch opened this issue Nov 3, 2023 · 0 comments
Open

Correct "Max retries exceeded with url .." error #9

edvard-munch opened this issue Nov 3, 2023 · 0 comments

Comments

@edvard-munch
Copy link
Owner

Tracebak

Uploading from yearByYear report
0%| | 0/744 [00:00<?, ?it/s]dict_keys(['season', 'stat', 'team', 'league', 'sequenceNumber'])
............
53%|█████████████████████▋ | 393/744 [02:37<02:35, 2.26it/s]Traceback (most recent call last):
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connection.py", line 157, in _new_conn
(self._dns_host, self.port), self.timeout, **extra_kw
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/util/connection.py", line 61, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
File "/usr/lib/python3.7/socket.py", line 752, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
chunked=chunked,
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", line 376, in _make_request
self._validate_conn(conn)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", line 994, in _validate_conn
conn.connect()
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connection.py", line 334, in connect
conn = self._new_conn()
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connection.py", line 169, in _new_conn
self, "Failed to establish a new connection: %s" % e
urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7fc069ec4c90>: Failed to establish a new connection: [Errno -5] No address associated with hostname

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/urllib3/util/retry.py", line 436, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='statsapi.web.nhl.com', port=443): Max retries exceeded with url: /api/v1/people/8479980?hydrate=stats(splits=yearByYear) (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fc069ec4c90>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/edvard_munch/programming/py/nhl_web_app/manage.py", line 15, in
execute_from_command_line(sys.argv)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/init.py", line 381, in execute_from_command_line
utility.execute()
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/init.py", line 375, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/base.py", line 323, in run_from_argv
self.execute(*args, **cmd_options)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/base.py", line 364, in execute
output = self.handle(*args, **options)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/commands/shell.py", line 92, in handle
exec(sys.stdin.read())
File "", line 8, in
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/init.py", line 148, in call_command
return command.execute(*args, **defaults)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/django/core/management/base.py", line 364, in execute
output = self.handle(*args, **options)
File "/home/edvard_munch/programming/py/nhl_web_app/players/management/commands/upd_pls_sbs.py", line 77, in handle
player_ind_stats(player.nhl_id).json()['people'][0]
File "/home/edvard_munch/programming/py/nhl_web_app/players/management/commands/upd_pls_sbs.py", line 223, in player_ind_stats
response = requests.get(url)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/requests/api.py", line 75, in get
return request('get', url, params=params, **kwargs)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/requests/api.py", line 60, in request
return session.request(method=method, url=url, **kwargs)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "/home/edvard_munch/programming/py/nhl_web_app/venv/lib/python3.7/site-packages/requests/adapters.py", line 516, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='statsapi.web.nhl.com', port=443): Max retries exceeded with url: /api/v1/people/8479980?hydrate=stats(splits=yearByYear) (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fc069ec4c90>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Probably just use urllib3.util.retry
See here: https://stackoverflow.com/a/47475019/7744657

And maybe also add user-agent key for a headers dict
E.g., headers = { 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.111 Safari/537.36'}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant