SSL issue when installing tool through databricks labs install ...

[wouove]

Describe the issue

I am not able to install tools in my workspace using databricks labs install .... There is an SSL issue. I'd like to install databricks lab's dqx, but I got the same error when trying to install databricks lab's ucx.

Steps to reproduce the behavior

Please list the steps required to reproduce the issue, for example:

1. Run databricks labs install dqx
2. Error is returned

Expected Behavior

I expect dqx to get installed without any issues.

Actual Behavior

The following error is returned:

ERROR: Could not find a version that satisfies the requirement hatchling (from versions: none)
      ERROR: No matching distribution found for hatchling
      WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
      Could not fetch URL https://***:****@****/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='****', port=443): Max retries exceeded with url: /pypi/***/simple/pip/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
      [end of output]

Some context

We do use a private package index for our private packages, set in global.index-url, which should redirect to PyPI. When I unset global.index-url it was still unable to install dqx.
When I created a virtual env myself, I was able to install hatchling in there.

OS and CLI version

MacOS Sonoma 14.6.1
Databricks CLI v0.239.1

Is this a regression?

Over a year ago, I was able to install another databricks labs tool, dbx, through the databricks CLI.

Debug Logs

14:26:54  INFO start pid=32584 version=0.239.1 args="/opt/homebrew/bin/databricks, labs, install, dqx, --debug"
14:26:54 DEBUG Fetching latest releases for databrickslabs/dqx from GitHub API pid=32584
14:26:54 DEBUG Latest dqx version is: v0.1.12 pid=32584
14:26:54 DEBUG Reading labs.yml@v0.1.12 from databrickslabs/dqx pid=32584
14:26:54 DEBUG Loading login configuration from: /Users/***/.databricks/labs/dqx/config/login.json pid=32584
14:26:54 DEBUG Using workspace-level login profile: DEFAULT pid=32584
14:26:54 DEBUG Loading DEFAULT profile from /Users/***/.databrickscfg pid=32584 sdk=true
14:26:54 DEBUG Resolved login: Config: host=https://***.cloud.databricks.com, cluster_id=0628-120112-1xg8obvb, token=***, profile=DEFAULT, config_file=/Users/***/.databrickscfg, databricks_cli_path=/opt/homebrew/bin/databricks. Env: DATABRICKS_CLI_PATH pid=32584 sdk=true
14:26:54 DEBUG Writing auth configuration to: /Users/***/.databricks/labs/dqx/config/login.json pid=32584
⣾ Cleaning up previous installation if necessary14:26:54 DEBUG Downloading zipball for v0.1.12 from databrickslabs/dqx pid=32584
⣻ Downloading and unpacking zipball for v0.1.1214:26:55 DEBUG Unpacking zipball to: /Users/***/.databricks/labs/dqx/lib pid=32584
⣾ Detecting all installed Python interpreters on the system14:26:55 DEBUG found 14 potential alternative Python versions in $PATH pid=32584
14:26:55 DEBUG running: /Users/***/.pyenv/shims/python --version pid=32584
14:26:55 DEBUG /Users/***/.pyenv/shims/python --version: Python 3.10.3 pid=32584
14:26:55 DEBUG running: /Users/***/.pyenv/shims/python3 --version pid=32584
14:26:55 DEBUG /Users/***/.pyenv/shims/python3 --version: Python 3.10.3 pid=32584
14:26:55 DEBUG running: /Users/***/.pyenv/shims/python3.10 --version pid=32584
⣽ Detecting all installed Python interpreters on the system14:26:55 DEBUG /Users/***/.pyenv/shims/python3.10 --version: Python 3.10.3 pid=32584
14:26:55 DEBUG running: /Users/***/.pyenv/shims/python3.11 --version pid=32584
14:26:55 DEBUG /Users/***/.pyenv/shims/python3.11 --version: Python 3.11.11 pid=32584
14:26:55 DEBUG running: /Users/***/.pyenv/shims/python3.9 --version pid=32584
14:26:55 DEBUG /Users/***/.pyenv/shims/python3.9 --version: Python 3.9.21 pid=32584
14:26:55 DEBUG running: /opt/homebrew/Cellar/python@3.13/3.13.1/Frameworks/Python.framework/Versions/3.13/bin/python3.13 --version pid=32584
14:26:55 DEBUG /opt/homebrew/Cellar/python@3.13/3.13.1/Frameworks/Python.framework/Versions/3.13/bin/python3.13 --version: Python 3.13.1 pid=32584
14:26:55 DEBUG running: /opt/homebrew/Cellar/python@3.10/3.10.16/Frameworks/Python.framework/Versions/3.10/bin/python3.10 --version pid=32584
14:26:55 DEBUG /opt/homebrew/Cellar/python@3.10/3.10.16/Frameworks/Python.framework/Versions/3.10/bin/python3.10 --version: Python 3.10.16 pid=32584
14:26:55 DEBUG running: /opt/homebrew/Cellar/python@3.11/3.11.11/Frameworks/Python.framework/Versions/3.11/bin/python3.11 --version pid=32584
⣻ Detecting all installed Python interpreters on the system14:26:55 DEBUG /opt/homebrew/Cellar/python@3.11/3.11.11/Frameworks/Python.framework/Versions/3.11/bin/python3.11 --version: Python 3.11.11 pid=32584
14:26:55 DEBUG running: /opt/homebrew/Cellar/python@3.12/3.12.8/Frameworks/Python.framework/Versions/3.12/bin/python3.12 --version pid=32584
14:26:55 DEBUG /opt/homebrew/Cellar/python@3.12/3.12.8/Frameworks/Python.framework/Versions/3.12/bin/python3.12 --version: Python 3.12.8 pid=32584
14:26:55 DEBUG running: /opt/homebrew/Cellar/python@3.9/3.9.21/Frameworks/Python.framework/Versions/3.9/bin/python3.9 --version pid=32584
14:26:55 DEBUG /opt/homebrew/Cellar/python@3.9/3.9.21/Frameworks/Python.framework/Versions/3.9/bin/python3.9 --version: Python 3.9.21 pid=32584
14:26:55 DEBUG running: /usr/local/Cellar/python@3.12/3.12.5/Frameworks/Python.framework/Versions/3.12/bin/python3.12 --version pid=32584
14:26:55 DEBUG /usr/local/Cellar/python@3.12/3.12.5/Frameworks/Python.framework/Versions/3.12/bin/python3.12 --version: Python 3.12.5 pid=32584
14:26:55 DEBUG running: /usr/bin/python3 --version pid=32584
14:26:55 DEBUG /usr/bin/python3 --version: Python 3.9.6 pid=32584
14:26:55 DEBUG Detected Python v3.10.3 at: /Users/***/.pyenv/shims/python pid=32584
14:26:55 DEBUG Creating Python Virtual Environment at: /Users/***/.databricks/labs/dqx/state/venv pid=32584
14:26:55 DEBUG running: /Users/***/.pyenv/shims/python -m venv /Users/***/.databricks/labs/dqx/state/venv pid=32584
⣽ Creating Virtual Environment with Python v3.10.314:26:57 DEBUG Installing Python dependencies for: /Users/***/.databricks/labs/dqx/lib pid=32584
14:26:57 DEBUG running: /Users/***/.databricks/labs/dqx/state/venv/bin/python3 -m pip install --upgrade --upgrade-strategy eager . pid=32584
⣯ Installing Python library dependenciesWARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Looking in indexes: https://***:****@***.com/pypi/***/simple/
Processing /Users/***/.databricks/labs/dqx/lib
  Installing build dependencies: started
  Installing build dependencies: finished with status 'error'
  error: subprocess-exited-with-error

  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [12 lines of output]
      WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
      Looking in indexes: https://***:****@***.com/pypi/***/simple/
      WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /pypi/***/simple/hatchling/
      WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /pypi/***/simple/hatchling/
      WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /pypi/***/simple/hatchling/
      WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /pypi/***/simple/hatchling/
      WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /pypi/***/simple/hatchling/
      Could not fetch URL https://***:****@***.com/pypi/***/simple/hatchling/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='***.com', port=443): Max retries exceeded with url: /pypi/***/simple/hatchling/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
      ERROR: Could not find a version that satisfies the requirement hatchling (from versions: none)
      ERROR: No matching distribution found for hatchling
      WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
      Could not fetch URL https://***:****@***.com/pypi/***/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='***.com', port=443): Max retries exceeded with url: /pypi/***/simple/pip/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Could not fetch URL https://***:****@***.com/pypi/***/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='***.com', port=443): Max retries exceeded with url: /pypi/***/simple/pip/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping

Error: python: failed to install dependencies of .
14:27:06 ERROR failed execution pid=32584 exit_code=1 error="python: failed to install dependencies of ."