Bug: Install library from git using ssh is not success on python3.12 and python3.13 #153

husseinmimi · 2025-01-22T17:35:50Z

Description:

When i was building my python lambda i can't download packages from github repo, installing packages worked using pip command, but it is failing using sam build and it failed to build my sam template

Steps to reproduce:

Run Docker container with Python 3.12

SSH_KEY_PATH="${HOME}/.ssh"
docker run -it  \
--entrypoint /bin/bash \
-v "${SSH_KEY_PATH}:/root/.ssh" \
 public.ecr.aws/sam/build-python3.12:latest

Inside the container

Add SSH key

chmod 400 ~/.ssh/github  
eval `ssh-agent -s`
ssh-add ~/.ssh/github  
ssh-keyscan github.com >> ~/.ssh/known_hosts

Add requirements to test

echo "git+ssh://git@github.com/aio-libs/aiohttp.git@v3.11.11" >> requirements.txt

Install vim to paste sam template

dnf install vim -y
vim test_sam.yml

Paste python3.12 sam template for lambda

AWSTemplateFormatVersion: '2010-09-09'
Transform:
  - AWS::Serverless-2016-10-31
Description: test
Resources:
  lambda:
    Type: AWS::Serverless::Function
    DependsOn:
      - LambdaRole
    Properties:
      FunctionName: test
      Handler: app.listen
      Runtime: python3.12
      CodeUri: ./
      MemorySize: 512
      Timeout: 300
      Environment:
        Variables:
          ENV: 'dev'

Build Sam

sam build  --debug --template test_sam.yml

Observed result:

bash-5.2# sam build  --debug --template test_sam.yml
2025-01-22 17:31:27,557 | Using SAM Template at /var/task/test_sam.yml                                                                                                                
2025-01-22 17:31:27,559 | No config file found in this directory.                                                                                                                     
2025-01-22 17:31:27,560 | OSError occurred while reading TOML file: [Errno 2] No such file or directory: '/var/task/samconfig.toml'                                                   
2025-01-22 17:31:27,561 | Config file location: /var/task/samconfig.toml                                                                                                              
2025-01-22 17:31:27,561 | Config file '/var/task/samconfig.toml' does not exist                                                                                                       
2025-01-22 17:31:27,573 | OSError occurred while reading TOML file: [Errno 2] No such file or directory: '/var/task/samconfig.toml'                                                   
2025-01-22 17:31:27,574 | Using config file: samconfig.toml, config environment: default                                                                                              
2025-01-22 17:31:27,574 | Expand command line arguments to:                                                                                                                           
2025-01-22 17:31:27,575 | --template_file=/var/task/test_sam.yml --mount_with=READ --build_dir=.aws-sam/build --cache_dir=.aws-sam/cache                                              
2025-01-22 17:31:27,629 | 'build' command is called                                                                                                                                   
2025-01-22 17:31:27,631 | No Parameters detected in the template                                                                                                                      
2025-01-22 17:31:27,646 | There is no customer defined id or cdk path defined for resource lambda, so we will use the resource logical id as the resource id                          
2025-01-22 17:31:27,647 | 0 stacks found in the template                                                                                                                              
2025-01-22 17:31:27,647 | No Parameters detected in the template                                                                                                                      
2025-01-22 17:31:27,664 | There is no customer defined id or cdk path defined for resource lambda, so we will use the resource logical id as the resource id                          
2025-01-22 17:31:27,664 | 1 resources found in the stack                                                                                                                              
2025-01-22 17:31:27,665 | Found Serverless function with name='lambda' and CodeUri='./'                                                                                               
2025-01-22 17:31:27,666 | --base-dir is not presented, adjusting uri ./ relative to /var/task/test_sam.yml                                                                            
2025-01-22 17:31:27,686 | 1 resources found in the stack                                                                                                                              
2025-01-22 17:31:27,692 | Found Serverless function with name='lambda' and CodeUri='./'                                                                                               
2025-01-22 17:31:27,699 | Instantiating build definitions                                                                                                                             
2025-01-22 17:31:27,700 | No previous build graph found, generating new one                                                                                                           
2025-01-22 17:31:27,704 | Unique function build definition found, adding as new (Function Build Definition: BuildDefinition(python3.12, /var/task, Zip, ,                             
9ac2641a-a1c2-4be7-bc02-7f114631de01, {}, {}, x86_64, []), Function: Function({'function_id': 'lambda', 'name': 'lambda', 'functionname': 'test', 'runtime': 'python3.12', 'memory':  
512, 'timeout': 300, 'handler': 'app.listen', 'imageuri': None, 'packagetype': 'Zip', 'imageconfig': None, 'codeuri': '/var/task', 'environment': {'Variables': {'ENV': 'dev'}},      
'rolearn': None, 'layers': [], 'events': None, 'metadata': {'SamResourceId': 'lambda'}, 'inlinecode': None, 'codesign_config_arn': None, 'architectures': None, 'function_url_config':
None, 'function_build_info': <FunctionBuildInfo.BuildableZip: ('BuildableZip', 'Regular ZIP function which can be build with SAM CLI')>, 'stack_path': '',                            
'runtime_management_config': None, 'logging_config': None}))                                                                                                                          
2025-01-22 17:31:27,709 | Building codeuri: /var/task runtime: python3.12 architecture: x86_64 functions: lambda                                                                      
2025-01-22 17:31:27,710 | Building to following folder /var/task/.aws-sam/build/lambda                                                                                                
2025-01-22 17:31:27,715 | Loading workflow module 'aws_lambda_builders.workflows'                                                                                                     
2025-01-22 17:31:27,720 | Registering workflow 'CustomMakeBuilder' with capability 'Capability(language='provided', dependency_manager=None, application_framework=None)'             
2025-01-22 17:31:27,722 | Registering workflow 'DotnetCliPackageBuilder' with capability 'Capability(language='dotnet', dependency_manager='cli-package', application_framework=None)'
2025-01-22 17:31:27,723 | Registering workflow 'GoModulesBuilder' with capability 'Capability(language='go', dependency_manager='modules', application_framework=None)'               
2025-01-22 17:31:27,725 | Registering workflow 'JavaGradleWorkflow' with capability 'Capability(language='java', dependency_manager='gradle', application_framework=None)'            
2025-01-22 17:31:27,727 | Registering workflow 'JavaMavenWorkflow' with capability 'Capability(language='java', dependency_manager='maven', application_framework=None)'              
2025-01-22 17:31:27,730 | Registering workflow 'NodejsNpmBuilder' with capability 'Capability(language='nodejs', dependency_manager='npm', application_framework=None)'               
2025-01-22 17:31:27,732 | Registering workflow 'NodejsNpmEsbuildBuilder' with capability 'Capability(language='nodejs', dependency_manager='npm-esbuild', application_framework=None)'
2025-01-22 17:31:27,737 | Registering workflow 'PythonPipBuilder' with capability 'Capability(language='python', dependency_manager='pip', application_framework=None)'               
2025-01-22 17:31:27,757 | Registering workflow 'RubyBundlerBuilder' with capability 'Capability(language='ruby', dependency_manager='bundler', application_framework=None)'           
2025-01-22 17:31:27,758 | Registering workflow 'RustCargoLambdaBuilder' with capability 'Capability(language='rust', dependency_manager='cargo', application_framework=None)'         
2025-01-22 17:31:27,759 | Found workflow 'PythonPipBuilder' to support capabilities 'Capability(language='python', dependency_manager='pip', application_framework=None)'             
2025-01-22 17:31:27,778 | Running workflow 'PythonPipBuilder'                                                                                                                         
2025-01-22 17:31:27,779 |  Running PythonPipBuilder:ResolveDependencies                                                                                                               
2025-01-22 17:31:27,819 | calling pip download -r /var/task/requirements.txt --dest /tmp/tmp3c7dm8ym --exists-action i                                                                
2025-01-22 17:31:45,975 | pip stdout: b"Collecting git+ssh://****@github.com/aio-libs/aiohttp.git@v3.11.11 (from -r /var/task/requirements.txt (line 1))\n  Cloning                   
ssh://****@github.com/aio-libs/aiohttp.git (to revision v3.11.11) to /tmp/pip-req-build-7509bqax\n  Resolved ssh://****@github.com/aio-libs/aiohttp.git to commit                     
d8d79215ee4f27742b8ce96ea3a0d21756e6afde\n  Installing build dependencies: started\n  Installing build dependencies: finished with status 'done'\n  Getting requirements to build     
wheel: started\n  Getting requirements to build wheel: finished with status 'done'\n  Preparing metadata (pyproject.toml): started\n  Preparing metadata (pyproject.toml): finished   
with status 'done'\nCollecting aiohappyeyeballs>=2.3.0 (from aiohttp==3.11.11->-r /var/task/requirements.txt (line 1))\n  Downloading aiohappyeyeballs-2.4.4-py3-none-any.whl.metadata
(6.1 kB)\nCollecting aiosignal>=1.1.2 (from aiohttp==3.11.11->-r /var/task/requirements.txt (line 1))\n  Downloading aiosignal-1.3.2-py2.py3-none-any.whl.metadata (3.8               
kB)\nCollecting attrs>=17.3.0 (from aiohttp==3.11.11->-r /var/task/requirements.txt (line 1))\n  Downloading attrs-24.3.0-py3-none-any.whl.metadata (11 kB)\nCollecting               
frozenlist>=1.1.1 (from aiohttp==3.11.11->-r /var/task/requirements.txt (line 1))\n  Downloading                                                                                      
frozenlist-1.5.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (13 kB)\nCollecting multidict<7.0,>=4.5 (from aiohttp==3.11.11->-r /var/task/requirements.txt  
(line 1))\n  Downloading multidict-6.1.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (5.0 kB)\nCollecting propcache>=0.2.0 (from aiohttp==3.11.11->-r       
/var/task/requirements.txt (line 1))\n  Downloading propcache-0.2.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (9.2 kB)\nCollecting yarl<2.0,>=1.17.0 (from
aiohttp==3.11.11->-r /var/task/requirements.txt (line 1))\n  Downloading yarl-1.18.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (69 kB)\nCollecting        
idna>=2.0 (from yarl<2.0,>=1.17.0->aiohttp==3.11.11->-r /var/task/requirements.txt (line 1))\n  Downloading idna-3.10-py3-none-any.whl.metadata (10 kB)\nDownloading                  
aiohappyeyeballs-2.4.4-py3-none-any.whl (14 kB)\nDownloading aiosignal-1.3.2-py2.py3-none-any.whl (7.6 kB)\nDownloading attrs-24.3.0-py3-none-any.whl (63 kB)\nDownloading            
frozenlist-1.5.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (282 kB)\nDownloading multidict-6.1.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (130 
kB)\nDownloading propcache-0.2.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (241 kB)\nDownloading                                                                   
yarl-1.18.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (332 kB)\nDownloading idna-3.10-py3-none-any.whl (70 kB)\nSaved /tmp/tmp3c7dm8ym/aiohttp-3.11.11.zip\nSaved  
/tmp/tmp3c7dm8ym/aiohappyeyeballs-2.4.4-py3-none-any.whl\nSaved /tmp/tmp3c7dm8ym/aiosignal-1.3.2-py2.py3-none-any.whl\nSaved /tmp/tmp3c7dm8ym/attrs-24.3.0-py3-none-any.whl\nSaved    
/tmp/tmp3c7dm8ym/frozenlist-1.5.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl\nSaved                                                                                 
/tmp/tmp3c7dm8ym/multidict-6.1.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl\nSaved                                                                                  
/tmp/tmp3c7dm8ym/propcache-0.2.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl\nSaved                                                                                  
/tmp/tmp3c7dm8ym/yarl-1.18.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl\nSaved /tmp/tmp3c7dm8ym/idna-3.10-py3-none-any.whl\nSuccessfully downloaded aiohttp         
aiohappyeyeballs aiosignal attrs frozenlist multidict propcache yarl idna\n"                                                                                                          
2025-01-22 17:31:45,990 | pip stderr: b"WARNING: pip is being invoked by an old script wrapper. This will fail in a future version of pip.\nPlease see                                
https://github.com/pypa/pip/issues/5599 for advice on fixing the underlying issue.\nTo avoid this problem you can invoke Python with '-m pip' instead of running pip directly.\n      
Running command git clone --filter=blob:none --quiet 'ssh://****@github.com/aio-libs/aiohttp.git' /tmp/pip-req-build-7509bqax\n  Running command git checkout -q                      
d8d79215ee4f27742b8ce96ea3a0d21756e6afde\n  Running command git submodule update --init --recursive -q\n\n[notice] A new release of pip is available: 24.2 -> 24.3.1\n[notice] To     
update, run: pip install --upgrade pip\n"                                                                                                                                             
2025-01-22 17:31:46,176 | Non zero rc (1) from the setup.py egg_info command: b'Traceback (most recent call last):\n  File "<string>", line 1, in <module>\nModuleNotFoundError: No   
module named \'setuptools\'\n'                                                                                                                                                        
2025-01-22 17:31:46,177 | Using fallback location for PKG-INFO file in package directory: /tmp/tmpq8gl6mbt/aiohttp                                                                    
2025-01-22 17:31:46,183 | PythonPipBuilder:ResolveDependencies raised unhandled exception                                                                                             
Traceback (most recent call last):                                                                                                                                                    
  File "aws_lambda_builders/workflow.py", line 374, in run                                                                                                                            
  File "aws_lambda_builders/workflows/python_pip/actions.py", line 71, in execute                                                                                                     
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 158, in build_dependencies                                                                                        
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 263, in build_site_packages                                                                                       
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 287, in _download_dependencies                                                                                    
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 370, in _download_all_dependencies                                                                                
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 371, in <setcomp>                                                                                                 
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 523, in __init__                                                                                                  
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 565, in _calculate_name_and_version                                                                               
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 707, in get_package_name_and_version                                                                              
  File "aws_lambda_builders/workflows/python_pip/packager.py", line 619, in _get_pkg_info_filepath                                                                                    
aws_lambda_builders.workflows.python_pip.packager.UnsupportedPackageError: Unable to retrieve name/version for package: aiohttp                                                       

Build Failed
2025-01-22 17:31:46,192 | Telemetry endpoint configured to be https://aws-serverless-tools-telemetry.us-west-2.amazonaws.com/metrics                                                  
2025-01-22 17:31:46,216 | Telemetry endpoint configured to be https://aws-serverless-tools-telemetry.us-west-2.amazonaws.com/metrics                                                  
2025-01-22 17:31:46,217 | Sending Telemetry: {'metrics': [{'commandRun': {'requestId': '19352686-8229-439b-a4e9-78fbd20af953', 'installationId':                                      
'f02e5575-fe7a-4805-8cb7-b230e61a4de7', 'sessionId': '243b271f-e9cf-4703-84d1-b3ec2510f9fe', 'executionEnvironment': 'CLI', 'ci': False, 'pyversion': '3.11.10', 'samcliVersion':     
'1.132.0', 'awsProfileProvided': False, 'debugFlagProvided': True, 'region': '', 'commandName': 'sam build', 'metricSpecificAttributes': {'projectType': 'CFN', 'gitOrigin': None,    
'projectName': '0ebb429fa86d481c2630fac53db1c91cffed5d4d41d1021c179444eb67e7ee0b', 'initialCommit': None}, 'duration': 18617, 'exitReason': 'WorkflowUnknownError', 'exitCode': 1}}]} 
2025-01-22 17:31:46,217 | Unable to find Click Context for getting session_id.                                                                                                        
2025-01-22 17:31:46,221 | Sending Telemetry: {'metrics': [{'events': {'requestId': '7161d8d8-fbf0-463a-94b7-023663c84012', 'installationId': 'f02e5575-fe7a-4805-8cb7-b230e61a4de7',  
'sessionId': '243b271f-e9cf-4703-84d1-b3ec2510f9fe', 'executionEnvironment': 'CLI', 'ci': False, 'pyversion': '3.11.10', 'samcliVersion': '1.132.0', 'commandName': 'sam build',      
'metricSpecificAttributes': {'events': [{'event_name': 'SamConfigFileExtension', 'event_value': '.toml', 'thread_id': '7d14c9db89704d2c97cc7930c4a0e511', 'time_stamp': '2025-01-22   
17:31:27.561', 'exception_name': None}, {'event_name': 'SamConfigFileExtension', 'event_value': '.toml', 'thread_id': 'd67180278a6e46d2a5745e958d12cd2a', 'time_stamp': '2025-01-22   
17:31:27.574', 'exception_name': None}, {'event_name': 'BuildFunctionRuntime', 'event_value': 'python3.12', 'thread_id': 'b7b41f6c0e1346428cf93849577035f8', 'time_stamp': '2025-01-22
17:31:27.698', 'exception_name': None}, {'event_name': 'BuildWorkflowUsed', 'event_value': 'python-pip', 'thread_id': '366d46e446194dc08ef1c7fc9042f38c', 'time_stamp': '2025-01-22   
17:31:27.710', 'exception_name': None}]}}}]}                                                                                                                                          
2025-01-22 17:31:46,791 | HTTPSConnectionPool(host='aws-serverless-tools-telemetry.us-west-2.amazonaws.com', port=443): Read timed out. (read timeout=0.1)                            
Error: PythonPipBuilder:ResolveDependencies - Unable to retrieve name/version for package: aiohttp
2025-01-22 17:31:46,798 | HTTPSConnectionPool(host='aws-serverless-tools-telemetry.us-west-2.amazonaws.com', port=443): Read timed out. (read timeout=0.1)                            
bash-5.2#

Expected result:

Build Success

Additional environment details (Ex: Windows, Mac, Amazon Linux etc)

Used Images: public.ecr.aws/sam/build-python3.12:latest and public.ecr.aws/sam/build-python3.13:latest
Fixed by install setuptools while running by pip3 install setuptools

The text was updated successfully, but these errors were encountered:

husseinmimi · 2025-01-23T14:51:47Z

@hawflau @hnnasit can you have a look into this issue ?

roger-zhangg · 2025-01-24T03:15:47Z

git+ssh://git@github.com/aio-libs/aiohttp.git@v3.11.11 it seems adding dependency this way will actually build the package on the fly. Which I don't think sam support that. Is there any limitation that you can't use the package directly from pipy?

husseinmimi · 2025-01-24T13:28:05Z

@roger-zhangg i did this as example and to help community to reproduce the issue, but i use this to install private package, that was work on python3.11 and before, but now it is not working on python3.12 and python3.13

roger-zhangg · 2025-01-24T19:09:40Z

Thanks for the context, I believe sam is doing a pip download -r /var/task/requirements.txt could you help to try if the error is the same if you run the command directly?

husseinmimi · 2025-01-25T09:18:04Z

@roger-zhangg i have a flow that build venv with flake8 to do syntax check before sam build, it work and successful to install venv with the package but it fail on sam build, I don't know why, but it worked when i tried to install setuptools before sam build then it worked, I don't know how sam build install packages, but we started see this error on python3.12 and 3.13 images

husseinmimi · 2025-01-27T07:34:18Z

@roger-zhangg please let me know if there any other info needed

roger-zhangg · 2025-01-27T17:35:19Z

Thanks @husseinmimi , will investigate more on this one.

husseinmimi · 2025-01-29T09:38:48Z

@roger-zhangg any updates ?

anaszakarneh1 · 2025-01-29T09:50:03Z

any updates on this?

husseinmimi · 2025-02-03T19:31:28Z

@roger-zhangg can this be escalated ?

husseinmimi · 2025-02-08T19:09:37Z

@roger-zhangg any updates

husseinmimi · 2025-02-26T19:51:36Z

@roger-zhangg @vicheey any updates, can we get this done ?

husseinmimi · 2025-03-04T11:43:27Z

any updates ?

husseinmimi added the stage/needs-triage Automatically applied to new issues and PRs, indicating they haven't been looked at. label Jan 22, 2025

husseinmimi linked a pull request Jan 22, 2025 that will close this issue

Install setuptools for python3.12 and python3.13 #154

Open

roger-zhangg added blocked/more-info-needed More info is needed from the requester. If no response in 14 days, it will become stale. and removed stage/needs-triage Automatically applied to new issues and PRs, indicating they haven't been looked at. labels Jan 24, 2025

roger-zhangg removed the blocked/more-info-needed More info is needed from the requester. If no response in 14 days, it will become stale. label Jan 27, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Bug: Install library from git using ssh is not success on python3.12 and python3.13 #153

Bug: Install library from git using ssh is not success on python3.12 and python3.13 #153

husseinmimi commented Jan 22, 2025

husseinmimi commented Jan 23, 2025 •

edited

Loading

roger-zhangg commented Jan 24, 2025

husseinmimi commented Jan 24, 2025

roger-zhangg commented Jan 24, 2025

husseinmimi commented Jan 25, 2025

husseinmimi commented Jan 27, 2025

roger-zhangg commented Jan 27, 2025

husseinmimi commented Jan 29, 2025

anaszakarneh1 commented Jan 29, 2025

husseinmimi commented Feb 3, 2025

husseinmimi commented Feb 8, 2025

husseinmimi commented Feb 26, 2025

husseinmimi commented Mar 4, 2025

Bug: Install library from git using ssh is not success on python3.12 and python3.13 #153

Bug: Install library from git using ssh is not success on python3.12 and python3.13 #153

Comments

husseinmimi commented Jan 22, 2025

Description:

Steps to reproduce:

Run Docker container with Python 3.12

Inside the container

Add SSH key

Add requirements to test

Install vim to paste sam template

Paste python3.12 sam template for lambda

Build Sam

Observed result:

Expected result:

Additional environment details (Ex: Windows, Mac, Amazon Linux etc)

husseinmimi commented Jan 23, 2025 • edited Loading

roger-zhangg commented Jan 24, 2025

husseinmimi commented Jan 24, 2025

roger-zhangg commented Jan 24, 2025

husseinmimi commented Jan 25, 2025

husseinmimi commented Jan 27, 2025

roger-zhangg commented Jan 27, 2025

husseinmimi commented Jan 29, 2025

anaszakarneh1 commented Jan 29, 2025

husseinmimi commented Feb 3, 2025

husseinmimi commented Feb 8, 2025

husseinmimi commented Feb 26, 2025

husseinmimi commented Mar 4, 2025

husseinmimi commented Jan 23, 2025 •

edited

Loading