Unable to install airavata-mft with Python3.11

[nandarshan]

Describe the bug
Unable to install airavata-mft with Python3.11. I get the following errors:
-> ERROR: Could not build wheels for grpcio, grpcio-tools, which is required to install pyproject.toml-based projects

To Reproduce
To reproduce,

1. Install python3.11
   
2. If you have already installed airavata-mft, create a virtual environment with python3.11.
   
3. To create venv: python3.11 -m venv <path>
   
4. To activate venv: source <path>/bin/activate
   
5. python3.11 -m pip install airavata-mft-cli
6. Error I got is shown in the following screenshot.

Expected behavior
To install successfully

Additional context 1
System Configuration:

1. Processor: 2.4 GHz 8-Core Intel Core i9
2. Operating System: macOS Ventura Version 13.4
3. Python version: 3.11.4
   

Additional context 2
Even though this issue is for M1/M2 Macs, I found this issue similar to the above error. This issue had a solution which is to install a specific version of grpcio and grpcio-tools. But installing those gave an error in python3.11

On entering the following to the testvenv activated above:

python3.11 -m pip install grpcio==1.47.0rc1

I got the following error

I tried the second command in the solution of this issue.
On entering the following to the testenv activated above:

python3 -m pip install grpcio-tools==1.47.0rc1

I got the following error

Additional context 3
I was able to successfully install the airavata-mft after downgrading to python3.10. Since I was not able to install airavata-mft with python3.11, I am posting this issue.

EDIT: Added backslashes before < and > in the markdown so that <path> is visible in step 3 and step 4 of the "To Reproduce" section.

[machristie]

I ran into this with the airavata-django-portal-sdk, I found the following versions to work well (this was 6 months ago):

grpcio-tools==1.48.2 ; python_version < "3.7"
grpcio-tools==1.51.1 ; python_version >= "3.7"
grpcio==1.48.2 ; python_version < "3.7"
grpcio==1.51.1 ; python_version >= "3.7"

https://github.com/apache/airavata-django-portal-sdk/blob/master/requirements.txt#L8-L11

Also, with the SDK we needed to support Python 3.6, but I wouldn't recommend that for MFT.

[nandarshan]

Description
Thank you for the reply. I installed the grpcio 1.51.1 and grpcio-tools 1.51.1 as I'm experimenting with python3.11 (>= "3.7"). The installations of grpcio and grpcio-tools were successful. But the installation of airavata-mft-cli failed.

To reproduce
I ran the following commands to install them with the required versions.
The commands used to install grpcio and grpcio-tools are:

1. python3.11 -m pip install grpcio==1.51.1
2. python3.11 -m pip install grpcio-tools==1.51.1

The same can be seen in the following screenshot.

After installing grpcio and grpcio-tools, I ran the following command to install the airavata-mft-cli
-> python3.11 -m pip install airavata-mft-cli

But the installation failed with the following error.
-> ERROR: Could not build wheels for grpcio, grpcio-tools, which is required to install pyproject.toml-based projects

This is the same error I got before too.

This error can be seen in the following screenshot

Expected Behavior
To install successfully

Additional Context 1
The System configuration is the same as the one mentioned in my previous comment on this issue.

And, all the commands are executed in a virtual environment which was created using the steps mentioned in my previous comment on this issue

Additional Context 2
Before Installing grpcio and grpcio-tools
I ran the following to uninstall all the previously installed versions of grpcio and grpcio-tools

1. python3.11 -m pip uninstall grpcio
2. python3.11 -m pip uninstall grpcio-tools

[machristie]

I think the problem is here: https://github.com/apache/airavata-mft/blob/master/python-sdk/pyproject.toml#L20. The pyproject.toml requires specific versions of grpcio and grpcio-tools, so even though you've already upgraded them, it reverts to these older versions.

I think you could try just removing grpcio and grpcio-tools from the requires list in pyproject.toml.

[nandarshan]

Thank you so much. It worked. I removed grpcio and grpcio-tools from pyproject.toml in the python-sdk folder and built the sdk locally. It got installed successfully.

[DImuthuUpe]

Closing this as the issue was resolved

[ZhenmeiOng]

I think the problem is here: https://github.com/apache/airavata-mft/blob/master/python-sdk/pyproject.toml#L20. The pyproject.toml requires specific versions of grpcio and grpcio-tools, so even though you've already upgraded them, it reverts to these older versions.

I think you could try just removing grpcio and grpcio-tools from the requires list in pyproject.toml.

how do you do that? I can't find the file on my local files.