The msgraph-core 1.1.8 import of LargeFileUpload tasks raises 'ABCMeta' object is not subscriptable error #781

potiuk · 2024-12-18T16:27:35Z

Describe the bug

When you install msgraph-core 1.1.8 and attempt to import LargeFileUploadTask it fails with 'ABCMeta' object is not subscriptable error. This was working fine in 1.1.7.

The stacktrace:

  File "/opt/airflow/airflow/models/dagbag.py", line 384, in parse
    loader.exec_module(new_module)
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/opt/airflow/providers/tests/system/microsoft/azure/example_powerbi_dataset_refresh.py", line 26, in <module>
    from airflow.providers.microsoft.azure.operators.powerbi import PowerBIDatasetRefreshOperator
  File "/opt/airflow/providers/src/airflow/providers/microsoft/azure/operators/powerbi.py", line 25, in <module>
    from airflow.providers.microsoft.azure.hooks.powerbi import (
  File "/opt/airflow/providers/src/airflow/providers/microsoft/azure/hooks/powerbi.py", line 24, in <module>
    from airflow.providers.microsoft.azure.hooks.msgraph import KiotaRequestAdapterHook
  File "/opt/airflow/providers/src/airflow/providers/microsoft/azure/hooks/msgraph.py", line 43, in <module>
    from msgraph_core import APIVersion, GraphClientFactory
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/__init__.py", line 16, in <module>
    from .tasks import PageIterator
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/tasks/__init__.py", line 2, in <module>
    from .large_file_upload import LargeFileUploadTask
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/tasks/large_file_upload.py", line 21, in <module>
    class LargeFileUploadTask:
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/tasks/large_file_upload.py", line 28, in LargeFileUploadTask
    parsable_factory: Optional[ParsableFactory[T]] = None,
TypeError: 'ABCMeta' object is not subscriptable

Example failures in airflow CI: https://github.com/apache/airflow/actions/runs/12394058058/job/34597170319#step:7:2472

Expected behavior

No exception raised when importing the class.

How to reproduce

Install msgraph-core 1.1.8
Run this:

from msgraph_core import APIVersion, GraphClientFactory

Result:

root@5ae8d440acf3:/opt/airflow# pip install msgraph-core==1.1.8
Collecting msgraph-core==1.1.8
  Downloading msgraph_core-1.1.8-py3-none-any.whl.metadata (7.4 kB)
Requirement already satisfied: microsoft-kiota-abstractions<2.0.0,>=1.0.0 in /usr/local/lib/python3.9/site-packages (from msgraph-core==1.1.8) (1.3.3)
Requirement already satisfied: microsoft-kiota-authentication-azure<2.0.0,>=1.0.0 in /usr/local/lib/python3.9/site-packages (from msgraph-core==1.1.8) (1.1.0)
Requirement already satisfied: microsoft-kiota-http<2.0.0,>=1.0.0 in /usr/local/lib/python3.9/site-packages (from msgraph-core==1.1.8) (1.3.3)
Requirement already satisfied: httpx>=0.23.0 in /usr/local/lib/python3.9/site-packages (from httpx[http2]>=0.23.0->msgraph-core==1.1.8) (0.27.0)
Requirement already satisfied: anyio in /usr/local/lib/python3.9/site-packages (from httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (4.7.0)
Requirement already satisfied: certifi in /usr/local/lib/python3.9/site-packages (from httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (2024.12.14)
Requirement already satisfied: httpcore==1.* in /usr/local/lib/python3.9/site-packages (from httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (1.0.7)
Requirement already satisfied: idna in /usr/local/lib/python3.9/site-packages (from httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (3.10)
Requirement already satisfied: sniffio in /usr/local/lib/python3.9/site-packages (from httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /usr/local/lib/python3.9/site-packages (from httpcore==1.*->httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (0.14.0)
Requirement already satisfied: h2<5,>=3 in /usr/local/lib/python3.9/site-packages (from httpx[http2]>=0.23.0->msgraph-core==1.1.8) (4.1.0)
Requirement already satisfied: std-uritemplate>=0.0.38 in /usr/local/lib/python3.9/site-packages (from microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (2.0.1)
Requirement already satisfied: opentelemetry-api>=1.19.0 in /usr/local/lib/python3.9/site-packages (from microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.27.0)
Requirement already satisfied: opentelemetry-sdk>=1.19.0 in /usr/local/lib/python3.9/site-packages (from microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.27.0)
Requirement already satisfied: aiohttp>=3.8.0 in /usr/local/lib/python3.9/site-packages (from microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (3.11.10)
Requirement already satisfied: azure-core>=1.21.1 in /usr/local/lib/python3.9/site-packages (from microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.32.0)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (2.4.4)
Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.3.2)
Requirement already satisfied: async-timeout<6.0,>=4.0 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (5.0.1)
Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (24.3.0)
Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.5.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (6.1.0)
Requirement already satisfied: propcache>=0.2.0 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (0.2.1)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /usr/local/lib/python3.9/site-packages (from aiohttp>=3.8.0->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.18.3)
Requirement already satisfied: requests>=2.21.0 in /usr/local/lib/python3.9/site-packages (from azure-core>=1.21.1->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (2.32.3)
Requirement already satisfied: six>=1.11.0 in /usr/local/lib/python3.9/site-packages (from azure-core>=1.21.1->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.17.0)
Requirement already satisfied: typing-extensions>=4.6.0 in /usr/local/lib/python3.9/site-packages (from azure-core>=1.21.1->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (4.12.2)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.9/site-packages (from h2<5,>=3->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.9/site-packages (from h2<5,>=3->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (4.0.0)
Requirement already satisfied: deprecated>=1.2.6 in /usr/local/lib/python3.9/site-packages (from opentelemetry-api>=1.19.0->microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.2.15)
Requirement already satisfied: importlib-metadata<=8.4.0,>=6.0 in /usr/local/lib/python3.9/site-packages (from opentelemetry-api>=1.19.0->microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (6.11.0)
Requirement already satisfied: opentelemetry-semantic-conventions==0.48b0 in /usr/local/lib/python3.9/site-packages (from opentelemetry-sdk>=1.19.0->microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (0.48b0)
Requirement already satisfied: exceptiongroup>=1.0.2 in /usr/local/lib/python3.9/site-packages (from anyio->httpx>=0.23.0->httpx[http2]>=0.23.0->msgraph-core==1.1.8) (1.2.2)
Requirement already satisfied: wrapt<2,>=1.10 in /usr/local/lib/python3.9/site-packages (from deprecated>=1.2.6->opentelemetry-api>=1.19.0->microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.17.0)
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.9/site-packages (from importlib-metadata<=8.4.0,>=6.0->opentelemetry-api>=1.19.0->microsoft-kiota-abstractions<2.0.0,>=1.0.0->msgraph-core==1.1.8) (3.21.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.9/site-packages (from requests>=2.21.0->azure-core>=1.21.1->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (3.4.0)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.9/site-packages (from requests>=2.21.0->azure-core>=1.21.1->microsoft-kiota-authentication-azure<2.0.0,>=1.0.0->msgraph-core==1.1.8) (1.26.20)
Downloading msgraph_core-1.1.8-py3-none-any.whl (35 kB)
Installing collected packages: msgraph-core
  Attempting uninstall: msgraph-core
    Found existing installation: msgraph-core 1.1.7
    Uninstalling msgraph-core-1.1.7:
      Successfully uninstalled msgraph-core-1.1.7
Successfully installed msgraph-core-1.1.8
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
root@5ae8d440acf3:/opt/airflow# python
Python 3.9.21 (main, Dec  4 2024, 20:35:10) 
[GCC 12.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from msgraph_core import APIVersion, GraphClientFactory

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/__init__.py", line 16, in <module>
    from .tasks import PageIterator
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/tasks/__init__.py", line 2, in <module>
    from .large_file_upload import LargeFileUploadTask
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/tasks/large_file_upload.py", line 21, in <module>
    class LargeFileUploadTask:
  File "/usr/local/lib/python3.9/site-packages/msgraph_core/tasks/large_file_upload.py", line 28, in LargeFileUploadTask
    parsable_factory: Optional[ParsableFactory[T]] = None,
TypeError: 'ABCMeta' object is not subscriptable
>>> 
>>>

SDK Version

1.1.8

Latest version known to work for scenario above?

1.1.7

Known Workarounds

Downgrade msgraph-core to 1.1.7

Debug output

No need for more debugging.

Configuration

Linux Debian Bookworm, Python 3.9.21

Other information

No response

The 1.1.8 version of msgraph-core is buggy - importing some basic classes causes import error "ABCMeta" is not subscriptable. We are removing the version from azure provider dependencies hoping that it will be fixed in the next version. microsoftgraph/msgraph-sdk-python-core#781

potiuk · 2024-12-22T22:57:33Z

Any news here ? You are pretty-much breaking everyone who is using your library and using this feature

…e#45139) * session expire on pass change * fix statis checks * add tests (cherry picked from commit cf401c4) Co-authored-by: Shubham Raj <48172486+shubhamraj-git@users.noreply.github.com> Avoid 1.1.8 version of msgraph-core (apache#45044) The 1.1.8 version of msgraph-core is buggy - importing some basic classes causes import error "ABCMeta" is not subscriptable. We are removing the version from azure provider dependencies hoping that it will be fixed in the next version. microsoftgraph/msgraph-sdk-python-core#781 (cherry picked from commit 3310b86)

The 1.1.8 version of msgraph-core is buggy - importing some basic classes causes import error "ABCMeta" is not subscriptable. We are removing the version from azure provider dependencies hoping that it will be fixed in the next version. microsoftgraph/msgraph-sdk-python-core#781 (cherry picked from commit 3310b86)

The 1.1.8 version of msgraph-core is buggy - importing some basic classes causes import error "ABCMeta" is not subscriptable. We are removing the version from azure provider dependencies hoping that it will be fixed in the next version. microsoftgraph/msgraph-sdk-python-core#781

shemogumbe · 2025-01-08T07:32:35Z

Hello @potiuk and thanks for raising this.

In order to try reproduce:

I have created a virtualenvironment core_debug_en and install msgraph_core
Run a script that just imports APIVersion and GraphClientFactory
`python
from msgraph_core import APIVersion, GraphClientFactory
from msgraph_core.tasks.large_file_upload import LargeFileUploadTask

print(f"API VERSION: {APIVersion.v1}")
print(f"GRAPH CLIENT FACTORY: {GraphClientFactory}")
`
Results in:

Done 2 above in the python shell
The results in both situations do not show the error:
could there be a specific setup you are using that I can try replicate to reproduce this.

My env has:

pamelafox · 2025-01-08T17:00:13Z

Here's my traceback from a Python 3.12 environment:

Traceback (most recent call last):
  File "/Users/pamelafox/azure-search-openai-demo/./scripts/auth_init.py", line 10, in <module>
    from msgraph import GraphServiceClient
  File "/Users/pamelafox/azure-search-openai-demo/.venv/lib/python3.12/site-packages/msgraph/__init__.py", line 5, in <module>
    from .graph_request_adapter import GraphRequestAdapter
  File "/Users/pamelafox/azure-search-openai-demo/.venv/lib/python3.12/site-packages/msgraph/graph_request_adapter.py", line 5, in <module>
    from msgraph_core import APIVersion, BaseGraphRequestAdapter, GraphClientFactory
  File "/Users/pamelafox/azure-search-openai-demo/.venv/lib/python3.12/site-packages/msgraph_core/__init__.py", line 16, in <module>
    from .tasks import PageIterator
  File "/Users/pamelafox/azure-search-openai-demo/.venv/lib/python3.12/site-packages/msgraph_core/tasks/__init__.py", line 2, in <module>
    from .large_file_upload import LargeFileUploadTask
  File "/Users/pamelafox/azure-search-openai-demo/.venv/lib/python3.12/site-packages/msgraph_core/tasks/large_file_upload.py", line 21, in <module>
    class LargeFileUploadTask:
  File "/Users/pamelafox/azure-search-openai-demo/.venv/lib/python3.12/site-packages/msgraph_core/tasks/large_file_upload.py", line 28, in LargeFileUploadTask
    parsable_factory: Optional[ParsableFactory[T]] = None,
                               ~~~~~~~~~~~~~~~^^^
TypeError: type 'ParsableFactory' is not subscriptable

I see you're in Python 3.10, perhaps it doesn't replicate there?

pamelafox · 2025-01-08T17:06:02Z

I see there's a linked PR now, so it seems you replicated the error. Thanks!

The 1.1.8 version of msgraph-core is buggy - importing some basic classes causes import error "ABCMeta" is not subscriptable. We are removing the version from azure provider dependencies hoping that it will be fixed in the next version. microsoftgraph/msgraph-sdk-python-core#781

potiuk added status:waiting-for-triage An issue that is yet to be reviewed or assigned type:bug A broken experience labels Dec 18, 2024

potiuk mentioned this issue Dec 18, 2024

Avoid 1.1.8 version of msgraph-core apache/airflow#45044

Merged

potiuk mentioned this issue Dec 18, 2024

[v2-10-test] Avoid 1.1.8 version of msgraph-core (#45044) apache/airflow#45063

Merged

pamelafox mentioned this issue Jan 8, 2025

Revert upgrade of msgraph-core SDK Azure-Samples/azure-search-openai-demo#2257

Merged

5 tasks

shemogumbe self-assigned this Jan 8, 2025

shemogumbe removed the status:waiting-for-triage An issue that is yet to be reviewed or assigned label Jan 8, 2025

shemogumbe mentioned this issue Jan 8, 2025

remove generic from parsable factory type hint error #796

Merged

microsoft-github-policy-service bot added the WIP label Jan 8, 2025

shemogumbe closed this as completed in #796 Jan 9, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

The msgraph-core 1.1.8 import of LargeFileUpload tasks raises 'ABCMeta' object is not subscriptable error #781

The msgraph-core 1.1.8 import of LargeFileUpload tasks raises 'ABCMeta' object is not subscriptable error #781

potiuk commented Dec 18, 2024

potiuk commented Dec 22, 2024

shemogumbe commented Jan 8, 2025

pamelafox commented Jan 8, 2025

pamelafox commented Jan 8, 2025

The msgraph-core 1.1.8 import of LargeFileUpload tasks raises 'ABCMeta' object is not subscriptable error #781

The msgraph-core 1.1.8 import of LargeFileUpload tasks raises 'ABCMeta' object is not subscriptable error #781

Comments

potiuk commented Dec 18, 2024

Describe the bug

Expected behavior

How to reproduce

SDK Version

Latest version known to work for scenario above?

Known Workarounds

Debug output

Configuration

Other information

potiuk commented Dec 22, 2024

shemogumbe commented Jan 8, 2025

pamelafox commented Jan 8, 2025

pamelafox commented Jan 8, 2025