Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release of azure-storage-blob 12.0.0 breaks snowflake-connector-python #225

Closed
rcramblit opened this issue Oct 31, 2019 · 11 comments
Closed
Milestone

Comments

@rcramblit
Copy link

rcramblit commented Oct 31, 2019

https://pypi.org/project/azure-storage-blob/
azure-storage-blob==12.0.0 was just released a few minutes ago, where this was previously working

Please answer these questions before submitting your issue. Thanks!

  1. What version of Python are you using (python --version)?
    python3.6

  2. What operating system and processor architecture are you using (python -c 'import platform; print(platform.platform())')?
    Ubuntu

  3. What are the component versions in the environment (pip list)?
    snowflake-connector-python==1.9.1
    snowflake-sqlalchemy==1.1.16
    azure-storage-blob==12.0.0
    azure-common==1.1.23
    azure-core==1.0.0

Error:

File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/sqlalchemy/__init__.py", line 8, in <module>
     from snowflake.sqlalchemy import URL as SNOWFLAKE_URL
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/sqlalchemy/__init__.py", line 8, in <module>
    from . import snowdialect
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/sqlalchemy/snowdialect.py", line 25, in <module>
    from snowflake.connector.constants import UTF8
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/connector/__init__.py", line 21, in <module>
  from .connection import SnowflakeConnection
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/connector/connection.py", line 44, in <module>
  from .cursor import SnowflakeCursor, LOG_MAX_QUERY_LENGTH
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/connector/cursor.py", line 26, in <module>
   from .file_transfer_agent import (SnowflakeFileTransferAgent)
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/connector/file_transfer_agent.py", line 20, in <module>
  from .azure_util import SnowflakeAzureUtil
File "/srv/.virtualenvs/script-find_mesh_terms_in_article_contents-hO_pU6QM/lib/python3.6/site-packages/snowflake/connector/azure_util.py", line 9, in <module>
  from azure.storage.blob import BlockBlobService
ImportError: cannot import name 'BlockBlobService'
@aaronreidsmith
Copy link

+1. My workaround was to pin azure-storage-blob to 2.1.0 for now.

@smomen
Copy link

smomen commented Oct 31, 2019

+1

beckjake pushed a commit to dbt-labs/dbt-core that referenced this issue Oct 31, 2019
@aamangeldi
Copy link

+1

@smtakeda smtakeda added the jira label Oct 31, 2019
@smtakeda
Copy link
Contributor

Working on the fix now.

@buva7687
Copy link

pip install --force-reinstall --upgrade azure-storage-blob==2.1.0 urllib3==1.24.3 snowflake-connector-python

@Talador12
Copy link

Talador12 commented Oct 31, 2019

There should be a fix for Azure that @smtakeda is working on. I will say - either #182 or #172 could help as well. I am not using Azure, so having those portions optional would avoid this problem entirely.

@smtakeda
Copy link
Contributor

Just to clarify the patch we are creating is to pin azure package and not include the latest azure package support. That will be a separate change.

Making AWS, Azure and GCP option is in the plan.

@mingrammer
Copy link

mingrammer commented Nov 1, 2019

+1 for the airflow

@sfc-gh-stakeda
Copy link
Contributor

Released v2.0.3

fdosani pushed a commit to capitalone/locopy that referenced this issue Nov 1, 2019
* Fix merge conflict for execute

* Merge conflict to add testing for pandas dataframe

* Catch S3CredentialError

* Remove unrelated warning

* Fix for formatting

* blacken tests

* adding .idea/ to ignore

* fixing sf tests

* adding many to docstring

* fix for snowflakedb/snowflake-connector-python#225

* bumping pytest and cov for tests

* updating find_column_type to use OrderedDict for py3.5

* full isort and black

* updating metadata to use OrderedDict
@Josh-a-e
Copy link

Are there plans to actually use azure-storage-blob > 12? I don't love having to migrate my code to use an old version of another dependency.

@sfc-gh-mkeller
Copy link
Collaborator

Yes, in the next release!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests