Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce Databricks personal staging locations #13809

Closed
tuliren opened this issue Jun 15, 2022 · 3 comments · Fixed by #18557
Closed

Introduce Databricks personal staging locations #13809

tuliren opened this issue Jun 15, 2022 · 3 comments · Fixed by #18557
Assignees
@tuliren
Labels
from/connector-ops team/destinations Destinations team's backlog

Comments

@tuliren
Copy link
Contributor

tuliren commented Jun 15, 2022

No description provided.

@tuliren tuliren self-assigned this Jun 15, 2022
@johnwasserman
Copy link
Contributor

johnwasserman commented Jul 19, 2022 •
edited
Loading

Hi @tuliren - hoping to clarify what this is covering. We have a user with Databricks hosted on Azure. Would an internal staging API allow them to stage their data in Blobstorage in this instance? They're blocked because we can only support s3 currently

@tuliren
Copy link
Contributor Author

tuliren commented Jul 27, 2022

@johnwasserman, sorry about the delayed reply.

Would an internal staging API allow them to stage their data in Blobstorage in this instance?

The internal staging API won't help in the short term for two reasons:

  1. As far as I know, the staging API is currently for S3 only.
  2. This staging solution is in preview stage. So it is not generally available yet.

@grishick grishick added the team/destinations Destinations team's backlog label Sep 27, 2022
@evantahler
Copy link
Contributor

Possibly closed by #18032

@tuliren tuliren changed the title Migrate to Databricks internal staging API Introduce Databricks personal staging locations Oct 27, 2022
@tuliren tuliren mentioned this issue Oct 27, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tuliren tuliren

Labels
from/connector-ops team/destinations Destinations team's backlog
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Databricks destination: introduce personal staging location airbytehq/airbyte
4 participants
@evantahler @grishick @tuliren @johnwasserman