Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Destination databricks: Remove user/pass auth #40712

Merged
merged 2 commits into from
Aug 14, 2024

Conversation

edgao
Copy link
Contributor

@edgao edgao commented Jul 3, 2024

closes https://github.com/airbytehq/airbyte-internal-issues/issues/9146

(note: I don't think there's much urgency on this PR, in spite of the ostensible deadline. Databricks is clearly sending comms to all of their users already, so 🤷 hopefully anyone using airbyte+databricks already knows they should switch to oauth)

Databricks will deprecate user/pass auth on july 10

Databricks-managed passwords will reach end of life on July 10, 2024

but PATs will continue working

Note that Personal Access Tokens (PATs) will continue to work for API authentication

AFAICT we don't actually need the user+pass? I.e. a PAT is sufficient. (relevant docs) So just... stop using the user+pass stuff

Also move oauth to be the first option, since it's the recommended auth type

(I created a databricks PAT + uploaded it into https://console.cloud.google.com/security/secret-manager/secret/SECRET_DESTINATION_DATABRICKS_PERSONAL_ACCESS_TOKEN_CONFIG/versions?project=dataline-integration-testing)

Closes https://github.com/airbytehq/airbyte-internal-issues/issues/9146

Copy link

vercel bot commented Jul 3, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Aug 14, 2024 5:59pm

@edgao edgao force-pushed the edgao/databricks_password_auth branch 2 times, most recently from a7384fd to aa5f4d5 Compare July 3, 2024 21:10
@edgao edgao changed the title Destination databricks: Remvoe password auth Destination databricks: Remove user/pass auth Jul 3, 2024
@edgao edgao force-pushed the edgao/databricks_password_auth branch 3 times, most recently from 035032d to f8228c3 Compare July 3, 2024 22:38
override val imageName: String
get() = "airbyte/destination-databricks:dev"

companion object {
private var jdbcDatabase: JdbcDatabase = Mockito.mock()
private var connectorConfig: DatabricksConnectorConfig = Mockito.mock()
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we need these variables to be instanced per connector config, so push them down into their respective class' companion object

@edgao edgao force-pushed the edgao/databricks_password_auth branch from f8228c3 to 06ee74e Compare July 5, 2024 22:54
@edgao edgao force-pushed the edgao/redshift_refreshes branch 4 times, most recently from ed23537 to 4b5fff5 Compare July 12, 2024 17:59
Base automatically changed from edgao/redshift_refreshes to master July 12, 2024 18:23
@edgao edgao force-pushed the edgao/databricks_password_auth branch 2 times, most recently from 14ca76b to 19b3cf4 Compare July 12, 2024 23:00
@gisripa gisripa force-pushed the edgao/databricks_password_auth branch from 19b3cf4 to d537847 Compare July 16, 2024 23:39
@gisripa gisripa marked this pull request as ready for review July 17, 2024 18:28
@gisripa gisripa requested a review from a team as a code owner July 17, 2024 18:28
@edgao edgao force-pushed the edgao/databricks_password_auth branch from d537847 to 3766180 Compare August 12, 2024 17:24
@edgao edgao force-pushed the edgao/databricks_password_auth branch from 3766180 to dda8229 Compare August 12, 2024 18:06
@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label Aug 12, 2024
@edgao edgao enabled auto-merge (squash) August 12, 2024 18:07
@edgao edgao force-pushed the edgao/databricks_password_auth branch from dda8229 to 5f06e35 Compare August 13, 2024 17:30
@edgao edgao force-pushed the edgao/databricks_password_auth branch from 3d76924 to 8c959c8 Compare August 14, 2024 16:27
@edgao edgao force-pushed the edgao/databricks_password_auth branch 2 times, most recently from 86e4091 to 75ee096 Compare August 14, 2024 17:33
@edgao edgao force-pushed the edgao/databricks_password_auth branch from 75ee096 to b74867f Compare August 14, 2024 17:59
@edgao edgao merged commit 34f58fa into master Aug 14, 2024
34 checks passed
@edgao edgao deleted the edgao/databricks_password_auth branch August 14, 2024 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/destination/databricks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants