Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Kerberos Support for Presto Hook #10306

Closed
jaketf opened this issue Aug 12, 2020 · 3 comments · Fixed by #10488
Closed

Add Kerberos Support for Presto Hook #10306

jaketf opened this issue Aug 12, 2020 · 3 comments · Fixed by #10488

Comments

@jaketf
Copy link
Contributor

jaketf commented Aug 12, 2020

Description
Airflow should be able to use kerberos security features to run queries against a kerberized presto cluster from an airflow task.

Use case / motivation

Schedule queries on a kerberized presto infrastructure using airflow.

Related Issues
abandoned / stale PR w/ lack of test coverage requesting same feature
#8491

@mik-laj
Copy link
Member

mik-laj commented Aug 13, 2020

@jaketf I'd love to do it.

@mik-laj mik-laj self-assigned this Aug 13, 2020
@mik-laj
Copy link
Member

mik-laj commented Aug 17, 2020

Small update:
I tried to complete this ticket but couldn't test Airflow with Kerberos because the Kerberos setup in Breeze is not complete.
I have a new setup: https://github.com/mik-laj/presto-kerberos-docker

I also opened PR to presto-python-client to add support for self-signed SSL certificate: trinodb/trino-python-client#36
I will have to prepare some documents so that this change can be merged, but that doesn't block us as I have a workaround.

@mik-laj
Copy link
Member

mik-laj commented Aug 24, 2020

Small update:
I have a working PR, but it still needs some care to make everything easily accessible with the breeze command.

One problem has already been found thanks to system tests. Snowflake-connector-python library monkey patch Python core. It enforce SSL certificates verification ,so it cannot be turned off certificate verification for developing purposes. We will probably have to report the bug to the maintainers of this library, and for now I will have to skip tests for Salesforce.
https://github.com/snowflakedb/snowflake-connector-python/blob/master/src/snowflake/connector/network.py#L89-L92

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants