You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/12 22:03:02 UTC
[GitHub] [airflow] jaketf opened a new issue #10306: Add Kerberos Support for Presto Hook
jaketf opened a new issue #10306:
URL: https://github.com/apache/airflow/issues/10306
**Description**
Airflow should be able to use [kerberos security features](https://airflow.apache.org/docs/stable/security.html#kerberos) to run queries against a kerberized presto cluster from an airflow task.
**Use case / motivation**
Schedule queries on a kerberized presto infrastructure using airflow.
**Related Issues**
abandoned / stale PR w/ lack of test coverage requesting same feature
https://github.com/apache/airflow/pull/8491
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj closed issue #10306: Add Kerberos Support for Presto Hook
Posted by GitBox <gi...@apache.org>.
mik-laj closed issue #10306:
URL: https://github.com/apache/airflow/issues/10306
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #10306: Add Kerberos Support for Presto Hook
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #10306:
URL: https://github.com/apache/airflow/issues/10306#issuecomment-673761748
@jaketf I'd love to do it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #10306: Add Kerberos Support for Presto Hook
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #10306:
URL: https://github.com/apache/airflow/issues/10306#issuecomment-678878973
Small update:
I have a working PR, but it still needs some care to make everything easily accessible with the breeze command.
One problem has already been found thanks to system tests. Snowflake-connector-python library monkey patch Python core. It enforce SSL certificates verification ,so it cannot be turned off certificate verification for developing purposes. We will probably have to report the bug to the maintainers of this library, and for now I will have to skip tests for Salesforce.
https://github.com/snowflakedb/snowflake-connector-python/blob/master/src/snowflake/connector/network.py#L89-L92
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #10306: Add Kerberos Support for Presto Hook
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #10306:
URL: https://github.com/apache/airflow/issues/10306#issuecomment-675045982
Small update:
I tried to complete this ticket but couldn't test Airflow with Kerberos because the Kerberos setup in Breeze is not complete.
I have a new setup: https://github.com/mik-laj/presto-kerberos-docker
I also opened PR to presto-python-client to add support for self-signed SSL certificate: https://github.com/prestosql/presto-python-client/pull/36
I will have to prepare some documents so that this change can be merged, but that doesn't block us as I have a workaround.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org