You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Aishwarya Mohan (JIRA)" <ji...@apache.org> on 2018/07/17 17:56:00 UTC

[jira] [Created] (AIRFLOW-2759) Simplify proxy server based access to external platforms like S3, Google cloud

Aishwarya Mohan created AIRFLOW-2759:
----------------------------------------

             Summary: Simplify proxy server based access to external platforms like S3, Google cloud 
                 Key: AIRFLOW-2759
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2759
             Project: Apache Airflow
          Issue Type: Improvement
          Components: hooks
            Reporter: Aishwarya Mohan
            Assignee: Aishwarya Mohan


Several companies adopt a Proxy Server based approach in order to provide an additional layer of security while communicating with external platforms to establish legitimacy of caller and calle. A potential use case would be writing logs from Airflow to a cloud storage platform like google cloud via an intermediary proxy server.

In the current scenario the proxy details need to be hardcoded and passed to the HTTP client library(httplib2) in the GoogleCloudBaseHook class (gcp_api_base_hook.py). It would be convenient if the proxy details (for example, host and port) can be extracted from a separate section in airflow.cfg file as opposed to hardcoding the details at hook level.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)