[jira] [Updated] (TEZ-1611) Change DataSource/Sink to be able to supply URIs for credentials

["Bikas Saha (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bikas Saha updated TEZ-1611:
----------------------------
    Attachment: TEZ-1611.1.patch

Straightforward patch that replaces adds URIs to data source/sink so that dag submission can use URIs to get credentials. Given the HDFS tokens cached in the dagCredentials from the session credentials, this change prevents extra calls to the NN to fetch the tokens. [~rajesh.balamohan] please review.

Still figuring out a test for this. 

> Change DataSource/Sink to be able to supply URIs for credentials
> ----------------------------------------------------------------
>
>                 Key: TEZ-1611
>                 URL: https://issues.apache.org/jira/browse/TEZ-1611
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>         Attachments: TEZ-1611.1.patch
>
>
> This way commonly used credentials (HDFS) can be obtained globally for the DAG and take advantage of previously cached credentials where appropriate. This would reduce round trips to the NN. The existing method to get credentials will still be in place for other credentials that we cannot obtain automatically via URIs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)