You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Vishal Santoshi <vi...@gmail.com> on 2017/11/21 14:05:22 UTC

Impersonate user for hdfs

Hello folks,

         I need to write to hdfs as a proxy user ( I am running TM /JM as root but hive on our setup is under this proxy user and thus the permissions issue ) . I think that this is possible in Hadoop MR and I am sure this is a common request. 

Thanks 

Vishal

Re: Impersonate user for hdfs

Posted by Vishal Santoshi <vi...@gmail.com>.

Thank you Timo,  I should have thought through. We have done this for
oozie, so definitely an avenue to explore.  Will let you know.

On Wed, Nov 22, 2017 at 9:05 AM, Timo Walther <tw...@apache.org> wrote:

> Hi Vishal,
>
> shouldn't it be possible to configure a proxy user via core-site.xml?
> Flink is also using this XML for HDFS.
>
> You can also set the configuration files manually, see
> https://ci.apache.org/projects/flink/flink-docs-
> release-1.3/setup/config.html#hdfs
>
> Regards,
> Timo
>
>
> Am 11/21/17 um 3:05 PM schrieb Vishal Santoshi:
>
> Hello folks,
>
>          I need to write to hdfs as a proxy user ( I am running TM /JM as root but hive on our setup is under this proxy user and thus the permissions issue ) . I think that this is possible in Hadoop MR and I am sure this is a common request.
>
> Thanks
>
> Vishal
>
>
>

Re: Impersonate user for hdfs

Posted by Timo Walther <tw...@apache.org>.

Hi Vishal,

shouldn't it be possible to configure a proxy user via core-site.xml? 
Flink is also using this XML for HDFS.

You can also set the configuration files manually, see 
https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#hdfs

Regards,
Timo


Am 11/21/17 um 3:05 PM schrieb Vishal Santoshi:
> Hello folks,
>
>           I need to write to hdfs as a proxy user ( I am running TM /JM as root but hive on our setup is under this proxy user and thus the permissions issue ) . I think that this is possible in Hadoop MR and I am sure this is a common request.
>
> Thanks
>
> Vishal