You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/10/19 07:54:00 UTC

[jira] [Updated] (FLINK-10601) Make user home dir consistent with Flink default filesystem

     [ https://issues.apache.org/jira/browse/FLINK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated FLINK-10601:
-----------------------------------
    Labels: pull-request-available  (was: )

> Make user home dir consistent with Flink default filesystem
> -----------------------------------------------------------
>
>                 Key: FLINK-10601
>                 URL: https://issues.apache.org/jira/browse/FLINK-10601
>             Project: Flink
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 1.6.1
>            Reporter: Paul Lin
>            Priority: Major
>              Labels: pull-request-available
>
> Currently, Flink client uses the raw default Hadoop filesystem to upload local files, and this could be problematic when using a non-default filesystem for HA or checkpointing in delegation tokens scenarios. The jobmanager only has the delegation tokens for the default FS, so it gets authentication errors when trying to connect a non-default filesystem.
> So I propose to replace the default FS property in yarn configuration with the Flink filesystem property `fs.default-scheme` on the client side (AbstractYarnClusterDescriptor), to avoid this problem and also make the client behavior more configurable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)