You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2019/09/06 14:37:00 UTC

[jira] [Commented] (FLINK-13758) failed to submit JobGraph when registered hdfs file in DistributedCache

    [ https://issues.apache.org/jira/browse/FLINK-13758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924291#comment-16924291 ] 

Chesnay Schepler commented on FLINK-13758:
------------------------------------------

ahhhh I may have remembered wrong; it is true that files from a DFS are never downloaded on the client. They are also never added to the blobstore, but only cached locally on the TaskExecutor when a task requests it.

Please expand on how exactly your job is failing; at this time I'm a bit unsure on what this issue is about.

> failed to submit JobGraph when registered hdfs file in DistributedCache 
> ------------------------------------------------------------------------
>
>                 Key: FLINK-13758
>                 URL: https://issues.apache.org/jira/browse/FLINK-13758
>             Project: Flink
>          Issue Type: Bug
>          Components: Command Line Client
>    Affects Versions: 1.6.3, 1.6.4, 1.7.2, 1.8.0, 1.8.1
>            Reporter: luoguohao
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> when using HDFS files for DistributedCache, it would failed to submit jobGraph, we can see exceptions stack traces in log file after a while, but if DistributedCache file is a local file, every thing goes fine.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)