You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2019/09/06 14:37:00 UTC
[jira] [Commented] (FLINK-13758) failed to submit JobGraph when
registered hdfs file in DistributedCache
[ https://issues.apache.org/jira/browse/FLINK-13758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924291#comment-16924291 ]
Chesnay Schepler commented on FLINK-13758:
------------------------------------------
ahhhh I may have remembered wrong; it is true that files from a DFS are never downloaded on the client. They are also never added to the blobstore, but only cached locally on the TaskExecutor when a task requests it.
Please expand on how exactly your job is failing; at this time I'm a bit unsure on what this issue is about.
> failed to submit JobGraph when registered hdfs file in DistributedCache
> ------------------------------------------------------------------------
>
> Key: FLINK-13758
> URL: https://issues.apache.org/jira/browse/FLINK-13758
> Project: Flink
> Issue Type: Bug
> Components: Command Line Client
> Affects Versions: 1.6.3, 1.6.4, 1.7.2, 1.8.0, 1.8.1
> Reporter: luoguohao
> Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> when using HDFS files for DistributedCache, it would failed to submit jobGraph, we can see exceptions stack traces in log file after a while, but if DistributedCache file is a local file, every thing goes fine.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)