You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Ji Liu (JIRA)" <ji...@apache.org> on 2019/04/11 12:04:00 UTC
[jira] [Commented] (FLINK-9542) ExEnv#registerCachedFile should
accept Path
[ https://issues.apache.org/jira/browse/FLINK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815362#comment-16815362 ]
Ji Liu commented on FLINK-9542:
-------------------------------
[~Zentol] Is this issue still open? I quickly looked into the code and it seems that _DistributedCacheEntries_ still keeps String as file-path. I would like to provide a fix.
> ExEnv#registerCachedFile should accept Path
> -------------------------------------------
>
> Key: FLINK-9542
> URL: https://issues.apache.org/jira/browse/FLINK-9542
> Project: Flink
> Issue Type: Improvement
> Components: API / DataSet, API / DataStream
> Reporter: Chesnay Schepler
> Priority: Major
>
> Currently, {{registerCachedFile}} accepts {{Strings}} as file-paths.
> This is undesirable because invalid paths are detected much later than necessary; at the moment this happens when we attempt to upload them to the blob store, i.e. during job submission, when ideally it should fail right away.
> As an intermediate solution we can modify the {{DistributedCacheEntries}} to contain {{Paths}} instead of {{Strings}}. This will not require API changes but still allow earlier detection.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)