You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/18 11:50:00 UTC

[jira] [Commented] (FLINK-9793) When submitting a flink job with yarn-cluster, flink-dist*.jar is repeatedly uploaded

    [ https://issues.apache.org/jira/browse/FLINK-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547712#comment-16547712 ] 

ASF GitHub Bot commented on FLINK-9793:
---------------------------------------

Github user zentol commented on the issue:

    https://github.com/apache/flink/pull/6296
  
    merging.


> When submitting a flink job with yarn-cluster, flink-dist*.jar is repeatedly uploaded
> -------------------------------------------------------------------------------------
>
>                 Key: FLINK-9793
>                 URL: https://issues.apache.org/jira/browse/FLINK-9793
>             Project: Flink
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 1.4.0, 1.5.0
>            Reporter: linzhongjun
>            Assignee: linzhongjun
>            Priority: Minor
>              Labels: patch, pull-request-available
>             Fix For: 1.4.3, 1.5.2, 1.6.0
>
>         Attachments: 20180710224808.png, 20180710224848.png, 20180710231518.png
>
>
> We are using flink1.4.2 in our company. When the flink job is submitted to run on yarn with yarn-cluster mode,we actually find that the flink-dist_2.11-1.4.2.jar is uploaded to HDFS. The jars lies in different directories e.g.,
> 1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
> 2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
> Through reviewing source code of flink and having some tests, we suppose that the code below may have a bug in the Linux environment.
>  
> java.nio.file.Path file
> !(file.getFileName().startsWith("flink-dist") &&file.getFileName().endsWith("jar")) is Always be true



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)