You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Gao Pan (JIRA)" <ji...@apache.org> on 2018/07/22 04:01:00 UTC

[jira] [Created] (YARN-8562) Spark Application fails due to resource file timestamp difference

Gao Pan created YARN-8562:
-----------------------------

             Summary: Spark Application fails due to resource file timestamp difference
                 Key: YARN-8562
                 URL: https://issues.apache.org/jira/browse/YARN-8562
             Project: Hadoop YARN
          Issue Type: Bug
          Components: yarn
    Affects Versions: 2.8.4, 2.9.1
         Environment: Spark 2.3.1 (build with Hadoop 2.7)

Hadoop 2.8.4 & 2.9.1
            Reporter: Gao Pan


Application was submitted to YARN by spark-submit and accepted but alway failed with following exception. The expected timestamp alway comes with 000 as the right most digits and other digits always match.

2018-07-21 18:16:16 INFO Client:54 - 
 client token: N/A
 diagnostics: Application application_1532213527145_0003 failed 2 times due to AM Container for appattempt_1532213527145_0003_000002 exited with exitCode: -1000
Failing this attempt.Diagnostics: [2018-07-21 18:16:15.668]Resource file:/Users/gpan/.sparkStaging/application_1532213527145_0003/com.amazonaws_aws-java-sdk-kms-1.11.76.jar changed on src filesystem (expected 1532222173000, was 1532222173543
java.io.IOException: Resource file:/Users/gpan/.sparkStaging/application_1532213527145_0003/com.amazonaws_aws-java-sdk-kms-1.11.76.jar changed on src filesystem (expected 1532222173000, was 1532222173543
 at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:255)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org