You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Fakrudeen Ali Ahmed <al...@adobe.com> on 2018/10/25 22:48:19 UTC

Link on Azure HDInsight cluster with WASB storage

Hi there,

https://stackoverflow.com/questions/52996054/resource-changed-on-src-filesystem-in-azure-flink

We are unable to start flink on Azure Hadoop cluster [on top of WASB]. This throws:

Application application_1539730571763_0046 failed 1 times (global limit =5; local limit is =1) due to AM Container for appattempt_1539730571763_0046_000001 exited with exitCode: -1000
Failing this attempt.
Diagnostics: [2018-10-23 23:31:31.563]Resource wasb://realtime-id-graph-2018-10-16t22-41-48-767z@fakrudeenstorage.blob.core.windows.net/user/aliahmed/.flink/application_1539730571763_0046/logback.xml changed on src filesystem (expected 1536955416000, was 1540337488000
java.io.IOException: Resource wasb://realtime-id-graph-2018-10-16t22-41-48-767z@fakrudeenstorage.blob.core.windows.net/user/aliahmed/.flink/application_1539730571763_0046/logback.xml changed on src filesystem (expected 1536955416000, was 1540337488000
at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:273)

Is Flink not supported on Azure Hadoop cluster?

It looks like this file timestamp changes in WASB during file copy and YARN is complaining about original timestamp.

Thanks,
-Fakrudeen