You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by PedroMrChaves <pe...@gmail.com> on 2018/03/01 10:27:45 UTC
Getting warning messages (...hdfs.DataStreamer - caught exception)
while running Flink with Hadoop as the state backend
While my flink job is running I keep getting the following warning message in
the log:
/2018-02-23 09:08:11,681 WARN org.apache.hadoop.hdfs.DataStreamer
- Caught exception
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1252)
at java.lang.Thread.join(Thread.java:1326)
at
org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:927)
at
org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:578)
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:755)
But the job keeps running, apparently without issues./
Flink Version: 1.4.0 bundled with Hadoop 2.8
Hadoop version: 2.8.3
Any ideas on what might be the problem?
-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Getting warning messages (...hdfs.DataStreamer - caught
exception) while running Flink with Hadoop as the state backend
Posted by PedroMrChaves <pe...@gmail.com>.
No. It is just a log message with no apparent side effects.
-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Getting warning messages (...hdfs.DataStreamer - caught
exception) while running Flink with Hadoop as the state backend
Posted by Stephan Ewen <se...@apache.org>.
Is this happening around a failure / recovery?
Flink interrupts threads when canceling user code in order to reset an
operator to a checkpoint.
On Thu, Mar 1, 2018 at 11:27 AM, PedroMrChaves <pe...@gmail.com>
wrote:
> While my flink job is running I keep getting the following warning message
> in
> the log:
>
> /2018-02-23 09:08:11,681 WARN org.apache.hadoop.hdfs.DataStreamer
> - Caught exception
> java.lang.InterruptedException
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:927)
> at
> org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:578)
> at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:755)
> But the job keeps running, apparently without issues./
>
> Flink Version: 1.4.0 bundled with Hadoop 2.8
>
> Hadoop version: 2.8.3
>
> Any ideas on what might be the problem?
>
>
>
> -----
> Best Regards,
> Pedro Chaves
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/
>