You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by PedroMrChaves <pe...@gmail.com> on 2018/03/01 10:27:45 UTC

Getting warning messages (...hdfs.DataStreamer - caught exception) while running Flink with Hadoop as the state backend

While my flink job is running I keep getting the following warning message in
the log:

/2018-02-23 09:08:11,681 WARN  org.apache.hadoop.hdfs.DataStreamer                          
- Caught exception
java.lang.InterruptedException
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at
org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:927)
        at
org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:578)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:755)
But the job keeps running, apparently without issues./

Flink Version: 1.4.0 bundled with Hadoop 2.8

Hadoop version: 2.8.3

Any ideas on what might be the problem?



-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Getting warning messages (...hdfs.DataStreamer - caught exception) while running Flink with Hadoop as the state backend

Posted by PedroMrChaves <pe...@gmail.com>.
No. It is just a log message with no apparent side effects. 



-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Getting warning messages (...hdfs.DataStreamer - caught exception) while running Flink with Hadoop as the state backend

Posted by Stephan Ewen <se...@apache.org>.
Is this happening around a failure / recovery?

Flink interrupts threads when canceling user code in order to reset an
operator to a checkpoint.

On Thu, Mar 1, 2018 at 11:27 AM, PedroMrChaves <pe...@gmail.com>
wrote:

> While my flink job is running I keep getting the following warning message
> in
> the log:
>
> /2018-02-23 09:08:11,681 WARN  org.apache.hadoop.hdfs.DataStreamer
> - Caught exception
> java.lang.InterruptedException
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Thread.join(Thread.java:1252)
>         at java.lang.Thread.join(Thread.java:1326)
>         at
> org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:927)
>         at
> org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:578)
>         at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:755)
> But the job keeps running, apparently without issues./
>
> Flink Version: 1.4.0 bundled with Hadoop 2.8
>
> Hadoop version: 2.8.3
>
> Any ideas on what might be the problem?
>
>
>
> -----
> Best Regards,
> Pedro Chaves
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/
>