You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2017/01/26 20:51:24 UTC

[jira] [Commented] (FLINK-5664) RocksDBBackend logging is noisy

    [ https://issues.apache.org/jira/browse/FLINK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840429#comment-15840429 ] 

Robert Metzger commented on FLINK-5664:
---------------------------------------

IIRC this log entry has been there since rocksdb supports async checkpoints. I don't think it's an issue.

However, since we now have this nice checkpoint monitoring interface, we could remove it :)

> RocksDBBackend logging is noisy
> -------------------------------
>
>                 Key: FLINK-5664
>                 URL: https://issues.apache.org/jira/browse/FLINK-5664
>             Project: Flink
>          Issue Type: Improvement
>          Components: State Backends, Checkpointing
>            Reporter: Ufuk Celebi
>
> Running a job with rocks db and a low checkpointing interval the logs are flooded with
> {code}
> 2017-01-26 17:29:39,345 INFO  org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend  - Asynchronous RocksDB snapshot (File Stream Factory @ file:/Users/uce/Desktop/1-2-testing/fs/83889867a493a1dc80f6c588c071b679, synchronous part) in thread Thread[Flat Map -> Sink: Unnamed (3/8),5,Flink Task Threads] took 0 ms.
> 2017-01-26 17:29:39,398 INFO  org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend  - Asynchronous RocksDB snapshot (File Stream Factory @ file:/Users/uce/Desktop/1-2-testing/fs/83889867a493a1dc80f6c588c071b679, asynchronous part) in thread Thread[pool-88-thread-1,5,Flink Task Threads] took 53 ms.
> {code}
> Two log lines per stateful task per task manager per checkpoint. I can see that this is helpful for debugging, but maybe too much by default. Should we decrease the log level to debug?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)