You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2017/01/26 20:51:24 UTC
[jira] [Commented] (FLINK-5664) RocksDBBackend logging is noisy
[ https://issues.apache.org/jira/browse/FLINK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840429#comment-15840429 ]
Robert Metzger commented on FLINK-5664:
---------------------------------------
IIRC this log entry has been there since rocksdb supports async checkpoints. I don't think it's an issue.
However, since we now have this nice checkpoint monitoring interface, we could remove it :)
> RocksDBBackend logging is noisy
> -------------------------------
>
> Key: FLINK-5664
> URL: https://issues.apache.org/jira/browse/FLINK-5664
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
> Reporter: Ufuk Celebi
>
> Running a job with rocks db and a low checkpointing interval the logs are flooded with
> {code}
> 2017-01-26 17:29:39,345 INFO org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Asynchronous RocksDB snapshot (File Stream Factory @ file:/Users/uce/Desktop/1-2-testing/fs/83889867a493a1dc80f6c588c071b679, synchronous part) in thread Thread[Flat Map -> Sink: Unnamed (3/8),5,Flink Task Threads] took 0 ms.
> 2017-01-26 17:29:39,398 INFO org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Asynchronous RocksDB snapshot (File Stream Factory @ file:/Users/uce/Desktop/1-2-testing/fs/83889867a493a1dc80f6c588c071b679, asynchronous part) in thread Thread[pool-88-thread-1,5,Flink Task Threads] took 53 ms.
> {code}
> Two log lines per stateful task per task manager per checkpoint. I can see that this is helpful for debugging, but maybe too much by default. Should we decrease the log level to debug?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)