You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Anu Engineer (JIRA)" <ji...@apache.org> on 2018/05/10 21:17:00 UTC

[jira] [Commented] (HDFS-13544) Improve logging for JournalNode in federated cluster

    [ https://issues.apache.org/jira/browse/HDFS-13544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471127#comment-16471127 ] 

Anu Engineer commented on HDFS-13544:
-------------------------------------

+1, pending jenkins. I suggest that we apply this patch to 3.1.1, 3.0.3 and branch-2. It is a good improvement to have when we are looking at the logs.

 

> Improve logging for JournalNode in federated cluster
> ----------------------------------------------------
>
>                 Key: HDFS-13544
>                 URL: https://issues.apache.org/jira/browse/HDFS-13544
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: federation, hdfs
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>            Priority: Major
>         Attachments: HDFS-13544.001.patch
>
>
> In a federated cluster,when two namespaces utilize the same JournalSet, it is difficult to decode some of the log statements as to which Namespace it is logging for. 
> For example, the following two log statements do not tell us which Namespace the edit log belongs to.
> {code:java}
> INFO  server.Journal (Journal.java:prepareRecovery(773)) - Prepared recovery for segment 1: segmentState { startTxId: 1 endTxId: 10 isInProgress: true } lastWriterEpoch: 1 lastCommittedTxId: 10
> INFO  server.Journal (Journal.java:acceptRecovery(826)) - Synchronizing log startTxId: 1 endTxId: 11 isInProgress: true: old segment startTxId: 1 endTxId: 10 isInProgress: true is not the right length{code}
> We should add the NameserviceID or the JournalID to appropriate JournalNode logs to help with debugging.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org