You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Sujee Maniyam <su...@sujee.net> on 2012/10/24 00:31:49 UTC
need some help understanding NN quorum edit log
Hi devs,
I am reading through the HA code, trying to understand how the
editlogs propagate.
I have looked at the following classes
EditLogTailer
JournalNode
QuorumJournalManager
NameNode
FSNameSystem
I see FSNameSystem is using FSImage editlog. where is the tie-in
between NN and QuorumJournal?
thanks
Sujee Maniyam
http://sujee.net
Re: need some help understanding NN quorum edit log
Posted by Todd Lipcon <to...@cloudera.com>.
Yep, that's right.
-Todd
On Wed, Oct 24, 2012 at 4:58 PM, Sujee Maniyam <su...@sujee.net> wrote:
> Hi Todd,
> thanks!
>
> So
> FSEditLog.java :: createJournal(URI uri)
> is where a specific journal is chosen.
> Config parameters are : dfs.namenode.shared.edits.dir and
> dfs.namenode.edits.journal-plugin
>
> correct?
>
> regards
> Sujee
>
> http://sujee.net
>
>
> On Tue, Oct 23, 2012 at 4:49 PM, Todd Lipcon <to...@cloudera.com> wrote:
> > Hi Sujee,
> >
> > QuorumJournalManager implements the JournalManager interface. The javadoc
> > on JournalManager may help you understand. Also, I would recommend
> > understanding the local-disk implementation (FileJournalManager) before
> > digging too deep into the QuorumJournalManager, which is a bit more
> complex.
> >
> > -Todd
> >
> > On Tue, Oct 23, 2012 at 3:31 PM, Sujee Maniyam <su...@sujee.net> wrote:
> >
> >> Hi devs,
> >> I am reading through the HA code, trying to understand how the
> >> editlogs propagate.
> >>
> >> I have looked at the following classes
> >> EditLogTailer
> >> JournalNode
> >> QuorumJournalManager
> >> NameNode
> >> FSNameSystem
> >>
> >> I see FSNameSystem is using FSImage editlog. where is the tie-in
> >> between NN and QuorumJournal?
> >>
> >> thanks
> >> Sujee Maniyam
> >>
> >> http://sujee.net
> >>
> >
> >
> >
> > --
> > Todd Lipcon
> > Software Engineer, Cloudera
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: need some help understanding NN quorum edit log
Posted by Sujee Maniyam <su...@sujee.net>.
Hi Todd,
thanks!
So
FSEditLog.java :: createJournal(URI uri)
is where a specific journal is chosen.
Config parameters are : dfs.namenode.shared.edits.dir and
dfs.namenode.edits.journal-plugin
correct?
regards
Sujee
http://sujee.net
On Tue, Oct 23, 2012 at 4:49 PM, Todd Lipcon <to...@cloudera.com> wrote:
> Hi Sujee,
>
> QuorumJournalManager implements the JournalManager interface. The javadoc
> on JournalManager may help you understand. Also, I would recommend
> understanding the local-disk implementation (FileJournalManager) before
> digging too deep into the QuorumJournalManager, which is a bit more complex.
>
> -Todd
>
> On Tue, Oct 23, 2012 at 3:31 PM, Sujee Maniyam <su...@sujee.net> wrote:
>
>> Hi devs,
>> I am reading through the HA code, trying to understand how the
>> editlogs propagate.
>>
>> I have looked at the following classes
>> EditLogTailer
>> JournalNode
>> QuorumJournalManager
>> NameNode
>> FSNameSystem
>>
>> I see FSNameSystem is using FSImage editlog. where is the tie-in
>> between NN and QuorumJournal?
>>
>> thanks
>> Sujee Maniyam
>>
>> http://sujee.net
>>
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
Re: need some help understanding NN quorum edit log
Posted by Todd Lipcon <to...@cloudera.com>.
Hi Sujee,
QuorumJournalManager implements the JournalManager interface. The javadoc
on JournalManager may help you understand. Also, I would recommend
understanding the local-disk implementation (FileJournalManager) before
digging too deep into the QuorumJournalManager, which is a bit more complex.
-Todd
On Tue, Oct 23, 2012 at 3:31 PM, Sujee Maniyam <su...@sujee.net> wrote:
> Hi devs,
> I am reading through the HA code, trying to understand how the
> editlogs propagate.
>
> I have looked at the following classes
> EditLogTailer
> JournalNode
> QuorumJournalManager
> NameNode
> FSNameSystem
>
> I see FSNameSystem is using FSImage editlog. where is the tie-in
> between NN and QuorumJournal?
>
> thanks
> Sujee Maniyam
>
> http://sujee.net
>
--
Todd Lipcon
Software Engineer, Cloudera