You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bookkeeper.apache.org by Rakesh R <ra...@huawei.com> on 2012/06/14 10:13:46 UTC
Preparing bookkeeper environment during bookie startup
Hi All,
As per my understanding, bookkeeper doesn't have the logic to pre-create the following items and the operators need to manually create all these items before starting the bookkeeper. I feel it would be great if the bookkepper himself will internally maintaining logic to prepare bookkeeper environment ?
Currently following items to be pre-created by the admin:
Zookeeper paths (znodes):
-------------------------------
- ledger's root path
- bookie's available path
Directories:
-------------------------------
- Journal directories
- Ledger directories
-Rakesh
RE: Preparing bookkeeper environment during bookie startup
Posted by Rakesh R <ra...@huawei.com>.
Yeah it would be admin command, used for cleaning and preparing the bk env ready to start.
BTW, could you please give the JIRA id.
-Rakesh
________________________________________
From: Sijie Guo [guosijie@gmail.com]
Sent: Thursday, June 14, 2012 2:40 PM
To: bookkeeper-dev@zookeeper.apache.org
Subject: Re: Preparing bookkeeper environment during bookie startup
I remembered that Ivan created a jira to provide admin commands to listing
bookies & ledgers. Is the format command a kind of admin command?
Sijie
On Thu, Jun 14, 2012 at 5:06 PM, Rakesh R <ra...@huawei.com> wrote:
> Shall I raise a JIRA for supporting the bookkeeper format command?
>
> -Rakesh
> ________________________________________
> From: Uma Maheswara Rao G [maheswara@huawei.com]
> Sent: Thursday, June 14, 2012 2:28 PM
> To: bookkeeper-dev@zookeeper.apache.org
> Subject: RE: Preparing bookkeeper environment during bookie startup
>
> +1 for bookie format command.
>
> Also is it reasonable to expose one client API for format?
>
> Because infuture we may get the requirement like when we format the NN, we
> also should be able to format BK storage.
>
> Currently we don't have the format API for Journal namager. That is the
> current limitation in NN. Currently it will format only 'file' based
> storage dirs.
> We have the plans to implement format for all kind of JornalManager. So,
> we may add format API for JournalManager interface. So, all JournalManager
> implementation classes should provide the respective implementation for
> format of their storage. BKJM can make use of the format API from BK and
> format it.
>
> Regards,
> Uma
> ________________________________________
> From: Ivan Kelly [ivank@apache.org]
> Sent: Thursday, June 14, 2012 2:10 PM
> To: bookkeeper-dev@zookeeper.apache.org
> Subject: Re: Preparing bookkeeper environment during bookie startup
>
> Perhaps we should create a bookie format command, which does all this
> stuff. Then the admin would just have to run
>
> bookkeeper-server/bin/bookkeeper bookie -format
>
> on each machine.
>
> -Ivan
>
>
> On Thu, Jun 14, 2012 at 08:13:46AM +0000, Rakesh R wrote:
> > Hi All,
> >
> > As per my understanding, bookkeeper doesn't have the logic to pre-create
> the following items and the operators need to manually create all these
> items before starting the bookkeeper. I feel it would be great if the
> bookkepper himself will internally maintaining logic to prepare bookkeeper
> environment ?
> >
> > Currently following items to be pre-created by the admin:
> >
> > Zookeeper paths (znodes):
> > -------------------------------
> > - ledger's root path
> > - bookie's available path
> >
> > Directories:
> > -------------------------------
> > - Journal directories
> > - Ledger directories
> >
> >
> > -Rakesh
>
Re: Preparing bookkeeper environment during bookie startup
Posted by Sijie Guo <gu...@gmail.com>.
I remembered that Ivan created a jira to provide admin commands to listing
bookies & ledgers. Is the format command a kind of admin command?
Sijie
On Thu, Jun 14, 2012 at 5:06 PM, Rakesh R <ra...@huawei.com> wrote:
> Shall I raise a JIRA for supporting the bookkeeper format command?
>
> -Rakesh
> ________________________________________
> From: Uma Maheswara Rao G [maheswara@huawei.com]
> Sent: Thursday, June 14, 2012 2:28 PM
> To: bookkeeper-dev@zookeeper.apache.org
> Subject: RE: Preparing bookkeeper environment during bookie startup
>
> +1 for bookie format command.
>
> Also is it reasonable to expose one client API for format?
>
> Because infuture we may get the requirement like when we format the NN, we
> also should be able to format BK storage.
>
> Currently we don't have the format API for Journal namager. That is the
> current limitation in NN. Currently it will format only 'file' based
> storage dirs.
> We have the plans to implement format for all kind of JornalManager. So,
> we may add format API for JournalManager interface. So, all JournalManager
> implementation classes should provide the respective implementation for
> format of their storage. BKJM can make use of the format API from BK and
> format it.
>
> Regards,
> Uma
> ________________________________________
> From: Ivan Kelly [ivank@apache.org]
> Sent: Thursday, June 14, 2012 2:10 PM
> To: bookkeeper-dev@zookeeper.apache.org
> Subject: Re: Preparing bookkeeper environment during bookie startup
>
> Perhaps we should create a bookie format command, which does all this
> stuff. Then the admin would just have to run
>
> bookkeeper-server/bin/bookkeeper bookie -format
>
> on each machine.
>
> -Ivan
>
>
> On Thu, Jun 14, 2012 at 08:13:46AM +0000, Rakesh R wrote:
> > Hi All,
> >
> > As per my understanding, bookkeeper doesn't have the logic to pre-create
> the following items and the operators need to manually create all these
> items before starting the bookkeeper. I feel it would be great if the
> bookkepper himself will internally maintaining logic to prepare bookkeeper
> environment ?
> >
> > Currently following items to be pre-created by the admin:
> >
> > Zookeeper paths (znodes):
> > -------------------------------
> > - ledger's root path
> > - bookie's available path
> >
> > Directories:
> > -------------------------------
> > - Journal directories
> > - Ledger directories
> >
> >
> > -Rakesh
>
RE: Preparing bookkeeper environment during bookie startup
Posted by Rakesh R <ra...@huawei.com>.
Shall I raise a JIRA for supporting the bookkeeper format command?
-Rakesh
________________________________________
From: Uma Maheswara Rao G [maheswara@huawei.com]
Sent: Thursday, June 14, 2012 2:28 PM
To: bookkeeper-dev@zookeeper.apache.org
Subject: RE: Preparing bookkeeper environment during bookie startup
+1 for bookie format command.
Also is it reasonable to expose one client API for format?
Because infuture we may get the requirement like when we format the NN, we also should be able to format BK storage.
Currently we don't have the format API for Journal namager. That is the current limitation in NN. Currently it will format only 'file' based storage dirs.
We have the plans to implement format for all kind of JornalManager. So, we may add format API for JournalManager interface. So, all JournalManager implementation classes should provide the respective implementation for format of their storage. BKJM can make use of the format API from BK and format it.
Regards,
Uma
________________________________________
From: Ivan Kelly [ivank@apache.org]
Sent: Thursday, June 14, 2012 2:10 PM
To: bookkeeper-dev@zookeeper.apache.org
Subject: Re: Preparing bookkeeper environment during bookie startup
Perhaps we should create a bookie format command, which does all this
stuff. Then the admin would just have to run
bookkeeper-server/bin/bookkeeper bookie -format
on each machine.
-Ivan
On Thu, Jun 14, 2012 at 08:13:46AM +0000, Rakesh R wrote:
> Hi All,
>
> As per my understanding, bookkeeper doesn't have the logic to pre-create the following items and the operators need to manually create all these items before starting the bookkeeper. I feel it would be great if the bookkepper himself will internally maintaining logic to prepare bookkeeper environment ?
>
> Currently following items to be pre-created by the admin:
>
> Zookeeper paths (znodes):
> -------------------------------
> - ledger's root path
> - bookie's available path
>
> Directories:
> -------------------------------
> - Journal directories
> - Ledger directories
>
>
> -Rakesh
RE: Preparing bookkeeper environment during bookie startup
Posted by Uma Maheswara Rao G <ma...@huawei.com>.
+1 for bookie format command.
Also is it reasonable to expose one client API for format?
Because infuture we may get the requirement like when we format the NN, we also should be able to format BK storage.
Currently we don't have the format API for Journal namager. That is the current limitation in NN. Currently it will format only 'file' based storage dirs.
We have the plans to implement format for all kind of JornalManager. So, we may add format API for JournalManager interface. So, all JournalManager implementation classes should provide the respective implementation for format of their storage. BKJM can make use of the format API from BK and format it.
Regards,
Uma
________________________________________
From: Ivan Kelly [ivank@apache.org]
Sent: Thursday, June 14, 2012 2:10 PM
To: bookkeeper-dev@zookeeper.apache.org
Subject: Re: Preparing bookkeeper environment during bookie startup
Perhaps we should create a bookie format command, which does all this
stuff. Then the admin would just have to run
bookkeeper-server/bin/bookkeeper bookie -format
on each machine.
-Ivan
On Thu, Jun 14, 2012 at 08:13:46AM +0000, Rakesh R wrote:
> Hi All,
>
> As per my understanding, bookkeeper doesn't have the logic to pre-create the following items and the operators need to manually create all these items before starting the bookkeeper. I feel it would be great if the bookkepper himself will internally maintaining logic to prepare bookkeeper environment ?
>
> Currently following items to be pre-created by the admin:
>
> Zookeeper paths (znodes):
> -------------------------------
> - ledger's root path
> - bookie's available path
>
> Directories:
> -------------------------------
> - Journal directories
> - Ledger directories
>
>
> -Rakesh
Re: Preparing bookkeeper environment during bookie startup
Posted by Ivan Kelly <iv...@apache.org>.
Perhaps we should create a bookie format command, which does all this
stuff. Then the admin would just have to run
bookkeeper-server/bin/bookkeeper bookie -format
on each machine.
-Ivan
On Thu, Jun 14, 2012 at 08:13:46AM +0000, Rakesh R wrote:
> Hi All,
>
> As per my understanding, bookkeeper doesn't have the logic to pre-create the following items and the operators need to manually create all these items before starting the bookkeeper. I feel it would be great if the bookkepper himself will internally maintaining logic to prepare bookkeeper environment ?
>
> Currently following items to be pre-created by the admin:
>
> Zookeeper paths (znodes):
> -------------------------------
> - ledger's root path
> - bookie's available path
>
> Directories:
> -------------------------------
> - Journal directories
> - Ledger directories
>
>
> -Rakesh