Re: [giraph-users:75] On the relationship between Giraph and Zookeeper

[Claudio Martella <cl...@gmail.com>]

Hi Avery,

thanks for you answers!

I guess I'll just have to start with my own code rolling on our Zookeeper.

On Mon, Sep 5, 2011 at 8:07 PM, Avery Ching <av...@gmail.com> wrote:

> Hi Claudio,
>
> Thanks for your questions.  Answers are inlined.  BTW, we are moving to the
> Apache mailing lists, so I will cross post to
> giraph-user@incubator.apache.**org <gi...@incubator.apache.org> as
> well.
>
> Avery
>
>
> On 9/5/11 3:48 AM, Claudio Martella wrote:
>
>> Hi,
>>
>> I'm trying to deploy my Giraph application on my hadoop 0.20-append
>> cluster. We have HBase 0.90.4, so we have a working Zookeeper 3.3.2.
>> I understand we have to modify GiraphJob's ZOOKEEPER_LIST and set the
>> hostname of the Zookeeper node (i have only one). Is that correct?
>>
>>
> That is correct (ZooKeeper hostname and port number).  You should be able
> to do this two ways.
>
> 1)  You have an already existing app and don't want to modify code.  Just
> set the configuration to the correct zookeeper comma separated list.  I.e.
> -Dgiraph.zkList=<zknode1>:<**zkport1>,<zknode2>:<zkport2>
>
> 2)  You can do it in code with a method in GiraphJob.
>
>    /**
>     * Utilize an existing ZooKeeper service.  If this is not set, ZooKeeper
>     * will be dynamically started by Giraph for this job.
>     *
>     * @param serverList Comma separated list of servers and ports
>     *        (i.e. zk1:2221,zk2:2221)
>     */
>    final public void setZooKeeperConfiguration(**String serverList) {
>        conf.set(ZOOKEEPER_LIST, serverList);
>
>    }
>
>  Second question, I'd like to first test giraph on my cluster through mvn
>> test -Dprop.mapred.job.tracker=**trackerhost:51030, but it doesn't work
>> as it doesn't find Zookeeper.
>> Question now is: does the test need me to modify the ZOOKEEPER_LIST
>> variable? Shouldn't it run by default autonomously at least for the test (it
>> says it would start a zookeeper)?
>>
>
> Ah, I often do this myself to help in debugging.  You just need to set one
> more system property for the unittests to know where to get the ZooKeeper
> list (prop.zookeeper.list), i.e. -Dprop.zookeeper.list=<**
> zkhost1>:<zkport1>...
>
>
>> TIA
>>
>>
>>
>


-- 
    Claudio Martella
    claudio.martella@gmail.com