gsoc

[Pek Daniel <pe...@gmail.com>]

Hi everyone!

I'm doing my master thesis about hadoop/hbase, hypertable, cassandra,
voldemort and friends. The actual topic is noSQL databases as backends
in various data-access patterns.

In the meantime, I'm going to apply to google summer of code program.
I have faced with some unresolved issues while i was doing my
research, and i thought, maybe it would be a good challange as a GSOC
project, and a great chance to get more familiar with the hadoop
internals.

As far as i know Google's solution for storing static configuration is
Chubby. Hadoop currently suggests manage-scripts for keeping in sync
the xml-files on the nodes' local fs. I think, it would be a great
summer project to make hadoop services able to store their
configuration on ZooKeeper. When a config-file changes, services could
be announced runtime, and do the appropriate thing based on the
change.
What do you think of this idea?

Thanks,
Daniel

Re: gsoc

[alex kamil <al...@gmail.com>]

Pek,

also check out these references, you may find some overlap with your thesis
topic
http://ianvarley.com/UT/MR/Varley_MastersReport_Full_2009-08-07.pdf
http://www.umiacs.umd.edu/~jimmylin/book.html

btw, if you are looking for an exciting research topic applying Hadoop in
biomed world pls drop me a line

Cheers
Alex
<http://ianvarley.com/UT/MR/Varley_MastersReport_Full_2009-08-07.pdf>
ak2834@columbia.edu

On Mon, Apr 5, 2010 at 4:06 PM, Allen Wittenauer
<aw...@linkedin.com>wrote:

>
> On Apr 5, 2010, at 12:58 PM, Pek Daniel wrote:
> > As far as i know Google's solution for storing static configuration is
> > Chubby. Hadoop currently suggests manage-scripts for keeping in sync
> > the xml-files on the nodes' local fs. I think, it would be a great
> > summer project to make hadoop services able to store their
> > configuration on ZooKeeper. When a config-file changes, services could
> > be announced runtime, and do the appropriate thing based on the
> > change.
> > What do you think of this idea?
>
> See https://issues.apache.org/jira/browse/HADOOP-5670 .
>
>
>

Re: gsoc

[Stack <st...@duboce.net>]

Its a good idea Daniel.  See https://issues.apache.org/jira/browse/HBASE-1109
St.Ack

On Mon, Apr 5, 2010 at 1:06 PM, Allen Wittenauer
<aw...@linkedin.com> wrote:
>
> On Apr 5, 2010, at 12:58 PM, Pek Daniel wrote:
>> As far as i know Google's solution for storing static configuration is
>> Chubby. Hadoop currently suggests manage-scripts for keeping in sync
>> the xml-files on the nodes' local fs. I think, it would be a great
>> summer project to make hadoop services able to store their
>> configuration on ZooKeeper. When a config-file changes, services could
>> be announced runtime, and do the appropriate thing based on the
>> change.
>> What do you think of this idea?
>
> See https://issues.apache.org/jira/browse/HADOOP-5670 .
>
>
>

Re: gsoc

[Allen Wittenauer <aw...@linkedin.com>]

On Apr 5, 2010, at 12:58 PM, Pek Daniel wrote:
> As far as i know Google's solution for storing static configuration is
> Chubby. Hadoop currently suggests manage-scripts for keeping in sync
> the xml-files on the nodes' local fs. I think, it would be a great
> summer project to make hadoop services able to store their
> configuration on ZooKeeper. When a config-file changes, services could
> be announced runtime, and do the appropriate thing based on the
> change.
> What do you think of this idea?

See https://issues.apache.org/jira/browse/HADOOP-5670 .