Hadoop 101

[HHB <hu...@yahoo.ca>]

Hey,
I'm reading about Hadoop lately but I'm unable to understand it.
Would you please explain it to me in easy words?
How to know if I can employ Hadoop in my current company?
Thanks.
-- 
View this message in context: http://www.nabble.com/Hadoop-101-tp19251524p19251524.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.

Re: Hadoop 101

[Owen O'Malley <om...@apache.org>]

On Mon, Sep 1, 2008 at 2:27 AM, HHB <hu...@yahoo.ca> wrote:

>
> Hey,
> I'm reading about Hadoop lately but I'm unable to understand it.
> Would you please explain it to me in easy words?


Let me try. Hadoop is a framework that lets you write programs that work
with very large datasets in reasonable amounts of time using "normal"
computers instead of fancy servers.

It does this by using large numbers of computers (from 4 up to 3,000 or so)
to both store the data and process the data. When you write programs that
run on large number of computers, one of the primary requirements is that it
handles failures automatically, because you'll be losing a handful a day.
Hadoop handles the failures automatically for you both in terms of storage
on the local disks and computation.

Also take a look at the
presentations<http://wiki.apache.org/hadoop/HadoopPresentations>about
it. Google also has a lot video
lectures <http://code.google.com/edu/parallel/index.html> about it.

>
> How to know if I can employ Hadoop in my current company?


The primary way that companies use Hadoop is to process large sets of log
data. Yahoo collects terabytes a day of user behaviors and wants to
understand them and uses Hadoop to do it. It also has lots of other uses.
See the powered by <http://wiki.apache.org/hadoop/PoweredBy> Hadoop page for
examples of what users are doing with it.

-- Owen

Re: Hadoop 101

[tim robertson <ti...@gmail.com>]

I suggest reading up around map reduce first:
http://labs.google.com/papers/mapreduce-osdi04.pdf

Cheers



On Mon, Sep 1, 2008 at 11:27 AM, HHB <hu...@yahoo.ca> wrote:
>
> Hey,
> I'm reading about Hadoop lately but I'm unable to understand it.
> Would you please explain it to me in easy words?
> How to know if I can employ Hadoop in my current company?
> Thanks.
> --
> View this message in context: http://www.nabble.com/Hadoop-101-tp19251524p19251524.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>