Beginners Questions....

[Chris Gray <cm...@gmail.com>]

All,
I am using Hadoop using a test case set up by Michael Noll found on his web
page (http://www.michael-noll.com).

I have successfully ran a job on a single Node Cluster from his examples. I
am trying to add a additional machine to the mix and set it up the same way
as the first machine. It ran a job and it ran successfully as a Single Node
Cluster in about a minute. So I attempted to do the changes that were
necessary for a MultiNode Cluster and everything seems to be following
Michael's example. The only thing is when I run the same job, that again
takes about a minute on a single Node Cluster, It completes in 20 mins with
occasional errors about "Too Many Fetch Failures" on the two machine
MultiNode Cluster.

We have one more machine we would like to add to the cluster for the test
but are afraid we are missing something or have messed something up.  Any
ideas or suggestions for a person just starting out?

Thanks,
Chris

Re: Beginners Questions....

[Arun C Murthy <ac...@yahoo-inc.com>]

On Aug 22, 2008, at 11:15 AM, Chris Gray wrote:

> All,
> I am using Hadoop using a test case set up by Michael Noll found on  
> his web
> page (http://www.michael-noll.com).
>
> I have successfully ran a job on a single Node Cluster from his  
> examples. I
> am trying to add a additional machine to the mix and set it up the  
> same way
> as the first machine. It ran a job and it ran successfully as a  
> Single Node
> Cluster in about a minute. So I attempted to do the changes that were
> necessary for a MultiNode Cluster and everything seems to be following
> Michael's example. The only thing is when I run the same job, that  
> again
> takes about a minute on a single Node Cluster, It completes in 20  
> mins with
> occasional errors about "Too Many Fetch Failures" on the two machine
> MultiNode Cluster.
>

Check the logs of your reduce tasks - the reduces are having trouble  
fetching map-outputs via http.

Arun

> We have one more machine we would like to add to the cluster for the  
> test
> but are afraid we are missing something or have messed something  
> up.  Any
> ideas or suggestions for a person just starting out?
>
> Thanks,
> Chris

Re: Beginners Questions....

[Arun C Murthy <ac...@yahoo-inc.com>]

On Aug 22, 2008, at 11:35 AM, Prerna Manaktala wrote:

> Hi
> does anyone know of the changes made in the latest version of  
> hadoop-18.0?
>

http://hadoop.apache.org/core/docs/r0.18.0/changes.html
http://hadoop.apache.org/core/docs/r0.18.0/releasenotes.html
http://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310240&styleName=Html&version=12312972

Arun

PS: Please don't hijack the thread, start a new one! *smile*

Re: Beginners Questions....

[Prerna Manaktala <pr...@gmail.com>]

Hi
does anyone know of the changes made in the latest version of hadoop-18.0?

Thanks
Prerna