You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Sai Sai <sa...@yahoo.in> on 2013/03/08 06:41:52 UTC

Re: Find current version & cluster info of hadoop

Just wondering if there r any commands in Hadoop which would give us the current version that we
r using and any command which will give us the info of cluster setup of H we r working on.
Thanks
Sai

Re: Find current version & cluster info of hadoop

Posted by Harsh J <ha...@cloudera.com>.

Something like "hadoop version" and "hdfs dfsadmin -report" is what
you're looking for?

On Fri, Mar 8, 2013 at 11:11 AM, Sai Sai <sa...@yahoo.in> wrote:
> Just wondering if there r any commands in Hadoop which would give us the
> current version that we
> r using and any command which will give us the info of cluster setup of H we
> r working on.
> Thanks
> Sai



--
Harsh J

Re: Dissecting MR output article

Posted by Harsh J <ha...@cloudera.com>.

+1 for Hadoop: The Definitive Guide and other books.

Sidenote: The 3rd Edition of Tom White's Hadoop: The
Definitive Guide does have good details on MRv2 and YARN.

On Sat, Mar 23, 2013 at 11:22 AM, Azuryy Yu <az...@gmail.com> wrote:
> hadoop definition guide.pdf should be helpful. there is a chapter for this.
> but only for MRv1.
>
> On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:
>>
>>
>> Just wondering if there is any step by step explaination/article of MR
>> output we get when we run a job either in eclipse or ubuntu.
>> Any help is appreciated.
>> Thanks
>> Sai



--
Harsh J

Re: Dissecting MR output article

Posted by Harsh J <ha...@cloudera.com>.

+1 for Hadoop: The Definitive Guide and other books.

Sidenote: The 3rd Edition of Tom White's Hadoop: The
Definitive Guide does have good details on MRv2 and YARN.

On Sat, Mar 23, 2013 at 11:22 AM, Azuryy Yu <az...@gmail.com> wrote:
> hadoop definition guide.pdf should be helpful. there is a chapter for this.
> but only for MRv1.
>
> On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:
>>
>>
>> Just wondering if there is any step by step explaination/article of MR
>> output we get when we run a job either in eclipse or ubuntu.
>> Any help is appreciated.
>> Thanks
>> Sai



--
Harsh J

Re: Dissecting MR output article

Posted by Harsh J <ha...@cloudera.com>.

+1 for Hadoop: The Definitive Guide and other books.

Sidenote: The 3rd Edition of Tom White's Hadoop: The
Definitive Guide does have good details on MRv2 and YARN.

On Sat, Mar 23, 2013 at 11:22 AM, Azuryy Yu <az...@gmail.com> wrote:
> hadoop definition guide.pdf should be helpful. there is a chapter for this.
> but only for MRv1.
>
> On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:
>>
>>
>> Just wondering if there is any step by step explaination/article of MR
>> output we get when we run a job either in eclipse or ubuntu.
>> Any help is appreciated.
>> Thanks
>> Sai



--
Harsh J

Re: Dissecting MR output article

Posted by Harsh J <ha...@cloudera.com>.

+1 for Hadoop: The Definitive Guide and other books.

Sidenote: The 3rd Edition of Tom White's Hadoop: The
Definitive Guide does have good details on MRv2 and YARN.

On Sat, Mar 23, 2013 at 11:22 AM, Azuryy Yu <az...@gmail.com> wrote:
> hadoop definition guide.pdf should be helpful. there is a chapter for this.
> but only for MRv1.
>
> On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:
>>
>>
>> Just wondering if there is any step by step explaination/article of MR
>> output we get when we run a job either in eclipse or ubuntu.
>> Any help is appreciated.
>> Thanks
>> Sai



--
Harsh J

Re: Dissecting MR output article

Posted by Azuryy Yu <az...@gmail.com>.

hadoop definition guide.pdf should be helpful. there is a chapter for this.
but only for MRv1.
 On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:

>
> Just wondering if there is any step by step explaination/article of MR
> output we get when we run a job either in eclipse or ubuntu.
> Any help is appreciated.
> Thanks
> Sai
>

Re: Dissecting MR output article

Posted by Azuryy Yu <az...@gmail.com>.

hadoop definition guide.pdf should be helpful. there is a chapter for this.
but only for MRv1.
 On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:

>
> Just wondering if there is any step by step explaination/article of MR
> output we get when we run a job either in eclipse or ubuntu.
> Any help is appreciated.
> Thanks
> Sai
>

Re: Dissecting MR output article

Posted by Azuryy Yu <az...@gmail.com>.

hadoop definition guide.pdf should be helpful. there is a chapter for this.
but only for MRv1.
 On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:

>
> Just wondering if there is any step by step explaination/article of MR
> output we get when we run a job either in eclipse or ubuntu.
> Any help is appreciated.
> Thanks
> Sai
>

Re: Dissecting MR output article

Posted by Azuryy Yu <az...@gmail.com>.

hadoop definition guide.pdf should be helpful. there is a chapter for this.
but only for MRv1.
 On Mar 23, 2013 1:50 PM, "Sai Sai" <sa...@yahoo.in> wrote:

>
> Just wondering if there is any step by step explaination/article of MR
> output we get when we run a job either in eclipse or ubuntu.
> Any help is appreciated.
> Thanks
> Sai
>

Re: Dissecting MR output article

Posted by Sai Sai <sa...@yahoo.in>.


Just wondering if there is any step by step explaination/article of MR output we get when we run a job either in eclipse or ubuntu.Any help is appreciated.
Thanks
Sai

Re: Dissecting MR output article

Posted by Sai Sai <sa...@yahoo.in>.


Just wondering if there is any step by step explaination/article of MR output we get when we run a job either in eclipse or ubuntu.Any help is appreciated.
Thanks
Sai

Re: Dissecting MR output article

Posted by Sai Sai <sa...@yahoo.in>.


Just wondering if there is any step by step explaination/article of MR output we get when we run a job either in eclipse or ubuntu.Any help is appreciated.
Thanks
Sai

Re: Dissecting MR output article

Posted by Sai Sai <sa...@yahoo.in>.


Just wondering if there is any step by step explaination/article of MR output we get when we run a job either in eclipse or ubuntu.Any help is appreciated.
Thanks
Sai

Re: Setup/Cleanup question

Posted by Sai Sai <sa...@yahoo.in>.

Thanks Harsh.
So the setup/cleanup r for the Job and not the Mappers i take it.
Thanks.





________________________________
 From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>; Sai Sai <sa...@yahoo.in> 
Sent: Friday, 22 March 2013 10:05 PM
Subject: Re: Setup/Cleanup question
 
Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Sai Sai <sa...@yahoo.in>.

Thanks Harsh.
So the setup/cleanup r for the Job and not the Mappers i take it.
Thanks.





________________________________
 From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>; Sai Sai <sa...@yahoo.in> 
Sent: Friday, 22 March 2013 10:05 PM
Subject: Re: Setup/Cleanup question
 
Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Sai Sai <sa...@yahoo.in>.

Thanks Harsh.
So the setup/cleanup r for the Job and not the Mappers i take it.
Thanks.





________________________________
 From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>; Sai Sai <sa...@yahoo.in> 
Sent: Friday, 22 March 2013 10:05 PM
Subject: Re: Setup/Cleanup question
 
Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Sai Sai <sa...@yahoo.in>.

Thanks Harsh.
So the setup/cleanup r for the Job and not the Mappers i take it.
Thanks.





________________________________
 From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>; Sai Sai <sa...@yahoo.in> 
Sent: Friday, 22 March 2013 10:05 PM
Subject: Re: Setup/Cleanup question
 
Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Harsh J <ha...@cloudera.com>.

Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Harsh J <ha...@cloudera.com>.

Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Harsh J <ha...@cloudera.com>.

Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Harsh J <ha...@cloudera.com>.

Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job
Setup and 1 Job Cleanup tasks additionally run for each Job.

On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai <sa...@yahoo.in> wrote:
> When running an MR job/program assuming there r 'n' (=100) Mappers triggered
> then my question is will the setup & cleanup run n number of times which
> means once for each mapper or for all the mappers they will run only once.
> Any help is appreciated.
> Thanks
> Sai



-- 
Harsh J

Re: Setup/Cleanup question

Posted by Sai Sai <sa...@yahoo.in>.

When running an MR job/program assuming there r 'n' (=100) Mapperstriggered then my question is will the setup & cleanup run n number of times which means once for each mapper or for all the mappers they will run only once. 

Any help is appreciated.
Thanks
Sai

Re: Setup/Cleanup question

Posted by Sai Sai <sa...@yahoo.in>.

When running an MR job/program assuming there r 'n' (=100) Mapperstriggered then my question is will the setup & cleanup run n number of times which means once for each mapper or for all the mappers they will run only once. 

Any help is appreciated.
Thanks
Sai