You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Karthiksrivasthava <ka...@gmail.com> on 2014/09/24 06:14:26 UTC
Takes long time at map 100% Reduce 100%
Hi ,
My MapReduce program takes almost 10 minutes to finish the job after it reaches
map 100% reduce 100% ..
Thanks
Karthik
Re: Takes long time at map 100% Reduce 100%
Posted by unmesha sreeveni <un...@gmail.com>.
Do you have any type of calculation in Driver?
On Wed, Sep 24, 2014 at 10:19 AM, Rohith Sharma K S <
rohithsharmaks@huawei.com> wrote:
> Is it your custom job or any mapreduce-example jobs?
> How many mappers and reducers are running?
>
> Check application master container logs why job is not finished.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> -----Original Message-----
> From: Karthiksrivasthava [mailto:karthiksrivasthava@gmail.com]
> Sent: 24 September 2014 09:44
> To: user@hive.apache.org
> Subject: Takes long time at map 100% Reduce 100%
>
> Hi ,
>
> My MapReduce program takes almost 10 minutes to finish the job after it
> reaches map 100% reduce 100% ..
>
> Thanks
> Karthik
>
--
*Thanks & Regards *
*Unmesha Sreeveni U.B*
*Hadoop, Bigdata Developer*
*Center for Cyber Security | Amrita Vishwa Vidyapeetham*
http://www.unmeshasreeveni.blogspot.in/
Re: Takes long time at map 100% Reduce 100%
Posted by Karthiksrivasthava <ka...@gmail.com>.
Sorry for the late reply ..
It's a custom MapReduce job and It runs with 3 mappers ..160 reducers ..
It hangs for soo long at Map 100% Reduce 100%
I don't have Any calculation in DriverClass
Thanks
Karthik
> On Sep 23, 2014, at 23:49, Rohith Sharma K S <ro...@huawei.com> wrote:
>
> Is it your custom job or any mapreduce-example jobs?
> How many mappers and reducers are running?
>
> Check application master container logs why job is not finished.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> -----Original Message-----
> From: Karthiksrivasthava [mailto:karthiksrivasthava@gmail.com]
> Sent: 24 September 2014 09:44
> To: user@hive.apache.org
> Subject: Takes long time at map 100% Reduce 100%
>
> Hi ,
>
> My MapReduce program takes almost 10 minutes to finish the job after it reaches map 100% reduce 100% ..
>
> Thanks
> Karthik
RE: Takes long time at map 100% Reduce 100%
Posted by Rohith Sharma K S <ro...@huawei.com>.
Is it your custom job or any mapreduce-example jobs?
How many mappers and reducers are running?
Check application master container logs why job is not finished.
Thanks & Regards
Rohith Sharma K S
-----Original Message-----
From: Karthiksrivasthava [mailto:karthiksrivasthava@gmail.com]
Sent: 24 September 2014 09:44
To: user@hive.apache.org
Subject: Takes long time at map 100% Reduce 100%
Hi ,
My MapReduce program takes almost 10 minutes to finish the job after it reaches map 100% reduce 100% ..
Thanks
Karthik