You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Eugene Koifman <ek...@hortonworks.com> on 2013/07/23 00:54:07 UTC
setting mapred.task.timeout programmatically from client
Hello,
is there a way to set mapred.task.timeout programmatically from client?
Thank you
Re: setting mapred.task.timeout programmatically from client
Posted by Harsh J <ha...@cloudera.com>.
Yes, you can set it into your Job configuration object in code. If
your driver uses the Tool framework, then you can also pass a
-Dmapred.task.timeout=value CLI argument when invoking your program.
On Tue, Jul 23, 2013 at 4:24 AM, Eugene Koifman
<ek...@hortonworks.com> wrote:
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
--
Harsh J
Re: setting mapred.task.timeout programmatically from client
Posted by Harsh J <ha...@cloudera.com>.
Yes, you can set it into your Job configuration object in code. If
your driver uses the Tool framework, then you can also pass a
-Dmapred.task.timeout=value CLI argument when invoking your program.
On Tue, Jul 23, 2013 at 4:24 AM, Eugene Koifman
<ek...@hortonworks.com> wrote:
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
--
Harsh J
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Ok thanks
On Tue, Jul 23, 2013 at 3:02 PM, Ted Yu <yu...@gmail.com> wrote:
> For scheduling mechanism please take a look at oozie.
>
> Cheers
>
> On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
>
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one
> year).In one day records may include 1000 - lacks.I need to show average of
> these 1000 - lacks records.is there any built in haddop mechanism to
> process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually
> a job is submitting) in every 1 hour.Is there a scheduling mechanism in
> hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ekoifman@hortonworks.com
> > wrote:
>
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use
>> 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using
>> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
>> from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>>
>
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Ok thanks
On Tue, Jul 23, 2013 at 3:02 PM, Ted Yu <yu...@gmail.com> wrote:
> For scheduling mechanism please take a look at oozie.
>
> Cheers
>
> On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
>
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one
> year).In one day records may include 1000 - lacks.I need to show average of
> these 1000 - lacks records.is there any built in haddop mechanism to
> process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually
> a job is submitting) in every 1 hour.Is there a scheduling mechanism in
> hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ekoifman@hortonworks.com
> > wrote:
>
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use
>> 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using
>> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
>> from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>>
>
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Ok thanks
On Tue, Jul 23, 2013 at 3:02 PM, Ted Yu <yu...@gmail.com> wrote:
> For scheduling mechanism please take a look at oozie.
>
> Cheers
>
> On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
>
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one
> year).In one day records may include 1000 - lacks.I need to show average of
> these 1000 - lacks records.is there any built in haddop mechanism to
> process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually
> a job is submitting) in every 1 hour.Is there a scheduling mechanism in
> hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ekoifman@hortonworks.com
> > wrote:
>
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use
>> 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using
>> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
>> from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>>
>
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Ok thanks
On Tue, Jul 23, 2013 at 3:02 PM, Ted Yu <yu...@gmail.com> wrote:
> For scheduling mechanism please take a look at oozie.
>
> Cheers
>
> On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
>
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one
> year).In one day records may include 1000 - lacks.I need to show average of
> these 1000 - lacks records.is there any built in haddop mechanism to
> process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually
> a job is submitting) in every 1 hour.Is there a scheduling mechanism in
> hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ekoifman@hortonworks.com
> > wrote:
>
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use
>> 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using
>> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
>> from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>>
>
>
Re: setting mapred.task.timeout programmatically from client
Posted by Ted Yu <yu...@gmail.com>.
For scheduling mechanism please take a look at oozie.
Cheers
On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one year).In one day records may include 1000 - lacks.I need to show average of these 1000 - lacks records.is there any built in haddop mechanism to process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually a job is submitting) in every 1 hour.Is there a scheduling mechanism in hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ek...@hortonworks.com> wrote:
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Ted Yu <yu...@gmail.com>.
For scheduling mechanism please take a look at oozie.
Cheers
On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one year).In one day records may include 1000 - lacks.I need to show average of these 1000 - lacks records.is there any built in haddop mechanism to process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually a job is submitting) in every 1 hour.Is there a scheduling mechanism in hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ek...@hortonworks.com> wrote:
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Ted Yu <yu...@gmail.com>.
For scheduling mechanism please take a look at oozie.
Cheers
On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one year).In one day records may include 1000 - lacks.I need to show average of these 1000 - lacks records.is there any built in haddop mechanism to process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually a job is submitting) in every 1 hour.Is there a scheduling mechanism in hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ek...@hortonworks.com> wrote:
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Ted Yu <yu...@gmail.com>.
For scheduling mechanism please take a look at oozie.
Cheers
On Jul 22, 2013, at 10:37 PM, Balamurali <ba...@gmail.com> wrote:
> Hi,
>
> I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
> Created table in HBase.Inserted records.Processing the data using Hive.
> I have to show a graph with some points ( 7 - 7 days or 12 for one year).In one day records may include 1000 - lacks.I need to show average of these 1000 - lacks records.is there any built in haddop mechanism to process these records fast.
>
> Also I need to run a hive query or job (when we run a hive query actually a job is submitting) in every 1 hour.Is there a scheduling mechanism in hadoop to handle thsese
>
>
> Please reply.
> Balamurali
>
>
> On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman <ek...@hortonworks.com> wrote:
>> Than you both
>>
>> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
>> > 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>> >
>> > You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>> >
>> > Thanks
>> > Devaraj k
>> >
>> > -----Original Message-----
>> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
>> > Sent: 23 July 2013 04:24
>> > To: user@hadoop.apache.org
>> > Subject: setting mapred.task.timeout programmatically from client
>> >
>> > Hello,
>> > is there a way to set mapred.task.timeout programmatically from client?
>> >
>> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Hi,
I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
Created table in HBase.Inserted records.Processing the data using Hive.
I have to show a graph with some points ( 7 - 7 days or 12 for one year).In
one day records may include 1000 - lacks.I need to show average of these
1000 - lacks records.is there any built in haddop mechanism to process
these records fast.
Also I need to run a hive query or job (when we run a hive query actually
a job is submitting) in every 1 hour.Is there a scheduling mechanism in
hadoop to handle thsese
Please reply.
Balamurali
On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman
<ek...@hortonworks.com>wrote:
> Than you both
>
> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> > 'mapred.task.timeout' is deprecated configuration. You can use
> 'mapreduce.task.timeout' property to do the same.
> >
> > You could set this configuration while submitting the Job using
> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
> from conf or JobConf.
> >
> > Thanks
> > Devaraj k
> >
> > -----Original Message-----
> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> > Sent: 23 July 2013 04:24
> > To: user@hadoop.apache.org
> > Subject: setting mapred.task.timeout programmatically from client
> >
> > Hello,
> > is there a way to set mapred.task.timeout programmatically from client?
> >
> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Hi,
I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
Created table in HBase.Inserted records.Processing the data using Hive.
I have to show a graph with some points ( 7 - 7 days or 12 for one year).In
one day records may include 1000 - lacks.I need to show average of these
1000 - lacks records.is there any built in haddop mechanism to process
these records fast.
Also I need to run a hive query or job (when we run a hive query actually
a job is submitting) in every 1 hour.Is there a scheduling mechanism in
hadoop to handle thsese
Please reply.
Balamurali
On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman
<ek...@hortonworks.com>wrote:
> Than you both
>
> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> > 'mapred.task.timeout' is deprecated configuration. You can use
> 'mapreduce.task.timeout' property to do the same.
> >
> > You could set this configuration while submitting the Job using
> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
> from conf or JobConf.
> >
> > Thanks
> > Devaraj k
> >
> > -----Original Message-----
> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> > Sent: 23 July 2013 04:24
> > To: user@hadoop.apache.org
> > Subject: setting mapred.task.timeout programmatically from client
> >
> > Hello,
> > is there a way to set mapred.task.timeout programmatically from client?
> >
> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Hi,
I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
Created table in HBase.Inserted records.Processing the data using Hive.
I have to show a graph with some points ( 7 - 7 days or 12 for one year).In
one day records may include 1000 - lacks.I need to show average of these
1000 - lacks records.is there any built in haddop mechanism to process
these records fast.
Also I need to run a hive query or job (when we run a hive query actually
a job is submitting) in every 1 hour.Is there a scheduling mechanism in
hadoop to handle thsese
Please reply.
Balamurali
On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman
<ek...@hortonworks.com>wrote:
> Than you both
>
> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> > 'mapred.task.timeout' is deprecated configuration. You can use
> 'mapreduce.task.timeout' property to do the same.
> >
> > You could set this configuration while submitting the Job using
> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
> from conf or JobConf.
> >
> > Thanks
> > Devaraj k
> >
> > -----Original Message-----
> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> > Sent: 23 July 2013 04:24
> > To: user@hadoop.apache.org
> > Subject: setting mapred.task.timeout programmatically from client
> >
> > Hello,
> > is there a way to set mapred.task.timeout programmatically from client?
> >
> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Balamurali <ba...@gmail.com>.
Hi,
I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 .
Created table in HBase.Inserted records.Processing the data using Hive.
I have to show a graph with some points ( 7 - 7 days or 12 for one year).In
one day records may include 1000 - lacks.I need to show average of these
1000 - lacks records.is there any built in haddop mechanism to process
these records fast.
Also I need to run a hive query or job (when we run a hive query actually
a job is submitting) in every 1 hour.Is there a scheduling mechanism in
hadoop to handle thsese
Please reply.
Balamurali
On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman
<ek...@hortonworks.com>wrote:
> Than you both
>
> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> > 'mapred.task.timeout' is deprecated configuration. You can use
> 'mapreduce.task.timeout' property to do the same.
> >
> > You could set this configuration while submitting the Job using
> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API
> from conf or JobConf.
> >
> > Thanks
> > Devaraj k
> >
> > -----Original Message-----
> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> > Sent: 23 July 2013 04:24
> > To: user@hadoop.apache.org
> > Subject: setting mapred.task.timeout programmatically from client
> >
> > Hello,
> > is there a way to set mapred.task.timeout programmatically from client?
> >
> > Thank you
>
Re: setting mapred.task.timeout programmatically from client
Posted by Eugene Koifman <ek...@hortonworks.com>.
Than you both
On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>
> You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>
> Thanks
> Devaraj k
>
> -----Original Message-----
> From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> Sent: 23 July 2013 04:24
> To: user@hadoop.apache.org
> Subject: setting mapred.task.timeout programmatically from client
>
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
Re: setting mapred.task.timeout programmatically from client
Posted by Eugene Koifman <ek...@hortonworks.com>.
Than you both
On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>
> You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>
> Thanks
> Devaraj k
>
> -----Original Message-----
> From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> Sent: 23 July 2013 04:24
> To: user@hadoop.apache.org
> Subject: setting mapred.task.timeout programmatically from client
>
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
Re: setting mapred.task.timeout programmatically from client
Posted by Eugene Koifman <ek...@hortonworks.com>.
Than you both
On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>
> You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>
> Thanks
> Devaraj k
>
> -----Original Message-----
> From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> Sent: 23 July 2013 04:24
> To: user@hadoop.apache.org
> Subject: setting mapred.task.timeout programmatically from client
>
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
Re: setting mapred.task.timeout programmatically from client
Posted by Eugene Koifman <ek...@hortonworks.com>.
Than you both
On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <de...@huawei.com> wrote:
> 'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
>
> You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
>
> Thanks
> Devaraj k
>
> -----Original Message-----
> From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> Sent: 23 July 2013 04:24
> To: user@hadoop.apache.org
> Subject: setting mapred.task.timeout programmatically from client
>
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
RE: setting mapred.task.timeout programmatically from client
Posted by Devaraj k <de...@huawei.com>.
'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
Thanks
Devaraj k
-----Original Message-----
From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
Sent: 23 July 2013 04:24
To: user@hadoop.apache.org
Subject: setting mapred.task.timeout programmatically from client
Hello,
is there a way to set mapred.task.timeout programmatically from client?
Thank you
RE: setting mapred.task.timeout programmatically from client
Posted by Devaraj k <de...@huawei.com>.
'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
Thanks
Devaraj k
-----Original Message-----
From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
Sent: 23 July 2013 04:24
To: user@hadoop.apache.org
Subject: setting mapred.task.timeout programmatically from client
Hello,
is there a way to set mapred.task.timeout programmatically from client?
Thank you
Re: setting mapred.task.timeout programmatically from client
Posted by Harsh J <ha...@cloudera.com>.
Yes, you can set it into your Job configuration object in code. If
your driver uses the Tool framework, then you can also pass a
-Dmapred.task.timeout=value CLI argument when invoking your program.
On Tue, Jul 23, 2013 at 4:24 AM, Eugene Koifman
<ek...@hortonworks.com> wrote:
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
--
Harsh J
RE: setting mapred.task.timeout programmatically from client
Posted by Devaraj k <de...@huawei.com>.
'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
Thanks
Devaraj k
-----Original Message-----
From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
Sent: 23 July 2013 04:24
To: user@hadoop.apache.org
Subject: setting mapred.task.timeout programmatically from client
Hello,
is there a way to set mapred.task.timeout programmatically from client?
Thank you
Re: setting mapred.task.timeout programmatically from client
Posted by Harsh J <ha...@cloudera.com>.
Yes, you can set it into your Job configuration object in code. If
your driver uses the Tool framework, then you can also pass a
-Dmapred.task.timeout=value CLI argument when invoking your program.
On Tue, Jul 23, 2013 at 4:24 AM, Eugene Koifman
<ek...@hortonworks.com> wrote:
> Hello,
> is there a way to set mapred.task.timeout programmatically from client?
>
> Thank you
--
Harsh J
RE: setting mapred.task.timeout programmatically from client
Posted by Devaraj k <de...@huawei.com>.
'mapred.task.timeout' is deprecated configuration. You can use 'mapreduce.task.timeout' property to do the same.
You could set this configuration while submitting the Job using org.apache.hadoop.conf.Configuration.setLong(String name, long value) API from conf or JobConf.
Thanks
Devaraj k
-----Original Message-----
From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
Sent: 23 July 2013 04:24
To: user@hadoop.apache.org
Subject: setting mapred.task.timeout programmatically from client
Hello,
is there a way to set mapred.task.timeout programmatically from client?
Thank you