You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Viswanathan J <ja...@gmail.com> on 2013/08/27 04:17:22 UTC
Hadoop Conf properties
As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are the
key Conf properties that's to be configure for hdfs,MR and Job tracker as
well as any best practices.
Thanks,
Viswa.J
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Thanks Harsh.
On Aug 27, 2013 10:44 AM, "Harsh J" <ha...@cloudera.com> wrote:
> There isn't a major difference between 1.x releases enough to warrant
> a specific configuration change as the release is mostly a minor
> upgrade (as compared to upgrading to 2.x). If you are looking to find
> general tuning advice from other users, perhaps sharing your
> deployment, use-case and hardware details along with existing
> configuration may help them suggest something you're missing.
>
> On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
> <ja...@gmail.com> wrote:
> > Hi Harsh,
> >
> > Appreciate your response.
> >
> > On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
> >>
> >> Appreciate the response.
> >>
> >> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> >> wrote:
> >>>
> >>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> >>> the key Conf properties that's to be configure for hdfs,MR and Job
> tracker
> >>> as well as any best practices.
> >>>
> >>> Thanks,
> >>> Viswa.J
>
>
>
> --
> Harsh J
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Thanks Harsh.
On Aug 27, 2013 10:44 AM, "Harsh J" <ha...@cloudera.com> wrote:
> There isn't a major difference between 1.x releases enough to warrant
> a specific configuration change as the release is mostly a minor
> upgrade (as compared to upgrading to 2.x). If you are looking to find
> general tuning advice from other users, perhaps sharing your
> deployment, use-case and hardware details along with existing
> configuration may help them suggest something you're missing.
>
> On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
> <ja...@gmail.com> wrote:
> > Hi Harsh,
> >
> > Appreciate your response.
> >
> > On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
> >>
> >> Appreciate the response.
> >>
> >> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> >> wrote:
> >>>
> >>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> >>> the key Conf properties that's to be configure for hdfs,MR and Job
> tracker
> >>> as well as any best practices.
> >>>
> >>> Thanks,
> >>> Viswa.J
>
>
>
> --
> Harsh J
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Thanks Harsh.
On Aug 27, 2013 10:44 AM, "Harsh J" <ha...@cloudera.com> wrote:
> There isn't a major difference between 1.x releases enough to warrant
> a specific configuration change as the release is mostly a minor
> upgrade (as compared to upgrading to 2.x). If you are looking to find
> general tuning advice from other users, perhaps sharing your
> deployment, use-case and hardware details along with existing
> configuration may help them suggest something you're missing.
>
> On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
> <ja...@gmail.com> wrote:
> > Hi Harsh,
> >
> > Appreciate your response.
> >
> > On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
> >>
> >> Appreciate the response.
> >>
> >> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> >> wrote:
> >>>
> >>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> >>> the key Conf properties that's to be configure for hdfs,MR and Job
> tracker
> >>> as well as any best practices.
> >>>
> >>> Thanks,
> >>> Viswa.J
>
>
>
> --
> Harsh J
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Thanks Harsh.
On Aug 27, 2013 10:44 AM, "Harsh J" <ha...@cloudera.com> wrote:
> There isn't a major difference between 1.x releases enough to warrant
> a specific configuration change as the release is mostly a minor
> upgrade (as compared to upgrading to 2.x). If you are looking to find
> general tuning advice from other users, perhaps sharing your
> deployment, use-case and hardware details along with existing
> configuration may help them suggest something you're missing.
>
> On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
> <ja...@gmail.com> wrote:
> > Hi Harsh,
> >
> > Appreciate your response.
> >
> > On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
> >>
> >> Appreciate the response.
> >>
> >> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> >> wrote:
> >>>
> >>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> >>> the key Conf properties that's to be configure for hdfs,MR and Job
> tracker
> >>> as well as any best practices.
> >>>
> >>> Thanks,
> >>> Viswa.J
>
>
>
> --
> Harsh J
>
Re: Hadoop Conf properties
Posted by Harsh J <ha...@cloudera.com>.
There isn't a major difference between 1.x releases enough to warrant
a specific configuration change as the release is mostly a minor
upgrade (as compared to upgrading to 2.x). If you are looking to find
general tuning advice from other users, perhaps sharing your
deployment, use-case and hardware details along with existing
configuration may help them suggest something you're missing.
On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
<ja...@gmail.com> wrote:
> Hi Harsh,
>
> Appreciate your response.
>
> On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
>>
>> Appreciate the response.
>>
>> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
>> wrote:
>>>
>>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>>> as well as any best practices.
>>>
>>> Thanks,
>>> Viswa.J
--
Harsh J
Re: Hadoop Conf properties
Posted by Harsh J <ha...@cloudera.com>.
There isn't a major difference between 1.x releases enough to warrant
a specific configuration change as the release is mostly a minor
upgrade (as compared to upgrading to 2.x). If you are looking to find
general tuning advice from other users, perhaps sharing your
deployment, use-case and hardware details along with existing
configuration may help them suggest something you're missing.
On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
<ja...@gmail.com> wrote:
> Hi Harsh,
>
> Appreciate your response.
>
> On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
>>
>> Appreciate the response.
>>
>> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
>> wrote:
>>>
>>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>>> as well as any best practices.
>>>
>>> Thanks,
>>> Viswa.J
--
Harsh J
Re: Hadoop Conf properties
Posted by Harsh J <ha...@cloudera.com>.
There isn't a major difference between 1.x releases enough to warrant
a specific configuration change as the release is mostly a minor
upgrade (as compared to upgrading to 2.x). If you are looking to find
general tuning advice from other users, perhaps sharing your
deployment, use-case and hardware details along with existing
configuration may help them suggest something you're missing.
On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
<ja...@gmail.com> wrote:
> Hi Harsh,
>
> Appreciate your response.
>
> On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
>>
>> Appreciate the response.
>>
>> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
>> wrote:
>>>
>>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>>> as well as any best practices.
>>>
>>> Thanks,
>>> Viswa.J
--
Harsh J
Re: Hadoop Conf properties
Posted by Harsh J <ha...@cloudera.com>.
There isn't a major difference between 1.x releases enough to warrant
a specific configuration change as the release is mostly a minor
upgrade (as compared to upgrading to 2.x). If you are looking to find
general tuning advice from other users, perhaps sharing your
deployment, use-case and hardware details along with existing
configuration may help them suggest something you're missing.
On Tue, Aug 27, 2013 at 10:41 AM, Viswanathan J
<ja...@gmail.com> wrote:
> Hi Harsh,
>
> Appreciate your response.
>
> On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
>>
>> Appreciate the response.
>>
>> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
>> wrote:
>>>
>>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>>> as well as any best practices.
>>>
>>> Thanks,
>>> Viswa.J
--
Harsh J
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Hi Harsh,
Appreciate your response.
On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> Appreciate the response.
> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
>
>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>> as well as any best practices.
>>
>> Thanks,
>> Viswa.J
>>
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Hi Harsh,
Appreciate your response.
On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> Appreciate the response.
> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
>
>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>> as well as any best practices.
>>
>> Thanks,
>> Viswa.J
>>
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Hi Harsh,
Appreciate your response.
On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> Appreciate the response.
> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
>
>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>> as well as any best practices.
>>
>> Thanks,
>> Viswa.J
>>
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Hi Harsh,
Appreciate your response.
On Aug 27, 2013 8:58 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> Appreciate the response.
> On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com>
> wrote:
>
>> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
>> the key Conf properties that's to be configure for hdfs,MR and Job tracker
>> as well as any best practices.
>>
>> Thanks,
>> Viswa.J
>>
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Appreciate the response.
On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> the key Conf properties that's to be configure for hdfs,MR and Job tracker
> as well as any best practices.
>
> Thanks,
> Viswa.J
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Appreciate the response.
On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> the key Conf properties that's to be configure for hdfs,MR and Job tracker
> as well as any best practices.
>
> Thanks,
> Viswa.J
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Appreciate the response.
On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> the key Conf properties that's to be configure for hdfs,MR and Job tracker
> as well as any best practices.
>
> Thanks,
> Viswa.J
>
Re: Hadoop Conf properties
Posted by Viswanathan J <ja...@gmail.com>.
Appreciate the response.
On Aug 27, 2013 7:47 AM, "Viswanathan J" <ja...@gmail.com> wrote:
> As we are upgrading the hdfs cluster with Apache hadoop 1.2.1, what are
> the key Conf properties that's to be configure for hdfs,MR and Job tracker
> as well as any best practices.
>
> Thanks,
> Viswa.J
>