You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by abhiTowson cal <ab...@gmail.com> on 2012/07/23 05:26:47 UTC
Hive partitioner
hi all,
How to use total order partitioner hive?
Regards
Abhishek
Re: Hive partitioner
Posted by Abhishek <ab...@gmail.com>.
Data is skewed here so does it help?
Thanks
Abhi
Sent from my iPhone
On Jul 24, 2012, at 9:50 AM, Nitin Pawar <ni...@gmail.com> wrote:
> Tried rarely.
>
> It also depends on the data :)
>
> On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <ab...@gmail.com> wrote:
>> Hi nitin,
>>
>> Thanks for the reply.By setting this in hive does it improve the performance ?
>>
>> Regards
>> Abhi
>>
>> Sent from my iPhone
>>
>> On Jul 23, 2012, at 3:18 AM, Nitin Pawar <ni...@gmail.com> wrote:
>>
>>> you may try this
>>>
>>> set hive.mapred.partitioner=
>>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
>>> set total.order.partitioner.natural.order=[false|true];
>>> set total.order.partitioner.path=[path];
>>>
>>> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
>>> <ab...@gmail.com> wrote:
>>>>
>>>> hi all,
>>>>
>>>> How to use total order partitioner hive?
>>>>
>>>> Regards
>>>> Abhishek
>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>
>
>
> --
> Nitin Pawar
Re: Hive partitioner
Posted by Nitin Pawar <ni...@gmail.com>.
Tried rarely.
It also depends on the data :)
On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <ab...@gmail.com> wrote:
> Hi nitin,
>
> Thanks for the reply.By setting this in hive does it improve the performance ?
>
> Regards
> Abhi
>
> Sent from my iPhone
>
> On Jul 23, 2012, at 3:18 AM, Nitin Pawar <ni...@gmail.com> wrote:
>
>> you may try this
>>
>> set hive.mapred.partitioner=
>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
>> set total.order.partitioner.natural.order=[false|true];
>> set total.order.partitioner.path=[path];
>>
>> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
>> <ab...@gmail.com> wrote:
>>>
>>> hi all,
>>>
>>> How to use total order partitioner hive?
>>>
>>> Regards
>>> Abhishek
>>
>>
>>
>>
>> --
>> Nitin Pawar
--
Nitin Pawar
Re: Hive partitioner
Posted by Abhishek <ab...@gmail.com>.
Hi nitin,
Thanks for the reply.By setting this in hive does it improve the performance ?
Regards
Abhi
Sent from my iPhone
On Jul 23, 2012, at 3:18 AM, Nitin Pawar <ni...@gmail.com> wrote:
> you may try this
>
> set hive.mapred.partitioner=
> org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
> set total.order.partitioner.natural.order=[false|true];
> set total.order.partitioner.path=[path];
>
> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
> <ab...@gmail.com> wrote:
>>
>> hi all,
>>
>> How to use total order partitioner hive?
>>
>> Regards
>> Abhishek
>
>
>
>
> --
> Nitin Pawar
Re: Hive partitioner
Posted by Nitin Pawar <ni...@gmail.com>.
you may try this
set hive.mapred.partitioner=
org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
set total.order.partitioner.natural.order=[false|true];
set total.order.partitioner.path=[path];
On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
<ab...@gmail.com> wrote:
>
> hi all,
>
> How to use total order partitioner hive?
>
> Regards
> Abhishek
--
Nitin Pawar
thrift server and CDH issue?
Posted by hadoopman <ha...@gmail.com>.
I recall recently reading somewhere on cloudera's web site that it was
not recommended to run more than one thrift server connecting to hive
however it's been a couple months since reading this. I'm still digging
to find the article and was curious perhaps someone here can provide
some insight on this?
Perhaps I misread it.
Basically we're looking at setting up a thrift server port for every
hive user so it would be easier for us to identify who kicked off a job.
Thanks!