You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Karthik P <ka...@gmail.com> on 2018/03/26 09:21:22 UTC
Confluence - Need edit permission
Team,
I need edit permission to Confluence HBaseBulkLoad
<https://cwiki.apache.org/confluence/display/Hive/HBaseBulkLoad>. Some
distribution like HDP has enabled 'Tez' as execution engine which by
default. So HFile generation may not work properly and will throw the
following exception.
{code}
Caused by: java.io.IOException: wrong key class:
org.apache.hadoop.io.LongWritable
is not class org.apache.hadoop.hive.ql.io.HiveKey
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2332)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2384)
at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.
readPartitions(TotalOrderPartitioner.java:306)
at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.setConf(
TotalOrderPartitioner.java:88)
... 27 more
{code}
Some ref, TEZ-2741 <https://issues.apache.org/jira/browse/TEZ-2741>
*Document fix:* Set map-reduce engine when generating HFiles.
*set hive.execution.engine=mr;*
--
Thank you,
*Karthik Palanisamy*
Bangalore, *India*
Mobile : +91 9940089181
Skype : karthik.p01
Re: Confluence - Need edit permission
Posted by Karthik P <ka...@gmail.com>.
Thank you, Lefty Leverenz.
On Sun, Apr 1, 2018 at 9:47 AM, Lefty Leverenz <le...@gmail.com>
wrote:
> Done. Welcome to the Hive wiki team, Karthik!
>
> -- Lefty
>
>
> On Mon, Mar 26, 2018 at 8:39 AM Karthik P <ka...@gmail.com>
> wrote:
>
>> Confluence:
>> User ID : kpalanisamy
>> Name : Karthik Palanisamy
>>
>>
>> On Mon, Mar 26, 2018 at 2:51 PM, Karthik P <ka...@gmail.com>
>> wrote:
>>
>> > Team,
>> >
>> > I need edit permission to Confluence HBaseBulkLoad
>> > <https://cwiki.apache.org/confluence/display/Hive/HBaseBulkLoad>. Some
>> > distribution like HDP has enabled 'Tez' as execution engine which by
>> > default. So HFile generation may not work properly and will throw the
>> > following exception.
>> >
>> > {code}
>> >
>> > Caused by: java.io.IOException: wrong key class: org.apache.hadoop.io
>> > .LongWritable is not class org.apache.hadoop.hive.ql.io.HiveKey
>> >
>> > at org.apache.hadoop.io.SequenceFile$Reader.next(
>> SequenceFile.java:2332)
>> >
>> > at org.apache.hadoop.io.SequenceFile$Reader.next(
>> SequenceFile.java:2384)
>> >
>> > at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitio
>> > ner.readPartitions(TotalOrderPartitioner.java:306)
>> >
>> > at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitio
>> > ner.setConf(TotalOrderPartitioner.java:88)
>> >
>> > ... 27 more
>> > {code}
>> >
>> >
>> > Some ref, TEZ-2741 <https://issues.apache.org/jira/browse/TEZ-2741>
>> >
>> >
>> > *Document fix:* Set map-reduce engine when generating HFiles.
>> > *set hive.execution.engine=mr;*
>> >
>> > --
>> > Thank you,
>> > *Karthik Palanisamy*
>> > Bangalore, *India*
>> > Mobile : +91 9940089181
>> > Skype : karthik.p01
>> >
>>
>>
>>
>> --
>> Thank you,
>> *Karthik Palanisamy*
>> Bangalore, *India*
>> Mobile : +91 9940089181
>> Skype : karthik.p01
>>
>
--
Thank you,
*Karthik Palanisamy*
Bangalore, *India*
Mobile : +91 9940089181
Skype : karthik.p01
Re: Confluence - Need edit permission
Posted by Lefty Leverenz <le...@gmail.com>.
Done. Welcome to the Hive wiki team, Karthik!
-- Lefty
On Mon, Mar 26, 2018 at 8:39 AM Karthik P <ka...@gmail.com> wrote:
> Confluence:
> User ID : kpalanisamy
> Name : Karthik Palanisamy
>
>
> On Mon, Mar 26, 2018 at 2:51 PM, Karthik P <ka...@gmail.com>
> wrote:
>
> > Team,
> >
> > I need edit permission to Confluence HBaseBulkLoad
> > <https://cwiki.apache.org/confluence/display/Hive/HBaseBulkLoad>. Some
> > distribution like HDP has enabled 'Tez' as execution engine which by
> > default. So HFile generation may not work properly and will throw the
> > following exception.
> >
> > {code}
> >
> > Caused by: java.io.IOException: wrong key class: org.apache.hadoop.io
> > .LongWritable is not class org.apache.hadoop.hive.ql.io.HiveKey
> >
> > at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2332)
> >
> > at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2384)
> >
> > at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitio
> > ner.readPartitions(TotalOrderPartitioner.java:306)
> >
> > at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitio
> > ner.setConf(TotalOrderPartitioner.java:88)
> >
> > ... 27 more
> > {code}
> >
> >
> > Some ref, TEZ-2741 <https://issues.apache.org/jira/browse/TEZ-2741>
> >
> >
> > *Document fix:* Set map-reduce engine when generating HFiles.
> > *set hive.execution.engine=mr;*
> >
> > --
> > Thank you,
> > *Karthik Palanisamy*
> > Bangalore, *India*
> > Mobile : +91 9940089181
> > Skype : karthik.p01
> >
>
>
>
> --
> Thank you,
> *Karthik Palanisamy*
> Bangalore, *India*
> Mobile : +91 9940089181
> Skype : karthik.p01
>
Re: Confluence - Need edit permission
Posted by Karthik P <ka...@gmail.com>.
Confluence:
User ID : kpalanisamy
Name : Karthik Palanisamy
On Mon, Mar 26, 2018 at 2:51 PM, Karthik P <ka...@gmail.com> wrote:
> Team,
>
> I need edit permission to Confluence HBaseBulkLoad
> <https://cwiki.apache.org/confluence/display/Hive/HBaseBulkLoad>. Some
> distribution like HDP has enabled 'Tez' as execution engine which by
> default. So HFile generation may not work properly and will throw the
> following exception.
>
> {code}
>
> Caused by: java.io.IOException: wrong key class: org.apache.hadoop.io
> .LongWritable is not class org.apache.hadoop.hive.ql.io.HiveKey
>
> at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2332)
>
> at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2384)
>
> at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitio
> ner.readPartitions(TotalOrderPartitioner.java:306)
>
> at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitio
> ner.setConf(TotalOrderPartitioner.java:88)
>
> ... 27 more
> {code}
>
>
> Some ref, TEZ-2741 <https://issues.apache.org/jira/browse/TEZ-2741>
>
>
> *Document fix:* Set map-reduce engine when generating HFiles.
> *set hive.execution.engine=mr;*
>
> --
> Thank you,
> *Karthik Palanisamy*
> Bangalore, *India*
> Mobile : +91 9940089181
> Skype : karthik.p01
>
--
Thank you,
*Karthik Palanisamy*
Bangalore, *India*
Mobile : +91 9940089181
Skype : karthik.p01