You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by patcharee <Pa...@uni.no> on 2015/07/18 12:05:36 UTC
character '' not supported here
Hi,
I am using hive 0.14 with Tez engine. Found a weird problem. Any
suggestions?
hive> select count(*) from 4D;
line 1:1 character '' not supported here
line 1:2 character '' not supported here
line 1:3 character '' not supported here
line 1:4 character '' not supported here
line 1:5 character '' not supported here
line 1:6 character '' not supported here
line 1:7 character '' not supported here
line 1:8 character '' not supported here
line 1:9 character '' not supported here
...
...
line 1:131 character '' not supported here
line 1:132 character '' not supported here
line 1:133 character '' not supported here
line 1:134 character '' not supported here
line 1:135 character '' not supported here
line 1:136 character '' not supported here
line 1:137 character '' not supported here
line 1:138 character '' not supported here
line 1:139 character '' not supported here
line 1:140 character '' not supported here
line 1:141 character '' not supported here
line 1:142 character '' not supported here
line 1:143 character '' not supported here
line 1:144 character '' not supported here
line 1:145 character '' not supported here
line 1:146 character '' not supported here
BR,
Patcharee
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
I could not solve the problem so I had to recreate the table from another
temp table
I think its issue with ORC file format
may be we can post to dev@ or wait for some dev to response
On Mon, Jul 20, 2015 at 1:51 PM, patcharee <Pa...@uni.no>
wrote:
> Hi,
>
> I created a hive table stored as orc file (partitioned and compressed by
> ZLIB) from Hive CLI, added data into this table by a Spark application.
> After adding I was able to query data and everything looked fine. Then I
> concatenated the table from Hive CLI. After that I am not able to query
> data, like select count(*) from Table, any more, just got error line 1:1
> character '' not supported here, no matter Tez or MR engine.
>
> How can you solve the problem in your case?
>
> BR,
> Patcharee
>
>
>
> On 18. juli 2015 21:26, Nitin Pawar wrote:
>
> can you tell exactly what steps you did/?
> also did you try running the query with processing to MR instead of tez?
> not sure this issue with orc file formats .. i had once faced issues on
> alter table for orc backed tabled on adding a new column
>
> On Sun, Jul 19, 2015 at 12:05 AM, pth001 <Pa...@uni.no>
> wrote:
>
>> Hi,
>>
>> The query result>
>>
>> 1 12 361 190 12.64043 -5.970886 8.559207 0.0
>> 0.0 0.0 -19.686993 1308.8047 99848.0 0.006196644 0.0
>> 0.0 301.27475 0.38247046 0.0 NULL 1 1 2008 1
>> 1 12 361 220 12.513598 -6.3671713 7.3927946 0.0
>> 0.0 0.0 -22.300392 1441.0547 99848.0 0.0050846506 0.0
>> 0.0 112.20787 0.30459523 0.0 NULL 1 1 2008 1
>> 5 12 250 368 2415.195 5.172235 4.9027147
>> -0.024408612 0.0 23590.553 -38.96928 -1130.0469 74660.54
>> 2.5969802E-4 9.706164E-11 23054.268 0.0 0.24196737 0.0
>> NULL 1 1 2008 1
>> 9 12 144 94 12.251964 12.081688 -9.59462 0.0
>> 0.0 0.0 -25.93576 258.65625 99848.0 0.0021708217 0.0
>> 0.0 1.2963213 1.1560266 0.0 NULL 1 1 2008 1
>> 9 12 145 84 12.302098 7.752461 -12.183463 0.0
>> 0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599 0.0
>> 0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
>>
>> I stored table in orc format, partitioned and compressed by ZLIB. The
>> problem happened just after I concatenate table.
>>
>> BR,
>> Patcharee
>>
>> On 18/07/15 12:46, Nitin Pawar wrote:
>>
>> select * without where will work because it does not involve file
>> processing
>> I suspect the problem is with field delimiter so i asked for records so
>> that we can see whats the data in each column
>>
>> are you using csv file with columns delimited by some char and it has
>> numeric data in quotes ?
>>
>> On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Pa...@uni.no>
>> wrote:
>>
>>> This select * from table limit 5; works, but not others. So?
>>>
>>> Patcharee
>>>
>>>
>>> On 18. juli 2015 12:08, Nitin Pawar wrote:
>>>
>>> can you do select * from table limit 5;
>>>
>>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I am using hive 0.14 with Tez engine. Found a weird problem. Any
>>>> suggestions?
>>>>
>>>> hive> select count(*) from 4D;
>>>> line 1:1 character '' not supported here
>>>> line 1:2 character '' not supported here
>>>> line 1:3 character '' not supported here
>>>> line 1:4 character '' not supported here
>>>> line 1:5 character '' not supported here
>>>> line 1:6 character '' not supported here
>>>> line 1:7 character '' not supported here
>>>> line 1:8 character '' not supported here
>>>> line 1:9 character '' not supported here
>>>> ...
>>>> ...
>>>> line 1:131 character '' not supported here
>>>> line 1:132 character '' not supported here
>>>> line 1:133 character '' not supported here
>>>> line 1:134 character '' not supported here
>>>> line 1:135 character '' not supported here
>>>> line 1:136 character '' not supported here
>>>> line 1:137 character '' not supported here
>>>> line 1:138 character '' not supported here
>>>> line 1:139 character '' not supported here
>>>> line 1:140 character '' not supported here
>>>> line 1:141 character '' not supported here
>>>> line 1:142 character '' not supported here
>>>> line 1:143 character '' not supported here
>>>> line 1:144 character '' not supported here
>>>> line 1:145 character '' not supported here
>>>> line 1:146 character '' not supported here
>>>>
>>>> BR,
>>>> Patcharee
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>>
>>
>
>
> --
> Nitin Pawar
>
>
>
--
Nitin Pawar
Re: character '' not supported here
Posted by patcharee <Pa...@uni.no>.
Hi,
I created a hive table stored as orc file (partitioned and compressed by
ZLIB) from Hive CLI, added data into this table by a Spark application.
After adding I was able to query data and everything looked fine. Then I
concatenated the table from Hive CLI. After that I am not able to query
data, like select count(*) from Table, any more, just got error line 1:1
character '' not supported here, no matter Tez or MR engine.
How can you solve the problem in your case?
BR,
Patcharee
On 18. juli 2015 21:26, Nitin Pawar wrote:
> can you tell exactly what steps you did/?
> also did you try running the query with processing to MR instead of tez?
> not sure this issue with orc file formats .. i had once faced issues
> on alter table for orc backed tabled on adding a new column
>
> On Sun, Jul 19, 2015 at 12:05 AM, pth001 <Patcharee.Thongtra@uni.no
> <ma...@uni.no>> wrote:
>
> Hi,
>
> The query result>
>
> 1 12 361 190 12.64043 -5.970886 8.559207 0.0
> 0.0 0.0 -19.686993 1308.8047 99848.0 0.006196644
> 0.0 0.0 301.27475 0.38247046 0.0 NULL 1 1 2008 1
> 1 12 361 220 12.513598 -6.3671713 7.3927946
> 0.0 0.0 0.0 -22.300392 1441.0547 99848.0
> 0.0050846506 0.0 0.0 112.20787 0.30459523 0.0
> NULL 1 1 2008 1
> 5 12 250 368 2415.195 5.172235 4.9027147
> -0.024408612 0.0 23590.553 -38.96928 -1130.0469
> 74660.54 2.5969802E-4 9.706164E-11 23054.268 0.0
> 0.24196737 0.0 NULL 1 1 2008 1
> 9 12 144 94 12.251964 12.081688 -9.59462 0.0
> 0.0 0.0 -25.93576 258.65625 99848.0 0.0021708217
> 0.0 0.0 1.2963213 1.1560266 0.0 NULL 1 1
> 2008 1
> 9 12 145 84 12.302098 7.752461 -12.183463 0.0
> 0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599
> 0.0 0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
>
> I stored table in orc format, partitioned and compressed by ZLIB.
> The problem happened just after I concatenate table.
>
> BR,
> Patcharee
>
> On 18/07/15 12:46, Nitin Pawar wrote:
>> select * without where will work because it does not involve file
>> processing
>> I suspect the problem is with field delimiter so i asked for
>> records so that we can see whats the data in each column
>>
>> are you using csv file with columns delimited by some char and it
>> has numeric data in quotes ?
>>
>> On Sat, Jul 18, 2015 at 3:58 PM, patcharee
>> <Patcharee.Thongtra@uni.no <ma...@uni.no>> wrote:
>>
>> This select * from table limit 5; works, but not others. So?
>>
>> Patcharee
>>
>>
>> On 18. juli 2015 12:08, Nitin Pawar wrote:
>>> can you do select * from table limit 5;
>>>
>>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee
>>> <Patcharee.Thongtra@uni.no
>>> <ma...@uni.no>> wrote:
>>>
>>> Hi,
>>>
>>> I am using hive 0.14 with Tez engine. Found a weird
>>> problem. Any suggestions?
>>>
>>> hive> select count(*) from 4D;
>>> line 1:1 character '' not supported here
>>> line 1:2 character '' not supported here
>>> line 1:3 character '' not supported here
>>> line 1:4 character '' not supported here
>>> line 1:5 character '' not supported here
>>> line 1:6 character '' not supported here
>>> line 1:7 character '' not supported here
>>> line 1:8 character '' not supported here
>>> line 1:9 character '' not supported here
>>> ...
>>> ...
>>> line 1:131 character '' not supported here
>>> line 1:132 character '' not supported here
>>> line 1:133 character '' not supported here
>>> line 1:134 character '' not supported here
>>> line 1:135 character '' not supported here
>>> line 1:136 character '' not supported here
>>> line 1:137 character '' not supported here
>>> line 1:138 character '' not supported here
>>> line 1:139 character '' not supported here
>>> line 1:140 character '' not supported here
>>> line 1:141 character '' not supported here
>>> line 1:142 character '' not supported here
>>> line 1:143 character '' not supported here
>>> line 1:144 character '' not supported here
>>> line 1:145 character '' not supported here
>>> line 1:146 character '' not supported here
>>>
>>> BR,
>>> Patcharee
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>
>>
>>
>>
>> --
>> Nitin Pawar
>
>
>
>
> --
> Nitin Pawar
Re: character '' not supported here
Posted by patcharee <Pa...@uni.no>.
Hi,
I created a hive table stored as orc file (partitioned and compressed by
ZLIB) from Hive CLI, added data into this table by a Spark application.
After adding I was able to query data and everything looked fine. Then I
concatenated the table from Hive CLI. After that I am not able to query
data, like select count(*) from Table, any more, just got error line 1:1
character '' not supported here, no matter Tez or MR engine.
How can you solve the problem in your case?
BR,
Patcharee
On 18. juli 2015 21:26, Nitin Pawar wrote:
> can you tell exactly what steps you did/?
> also did you try running the query with processing to MR instead of tez?
> not sure this issue with orc file formats .. i had once faced issues
> on alter table for orc backed tabled on adding a new column
>
> On Sun, Jul 19, 2015 at 12:05 AM, pth001 <Patcharee.Thongtra@uni.no
> <ma...@uni.no>> wrote:
>
> Hi,
>
> The query result>
>
> 1 12 361 190 12.64043 -5.970886 8.559207 0.0
> 0.0 0.0 -19.686993 1308.8047 99848.0 0.006196644
> 0.0 0.0 301.27475 0.38247046 0.0 NULL 1 1 2008 1
> 1 12 361 220 12.513598 -6.3671713 7.3927946
> 0.0 0.0 0.0 -22.300392 1441.0547 99848.0
> 0.0050846506 0.0 0.0 112.20787 0.30459523 0.0
> NULL 1 1 2008 1
> 5 12 250 368 2415.195 5.172235 4.9027147
> -0.024408612 0.0 23590.553 -38.96928 -1130.0469
> 74660.54 2.5969802E-4 9.706164E-11 23054.268 0.0
> 0.24196737 0.0 NULL 1 1 2008 1
> 9 12 144 94 12.251964 12.081688 -9.59462 0.0
> 0.0 0.0 -25.93576 258.65625 99848.0 0.0021708217
> 0.0 0.0 1.2963213 1.1560266 0.0 NULL 1 1
> 2008 1
> 9 12 145 84 12.302098 7.752461 -12.183463 0.0
> 0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599
> 0.0 0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
>
> I stored table in orc format, partitioned and compressed by ZLIB.
> The problem happened just after I concatenate table.
>
> BR,
> Patcharee
>
> On 18/07/15 12:46, Nitin Pawar wrote:
>> select * without where will work because it does not involve file
>> processing
>> I suspect the problem is with field delimiter so i asked for
>> records so that we can see whats the data in each column
>>
>> are you using csv file with columns delimited by some char and it
>> has numeric data in quotes ?
>>
>> On Sat, Jul 18, 2015 at 3:58 PM, patcharee
>> <Patcharee.Thongtra@uni.no <ma...@uni.no>> wrote:
>>
>> This select * from table limit 5; works, but not others. So?
>>
>> Patcharee
>>
>>
>> On 18. juli 2015 12:08, Nitin Pawar wrote:
>>> can you do select * from table limit 5;
>>>
>>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee
>>> <Patcharee.Thongtra@uni.no
>>> <ma...@uni.no>> wrote:
>>>
>>> Hi,
>>>
>>> I am using hive 0.14 with Tez engine. Found a weird
>>> problem. Any suggestions?
>>>
>>> hive> select count(*) from 4D;
>>> line 1:1 character '' not supported here
>>> line 1:2 character '' not supported here
>>> line 1:3 character '' not supported here
>>> line 1:4 character '' not supported here
>>> line 1:5 character '' not supported here
>>> line 1:6 character '' not supported here
>>> line 1:7 character '' not supported here
>>> line 1:8 character '' not supported here
>>> line 1:9 character '' not supported here
>>> ...
>>> ...
>>> line 1:131 character '' not supported here
>>> line 1:132 character '' not supported here
>>> line 1:133 character '' not supported here
>>> line 1:134 character '' not supported here
>>> line 1:135 character '' not supported here
>>> line 1:136 character '' not supported here
>>> line 1:137 character '' not supported here
>>> line 1:138 character '' not supported here
>>> line 1:139 character '' not supported here
>>> line 1:140 character '' not supported here
>>> line 1:141 character '' not supported here
>>> line 1:142 character '' not supported here
>>> line 1:143 character '' not supported here
>>> line 1:144 character '' not supported here
>>> line 1:145 character '' not supported here
>>> line 1:146 character '' not supported here
>>>
>>> BR,
>>> Patcharee
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>
>>
>>
>>
>> --
>> Nitin Pawar
>
>
>
>
> --
> Nitin Pawar
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
can you tell exactly what steps you did/?
also did you try running the query with processing to MR instead of tez?
not sure this issue with orc file formats .. i had once faced issues on
alter table for orc backed tabled on adding a new column
On Sun, Jul 19, 2015 at 12:05 AM, pth001 <Pa...@uni.no> wrote:
> Hi,
>
> The query result>
>
> 1 12 361 190 12.64043 -5.970886 8.559207 0.0
> 0.0 0.0 -19.686993 1308.8047 99848.0 0.006196644 0.0
> 0.0 301.27475 0.38247046 0.0 NULL 1 1 2008 1
> 1 12 361 220 12.513598 -6.3671713 7.3927946 0.0
> 0.0 0.0 -22.300392 1441.0547 99848.0 0.0050846506 0.0
> 0.0 112.20787 0.30459523 0.0 NULL 1 1 2008 1
> 5 12 250 368 2415.195 5.172235 4.9027147
> -0.024408612 0.0 23590.553 -38.96928 -1130.0469 74660.54
> 2.5969802E-4 9.706164E-11 23054.268 0.0 0.24196737 0.0
> NULL 1 1 2008 1
> 9 12 144 94 12.251964 12.081688 -9.59462 0.0
> 0.0 0.0 -25.93576 258.65625 99848.0 0.0021708217 0.0
> 0.0 1.2963213 1.1560266 0.0 NULL 1 1 2008 1
> 9 12 145 84 12.302098 7.752461 -12.183463 0.0
> 0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599 0.0
> 0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
>
> I stored table in orc format, partitioned and compressed by ZLIB. The
> problem happened just after I concatenate table.
>
> BR,
> Patcharee
>
> On 18/07/15 12:46, Nitin Pawar wrote:
>
> select * without where will work because it does not involve file
> processing
> I suspect the problem is with field delimiter so i asked for records so
> that we can see whats the data in each column
>
> are you using csv file with columns delimited by some char and it has
> numeric data in quotes ?
>
> On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Pa...@uni.no>
> wrote:
>
>> This select * from table limit 5; works, but not others. So?
>>
>> Patcharee
>>
>>
>> On 18. juli 2015 12:08, Nitin Pawar wrote:
>>
>> can you do select * from table limit 5;
>>
>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
>> wrote:
>>
>>> Hi,
>>>
>>> I am using hive 0.14 with Tez engine. Found a weird problem. Any
>>> suggestions?
>>>
>>> hive> select count(*) from 4D;
>>> line 1:1 character '' not supported here
>>> line 1:2 character '' not supported here
>>> line 1:3 character '' not supported here
>>> line 1:4 character '' not supported here
>>> line 1:5 character '' not supported here
>>> line 1:6 character '' not supported here
>>> line 1:7 character '' not supported here
>>> line 1:8 character '' not supported here
>>> line 1:9 character '' not supported here
>>> ...
>>> ...
>>> line 1:131 character '' not supported here
>>> line 1:132 character '' not supported here
>>> line 1:133 character '' not supported here
>>> line 1:134 character '' not supported here
>>> line 1:135 character '' not supported here
>>> line 1:136 character '' not supported here
>>> line 1:137 character '' not supported here
>>> line 1:138 character '' not supported here
>>> line 1:139 character '' not supported here
>>> line 1:140 character '' not supported here
>>> line 1:141 character '' not supported here
>>> line 1:142 character '' not supported here
>>> line 1:143 character '' not supported here
>>> line 1:144 character '' not supported here
>>> line 1:145 character '' not supported here
>>> line 1:146 character '' not supported here
>>>
>>> BR,
>>> Patcharee
>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>>
>>
>
>
> --
> Nitin Pawar
>
>
>
--
Nitin Pawar
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
can you tell exactly what steps you did/?
also did you try running the query with processing to MR instead of tez?
not sure this issue with orc file formats .. i had once faced issues on
alter table for orc backed tabled on adding a new column
On Sun, Jul 19, 2015 at 12:05 AM, pth001 <Pa...@uni.no> wrote:
> Hi,
>
> The query result>
>
> 1 12 361 190 12.64043 -5.970886 8.559207 0.0
> 0.0 0.0 -19.686993 1308.8047 99848.0 0.006196644 0.0
> 0.0 301.27475 0.38247046 0.0 NULL 1 1 2008 1
> 1 12 361 220 12.513598 -6.3671713 7.3927946 0.0
> 0.0 0.0 -22.300392 1441.0547 99848.0 0.0050846506 0.0
> 0.0 112.20787 0.30459523 0.0 NULL 1 1 2008 1
> 5 12 250 368 2415.195 5.172235 4.9027147
> -0.024408612 0.0 23590.553 -38.96928 -1130.0469 74660.54
> 2.5969802E-4 9.706164E-11 23054.268 0.0 0.24196737 0.0
> NULL 1 1 2008 1
> 9 12 144 94 12.251964 12.081688 -9.59462 0.0
> 0.0 0.0 -25.93576 258.65625 99848.0 0.0021708217 0.0
> 0.0 1.2963213 1.1560266 0.0 NULL 1 1 2008 1
> 9 12 145 84 12.302098 7.752461 -12.183463 0.0
> 0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599 0.0
> 0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
>
> I stored table in orc format, partitioned and compressed by ZLIB. The
> problem happened just after I concatenate table.
>
> BR,
> Patcharee
>
> On 18/07/15 12:46, Nitin Pawar wrote:
>
> select * without where will work because it does not involve file
> processing
> I suspect the problem is with field delimiter so i asked for records so
> that we can see whats the data in each column
>
> are you using csv file with columns delimited by some char and it has
> numeric data in quotes ?
>
> On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Pa...@uni.no>
> wrote:
>
>> This select * from table limit 5; works, but not others. So?
>>
>> Patcharee
>>
>>
>> On 18. juli 2015 12:08, Nitin Pawar wrote:
>>
>> can you do select * from table limit 5;
>>
>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
>> wrote:
>>
>>> Hi,
>>>
>>> I am using hive 0.14 with Tez engine. Found a weird problem. Any
>>> suggestions?
>>>
>>> hive> select count(*) from 4D;
>>> line 1:1 character '' not supported here
>>> line 1:2 character '' not supported here
>>> line 1:3 character '' not supported here
>>> line 1:4 character '' not supported here
>>> line 1:5 character '' not supported here
>>> line 1:6 character '' not supported here
>>> line 1:7 character '' not supported here
>>> line 1:8 character '' not supported here
>>> line 1:9 character '' not supported here
>>> ...
>>> ...
>>> line 1:131 character '' not supported here
>>> line 1:132 character '' not supported here
>>> line 1:133 character '' not supported here
>>> line 1:134 character '' not supported here
>>> line 1:135 character '' not supported here
>>> line 1:136 character '' not supported here
>>> line 1:137 character '' not supported here
>>> line 1:138 character '' not supported here
>>> line 1:139 character '' not supported here
>>> line 1:140 character '' not supported here
>>> line 1:141 character '' not supported here
>>> line 1:142 character '' not supported here
>>> line 1:143 character '' not supported here
>>> line 1:144 character '' not supported here
>>> line 1:145 character '' not supported here
>>> line 1:146 character '' not supported here
>>>
>>> BR,
>>> Patcharee
>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>>
>>
>
>
> --
> Nitin Pawar
>
>
>
--
Nitin Pawar
Re: character '' not supported here
Posted by pth001 <Pa...@uni.no>.
Hi,
The query result>
1 12 361 190 12.64043 -5.970886 8.559207 0.0 0.0
0.0 -19.686993 1308.8047 99848.0 0.006196644 0.0 0.0
301.27475 0.38247046 0.0 NULL 1 1 2008 1
1 12 361 220 12.513598 -6.3671713 7.3927946 0.0
0.0 0.0 -22.300392 1441.0547 99848.0 0.0050846506 0.0
0.0 112.20787 0.30459523 0.0 NULL 1 1 2008 1
5 12 250 368 2415.195 5.172235 4.9027147
-0.024408612 0.0 23590.553 -38.96928 -1130.0469 74660.54
2.5969802E-4 9.706164E-11 23054.268 0.0 0.24196737 0.0
NULL 1 1 2008 1
9 12 144 94 12.251964 12.081688 -9.59462 0.0 0.0
0.0 -25.93576 258.65625 99848.0 0.0021708217 0.0 0.0
1.2963213 1.1560266 0.0 NULL 1 1 2008 1
9 12 145 84 12.302098 7.752461 -12.183463 0.0
0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599 0.0
0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
I stored table in orc format, partitioned and compressed by ZLIB. The
problem happened just after I concatenate table.
BR,
Patcharee
On 18/07/15 12:46, Nitin Pawar wrote:
> select * without where will work because it does not involve file
> processing
> I suspect the problem is with field delimiter so i asked for records
> so that we can see whats the data in each column
>
> are you using csv file with columns delimited by some char and it has
> numeric data in quotes ?
>
> On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Patcharee.Thongtra@uni.no
> <ma...@uni.no>> wrote:
>
> This select * from table limit 5; works, but not others. So?
>
> Patcharee
>
>
> On 18. juli 2015 12:08, Nitin Pawar wrote:
>> can you do select * from table limit 5;
>>
>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee
>> <Patcharee.Thongtra@uni.no <ma...@uni.no>> wrote:
>>
>> Hi,
>>
>> I am using hive 0.14 with Tez engine. Found a weird problem.
>> Any suggestions?
>>
>> hive> select count(*) from 4D;
>> line 1:1 character '' not supported here
>> line 1:2 character '' not supported here
>> line 1:3 character '' not supported here
>> line 1:4 character '' not supported here
>> line 1:5 character '' not supported here
>> line 1:6 character '' not supported here
>> line 1:7 character '' not supported here
>> line 1:8 character '' not supported here
>> line 1:9 character '' not supported here
>> ...
>> ...
>> line 1:131 character '' not supported here
>> line 1:132 character '' not supported here
>> line 1:133 character '' not supported here
>> line 1:134 character '' not supported here
>> line 1:135 character '' not supported here
>> line 1:136 character '' not supported here
>> line 1:137 character '' not supported here
>> line 1:138 character '' not supported here
>> line 1:139 character '' not supported here
>> line 1:140 character '' not supported here
>> line 1:141 character '' not supported here
>> line 1:142 character '' not supported here
>> line 1:143 character '' not supported here
>> line 1:144 character '' not supported here
>> line 1:145 character '' not supported here
>> line 1:146 character '' not supported here
>>
>> BR,
>> Patcharee
>>
>>
>>
>>
>>
>> --
>> Nitin Pawar
>
>
>
>
> --
> Nitin Pawar
Re: character '' not supported here
Posted by pth001 <Pa...@uni.no>.
Hi,
The query result>
1 12 361 190 12.64043 -5.970886 8.559207 0.0 0.0
0.0 -19.686993 1308.8047 99848.0 0.006196644 0.0 0.0
301.27475 0.38247046 0.0 NULL 1 1 2008 1
1 12 361 220 12.513598 -6.3671713 7.3927946 0.0
0.0 0.0 -22.300392 1441.0547 99848.0 0.0050846506 0.0
0.0 112.20787 0.30459523 0.0 NULL 1 1 2008 1
5 12 250 368 2415.195 5.172235 4.9027147
-0.024408612 0.0 23590.553 -38.96928 -1130.0469 74660.54
2.5969802E-4 9.706164E-11 23054.268 0.0 0.24196737 0.0
NULL 1 1 2008 1
9 12 144 94 12.251964 12.081688 -9.59462 0.0 0.0
0.0 -25.93576 258.65625 99848.0 0.0021708217 0.0 0.0
1.2963213 1.1560266 0.0 NULL 1 1 2008 1
9 12 145 84 12.302098 7.752461 -12.183463 0.0
0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599 0.0
0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1
I stored table in orc format, partitioned and compressed by ZLIB. The
problem happened just after I concatenate table.
BR,
Patcharee
On 18/07/15 12:46, Nitin Pawar wrote:
> select * without where will work because it does not involve file
> processing
> I suspect the problem is with field delimiter so i asked for records
> so that we can see whats the data in each column
>
> are you using csv file with columns delimited by some char and it has
> numeric data in quotes ?
>
> On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Patcharee.Thongtra@uni.no
> <ma...@uni.no>> wrote:
>
> This select * from table limit 5; works, but not others. So?
>
> Patcharee
>
>
> On 18. juli 2015 12:08, Nitin Pawar wrote:
>> can you do select * from table limit 5;
>>
>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee
>> <Patcharee.Thongtra@uni.no <ma...@uni.no>> wrote:
>>
>> Hi,
>>
>> I am using hive 0.14 with Tez engine. Found a weird problem.
>> Any suggestions?
>>
>> hive> select count(*) from 4D;
>> line 1:1 character '' not supported here
>> line 1:2 character '' not supported here
>> line 1:3 character '' not supported here
>> line 1:4 character '' not supported here
>> line 1:5 character '' not supported here
>> line 1:6 character '' not supported here
>> line 1:7 character '' not supported here
>> line 1:8 character '' not supported here
>> line 1:9 character '' not supported here
>> ...
>> ...
>> line 1:131 character '' not supported here
>> line 1:132 character '' not supported here
>> line 1:133 character '' not supported here
>> line 1:134 character '' not supported here
>> line 1:135 character '' not supported here
>> line 1:136 character '' not supported here
>> line 1:137 character '' not supported here
>> line 1:138 character '' not supported here
>> line 1:139 character '' not supported here
>> line 1:140 character '' not supported here
>> line 1:141 character '' not supported here
>> line 1:142 character '' not supported here
>> line 1:143 character '' not supported here
>> line 1:144 character '' not supported here
>> line 1:145 character '' not supported here
>> line 1:146 character '' not supported here
>>
>> BR,
>> Patcharee
>>
>>
>>
>>
>>
>> --
>> Nitin Pawar
>
>
>
>
> --
> Nitin Pawar
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
select * without where will work because it does not involve file
processing
I suspect the problem is with field delimiter so i asked for records so
that we can see whats the data in each column
are you using csv file with columns delimited by some char and it has
numeric data in quotes ?
On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Pa...@uni.no>
wrote:
> This select * from table limit 5; works, but not others. So?
>
> Patcharee
>
>
> On 18. juli 2015 12:08, Nitin Pawar wrote:
>
> can you do select * from table limit 5;
>
> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
> wrote:
>
>> Hi,
>>
>> I am using hive 0.14 with Tez engine. Found a weird problem. Any
>> suggestions?
>>
>> hive> select count(*) from 4D;
>> line 1:1 character '' not supported here
>> line 1:2 character '' not supported here
>> line 1:3 character '' not supported here
>> line 1:4 character '' not supported here
>> line 1:5 character '' not supported here
>> line 1:6 character '' not supported here
>> line 1:7 character '' not supported here
>> line 1:8 character '' not supported here
>> line 1:9 character '' not supported here
>> ...
>> ...
>> line 1:131 character '' not supported here
>> line 1:132 character '' not supported here
>> line 1:133 character '' not supported here
>> line 1:134 character '' not supported here
>> line 1:135 character '' not supported here
>> line 1:136 character '' not supported here
>> line 1:137 character '' not supported here
>> line 1:138 character '' not supported here
>> line 1:139 character '' not supported here
>> line 1:140 character '' not supported here
>> line 1:141 character '' not supported here
>> line 1:142 character '' not supported here
>> line 1:143 character '' not supported here
>> line 1:144 character '' not supported here
>> line 1:145 character '' not supported here
>> line 1:146 character '' not supported here
>>
>> BR,
>> Patcharee
>>
>>
>>
>
>
> --
> Nitin Pawar
>
>
>
--
Nitin Pawar
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
select * without where will work because it does not involve file
processing
I suspect the problem is with field delimiter so i asked for records so
that we can see whats the data in each column
are you using csv file with columns delimited by some char and it has
numeric data in quotes ?
On Sat, Jul 18, 2015 at 3:58 PM, patcharee <Pa...@uni.no>
wrote:
> This select * from table limit 5; works, but not others. So?
>
> Patcharee
>
>
> On 18. juli 2015 12:08, Nitin Pawar wrote:
>
> can you do select * from table limit 5;
>
> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
> wrote:
>
>> Hi,
>>
>> I am using hive 0.14 with Tez engine. Found a weird problem. Any
>> suggestions?
>>
>> hive> select count(*) from 4D;
>> line 1:1 character '' not supported here
>> line 1:2 character '' not supported here
>> line 1:3 character '' not supported here
>> line 1:4 character '' not supported here
>> line 1:5 character '' not supported here
>> line 1:6 character '' not supported here
>> line 1:7 character '' not supported here
>> line 1:8 character '' not supported here
>> line 1:9 character '' not supported here
>> ...
>> ...
>> line 1:131 character '' not supported here
>> line 1:132 character '' not supported here
>> line 1:133 character '' not supported here
>> line 1:134 character '' not supported here
>> line 1:135 character '' not supported here
>> line 1:136 character '' not supported here
>> line 1:137 character '' not supported here
>> line 1:138 character '' not supported here
>> line 1:139 character '' not supported here
>> line 1:140 character '' not supported here
>> line 1:141 character '' not supported here
>> line 1:142 character '' not supported here
>> line 1:143 character '' not supported here
>> line 1:144 character '' not supported here
>> line 1:145 character '' not supported here
>> line 1:146 character '' not supported here
>>
>> BR,
>> Patcharee
>>
>>
>>
>
>
> --
> Nitin Pawar
>
>
>
--
Nitin Pawar
Re: character '' not supported here
Posted by patcharee <Pa...@uni.no>.
This select * from table limit 5; works, but not others. So?
Patcharee
On 18. juli 2015 12:08, Nitin Pawar wrote:
> can you do select * from table limit 5;
>
> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Patcharee.Thongtra@uni.no
> <ma...@uni.no>> wrote:
>
> Hi,
>
> I am using hive 0.14 with Tez engine. Found a weird problem. Any
> suggestions?
>
> hive> select count(*) from 4D;
> line 1:1 character '' not supported here
> line 1:2 character '' not supported here
> line 1:3 character '' not supported here
> line 1:4 character '' not supported here
> line 1:5 character '' not supported here
> line 1:6 character '' not supported here
> line 1:7 character '' not supported here
> line 1:8 character '' not supported here
> line 1:9 character '' not supported here
> ...
> ...
> line 1:131 character '' not supported here
> line 1:132 character '' not supported here
> line 1:133 character '' not supported here
> line 1:134 character '' not supported here
> line 1:135 character '' not supported here
> line 1:136 character '' not supported here
> line 1:137 character '' not supported here
> line 1:138 character '' not supported here
> line 1:139 character '' not supported here
> line 1:140 character '' not supported here
> line 1:141 character '' not supported here
> line 1:142 character '' not supported here
> line 1:143 character '' not supported here
> line 1:144 character '' not supported here
> line 1:145 character '' not supported here
> line 1:146 character '' not supported here
>
> BR,
> Patcharee
>
>
>
>
>
> --
> Nitin Pawar
Re: character '' not supported here
Posted by patcharee <Pa...@uni.no>.
This select * from table limit 5; works, but not others. So?
Patcharee
On 18. juli 2015 12:08, Nitin Pawar wrote:
> can you do select * from table limit 5;
>
> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Patcharee.Thongtra@uni.no
> <ma...@uni.no>> wrote:
>
> Hi,
>
> I am using hive 0.14 with Tez engine. Found a weird problem. Any
> suggestions?
>
> hive> select count(*) from 4D;
> line 1:1 character '' not supported here
> line 1:2 character '' not supported here
> line 1:3 character '' not supported here
> line 1:4 character '' not supported here
> line 1:5 character '' not supported here
> line 1:6 character '' not supported here
> line 1:7 character '' not supported here
> line 1:8 character '' not supported here
> line 1:9 character '' not supported here
> ...
> ...
> line 1:131 character '' not supported here
> line 1:132 character '' not supported here
> line 1:133 character '' not supported here
> line 1:134 character '' not supported here
> line 1:135 character '' not supported here
> line 1:136 character '' not supported here
> line 1:137 character '' not supported here
> line 1:138 character '' not supported here
> line 1:139 character '' not supported here
> line 1:140 character '' not supported here
> line 1:141 character '' not supported here
> line 1:142 character '' not supported here
> line 1:143 character '' not supported here
> line 1:144 character '' not supported here
> line 1:145 character '' not supported here
> line 1:146 character '' not supported here
>
> BR,
> Patcharee
>
>
>
>
>
> --
> Nitin Pawar
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
can you do select * from table limit 5;
On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
wrote:
> Hi,
>
> I am using hive 0.14 with Tez engine. Found a weird problem. Any
> suggestions?
>
> hive> select count(*) from 4D;
> line 1:1 character '' not supported here
> line 1:2 character '' not supported here
> line 1:3 character '' not supported here
> line 1:4 character '' not supported here
> line 1:5 character '' not supported here
> line 1:6 character '' not supported here
> line 1:7 character '' not supported here
> line 1:8 character '' not supported here
> line 1:9 character '' not supported here
> ...
> ...
> line 1:131 character '' not supported here
> line 1:132 character '' not supported here
> line 1:133 character '' not supported here
> line 1:134 character '' not supported here
> line 1:135 character '' not supported here
> line 1:136 character '' not supported here
> line 1:137 character '' not supported here
> line 1:138 character '' not supported here
> line 1:139 character '' not supported here
> line 1:140 character '' not supported here
> line 1:141 character '' not supported here
> line 1:142 character '' not supported here
> line 1:143 character '' not supported here
> line 1:144 character '' not supported here
> line 1:145 character '' not supported here
> line 1:146 character '' not supported here
>
> BR,
> Patcharee
>
>
>
--
Nitin Pawar
Re: character '' not supported here
Posted by Nitin Pawar <ni...@gmail.com>.
can you do select * from table limit 5;
On Sat, Jul 18, 2015 at 3:35 PM, patcharee <Pa...@uni.no>
wrote:
> Hi,
>
> I am using hive 0.14 with Tez engine. Found a weird problem. Any
> suggestions?
>
> hive> select count(*) from 4D;
> line 1:1 character '' not supported here
> line 1:2 character '' not supported here
> line 1:3 character '' not supported here
> line 1:4 character '' not supported here
> line 1:5 character '' not supported here
> line 1:6 character '' not supported here
> line 1:7 character '' not supported here
> line 1:8 character '' not supported here
> line 1:9 character '' not supported here
> ...
> ...
> line 1:131 character '' not supported here
> line 1:132 character '' not supported here
> line 1:133 character '' not supported here
> line 1:134 character '' not supported here
> line 1:135 character '' not supported here
> line 1:136 character '' not supported here
> line 1:137 character '' not supported here
> line 1:138 character '' not supported here
> line 1:139 character '' not supported here
> line 1:140 character '' not supported here
> line 1:141 character '' not supported here
> line 1:142 character '' not supported here
> line 1:143 character '' not supported here
> line 1:144 character '' not supported here
> line 1:145 character '' not supported here
> line 1:146 character '' not supported here
>
> BR,
> Patcharee
>
>
>
--
Nitin Pawar