You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by kun yan <ya...@gmail.com> on 2014/02/20 04:21:58 UTC

How to solve the garbage problem

Hi all

GBK encoding data files, but the hive is UTF-8 encoding

select * from table display normal

I try to modify the following configuration

system:file.encoding=UTF-8
system:sun.jnu.encoding=UTF-8

But no effect, how do I deal with it


-- 

In the Hadoop world, I am just a novice, explore the entire Hadoop
ecosystem, I hope one day I can contribute their own code

YanBit
yankunhadoop@gmail.com

Re: How to solve the garbage problem

Posted by Navis류승우 <na...@nexr.com>.

Declare it as a binary column and use decoding UDF when accessing it.

Thanks,
Navis


2014-02-20 12:21 GMT+09:00 kun yan <ya...@gmail.com>:

>
> Hi all
>
> GBK encoding data files, but the hive is UTF-8 encoding
>
> select * from table display normal
>
> I try to modify the following configuration
>
> system:file.encoding=UTF-8
> system:sun.jnu.encoding=UTF-8
>
> But no effect, how do I deal with it
>
>
> --
>
> In the Hadoop world, I am just a novice, explore the entire Hadoop
> ecosystem, I hope one day I can contribute their own code
>
> YanBit
> yankunhadoop@gmail.com
>
>