You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sheng Zhou (Created) (JIRA)" <ji...@apache.org> on 2012/03/26 06:35:23 UTC

[jira] [Created] (HIVE-2905) Desc table can't read Chinese (UTF-8 character code)

Desc table can't read Chinese (UTF-8 character code)
----------------------------------------------------

                 Key: HIVE-2905
                 URL: https://issues.apache.org/jira/browse/HIVE-2905
             Project: Hive
          Issue Type: Bug
          Components: CLI
    Affects Versions: 0.7.0
         Environment: hive 0.7.0, mysql 5.1.45
            Reporter: Sheng Zhou


When desc a table with command line or hive jdbc way, the table's comment can't be read.
1. I have updated javax.jdo.option.ConnectionURL parameter in hive-site.xml file.
   jdbc:mysql://*.*.*.*:3306/hive?characterEncoding=UTF-8
2. In mysql database, the comment field of COLUMNS table can be read normally.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2905) Desc table can't read Chinese (UTF-8 character code)

Posted by "Sheng Zhou (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260162#comment-13260162 ] 

Sheng Zhou commented on HIVE-2905:
----------------------------------

version: hive-0.7.0-update
I only write a UDTF 'desc_t' to solve the problem temporarily.

                
> Desc table can't read Chinese (UTF-8 character code)
> ----------------------------------------------------
>
>                 Key: HIVE-2905
>                 URL: https://issues.apache.org/jira/browse/HIVE-2905
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 0.7.0
>         Environment: hive 0.7.0, mysql 5.1.45
>            Reporter: Sheng Zhou
>
> When desc a table with command line or hive jdbc way, the table's comment can't be read.
> 1. I have updated javax.jdo.option.ConnectionURL parameter in hive-site.xml file.
>    jdbc:mysql://*.*.*.*:3306/hive?characterEncoding=UTF-8
> 2. In mysql database, the comment field of COLUMNS table can be read normally.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2905) Desc table can't read Chinese (UTF-8 character code)

Posted by "Phoenix Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260159#comment-13260159 ] 

Phoenix Zhang commented on HIVE-2905:
-------------------------------------

version: hive-0.7.1-cdh3u2
                
> Desc table can't read Chinese (UTF-8 character code)
> ----------------------------------------------------
>
>                 Key: HIVE-2905
>                 URL: https://issues.apache.org/jira/browse/HIVE-2905
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 0.7.0
>         Environment: hive 0.7.0, mysql 5.1.45
>            Reporter: Sheng Zhou
>
> When desc a table with command line or hive jdbc way, the table's comment can't be read.
> 1. I have updated javax.jdo.option.ConnectionURL parameter in hive-site.xml file.
>    jdbc:mysql://*.*.*.*:3306/hive?characterEncoding=UTF-8
> 2. In mysql database, the comment field of COLUMNS table can be read normally.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2905) Desc table can't read Chinese (UTF-8 character code)

Posted by "Sheng Zhou (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260167#comment-13260167 ] 

Sheng Zhou commented on HIVE-2905:
----------------------------------

The source code is too long, so i write the steps:
1. Get the data from metadata---mysql tables(COLUMNS, TBLS);
2. Write the UDTF, and the parameter is the table name.

You can write a function to extend GenericUDTF and to override the process method.
                
> Desc table can't read Chinese (UTF-8 character code)
> ----------------------------------------------------
>
>                 Key: HIVE-2905
>                 URL: https://issues.apache.org/jira/browse/HIVE-2905
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 0.7.0
>         Environment: hive 0.7.0, mysql 5.1.45
>            Reporter: Sheng Zhou
>
> When desc a table with command line or hive jdbc way, the table's comment can't be read.
> 1. I have updated javax.jdo.option.ConnectionURL parameter in hive-site.xml file.
>    jdbc:mysql://*.*.*.*:3306/hive?characterEncoding=UTF-8
> 2. In mysql database, the comment field of COLUMNS table can be read normally.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2905) Desc table can't read Chinese (UTF-8 character code)

Posted by "Phoenix Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260165#comment-13260165 ] 

Phoenix Zhang commented on HIVE-2905:
-------------------------------------

can you paste your UDTF here?
                
> Desc table can't read Chinese (UTF-8 character code)
> ----------------------------------------------------
>
>                 Key: HIVE-2905
>                 URL: https://issues.apache.org/jira/browse/HIVE-2905
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 0.7.0
>         Environment: hive 0.7.0, mysql 5.1.45
>            Reporter: Sheng Zhou
>
> When desc a table with command line or hive jdbc way, the table's comment can't be read.
> 1. I have updated javax.jdo.option.ConnectionURL parameter in hive-site.xml file.
>    jdbc:mysql://*.*.*.*:3306/hive?characterEncoding=UTF-8
> 2. In mysql database, the comment field of COLUMNS table can be read normally.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2905) Desc table can't read Chinese (UTF-8 character code)

Posted by "Phoenix Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260154#comment-13260154 ] 

Phoenix Zhang commented on HIVE-2905:
-------------------------------------

I have the same issue.
                
> Desc table can't read Chinese (UTF-8 character code)
> ----------------------------------------------------
>
>                 Key: HIVE-2905
>                 URL: https://issues.apache.org/jira/browse/HIVE-2905
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 0.7.0
>         Environment: hive 0.7.0, mysql 5.1.45
>            Reporter: Sheng Zhou
>
> When desc a table with command line or hive jdbc way, the table's comment can't be read.
> 1. I have updated javax.jdo.option.ConnectionURL parameter in hive-site.xml file.
>    jdbc:mysql://*.*.*.*:3306/hive?characterEncoding=UTF-8
> 2. In mysql database, the comment field of COLUMNS table can be read normally.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira