You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2017/06/02 21:51:04 UTC

[jira] [Comment Edited] (HIVE-16808) WebHCat statusdir parameter doesn't properly handle Unicode characters when using relative path

    [ https://issues.apache.org/jira/browse/HIVE-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035092#comment-16035092 ] 

Eugene Koifman edited comment on HIVE-16808 at 6/2/17 9:50 PM:
---------------------------------------------------------------

[~pvary],
we aren't intentionally encoding anything - some library methods we use encode in UTF-8 so we need to decode it back to Unicode.
Unfortunately, the encoding code leaves {noformat}"+" as is but decoding turns "+" into " "{noformat} - that's why there is that mess in the patch to work around this.


was (Author: ekoifman):
[~pvary],
we aren't intentionally encoding anything - some library methods we use encode in UTF-8 so we need to decode it back to Unicode.
Unfortunately, the encoding code leaves "+" as is but decoding turns "+" into " " - that's why there is that mess in the patch to work around this.

> WebHCat statusdir parameter doesn't properly handle Unicode characters when using relative path
> -----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-16808
>                 URL: https://issues.apache.org/jira/browse/HIVE-16808
>             Project: Hive
>          Issue Type: Bug
>          Components: WebHCat
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>         Attachments: HIVE-16808.01.patch, HIVE-16808.02.patch
>
>
> {noformat}
> curl http://.....:20111/templeton/v1/hive?user.name=hive -d execute="select count(*) from default.all100k" -d statusdir="/user/hive/düsseldorf7"
> curl http://....:20111/templeton/v1/hive?user.name=hive -d execute="select count(*) from default.all100k" -d statusdir="/user/hive/䶴狝A﨩O"
> {noformat}
> will create statusdirs like so
> {noformat}
> /user/hive/düsseldorf-1
> drwxr-xr-x   - hive hive          0 2017-06-01 19:01 /user/hive/düsseldorf7
> drwxr-xr-x   - hive hive          0 2017-06-01 19:08 /user/hive/䶴狝A﨩O
> {noformat}
> but
> {noformat}
> curl http://.....:20111/templeton/v1/hive?user.name=hive -d execute="select count(*) from default.all100k" -d statusdir="düsseldorf7"
> curl http://....:20111/templeton/v1/hive?user.name=hive -d execute="select count(*) from default.all100k" -d statusdir="䶴狝A﨩O"
> {noformat}
> Will create 
> {noformat}
> drwxr-xr-x   - hive hive          0 2017-06-01 00:27 /user/hive/d%C3%BCsseldorf7
> drwxr-xr-x   - hive hive          0 2017-06-01 22:33 /user/hive/%E4%B6%B4%E7%8B%9DA%EF%A8%A9O
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)