You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Wonho Kim (JIRA)" <ji...@apache.org> on 2012/11/07 00:40:12 UTC

[jira] [Created] (HIVE-3679) Unescape partition names returned by show partitions

Wonho Kim created HIVE-3679:
-------------------------------

             Summary: Unescape partition names returned by show partitions
                 Key: HIVE-3679
                 URL: https://issues.apache.org/jira/browse/HIVE-3679
             Project: Hive
          Issue Type: Task
          Components: Configuration, Query Processor
    Affects Versions: 0.10.0
            Reporter: Wonho Kim
            Priority: Minor
             Fix For: 0.10.0


The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.

ex) SHOW PARTITIONS XXX;
returns partition names like
...ts=2012-02-02+17%3A12%3A43...where %3A is ':'

Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501360#comment-13501360 ] 

Hudson commented on HIVE-3679:
------------------------------

Integrated in Hive-trunk-h0.21 #1808 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1808/])
    Remove extra files accidentally committed with HIVE-3679. (kevinwilfong) (Revision 1411592)

     Result = FAILURE
kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1411592
Files : 
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/LoopingByteArrayInputStream.java

                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496728#comment-13496728 ] 

Kevin Wilfong commented on HIVE-3679:
-------------------------------------

+1
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496931#comment-13496931 ] 

Mark Grover commented on HIVE-3679:
-----------------------------------

Minor comments. Otherwise looks good! Thanks [~wonho]!
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wonho Kim updated HIVE-3679:
----------------------------

    Attachment: HIVE-3679.1.patch.txt

This patch is being reviewed in

https://reviews.facebook.net/D6555
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wonho Kim updated HIVE-3679:
----------------------------

    Assignee: Wonho Kim
    
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wonho Kim updated HIVE-3679:
----------------------------

    Release Note: 
Adds 'hive.decode.partition.name' option to config.
Decode the partition names when the option is set to true.
          Status: Patch Available  (was: Open)

This patch is being reviewed in
https://reviews.facebook.net/D6555
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500977#comment-13500977 ] 

Hudson commented on HIVE-3679:
------------------------------

Integrated in Hive-trunk-h0.21 #1807 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1807/])
    HIVE-3679. Unescape partition names returned by show partitions. (Wonho Kim via kevinwilfong) (Revision 1411521)

     Result = FAILURE
kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1411521
Files : 
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/LoopingByteArrayInputStream.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
* /hive/trunk/ql/src/test/queries/clientpositive/partition_decode_name.q
* /hive/trunk/ql/src/test/results/clientpositive/partition_decode_name.q.out

                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496882#comment-13496882 ] 

Wonho Kim commented on HIVE-3679:
---------------------------------

Hi [~kevinwilfong], I am not sure what you meant by the comment '+1' :)..
Please let me know if there's any step that I missed. Thanks.
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499201#comment-13499201 ] 

Wonho Kim commented on HIVE-3679:
---------------------------------

[~kevinwilfong]: Hi Kevin, will I get a notification from JIRA when the patch is committed? Thanks -- Wonho
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496926#comment-13496926 ] 

Kevin Wilfong commented on HIVE-3679:
-------------------------------------

Sorry confusion, think of it like me accepting your diff.  If no one comments in 24 hours or so, I'll commit your patch for you.  Assuming no one does you shouldn't need to take any more steps.
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499214#comment-13499214 ] 

Wonho Kim commented on HIVE-3679:
---------------------------------

I see. Thanks! -- Wonho
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13497733#comment-13497733 ] 

Wonho Kim commented on HIVE-3679:
---------------------------------

[~kevinwilfong] and [~mgrover]: Thanks for reviewing the diff.
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499211#comment-13499211 ] 

Kevin Wilfong commented on HIVE-3679:
-------------------------------------

Yes, I will comment here, and there will be a post from Hudson later on.
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Assignee: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3679.1.patch.txt
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3679) Unescape partition names returned by show partitions

Posted by "Wonho Kim (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491962#comment-13491962 ] 

Wonho Kim commented on HIVE-3679:
---------------------------------

I will assign this task to me after I am added as a contributor. Thanks!
                
> Unescape partition names returned by show partitions
> ----------------------------------------------------
>
>                 Key: HIVE-3679
>                 URL: https://issues.apache.org/jira/browse/HIVE-3679
>             Project: Hive
>          Issue Type: Task
>          Components: Configuration, Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Wonho Kim
>            Priority: Minor
>              Labels: features
>             Fix For: 0.10.0
>
>
> The partition names returned by the SHOW PARTITIONS call in Hive contain escape sequences from the metastore.
> ex) SHOW PARTITIONS XXX;
> returns partition names like
> ...ts=2012-02-02+17%3A12%3A43...where %3A is ':'
> Hive should unescape escape sequences like that before returning the partition names unless it is configured to return the URL encoded partition name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira