You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Aihua Xu (JIRA)" <ji...@apache.org> on 2016/09/19 21:00:22 UTC

[jira] [Updated] (HIVE-14341) Altered skewed location is not respected for list bucketing

     [ https://issues.apache.org/jira/browse/HIVE-14341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aihua Xu updated HIVE-14341:
----------------------------
    Attachment: HIVE-14341.2.patch

Patch-2: made the changes so the desc command will show skewed location for those locations not updated explicitly. 

With this patch, we will not automatically collect the skew mapping from the directory since that would cause the issue if the location is updated explicitly.

Rather, given a query like select * from list_bucket_single where key=1, if the skew location for key 1 is updated explicitly, then we will have the new location from HMS, otherwise, we will check the default location /list_bucket_single/key=1. 

> Altered skewed location is not respected for list bucketing
> -----------------------------------------------------------
>
>                 Key: HIVE-14341
>                 URL: https://issues.apache.org/jira/browse/HIVE-14341
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Planning
>    Affects Versions: 2.0.1
>            Reporter: Aihua Xu
>            Assignee: Aihua Xu
>         Attachments: HIVE-14341.1.patch, HIVE-14341.2.patch
>
>
> CREATE TABLE list_bucket_single (key STRING, value STRING)
>   SKEWED BY (key) ON (1,5,6) STORED AS DIRECTORIES;
> alter table list_bucket_single set skewed location (''1"="/user/hive/warehouse/hdfs_skewed/new1");
> While when you insert a row to key 1, the location falls back to the default one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)