You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Aditya Shah (Jira)" <ji...@apache.org> on 2020/01/23 09:47:00 UTC

[jira] [Comment Edited] (HIVE-22764) Create new command for "optimize" compaction and have basic implementation.

    [ https://issues.apache.org/jira/browse/HIVE-22764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021893#comment-17021893 ] 

Aditya Shah edited comment on HIVE-22764 at 1/23/20 9:46 AM:
-------------------------------------------------------------

I have submitted a basic implementation for the new compaction. [~pvary] [~lpinter] can you please review the patch as well as the [[https://docs.google.com/document/d/10zWk7FR6I0CMy57Uykbkcox4HZTMQv2sgLoZrHVeLYU/edit?usp=sharing]]

Thanks,

Aditya


was (Author: aditya-shah):
I have submitted a basic implementation for the new compaction. [~pvary] [~lpinter] can you please review the patch as well as the [doc|[http://example.com|https://docs.google.com/document/d/10zWk7FR6I0CMy57Uykbkcox4HZTMQv2sgLoZrHVeLYU/edit?usp=sharing]]

Thanks,

Aditya

> Create new command for "optimize" compaction and have basic implementation.
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-22764
>                 URL: https://issues.apache.org/jira/browse/HIVE-22764
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Aditya Shah
>            Assignee: Aditya Shah
>            Priority: Major
>         Attachments: HIVE-22764.patch
>
>
> Created new blocking compaction (added compaction type "optimize") by adding a lock request on the compaction's transaction. It works mostly like mmMajorCompaction and writes files w/o row_IDs. I have added an additional table property to provide optimize columns that is used by the compactor to cluster the data by. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)