You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/12/01 05:56:00 UTC

[jira] [Work logged] (HIVE-26793) Create a new configuration to override "no compaction" for tables

     [ https://issues.apache.org/jira/browse/HIVE-26793?focusedWorklogId=830241&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-830241 ]

ASF GitHub Bot logged work on HIVE-26793:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 01/Dec/22 05:55
            Start Date: 01/Dec/22 05:55
    Worklog Time Spent: 10m 
      Work Description: kokila-19 opened a new pull request, #3822:
URL: https://github.com/apache/hive/pull/3822

   ### What changes were proposed in this pull request?
   no_auto_compaction configuration should be allowed to overridden on a database level: adding no_auto_compaction=false should override the table level setting forcing the initiator to schedule compaction for all tables.
   
   ### Why are the changes needed?
   Currently a simple user can create a table with no_auto_compaction=true table property and create an aborted write transaction writing to this table. This way a malicious user can prevent cleaning up data for the aborted transaction, creating performance degradation.
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Unit tests 
   itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/txn/compactor/TestInitiator2.java
   itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/txn/compactor/TestCompactionMetrics2.java
   




Issue Time Tracking
-------------------

            Worklog Id:     (was: 830241)
    Remaining Estimate: 0h
            Time Spent: 10m

> Create a new configuration to override "no compaction" for tables
> -----------------------------------------------------------------
>
>                 Key: HIVE-26793
>                 URL: https://issues.apache.org/jira/browse/HIVE-26793
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Kokila N
>            Assignee: Kokila N
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently a simple user can create a table with {color:#6a8759}no_auto_compaction=true{color} table property and create an aborted write transaction writing to this table. This way a malicious user can prevent cleaning up data for the aborted transaction, creating performance degradation.
> This configuration should be allowed to overridden on a database level: adding {color:#6a8759}no_auto_compaction=false{color} should override the table level setting forcing the initiator to schedule compaction for all tables.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)