[jira] [Resolved] (CARBONDATA-2092) Fix compaction bug to prevent the compaction flow from going through the restructure compaction flow

["Ravindra Pesala (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CARBONDATA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala resolved CARBONDATA-2092.
-----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.0

> Fix compaction bug to prevent the compaction flow from going through the restructure compaction flow
> ----------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-2092
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2092
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>            Priority: Major
>             Fix For: 1.3.0
>
>          Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> Problem and analysis:
> ----------------------------------------
> During data load current schema timestamp is written to the carbondata fileHeader. This is used during compaction to decide whether the block is a restructured block or the block is according to the latest schema.
> As the blocklet information is now stored in the index file, while laoding it in memory the carbondata file header is not read and due to this the schema timestamp is not getting set to the blocklet information. Due to this during compaction flow there is a mismatch on comparing the current schema time stamp with the timestamp stored in the block and the flow goes through the restructure compaction flow instead of normal compaction flow.
> Impact:
> -------------
> Compaction performance degradation as restructure compaction flow involves sorting of data again.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)