You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Jacky Li (JIRA)" <ji...@apache.org> on 2018/03/18 16:17:00 UTC

[jira] [Resolved] (CARBONDATA-2230) Add a path into table path to store lock files and delete useless segment lock files before loading

     [ https://issues.apache.org/jira/browse/CARBONDATA-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li resolved CARBONDATA-2230.
----------------------------------
    Resolution: Fixed

> Add a path into table path to store lock files and delete useless segment lock files before loading
> ---------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-2230
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2230
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: data-load
>    Affects Versions: 1.3.0, 1.4.0
>            Reporter: Zhichao  Zhang
>            Assignee: Zhichao  Zhang
>            Priority: Minor
>             Fix For: 1.4.0, 1.3.0
>
>          Time Spent: 17h 20m
>  Remaining Estimate: 0h
>
> After [PR1984|https://github.com/apache/carbondata/pull/1984] merged, it doesn't delete the lock files when unlock, there are many useless lock files in table path, especially segment lock files, they grow after every batch loading.
> Solution :
> 1. add a child path into table path, called Locks, all lock files will be stored in this path;
> 2. Before loading, get all useless segment lock files and delete them, because just segment lock files will grow, other lock files dosen't grow.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)