You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@carbondata.apache.org by "Xingjun Hao (Jira)" <ji...@apache.org> on 2020/10/12 01:56:00 UTC

[jira] [Created] (CARBONDATA-4027) Fix the wrong modifiedtime of loading files in insert stage

Xingjun Hao created CARBONDATA-4027:
---------------------------------------

             Summary: Fix the wrong modifiedtime of loading files in insert stage
                 Key: CARBONDATA-4027
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4027
             Project: CarbonData
          Issue Type: Bug
            Reporter: Xingjun Hao


In the insertstage flow, there is a empty file with suffix '.loading' to mark the stage in the status of 'in processing'. We update the modifiedtime of '.loading' file for monitoring the insertstage start time, which can be used for calculate TIMEOUT, help to retry and recovery.

Before, we use setModifiedTime function to update the modifiedtime, which has a serious bug.

For S3 file, setModifiedTime operation do not take effect. leading to the incorrect inserstage starttime of 'loading' file.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)