You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/02/16 06:59:00 UTC

[jira] [Updated] (HUDI-5336) Fix log file parsing to consider "." at the beginning

     [ https://issues.apache.org/jira/browse/HUDI-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-5336:
----------------------------
    Fix Version/s: 0.13.0

> Fix log file parsing to consider "." at the beginning
> -----------------------------------------------------
>
>                 Key: HUDI-5336
>                 URL: https://issues.apache.org/jira/browse/HUDI-5336
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.12.2, 0.13.0
>
>
> In some of the cloud stores like GCS, some temporary marker files are created like "
> .hoodie/metadata/files/_GCS_SYNCABLE_TEMPFILE_.files-0000_20221110051755284001.log.9_0-45-1315.2.79df61f2-e409-4bd7-863d-33b8fc179e32"
>  
> which are not the ones created by Hudi. So, we need to parse or deduce the log files correctly and not just check for if the name contains "log" in in. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)