You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2021/11/04 07:01:00 UTC

[jira] [Commented] (HUDI-2303) TestMereIntoLogOnlyTable with metadata enabled surfaces likely bug

    [ https://issues.apache.org/jira/browse/HUDI-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438513#comment-17438513 ] 

Prashant Wason commented on HUDI-2303:
--------------------------------------

Looks fine even though the patch I referred was not committed. If the tests are passing then it should be good.

> TestMereIntoLogOnlyTable with metadata enabled surfaces likely bug
> ------------------------------------------------------------------
>
>                 Key: HUDI-2303
>                 URL: https://issues.apache.org/jira/browse/HUDI-2303
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: Common Core
>            Reporter: Udit Mehrotra
>            Assignee: Prashant Wason
>            Priority: Blocker
>             Fix For: 0.10.0
>
>
> While enabling Metadata as part of [https://github.com/apache/hudi/pull/3411/] one of the test that fails is *TestMereIntoLogOnlyTable*.
> Upon looking a bit, what I found is after the final *Merge* command there is an inline compaction that is triggered. The parquet file formed as part of the compaction misses out on the data from the latest log file right before compaction.
> I think it might be because of metadata returning an incorrect list for compaction, missing out on the latest log file.
> cc [~pwason] [~vinoth]
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)