You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2024/03/29 01:28:00 UTC

[jira] [Updated] (HUDI-2744) Parsing of metadata compaction timestamp fails when metadata is enabled

     [ https://issues.apache.org/jira/browse/HUDI-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-2744:
----------------------------
    Component/s: compaction
                 metadata
                 table-service

> Parsing of metadata compaction timestamp fails when metadata is enabled
> -----------------------------------------------------------------------
>
>                 Key: HUDI-2744
>                 URL: https://issues.apache.org/jira/browse/HUDI-2744
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: compaction, metadata, table-service
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.10.0
>
>
> Parsing of metadata compaction timestamp fails when metadata is enabled
> {code:java}
> 21/11/11 07:04:16 ERROR HoodieDeltaStreamer: Shutting down delta-sync due to exception
> java.time.format.DateTimeParseException: Text '20211111070307001' could not be parsed at index 0
>         at java.time.format.DateTimeFormatter.parseResolved0(DateTimeFormatter.java:1949)
>         at java.time.format.DateTimeFormatter.parse(DateTimeFormatter.java:1851)
>         at java.time.LocalDateTime.parse(LocalDateTime.java:492)
>         at org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator.parseInstantTime(HoodieInstantTimeGenerator.java:61)
>         at org.apache.hudi.common.table.timeline.HoodieActiveTimeline.parseInstantTime(HoodieActiveTimeline.java:78)
>         at org.apache.hudi.client.SparkRDDWriteClient.completeCompaction(SparkRDDWriteClient.java:327)
>         at org.apache.hudi.client.SparkRDDWriteClient.completeTableService(SparkRDDWriteClient.java:470)
>         at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:352)
>         at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:75)
>         at org.apache.hudi.client.AbstractHoodieWriteClient.compact(AbstractHoodieWriteClient.java:794)
>         at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:661)
>         at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:155)
>         at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:552) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)