You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/01/13 11:25:00 UTC
[jira] [Updated] (HUDI-526) inline compact not work
[ https://issues.apache.org/jira/browse/HUDI-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HUDI-526:
--------------------------------
Labels: pull-request-available (was: )
> inline compact not work
> -----------------------
>
> Key: HUDI-526
> URL: https://issues.apache.org/jira/browse/HUDI-526
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Compaction
> Reporter: liujianhui
> Priority: Minor
> Labels: pull-request-available
>
> hoodie.compact.inline set as true
> hoodie.index.type set as INMEMEORY
>
> compact not occur after dela commit
> {code}
> 20/01/13 16:43:43 INFO HoodieMergeOnReadTable: Checking if compaction needs to be run on file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO HoodieMergeOnReadTable: Compacting merge on read table file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO FileSystemViewManager: Creating InMemory based view for basePath file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO HoodieTableMetaClient: Loading HoodieTableMetaClient from file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO FSUtils: Hadoop Configuration: fs.defaultFS: [file:///], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml, __spark_hadoop_conf__.xml], FileSystem: [org.apache.hadoop.fs.LocalFileSystem@6a24b9e2]
> 20/01/13 16:43:43 INFO HoodieTableConfig: Loading table properties from file:/tmp/hudi_cow_table_read/.hoodie/hoodie.properties
> 20/01/13 16:43:43 INFO HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ(version=org.apache.hudi.common.model.TimelineLayoutVersion@20) from file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO HoodieTableMetaClient: Loading Active commit timeline for file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO HoodieActiveTimeline: Loaded instants [[20200109181330__deltacommit__COMPLETED], [20200110170000__deltacommit__COMPLETED], [20200110171526__deltacommit__COMPLETED], [20200113105844__deltacommit__COMPLETED], [20200113145851__deltacommit__COMPLETED], [20200113155502__deltacommit__COMPLETED], [20200113164342__deltacommit__COMPLETED]]
> 20/01/13 16:43:43 INFO HoodieRealtimeTableCompactor: Compacting file:///tmp/hudi_cow_table_read with commit 20200113164343
> 20/01/13 16:43:43 INFO HoodieTableMetaClient: Loading HoodieTableMetaClient from file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO FSUtils: Hadoop Configuration: fs.defaultFS: [file:///], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml, __spark_hadoop_conf__.xml], FileSystem: [org.apache.hadoop.fs.LocalFileSystem@6a24b9e2]
> 20/01/13 16:43:43 INFO HoodieTableConfig: Loading table properties from file:/tmp/hudi_cow_table_read/.hoodie/hoodie.properties
> 20/01/13 16:43:43 INFO HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ(version=org.apache.hudi.common.model.TimelineLayoutVersion@20) from file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO HoodieTableMetaClient: Loading Active commit timeline for file:///tmp/hudi_cow_table_read
> 20/01/13 16:43:43 INFO HoodieActiveTimeline: Loaded instants [[20200109181330__deltacommit__COMPLETED], [20200110170000__deltacommit__COMPLETED], [20200110171526__deltacommit__COMPLETED], [20200113105844__deltacommit__COMPLETED], [20200113145851__deltacommit__COMPLETED], [20200113155502__deltacommit__COMPLETED], [20200113164342__deltacommit__COMPLETED]]
> {code}
> not compact time record in the .hoodie path
--
This message was sent by Atlassian Jira
(v8.3.4#803005)