You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by xu...@apache.org on 2022/04/14 09:00:13 UTC

[hudi] branch release-0.11.0 updated (209d541648 -> 8c186eba32)

This is an automated email from the ASF dual-hosted git repository.

xushiyan pushed a change to branch release-0.11.0
in repository https://gitbox.apache.org/repos/asf/hudi.git


    from 209d541648 Create release branch for version 0.11.0.
     new 0048b78d18 [HUDI-3800] Fixed preserve commit metadata for compaction for untouched records (#5232)
     new 3b6634de6b [MINOR] Fixing build failure when using flink-1.13 (#5214)
     new 52205897a7 [HUDI-3760] Adding capability to fetch Metadata Records by prefix  (#5208)
     new 414f4bf63f [HUDI-3340] Fix deploy_staging_jars for different profiles (#5240)
     new 642b9deb63 [HUDI-3726] Switching from non-partitioned to partitioned key gen does not throw any exception (#5205)
     new 2fcea79f0c [HUDI-3340] Fix deploy_staging_jars command (#5243)
     new 32a1191b73 [HUDI-3739] Fix handling of the `isNotNull` predicate in Data Skipping (#5224)
     new b881e6d542 [HUDI-3808] Flink bulk_insert timestamp(3) can not be read by Spark (#5236)
     new ab2f313ccf [HUDI-3096] fixed the bug that the cow table(contains decimalType) write by flink cannot be read by spark. (#4421)
     new c539e8bdb5 [HUDI-3805] Delete existing corrupted requested rollback plan during rollback (#5245)
     new 63fc2ae184 [HUDI-3643] Fix hive count exception when the table is empty and the path depth is less than 3 (#5051)
     new 5a62b413dd [HUDI-3571] Spark datasource continuous ingestion tool (#5156)
     new 510e886e66 [HUDI-3637] Exclude uncommitted log files from metadata table validation (#5234)
     new 716ebe588b [HUDI-3810] Fixing lazy read for metadata log record readers (#5241)
     new 40699ebfe9 [HUDI-3823] Fix hudi-hive-sync-bundle to include HBase dependencies and shading (#5257)
     new e1092258d2 [HUDI-3454] Fix partition name in all code paths for LogRecordScanner (#5252)
     new 04e11c1e07 [HUDI-3781] fix spark delete sql can not delete record (#5215)
     new 8a56f3286c [HUDI-3827] Promote the inetAddress picking strategy for NetworkUtils#getHostname (#5260)
     new 0f9798f825 [HUDI-3825] Fixing non-partitioned table Partition Records persistence in MT (#5259)
     new 40c239fd64 [HUDI-3571] Spark datasource continuous checkpoint should have own fs variable (#5265)
     new 57343f912c [MINOR] Update README of docker build setup (#5256)
     new 0a87f1fb6b [HUDI-3825] Fixing Column Stats Index updating sequence (#5267)
     new 9ad7ae8721 [HUDI-3837] Fix license and rat check settings (#5273)
     new a2c226132f [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex (#5268)
     new 8897141ffc [MINOR] Fix typos in the comments of HoodieMergeHandle (#5271)
     new ac6b5050b5 [HUDI-3834] Fixing performance hits in reading Column Stats Index (#5266)
     new 65ba16da79 [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs (#5244)
     new 0cb266ec90 [HUDI-3842] Integ tests for non partitioned datasets (#5276)
     new edecf52028 [HUDI-3847] Fix NPE due to null schema in HoodieMetadataTableValidator (#5284)
     new 61e3a3fbf3 [HUDI-3798] Fixing ending of a transaction by different owner and removing some extraneous methods in trxn manager (#5255)
     new 52ca32d48a [HUDI-3817] shade parquet dependency for hudi-hadoop-mr-bundle (#5250)
     new baffd67ad4 [MINOR] fixing timeline server for integ tests (#5289)
     new ed02556863 [HUDI-3841] Fixing Column Stats in the presence of Schema Evolution (#5275)
     new 1261d8133c [HUDI-3844] Update props in indexer based on table config (#5293)
     new 0151d35432 [HUDI-3799] Fixing not deleting empty instants w/o archiving (#5261)
     new c19e4061d6 [HUDI-3839] Fixing incorrect selection of MT partitions to be updated (#5274)
     new 4f9144a6b8 [HUDI-3838] Implemented drop partition column feature for delta streamer code path (#5294)
     new 3f046a3de3 [HUDI-3843] Make flink profiles build with scala-2.11 (#5279)
     new 86844544fe [MINOR] Integ Test Reducing partitions for log running multi partition yaml (#5300)
     new 92f98f9ab0 [HUDI-3838] Moved the getPartitionColumns logic to driver. (#5303)
     new 5fa53f6c19 [HUDI-3859] Fix spark profiles and utilities-slim dep (#5297)
     new 7baf05aafa [HUDI-3855] Fixing `FILENAME_METADATA_FIELD` not being correctly updated in `HoodieMergeHandle` (#5296)
     new 1f4b4d99d0 [HUDI-3867] Disable Data Skipping by default (#5306)
     new 32d04fcb7c [HUDI-3868] Disable the sort input for flink streaming append mode (#5309)
     new 362798e946 [MINOR] Inline the partition path logic into the builder (#5310)
     new 0fb8bb0aa3 [HUDI-3870] Add timeout rollback for flink online compaction (#5314)
     new e9c48c7afd [HUDI-3869] Improve error handling of loading Hudi conf (#5311)
     new ccb64dd90c [HUDI-3686] Fix inline and async table service check in HoodieWriteConfig (#5307)
     new 59721fceb4 [MINOR] Code cleanup in test utils (#5312)
     new c501736e79 [HUDI-3876] Fixing fetching partitions in GlueSyncClient (#5318)
     new 462f26696b [HUDI-3826] Make truncate partition use delete_partition operation (#5272)
     new 8c186eba32 [HUDI-3845] Fix delete mor table's partition with urlencode's error (#5282)

The 52 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .github/workflows/bot.yml                          |  37 +-
 README.md                                          |  45 +-
 docker/README.md                                   |  18 +-
 .../docker-compose_hadoop284_hive233_spark244.yml  |  33 +-
 .../demo/config/test-suite/cow-spark-simple.yaml   |  54 --
 ...mer-long-running-multi-partitions-metadata.yaml |  12 +-
 ...eltastreamer-long-running-multi-partitions.yaml |  12 +-
 .../deltastreamer-medium-clustering.yaml           |   8 +-
 ...ltastreamer-medium-full-dataset-validation.yaml |   8 +-
 ...-ds.yaml => deltastreamer-non-partitioned.yaml} |  32 +-
 .../config/test-suite/insert-overwrite-table.yaml  |   2 +-
 ...aml => spark-long-running-non-partitioned.yaml} |  16 +-
 ...ssive-clean-archival-inline-compact.properties} |  11 +-
 .../test-aggressive-clean-archival.properties      |   9 +-
 ...ssive-clean-archival-inline-compact.properties} |  13 +-
 ...clustering-aggressive-clean-archival.properties |   9 +-
 ...s => test-clustering-inline-compact.properties} |  11 +-
 ...ssive-clean-archival-inline-compact.properties} |  10 +-
 ...g-metadata-aggressive-clean-archival.properties |   9 +-
 .../config/test-suite/test-clustering.properties   |  10 +-
 ...l.properties => test-inline-compact.properties} |  14 +-
 ...ssive-clean-archival-inline-compact.properties} |  10 +-
 ...t-metadata-aggressive-clean-archival.properties |   9 +-
 ...ies => test-metadata-inline-compact.properties} |  10 +-
 .../config/test-suite/test-metadata.properties     |   9 +-
 ... test-nonpartitioned-inline-compact.properties} |  16 +-
 ...partitioned-metadata-inline-compact.properties} |  16 +-
 ...ies => test-nonpartitioned-metadata.properties} |  15 +-
 ...g.properties => test-nonpartitioned.properties} |  15 +-
 docker/demo/config/test-suite/test.properties      |   9 +-
 docker/{ => images}/push_to_docker_hub.png         | Bin
 .../hudi/aws/sync/AWSGlueCatalogSyncClient.java    |  20 +-
 .../hudi/cli/commands/ArchivedCommitsCommand.java  |   4 +-
 .../apache/hudi/cli/commands/ExportCommand.java    |   2 +-
 .../hudi/cli/commands/HoodieLogFileCommand.java    |   8 +-
 .../hudi/cli/integ/ITTestClusteringCommand.java    |  15 +-
 .../hudi/cli/integ/ITTestCommitsCommand.java       |  10 +-
 .../hudi/cli/integ/ITTestCompactionCommand.java    |  15 +-
 .../apache/hudi/client/BaseHoodieWriteClient.java  |  57 +-
 .../apache/hudi/client/HoodieTimelineArchiver.java |  30 +-
 .../client/transaction/TransactionManager.java     |  27 +-
 .../hudi/client/utils/MetadataConversionUtils.java |  40 ++
 .../org/apache/hudi/config/HoodieIndexConfig.java  |  13 +
 .../org/apache/hudi/config/HoodieWriteConfig.java  |  17 +-
 .../apache/hudi/index/bloom/HoodieBloomIndex.java  |   3 +-
 .../org/apache/hudi/io/HoodieAppendHandle.java     |  14 +-
 .../org/apache/hudi/io/HoodieConcatHandle.java     |   4 +-
 .../org/apache/hudi/io/HoodieCreateHandle.java     |   2 +-
 .../org/apache/hudi/io/HoodieKeyLookupHandle.java  |   7 +-
 .../java/org/apache/hudi/io/HoodieMergeHandle.java |  34 +-
 .../apache/hudi/io/HoodieSortedMergeHandle.java    |   6 +-
 .../apache/hudi/io/storage/HoodieFileWriter.java   |   7 +-
 .../apache/hudi/io/storage/HoodieHFileWriter.java  |  29 +-
 .../apache/hudi/io/storage/HoodieOrcWriter.java    |  39 +-
 .../hudi/io/storage/HoodieParquetWriter.java       |  15 +-
 .../metadata/HoodieBackedTableMetadataWriter.java  | 123 ++--
 .../java/org/apache/hudi/table/HoodieTable.java    |  14 +-
 .../table/action/index/RunIndexActionExecutor.java |   4 +-
 .../action/index/ScheduleIndexActionExecutor.java  |   2 +-
 .../client/transaction/TestTransactionManager.java |  74 ++-
 .../apache/hudi/config/TestHoodieWriteConfig.java  |  74 ++-
 .../io/storage/TestHoodieHFileReaderWriter.java    | 123 +++-
 .../io/storage/TestHoodieReaderWriterBase.java     |   3 +-
 hudi-client/hudi-flink-client/pom.xml              |  11 +
 .../row/parquet/ParquetSchemaConverter.java        |  19 +-
 .../row/parquet/TestParquetSchemaConverter.java    |  25 +-
 .../index/bloom/SparkHoodieBloomIndexHelper.java   |  11 +-
 .../org/apache/hudi/HoodieConversionUtils.scala    |   8 +
 .../org/apache/hudi/client/TestClientRollback.java | 106 +++
 .../functional/TestHoodieBackedMetadata.java       | 188 +++++-
 .../functional/TestHoodieBackedTableMetadata.java  |  12 +-
 .../org/apache/hudi/io/TestHoodieMergeHandle.java  |  26 +-
 .../apache/hudi/io/TestHoodieTimelineArchiver.java |  20 +-
 .../java/org/apache/hudi/table/TestCleaner.java    |   2 +-
 .../hudi/testutils/HoodieClientTestHarness.java    |  10 +-
 .../hudi/testutils/HoodieClientTestUtils.java      |   4 +-
 .../org/apache/hudi/BaseHoodieTableFileIndex.java  |   2 +-
 .../java/org/apache/hudi/avro/HoodieAvroUtils.java |  11 +
 .../common/config/DFSPropertiesConfiguration.java  |  12 +-
 .../apache/hudi/common/config/HoodieConfig.java    |   2 +
 .../hudi/common/config/HoodieMetadataConfig.java   |  32 +-
 .../java/org/apache/hudi/common/fs/FSUtils.java    |  26 +-
 .../hudi/common/fs/HoodieWrapperFileSystem.java    |   4 +-
 .../org/apache/hudi/common/model/BaseFile.java     |  33 +-
 .../hudi/common/table/HoodieTableConfig.java       |  18 +-
 .../hudi/common/table/HoodieTableMetaClient.java   | 102 +--
 .../table/log/AbstractHoodieLogRecordReader.java   |  66 +-
 .../common/table/log/HoodieLogFormatReader.java    |  12 +-
 .../table/log/HoodieMergedLogRecordScanner.java    |  28 +-
 .../table/log/block/HoodieAvroDataBlock.java       |   2 +-
 .../common/table/log/block/HoodieDataBlock.java    |  28 +-
 .../table/log/block/HoodieHFileDataBlock.java      |  23 +-
 .../table/timeline/HoodieArchivedTimeline.java     |   2 +-
 .../table/view/AbstractTableFileSystemView.java    |   6 +-
 .../apache/hudi/common/util/CollectionUtils.java   |  13 +
 .../org/apache/hudi/common/util/NetworkUtils.java  |  60 +-
 .../org/apache/hudi/common/util/StringUtils.java   |  33 +-
 .../{FileNameCachingPath.java => CachingPath.java} |  44 +-
 .../SerializablePath.java}                         |  51 +-
 .../apache/hudi/io/storage/HoodieFileReader.java   |  42 +-
 .../apache/hudi/io/storage/HoodieHFileReader.java  | 712 ++++++++++++---------
 .../apache/hudi/io/storage/HoodieOrcReader.java    |  11 +-
 .../hudi/io/storage/HoodieParquetReader.java       |  19 +-
 .../apache/hudi/metadata/BaseTableMetadata.java    |   2 +-
 .../metadata/FileSystemBackedTableMetadata.java    |   7 +
 .../hudi/metadata/HoodieBackedTableMetadata.java   | 329 +++++++---
 .../HoodieMetadataMergedLogRecordReader.java       |  99 ++-
 .../hudi/metadata/HoodieMetadataPayload.java       |  60 +-
 .../apache/hudi/metadata/HoodieTableMetadata.java  |  13 +
 .../hudi/metadata/HoodieTableMetadataUtil.java     | 152 +++--
 .../metadata/MetadataRecordsGenerationParams.java  |  31 +-
 .../src/main/java/org/apache/hudi/util/Lazy.java   |  77 +++
 .../org/apache/hudi/avro/TestHoodieAvroUtils.java  |  30 +
 .../common/functional/TestHoodieLogFormat.java     |   2 +-
 .../hudi/common/testutils/FileCreateUtils.java     |  24 +-
 .../hudi/common/testutils/HoodieTestTable.java     |  14 +-
 .../apache/hudi/common/util/TestStringUtils.java   |  21 +-
 hudi-examples/hudi-examples-dbt/README.md          |  18 +-
 hudi-flink-datasource/hudi-flink/pom.xml           |   2 +-
 .../apache/hudi/configuration/FlinkOptions.java    |   2 +-
 .../hudi/sink/compact/CompactionPlanOperator.java  |  13 +-
 .../java/org/apache/hudi/sink/utils/Pipelines.java |  12 +-
 .../org/apache/hudi/table/HoodieTableSink.java     |   2 +-
 .../org/apache/hudi/util/AvroSchemaConverter.java  |  15 +-
 .../apache/hudi/util/RowDataToAvroConverters.java  |   7 +-
 .../apache/hudi/hadoop/utils/HoodieHiveUtils.java  |   1 -
 .../hudi/hadoop/utils/HoodieInputFormatUtils.java  |  18 +-
 .../hudi/hadoop/TestHoodieHFileInputFormat.java    |  15 +
 .../hudi/hadoop/TestHoodieParquetInputFormat.java  |  15 +
 .../apache/hudi/hadoop/TestInputPathHandler.java   |  18 +
 .../SparkDataSourceContinuousIngestTool.java       | 167 +++++
 .../dag/nodes/BaseValidateDatasetNode.java         |   4 +-
 .../testsuite/dag/nodes/ValidateDatasetNode.java   |   5 +-
 .../SparkDataSourceContinuousIngest.scala          |  97 +++
 .../org/apache/hudi/ColumnStatsIndexSupport.scala  | 212 ++++--
 .../scala/org/apache/hudi/DataSourceOptions.scala  |   2 +-
 .../scala/org/apache/hudi/HoodieBaseRelation.scala |  10 +-
 .../scala/org/apache/hudi/HoodieFileIndex.scala    |  57 +-
 .../org/apache/hudi/HoodieMergeOnReadRDD.scala     |  14 +-
 .../org/apache/hudi/HoodieSparkSqlWriter.scala     |  18 +-
 .../scala/org/apache/hudi/HoodieWriterUtils.scala  |  33 +-
 .../apache/hudi/SparkHoodieTableFileIndex.scala    |   2 +-
 .../apache/spark/sql/hudi/DataSkippingUtils.scala  |  30 +-
 .../spark/sql/hudi/HoodieSqlCommonUtils.scala      |   7 +-
 .../spark/sql/hudi/ProvidesHoodieConfig.scala      |   5 +-
 .../AlterHoodieTableDropPartitionCommand.scala     |  27 +-
 .../hudi/command/TruncateHoodieTableCommand.scala  | 125 ++--
 .../sql/hudi/streaming/HoodieStreamSource.scala    |   1 +
 .../spark/sql/hudi/analysis/HoodieAnalysis.scala   |   2 +-
 .../org/apache/hudi/ColumnStatsIndexHelper.java    |   2 +-
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |   0
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |   0
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |   0
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |   0
 .../index/colstats/column-stats-index-table.json   |   4 +
 ...-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json |   0
 ...-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json |   0
 ...-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json |   0
 ...-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json |   0
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |  10 +
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |  10 +
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |  10 +
 ...-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json |  10 +
 .../colstats/partial-column-stats-index-table.json |   4 +
 .../colstats/updated-column-stats-index-table.json |   8 +
 .../updated-partial-column-stats-index-table.json  |   8 +
 .../index/zorder/column-stats-index-table.json     |   4 -
 .../zorder/updated-column-stats-index-table.json   |   8 -
 .../org/apache/hudi/TestDataSkippingUtils.scala    | 314 ++++-----
 .../org/apache/hudi/TestHoodieFileIndex.scala      |  79 ++-
 .../org/apache/hudi/TestHoodieSparkSqlWriter.scala | 146 ++++-
 .../hudi/functional/TestColumnStatsIndex.scala     | 241 +++++--
 .../hudi/functional/TestLayoutOptimization.scala   |  10 +-
 .../TestMetadataTableWithSparkDataSource.scala     |  17 +-
 .../sql/hudi/TestAlterTableDropPartition.scala     |  39 +-
 .../apache/spark/sql/hudi/TestDeleteTable.scala    |  94 +++
 hudi-spark-datasource/hudi-spark2-common/pom.xml   |  18 +-
 .../hudi/sync/common/util/SyncUtilHelpers.java     |  19 +
 .../org/apache/hudi/utilities/HoodieIndexer.java   |  18 +
 .../utilities/HoodieMetadataTableValidator.java    | 165 ++++-
 .../hudi/utilities/deltastreamer/DeltaSync.java    |  32 +-
 .../apache/hudi/utilities/TestHoodieIndexer.java   |  87 ++-
 packaging/hudi-flink-bundle/pom.xml                |   4 +-
 packaging/hudi-hadoop-mr-bundle/pom.xml            |  18 +-
 packaging/hudi-hive-sync-bundle/pom.xml            | 117 +++-
 packaging/hudi-utilities-slim-bundle/pom.xml       |   8 -
 pom.xml                                            |  23 +-
 rfc/rfc-34/rfc-34.md                               |  16 +
 scripts/release/create_source_release.sh           |   1 +
 scripts/release/deploy_staging_jars.sh             |  72 ++-
 scripts/release/validate_staged_release.sh         |  14 +-
 191 files changed, 4560 insertions(+), 2040 deletions(-)
 delete mode 100644 docker/demo/config/test-suite/cow-spark-simple.yaml
 copy docker/demo/config/test-suite/{multi-writer-1-ds.yaml => deltastreamer-non-partitioned.yaml} (80%)
 rename docker/demo/config/test-suite/{cow-spark-long-running.yaml => spark-long-running-non-partitioned.yaml} (86%)
 copy docker/demo/config/test-suite/{test-metadata-aggressive-clean-archival.properties => test-aggressive-clean-archival-inline-compact.properties} (93%)
 copy docker/demo/config/test-suite/{test-clustering-metadata-aggressive-clean-archival.properties => test-clustering-aggressive-clean-archival-inline-compact.properties} (94%)
 copy docker/demo/config/test-suite/{test-clustering.properties => test-clustering-inline-compact.properties} (93%)
 copy docker/demo/config/test-suite/{test-clustering-metadata-aggressive-clean-archival.properties => test-clustering-metadata-aggressive-clean-archival-inline-compact.properties} (94%)
 copy docker/demo/config/test-suite/{test-aggressive-clean-archival.properties => test-inline-compact.properties} (91%)
 copy docker/demo/config/test-suite/{test-metadata-aggressive-clean-archival.properties => test-metadata-aggressive-clean-archival-inline-compact.properties} (93%)
 copy docker/demo/config/test-suite/{test-metadata.properties => test-metadata-inline-compact.properties} (93%)
 copy docker/demo/config/test-suite/{test-clustering.properties => test-nonpartitioned-inline-compact.properties} (90%)
 copy docker/demo/config/test-suite/{test-clustering.properties => test-nonpartitioned-metadata-inline-compact.properties} (90%)
 copy docker/demo/config/test-suite/{test-clustering.properties => test-nonpartitioned-metadata.properties} (91%)
 copy docker/demo/config/test-suite/{test-clustering.properties => test-nonpartitioned.properties} (91%)
 rename docker/{ => images}/push_to_docker_hub.png (100%)
 rename hudi-common/src/main/java/org/apache/hudi/hadoop/{FileNameCachingPath.java => CachingPath.java} (54%)
 copy hudi-common/src/main/java/org/apache/hudi/{common/config/SerializableConfiguration.java => hadoop/SerializablePath.java} (52%)
 create mode 100644 hudi-common/src/main/java/org/apache/hudi/util/Lazy.java
 create mode 100644 hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/SparkDataSourceContinuousIngestTool.java
 create mode 100644 hudi-integ-test/src/main/scala/org/apache/hudi/integ/testsuite/SparkDataSourceContinuousIngest.scala
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/another-input-table-json/part-00000-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json (100%)
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/another-input-table-json/part-00001-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json (100%)
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/another-input-table-json/part-00002-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json (100%)
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/another-input-table-json/part-00003-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json (100%)
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/column-stats-index-table.json
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/input-table-json/part-00000-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json (100%)
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/input-table-json/part-00001-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json (100%)
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/input-table-json/part-00002-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json (100%)
 rename hudi-spark-datasource/hudi-spark/src/test/resources/index/{zorder => colstats}/input-table-json/part-00003-4468afca-8a37-4ae8-a150-0c2fd3361080-c000.json (100%)
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/partial-another-input-table-json/part-00000-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/partial-another-input-table-json/part-00001-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/partial-another-input-table-json/part-00002-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/partial-another-input-table-json/part-00003-7e680484-e7e1-48b6-8289-1a7c483b530b-c000.json
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/partial-column-stats-index-table.json
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/updated-column-stats-index-table.json
 create mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/colstats/updated-partial-column-stats-index-table.json
 delete mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/zorder/column-stats-index-table.json
 delete mode 100644 hudi-spark-datasource/hudi-spark/src/test/resources/index/zorder/updated-column-stats-index-table.json