You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by yi...@apache.org on 2022/06/08 03:15:02 UTC
[hudi] branch release-0.11.1-rc1 created (now 39ebc28b6f)
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch release-0.11.1-rc1
in repository https://gitbox.apache.org/repos/asf/hudi.git
at 39ebc28b6f Create release branch for version 0.11.1.
This branch includes the following new commits:
new 91a5f3db1d [HUDI-3950] add parquet-avro to gcp-bundle (#5399)
new c9889799b4 [HUDI-3923] Fix cast exception while reading boolean type of partitioned field (#5373)
new ec12b82e58 [HUDI-3946] Validate option path in flink hudi sink (#5397)
new 1f173127e4 [HUDI-3972] Fixing hoodie.properties/tableConfig for no preCombine field with writes (#5424)
new 16dfd461af [MINOR] Update alter rename command class type for pattern matching (#5381)
new d754b8c1fc [HUDI-3977] Flink hudi table with date type partition path throws HoodieNotSupportedException (#5432)
new 77e277ab9c [HUDI-3945] After the async compaction operation is complete, the task should exit. (#5391)
new c5089da852 [HUDI-3815] Fix docs description of metadata.compaction.delta_commits default value error (#5368)
new 0acac93281 [HUDI-3943] Some description fixes for 0.10.1 docs (#5447)
new ea822a3780 [MINOR] support different cleaning policy for flink (#5459)
new 25c7182ace [HUDI-3758] Fix duplicate fileId error in MOR table type with flink bucket hash Index (#5185)
new aebc521960 [MINOR] Fix CI by ignoring SparkContext error (#5468)
new f790e9d3d0 [HUDI-3862] Fix default configurations of HoodieHBaseIndexConfig (#5308)
new a7e2669ac3 [HUDI-3978] Fix use of partition path field as hive partition field in flink (#5434)
new 2b51e0623b [MINOR] Update DOAP for release 0.11.0 (#5467)
new b8b77957e2 [MINOR] Update RFC status (#5486)
new 97d71d85d0 [HUDI-4005] Update release scripts to help validation (#5479)
new 3e9db9557c [HUDI-4031] Avoid clustering update handling when no pending replacecommit (#5487)
new 98c2931d54 [HUDI-3667] Run unit tests of hudi-integ-tests in CI (#5078)
new 00e2e0adc8 [MINOR] Optimize code logic (#5499)
new cde187f55e [HUDI-2875] Make HoodieParquetWriter Thread safe and memory executor exit gracefully (#4264)
new 497020293e [HUDI-4042] Support truncate-partition for Spark-3.2 (#5506)
new 7c0e443c11 [HUDI-4017] Improve spark sql coverage in CI (#5512)
new 56e2cc4f20 [HUDI-3849] AvroDeserializer supports AVRO_REBASE_MODE_IN_READ configuration (#5287)
new efe6cb650c [MINOR] Fixing class not found when using flink and enable metadata table (#5527)
new 891c415194 [MINOR] fixing flaky tests in deltastreamer tests (#5521)
new 7af52f1b8a [HUDI-4055]refactor ratelimiter to avoid stack overflow (#5530)
new 2f0f3b535b [MINOR] Fixing close for HoodieCatalog's test (#5531)
new 38c139060f [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti… (#5526)
new 78ec3a8c52 [HUDI-3995] Making perf optimizations for bulk insert row writer path (#5462)
new 23399624e8 [HUDI-4044] When reading data from flink-hudi to external storage, the … (#5516)
new 542efdd9e7 [HUDI-4003] Try to read all the log file to parse schema (#5473)
new e4d44b99ad [HUDI-4038] Avoid calling `getDataSize` after every record written (#5497)
new 16037bbff5 [HUDI-4079] Supports showing table comment for hudi with spark3 (#5546)
new 3ceb7b1df7 [HUDI-4085] Fixing flakiness with parquet empty batch tests in TestHoodieDeltaStreamer (#5559)
new 96035e4a90 [HUDI-4018][HUDI-4027] Adding integ test yamls for immutable use-cases. Added delete partition support to integ tests (#5501)
new 8cb8e04bee [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink (#5528)
new 9118c7c839 [MINOR] Fix a NPE for Option (#5461)
new 61763a8904 [HUDI-4078][HUDI-FLINK]BootstrapOperator contains the pending compact… (#5545)
new a170a182fa [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink (#5574)
new f906476aa4 [HUDI-4072] Fix NULL schema for empty batches in deltastreamer (#5543)
new 87b4263ef9 [HUDI-4097] add table info to jobStatus (#5529)
new bf4f9732b1 [HUDI-4001] Filter the properties should not be used when create table for Spark SQL (#5495)
new dea1836b71 fix hive sync no partition table error (#5585)
new 3b27ba4a39 [HUDI-4098] Metadata table heartbeat for instant has expired, last heartbeat 0 (#5583)
new c4bc06cc98 [HUDI-4103] [HUDI-4001] Filter the properties should not be used when create table for Spark SQL
new 1ee673b271 [HUDI-4104] DeltaWriteProfile includes the pending compaction file slice when deciding small buckets (#5594)
new 70b2e8dd3c [HUDI-4101] BucketIndexPartitioner should take partition path for better dispersion (#5590)
new 0a41dca5bc [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand (#5564)
new 6f784a8c9f [HUDI-4110] Clean the marker files for flink compaction (#5604)
new 7ad732e637 [MINOR] Fixing spark long running yaml for non-partitioned (#5607)
new 1d7f9e44a6 [minor] Some code refactoring for LogFileComparator and Instant instantiation (#5600)
new 0676d5be60 [HUDI-4109] Copy the old record directly when it is chosen for merging (#5603)
new eaf183f9d0 Clean the marker files for flink compaction (#5611)
new 679e7e8cd4 [HUDI-4111] Bump ANTLR runtime version in Spark 3.x (#5606)
new 631ae88338 Revert "[HUDI-3870] Add timeout rollback for flink online compaction (#5314)" (#5622)
new e4079da780 [HUDI-4116] Unify clustering/compaction related procedures' output type (#5620)
new 3d56c519db [HUDI-4114] Remove the unnecessary fs view sync for BaseWriteClient#initTable (#5617)
new 59abb095ac [HUDI-4119] the first read result is incorrect when Flink upsert- Kafka connector is used in HUDi (#5626)
new b0633f535c [HUDI-4130] Remove the upgrade/downgrade for flink #initTable (#5642)
new 702608da7c [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test (#5646)
new 1f31aa4f59 [HUDI-4122] Fix NPE caused by adding kafka nodes (#5632)
new 76c2931275 [MINOR] remove unused gson test dependency (#5652)
new 66b43d3332 [HUDI-3858] Shade javax.servlet for Spark bundle jar (#5295)
new ac27d9e79e [HUDI-4100] CTAS failed to clean up when given an illegal MANAGED table definition (#5588)
new a5257d1606 [HUDI-3890] fix rat plugin issue with sql files (#5644)
new 9052f7b0bb [HUDI-4129] Initializes a new fs view for WriteProfile#reload (#5640)
new 4b7d150c91 [HUDI-3933] Add UT cases to cover different key gen (#5638)
new f9bc63097a [MINOR] Removing redundant semicolons and line breaks (#5662)
new eca1091f4b [HUDI-4134] Fix Method naming consistency issues in FSUtils (#5655)
new 65df5cc262 [HUDI-4084] Add support to test async table services with integ test suite framework (#5557)
new a55d2f0118 [HUDI-4138] Fix the concurrency modification of hoodie table config for flink (#5660)
new efb97a2eb0 [HUDI-2473] Fixing compaction write operation in commit metadata (#5203)
new 6219f6cd13 [HUDI-4145] Archives the metadata file in HoodieInstant.State sequence (#5669)
new e85b131f03 [HUDI-4135] remove netty and netty-all (#5663)
new 723e54a0de [HUDI-4132] Fixing determining target table schema for delta sync with empty batch (#5648)
new d2364befa8 [MINOR] Fix a potential NPE and some finer points of hudi cli (#5656)
new db019262b6 [HUDI-4145] Archives the metadata file in HoodieInstant.State sequence (part2) (#5676)
new 209ce34dba [HUDI-4124] Add valid check in Spark Datasource configs (#5637)
new 9c746b8701 [HUDI-4162] Fixed some constant mapping issues. (#5700)
new f16a9939b7 [HUDI-4161] Make sure partition values are taken from partition path (#5699)
new 0ebf8419d7 [MINOR] Fix the issue when handling conf hoodie.datasource.write.operation=bulk_insert in sql mode (#5679)
new a9f575797c [HUDI-4160] Make database regex of MaxwellJsonKafkaSourcePostProcessor optional (#5697)
new 27fd101149 [MINOR] Fix Hive and meta sync config for sql statement (#5316)
new 06327281b5 [HUDI-4166] Added SimpleClient plugin for integ test (#5710)
new ba70ceda35 [HUDI-4086] Use CustomizedThreadFactory in async compaction and clustering (#5563)
new 2cac57632e [HUDI-4163] Catch general exception instead of IOException while fetching rollback plan during rollback (#5703)
new 7194d2e175 [HUDI-4149] Drop-Table fails when underlying table directory is broken (#5672)
new 27c745cf0d [HUDI-4107] Added --sync-tool-classes config option in HoodieMultiTableDeltaStreamer (#5597)
new 1e737c3bcc [HUDI-4174] Add hive conf dir option for flink sink (#5725)
new 55be49d439 [HUDI-3670] free temp views in sql transformers (#5080)
new 6c4200f64d [HUDI-4167] Remove the timeline refresh with initializing hoodie table (#5716)
new ae656c5d40 [HUDI-4179] Cluster with sort cloumns invalid (#5739)
new 4e053c0d3a Fix errors from cherry-picking
new 6db0720f61 [HUDI-4183] Fix using HoodieCatalog to create non-hudi tables (#5743)
new 7607b67883 [HUDI-4187] Fix partition order in aws glue sync (#5731)
new 8d01b07b93 [HUDI-4190] Include hbase-protocol for shading in the bundles (#5750)
new 3a8fb97b0e [HUDI-4192] HoodieHFileReader scan top cells after bottom cells throw NullPointerException (#5755)
new 834b13a1c0 [HUDI-4188] Fix flaky ITTestDataSTreamWrite.testWriteCopyOnWrite (#5749)
new c86ed44ce5 [HUDI-4195] Bulk insert should use right keygen for non-partitioned table (#5759)
new 048ab3dc62 [HUDI-4101] When BucketIndexPartitioner take partition path for dispersion may cause the fileID of the task to not be loaded correctly (#5763)
new d3f9e77bc5 [HUDI-4176] Fixing `TableSchemaResolver` to avoid repeated `HoodieCommitMetadata` parsing (#5733)
new 8ad2aa3901 [HUDI-4140] Fixing hive style partitioning and default partition with bulk insert row writer with SimpleKeyGen and virtual keys (#5664)
new 9f646d4b4f [HUDI-4197] Fix Async indexer to support building FILES partition (#5766)
new e3ce7a1867 [HUDI-4171] Fixing Non partitioned with virtual keys in read path (#5747)
new 2b689c22dc [MINOR] Mark AWSGlueCatalogSyncClient experimental (#5775)
new ad27bc352c [HUDI-4200] Fixing sorting of keys fetched from metadata table (#5773)
new 06ddb7296c [HUDI-4198] Fix hive config for AWSGlueClientFactory (#5768)
new 98ae2cb510 [HUDI-4178] Addressing performance regressions in Spark DataSourceV2 Integration (#5737)
new 39ebc28b6f Create release branch for version 0.11.1.
The 110 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.