[hudi] branch master updated (6ccbae4 -> d074089)

[si...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.


    from 6ccbae4  [HUDI-2757] Implement Hudi AWS Glue sync (#5076)
     add d074089  [HUDI-2566] Adding multi-writer test support to integ test (#5065)

No new revisions were added by this update.

Summary of changes:
 ...e-deltastreamer.yaml => multi-writer-1-ds.yaml} |  25 +--
 .../{test.properties => multi-writer-1.properties} |  17 +-
 ...w-spark-simple.yaml => multi-writer-2-sds.yaml} |  26 +--
 .../{test.properties => multi-writer-2.properties} |  17 +-
 ....properties => multi-writer-local-1.properties} |  23 +-
 ....properties => multi-writer-local-2.properties} |  23 +-
 .../hudi/config/metrics/HoodieMetricsConfig.java   |   2 +-
 .../testsuite/HoodieMultiWriterTestSuiteJob.java   | 241 +++++++++++++++++++++
 .../hudi/integ/testsuite/HoodieTestSuiteJob.java   |  37 +++-
 .../testsuite/configuration/DFSDeltaConfig.java    |  10 +-
 .../hudi/integ/testsuite/dag/WriterContext.java    |   2 +-
 .../hudi/integ/testsuite/dag/nodes/DeleteNode.java |   2 +-
 .../hudi/integ/testsuite/dag/nodes/InsertNode.java |   2 +-
 .../hudi/integ/testsuite/dag/nodes/UpsertNode.java |   2 +-
 .../integ/testsuite/generator/DeltaGenerator.java  |  61 +++---
 .../testsuite/dag/nodes/SparkBulkInsertNode.scala  |   2 +-
 .../testsuite/dag/nodes/SparkDeleteNode.scala      |  34 +--
 .../testsuite/dag/nodes/SparkInsertNode.scala      |  31 ++-
 .../testsuite/dag/nodes/SparkUpsertNode.scala      |  43 +++-
 .../dag/nodes/spark/sql/BaseSparkSqlNode.scala     |   2 +-
 .../nodes/spark/sql/SparkSqlCreateTableNode.scala  |   2 +-
 .../dag/nodes/spark/sql/SparkSqlDeleteNode.scala   |   2 +-
 .../dag/nodes/spark/sql/SparkSqlMergeNode.scala    |   2 +-
 .../dag/nodes/spark/sql/SparkSqlUpdateNode.scala   |   2 +-
 .../TestDFSHoodieTestSuiteWriterAdapter.java       |   2 +-
 25 files changed, 466 insertions(+), 146 deletions(-)
 copy docker/demo/config/test-suite/{simple-deltastreamer.yaml => multi-writer-1-ds.yaml} (82%)
 copy docker/demo/config/test-suite/{test.properties => multi-writer-1.properties} (81%)
 copy docker/demo/config/test-suite/{cow-spark-simple.yaml => multi-writer-2-sds.yaml} (78%)
 copy docker/demo/config/test-suite/{test.properties => multi-writer-2.properties} (81%)
 copy docker/demo/config/test-suite/{test-metadata-aggressive-clean-archival.properties => multi-writer-local-1.properties} (77%)
 copy docker/demo/config/test-suite/{test-metadata-aggressive-clean-archival.properties => multi-writer-local-2.properties} (77%)
 create mode 100644 hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/HoodieMultiWriterTestSuiteJob.java