You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by na...@apache.org on 2020/05/17 22:14:36 UTC
[incubator-hudi] branch hudi_test_suite_refactor updated (6f4547d
-> bbd4429)
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a change to branch hudi_test_suite_refactor
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git.
omit 6f4547d [MINOR] Code cleanup for dag package
omit 33590b7 [MINOR] Code cleanup for DeltaConfig
omit 7db66af [HUDI-394] Provide a basic implementation of test suite
add 19ca0b5 [HUDI-785] Refactor compaction/savepoint execution based on ActionExector abstraction (#1548)
add 6de9f5d [HUDI-819] Fix a bug with MergeOnReadLazyInsertIterable.
add 06dae30 [HUDI-810] Migrate ClientTestHarness to JUnit 5 (#1553)
add 69b1630 [HUDI-814] Migrate hudi-client tests to JUnit 5 (#1570)
add 9059bce [HUDI-702] Add test for HoodieLogFileCommand (#1522)
add c4b7162 [MINOR] Reorder HoodieTimeline#compareTimestamp arguments for better readability (#1575)
add 506447f [HUDI-850] Avoid unnecessary listings in incremental cleaning mode (#1576)
add 096f7f5 [HUDI-813] Migrate hudi-utilities tests to JUnit 5 (#1589)
add 5e0f5e5 [HUDI-852] adding check for table name for Append Save mode (#1580)
add e21441a Add changes for presto mor queries (#1578)
add 366bb10 [HUDI-812] Migrate hudi common tests to JUnit 5 (#1590)
add f921469 [HUDI-704] Add test for RepairsCommand (#1554)
add e783ab1 [HUDI-784] Adressing issue with log reader on GCS (#1516)
add d54b4b8 [HUDI-838] Support schema from HoodieCommitMetadata for HiveSync (#1559)
add fa6aba7 [MINOR] fixed building IndexFileFilter with a wrong condition in HoodieGlobalBloomIndex class (#1537)
add f92b9fd [MINOR] Fix hardcoding of ports in TestHoodieJmxMetrics (#1606)
add 8d0e231 [HUDI-820] cleaner repair command should only inspect clean metadata files (#1542)
add 6dac101 [HUDI-870] Remove spark context in ClientUtils and HoodieIndex (#1609)
add 5d37e66 [MINOR] Fix HoodieNotSupportedException description in KafkaOffsetGen (#1615)
add 295d00b [HUDI-880] Replace part of spark context by hadoop configuration in HoodieTable. (#1614)
add b54517a [HUDI-886] Replace jsc.hadoopConfiguration by hadoop configuration in hudi-client testcase (#1621)
add e8ffc6f [HUDI-881] Replace part of spark context by hadoop configuration in AbstractHoodieClient and HoodieReadClient (#1620)
add 404c7e8 [HUDI-884] Shade avro and parquet-avro in hudi-hive-sync-bundle (#1618)
add 32ea4c7 [HUDI-869] Add support for alluxio (#1608)
add 32bada2 [HUDI-889] Writer supports useJdbc configuration when hive synchronization is enabled (#1627)
add 0d4848b [HUDI-811] Restructure test packages (#1607)
add 83796b3 [HUDI-793] Adding proper default to hudi metadata fields and proper handling to rewrite routine (#1513)
add 3a2fe13 [HUDI-701] Add unit test for HDFSParquetImportCommand (#1574)
add f094f42 [HUDI-843] Add ability to specify time unit for TimestampBasedKeyGenerator (#1541)
add a64afdf HUDI-528 Handle empty commit in incremental pulling (#1612)
add bbd4429 [HUDI-394] Provide a basic implementation of test suite
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6f4547d)
\
N -- N -- N refs/heads/hudi_test_suite_refactor (bbd4429)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
hudi-cli/pom.xml | 7 +
.../apache/hudi/cli/HoodieTableHeaderFields.java | 21 +-
.../apache/hudi/cli/commands/CommitsCommand.java | 2 +-
.../hudi/cli/commands/CompactionCommand.java | 2 +-
.../hudi/cli/commands/FileSystemViewCommand.java | 4 +-
.../cli/commands/HDFSParquetImportCommand.java | 8 +-
.../hudi/cli/commands/HoodieLogFileCommand.java | 19 +-
.../hudi/cli/commands/HoodieSyncCommand.java | 2 +-
.../apache/hudi/cli/commands/RepairsCommand.java | 59 ++-
.../hudi/cli/commands/SavepointsCommand.java | 8 +-
.../org/apache/hudi/cli/commands/SparkMain.java | 35 +-
.../java/org/apache/hudi/cli/utils/CommitUtil.java | 2 +-
.../scala/org/apache/hudi/cli/SparkHelpers.scala | 4 +
.../hudi/cli/AbstractShellIntegrationTest.java | 17 +-
.../cli/commands/TestArchivedCommitsCommand.java | 28 +-
.../hudi/cli/commands/TestCleansCommand.java | 49 +-
.../cli/commands/TestFileSystemViewCommand.java | 42 +-
.../cli/commands/TestHoodieLogFileCommand.java | 222 +++++++++
.../hudi/cli/commands/TestRepairsCommand.java | 207 +++++++++
.../hudi/cli/commands/TestSparkEnvCommand.java | 8 +-
.../apache/hudi/cli/commands/TestTableCommand.java | 18 +-
.../hudi/cli/common/HoodieTestCommitUtilities.java | 4 +-
.../apache/hudi/cli/integ/ITTestCleansCommand.java | 33 +-
.../cli/integ/ITTestHDFSParquetImportCommand.java | 186 ++++++++
.../hudi/cli/integ/ITTestRepairsCommand.java | 179 +++++++
.../{clean.properties => table-config.properties} | 6 +-
.../apache/hudi/client/AbstractHoodieClient.java | 9 +-
.../hudi/client/AbstractHoodieWriteClient.java | 44 +-
.../apache/hudi/client/CompactionAdminClient.java | 12 +-
.../org/apache/hudi/client/HoodieReadClient.java | 11 +-
.../org/apache/hudi/client/HoodieWriteClient.java | 512 +++++----------------
.../org/apache/hudi/client/utils/ClientUtils.java | 9 +-
.../apache/hudi/config/HoodieCompactionConfig.java | 4 +-
.../org/apache/hudi/config/HoodieWriteConfig.java | 2 +-
.../hudi/execution/BulkInsertMapFunction.java | 2 +-
...InsertIterable.java => LazyInsertIterable.java} | 35 +-
.../execution/MergeOnReadLazyInsertIterable.java | 74 ---
.../java/org/apache/hudi/index/HoodieIndex.java | 4 +-
.../hudi/index/bloom/HoodieGlobalBloomIndex.java | 2 +-
.../org/apache/hudi/index/hbase/HBaseIndex.java | 4 +-
...oodieIOHandle.java => AppendHandleFactory.java} | 24 +-
...oodieIOHandle.java => CreateHandleFactory.java} | 24 +-
...HoodieIOHandle.java => WriteHandleFactory.java} | 23 +-
.../apache/hudi/table/HoodieCopyOnWriteTable.java | 23 +-
.../apache/hudi/table/HoodieMergeOnReadTable.java | 60 +--
.../java/org/apache/hudi/table/HoodieTable.java | 115 +++--
...chiveLog.java => HoodieTimelineArchiveLog.java} | 24 +-
.../hudi/table/action/BaseActionExecutor.java | 4 +
.../action/{commit => }/HoodieWriteMetadata.java | 2 +-
.../hudi/table/action/clean/CleanPlanner.java | 121 +++--
.../action/commit/BaseCommitActionExecutor.java | 6 +-
.../commit/BulkInsertCommitActionExecutor.java | 1 +
.../hudi/table/action/commit/BulkInsertHelper.java | 1 +
.../BulkInsertPreppedCommitActionExecutor.java | 1 +
.../table/action/commit/CommitActionExecutor.java | 4 +-
.../action/commit/DeleteCommitActionExecutor.java | 1 +
.../hudi/table/action/commit/DeleteHelper.java | 5 +-
.../action/commit/InsertCommitActionExecutor.java | 1 +
.../commit/InsertPreppedCommitActionExecutor.java | 1 +
.../action/commit/UpsertCommitActionExecutor.java | 1 +
.../commit/UpsertPreppedCommitActionExecutor.java | 1 +
.../hudi/table/action/commit/WriteHelper.java | 7 +-
.../hudi/table/action/compact/CompactHelpers.java | 70 +++
.../{ => action}/compact/HoodieCompactor.java | 2 +-
.../compact/HoodieMergeOnReadTableCompactor.java | 7 +-
.../{ => action}/compact/OperationResult.java | 2 +-
.../compact/RunCompactionActionExecutor.java | 93 ++++
.../compact/ScheduleCompactionActionExecutor.java | 121 +++++
.../strategy/BoundedIOCompactionStrategy.java | 2 +-
.../BoundedPartitionAwareCompactionStrategy.java | 2 +-
.../compact/strategy/CompactionStrategy.java | 4 +-
.../strategy/DayBasedCompactionStrategy.java | 2 +-
.../LogFileSizeBasedCompactionStrategy.java | 2 +-
.../strategy/UnBoundedCompactionStrategy.java | 2 +-
.../UnBoundedPartitionAwareCompactionStrategy.java | 2 +-
.../BulkInsertDeltaCommitActionExecutor.java | 2 +-
...BulkInsertPreppedDeltaCommitActionExecutor.java | 2 +-
.../DeleteDeltaCommitActionExecutor.java | 2 +-
.../deltacommit/DeltaCommitActionExecutor.java | 7 +-
.../InsertDeltaCommitActionExecutor.java | 2 +-
.../InsertPreppedDeltaCommitActionExecutor.java | 2 +-
.../UpsertDeltaCommitActionExecutor.java | 2 +-
.../UpsertPreppedDeltaCommitActionExecutor.java | 2 +-
.../action/restore/BaseRestoreActionExecutor.java | 2 +-
.../MergeOnReadRollbackActionExecutor.java | 6 +-
.../action/savepoint/SavepointActionExecutor.java | 115 +++++
.../table/action/savepoint/SavepointHelpers.java | 71 +++
.../org/apache/hudi/client/TestClientRollback.java | 44 +-
.../hudi/client/TestCompactionAdminClient.java | 88 ++--
.../apache/hudi/client/TestHoodieClientBase.java | 99 ++--
.../TestHoodieClientOnCopyOnWriteStorage.java | 243 +++++-----
.../apache/hudi/client/TestHoodieReadClient.java | 20 +-
.../java/org/apache/hudi/client/TestMultiFS.java | 20 +-
.../hudi/client/TestTableSchemaEvolution.java | 71 +--
.../hudi/client/TestUpdateSchemaEvolution.java | 33 +-
.../hudi/common/HoodieClientTestHarness.java | 7 +-
.../hudi/common/HoodieTestDataGenerator.java | 13 +-
.../hudi/common/config/TestHoodieWriteConfig.java | 8 +-
.../execution/TestBoundedInMemoryExecutor.java | 24 +-
.../hudi/execution/TestBoundedInMemoryQueue.java | 93 ++--
.../hudi/index/TestHBaseQPSResourceAllocator.java | 33 +-
.../java/org/apache/hudi/index/TestHbaseIndex.java | 96 ++--
.../org/apache/hudi/index/TestHoodieIndex.java | 67 +--
.../bloom/TestBucketizedBloomCheckPartitioner.java | 24 +-
.../hudi/index/bloom/TestHoodieBloomIndex.java | 132 +++---
.../index/bloom/TestHoodieGlobalBloomIndex.java | 76 +--
.../hudi/index/bloom/TestKeyRangeLookupTree.java | 4 +-
.../apache/hudi/io/TestHoodieCommitArchiveLog.java | 224 ++++-----
.../org/apache/hudi/io/TestHoodieMergeHandle.java | 106 +++--
.../io/storage/TestHoodieStorageWriterFactory.java | 19 +-
.../apache/hudi/metrics/TestHoodieJmxMetrics.java | 5 +-
.../java/org/apache/hudi/table/TestCleaner.java | 204 ++++----
.../apache/hudi/table/TestConsistencyGuard.java | 40 +-
.../apache/hudi/table/TestMergeOnReadTable.java | 284 ++++++------
.../commit/TestCopyOnWriteActionExecutor.java | 60 ++-
.../table/action/commit/TestUpsertPartitioner.java | 74 +--
.../{ => action}/compact/TestAsyncCompaction.java | 189 ++++----
.../{ => action}/compact/TestHoodieCompactor.java | 65 ++-
.../strategy/TestHoodieCompactionStrategy.java | 56 ++-
hudi-common/pom.xml | 14 +-
.../java/org/apache/hudi/avro/HoodieAvroUtils.java | 27 +-
.../org/apache/hudi/common/fs/StorageSchemes.java | 4 +-
.../apache/hudi/common/model/HoodieFileGroup.java | 6 +-
.../hudi/common/table/TableSchemaResolver.java | 64 ++-
.../table/log/AbstractHoodieLogRecordScanner.java | 4 +-
.../hudi/common/table/log/HoodieLogFileReader.java | 8 +-
.../table/timeline/HoodieActiveTimeline.java | 2 +-
.../table/timeline/HoodieDefaultTimeline.java | 6 +-
.../hudi/common/table/timeline/HoodieTimeline.java | 16 +-
.../common/table/timeline/TimelineDiffHelper.java | 2 +-
.../table/view/AbstractTableFileSystemView.java | 6 +-
.../table/view/RocksDbBasedFileSystemView.java | 6 +-
.../org/apache/hudi/avro/TestHoodieAvroUtils.java | 7 +-
.../apache/hudi/common/bloom/TestBloomFilter.java | 51 +-
.../bloom/TestInternalDynamicBloomFilter.java | 10 +-
.../org/apache/hudi/common/fs/TestFSUtils.java | 126 ++---
.../hudi/common/fs/inline/TestHFileInLining.java | 34 +-
.../common/fs/inline/TestInLineFileSystem.java | 148 +++---
.../common/fs/inline/TestInMemoryFileSystem.java | 61 +--
.../hudi/common/minicluster/HdfsTestService.java | 19 +-
.../apache/hudi/common/model/HoodieTestUtils.java | 20 +-
.../common/model/TestHoodieCommitMetadata.java | 27 +-
.../apache/hudi/common/model/TestHoodieRecord.java | 16 +-
.../hudi/common/model/TestHoodieWriteStat.java | 6 +-
.../hudi/common/storage/TestStorageSchemes.java | 16 +-
.../common/table/TestHoodieTableMetaClient.java | 22 +-
.../hudi/common/table/log/TestHoodieLogFormat.java | 363 +++++++--------
.../log/TestHoodieLogFormatAppendFailure.java | 18 +-
.../table/log/TestHoodieLogFormatVersion.java | 6 +-
.../table/timeline/TestHoodieActiveTimeline.java | 75 ++-
.../table/view/TestHoodieTableFileSystemView.java | 19 +-
.../table/view/TestIncrementalFSViewSync.java | 128 +++---
.../TestRocksDBBasedIncrementalFSViewSync.java | 4 +-
.../{ => testutils}/HoodieCommonTestHarness.java | 15 +-
.../testutils/HoodieCommonTestHarnessJunit5.java | 52 ---
.../hudi/common/testutils/NetworkTestUtils.java | 20 +-
.../hudi/common/util/CompactionTestUtils.java | 12 +-
.../hudi/common/util/TestBase64CodecUtil.java | 7 +-
.../hudi/common/util/TestCompactionUtils.java | 53 ++-
.../util/TestDFSPropertiesConfiguration.java | 33 +-
.../apache/hudi/common/util/TestFileIOUtils.java | 4 +-
.../apache/hudi/common/util/TestNumericUtils.java | 6 +-
.../apache/hudi/common/util/TestParquetUtils.java | 67 ++-
.../hudi/common/util/TestSerializationUtils.java | 15 +-
.../apache/hudi/common/util/TestStringUtils.java | 10 +-
.../common/util/collection/TestDiskBasedMap.java | 16 +-
.../util/collection/TestExternalSpillableMap.java | 31 +-
.../common/util/collection/TestRocksDBManager.java | 53 ++-
.../util/collection/TestRocksDbBasedMap.java | 13 +-
.../hadoop/UseRecordReaderFromInputFormat.java | 38 ++
.../realtime/HoodieParquetRealtimeInputFormat.java | 2 +
.../org/apache/hudi/hadoop/TestAnnotation.java | 23 +-
.../hudi/hadoop/TestHoodieParquetInputFormat.java | 1 +
.../hudi/hadoop/TestHoodieROTablePathFilter.java | 4 +-
...hHandlerTest.java => TestInputPathHandler.java} | 2 +-
.../TestHoodieCombineHiveInputFormat.java | 11 +-
.../realtime/TestHoodieRealtimeRecordReader.java | 2 +-
.../{ => testutils}/InputFormatTestUtil.java | 3 +-
.../org/apache/hudi/hive/HoodieHiveClient.java | 7 +-
.../org/apache/hudi/hive/TestHiveSyncTool.java | 111 +++--
.../hive/{util => testutils}/HiveTestService.java | 2 +-
.../apache/hudi/hive/{ => testutils}/TestUtil.java | 90 ++--
.../org/apache/hudi/integ/ITTestHoodieDemo.java | 11 +-
.../main/java/org/apache/hudi/DataSourceUtils.java | 2 +
.../scala/org/apache/hudi/DataSourceOptions.scala | 2 +
.../org/apache/hudi/HoodieSparkSqlWriter.scala | 13 +-
.../org/apache/hudi/IncrementalRelation.scala | 31 +-
hudi-spark/src/test/java/HoodieJavaApp.java | 1 +
.../src/test/java/HoodieJavaStreamingApp.java | 1 +
.../apache/hudi/TestDataSourceUtils.java} | 7 +-
.../hudi/testutils}/DataSourceTestUtils.java | 3 +
.../apache/hudi/HoodieSparkSqlWriterSuite.scala | 52 ---
.../apache/hudi}/TestDataSourceDefaults.scala | 3 +-
.../functional/HoodieSparkSqlWriterSuite.scala | 105 +++++
.../apache/hudi/functional}/TestDataSource.scala | 11 +
hudi-test-suite/README.md | 14 +-
hudi-test-suite/prepare_integration_suite.sh | 2 +-
.../DeltaWriter.java => DeltaWriteClient.java} | 14 +-
.../{job => }/HoodieDeltaStreamerWrapper.java | 2 +-
.../testsuite/{job => }/HoodieTestSuiteJob.java | 29 +-
.../testsuite/configuration/DFSDeltaConfig.java | 8 +-
.../hudi/testsuite/configuration/DeltaConfig.java | 45 +-
.../hudi/testsuite}/converter/Converter.java | 5 +-
.../hudi/testsuite/converter/UpdateConverter.java | 7 +-
.../org/apache/hudi/testsuite/dag/DagUtils.java | 6 +-
.../hudi/testsuite/dag/ExecutionContext.java | 12 +-
.../hudi/testsuite/dag/nodes/BulkInsertNode.java | 8 +-
.../apache/hudi/testsuite/dag/nodes/CleanNode.java | 4 +-
.../hudi/testsuite/dag/nodes/CompactNode.java | 8 +-
.../apache/hudi/testsuite/dag/nodes/DagNode.java | 12 +-
.../hudi/testsuite/dag/nodes/HiveQueryNode.java | 14 +-
.../hudi/testsuite/dag/nodes/HiveSyncNode.java | 8 +-
.../hudi/testsuite/dag/nodes/InsertNode.java | 23 +-
.../hudi/testsuite/dag/nodes/RollbackNode.java | 10 +-
.../testsuite/dag/nodes/ScheduleCompactNode.java | 10 +-
.../testsuite/dag/nodes/SparkSQLQueryNode.java | 10 +-
.../hudi/testsuite/dag/nodes/UpsertNode.java | 14 +-
.../hudi/testsuite/dag/scheduler/DagScheduler.java | 18 +-
.../hudi/testsuite/generator/DeltaGenerator.java | 22 +-
.../GenericRecordFullPayloadGenerator.java | 10 +-
.../testsuite/helpers/HiveServiceProvider.java | 6 +-
.../testsuite/reader/DFSAvroDeltaInputReader.java | 9 +-
.../reader/DFSHoodieDatasetInputReader.java | 16 +-
.../DeltaInputType.java} | 6 +-
...utWriter.java => AvroFileDeltaInputWriter.java} | 50 +-
.../{ => writer}/DFSDeltaWriterAdapter.java | 20 +-
.../{ => writer}/DFSSparkAvroDeltaWriter.java | 8 +-
.../hudi/testsuite/writer/DeltaInputWriter.java | 16 +-
.../DeltaOutputMode.java} | 4 +-
.../{WriteStats.java => DeltaWriteStats.java} | 4 +-
.../testsuite/{ => writer}/DeltaWriterAdapter.java | 8 +-
.../testsuite/{ => writer}/DeltaWriterFactory.java | 22 +-
.../testsuite/writer/FileDeltaInputWriter.java | 37 --
.../writer/SparkAvroDeltaInputWriter.java | 7 +-
...er.java => TestDFSDeltaWriteClientAdapter.java} | 28 +-
.../hudi/testsuite/TestFileDeltaInputWriter.java | 18 +-
.../hudi/testsuite/job/TestHoodieTestSuiteJob.java | 11 +-
.../reader/TestDFSHoodieDatasetInputReader.java | 1 +
...tDeltaWriter.java => TestDeltaWriteClient.java} | 37 +-
.../TestRemoteHoodieTableFileSystemView.java | 2 +-
.../hudi/utilities/HoodieSnapshotCopier.java | 4 +-
.../hudi/utilities/HoodieSnapshotExporter.java | 18 +-
.../keygen/TimestampBasedKeyGenerator.java | 65 ++-
.../sources/helpers/IncrSourceHelper.java | 4 +-
.../utilities/sources/helpers/KafkaOffsetGen.java | 2 +-
.../hudi/utilities/TestHiveIncrementalPuller.java | 15 +-
.../org/apache/hudi/utilities/TestUtilHelpers.java | 48 +-
.../TestKafkaConnectHdfsProvider.java | 4 +-
.../TestSchedulerConfGenerator.java | 20 +-
.../TestAWSDatabaseMigrationServiceSource.java | 19 +-
.../{ => functional}/TestHDFSParquetImporter.java | 44 +-
.../{ => functional}/TestHoodieDeltaStreamer.java | 101 ++--
.../TestHoodieMultiTableDeltaStreamer.java | 80 ++--
.../{ => functional}/TestHoodieSnapshotCopier.java | 7 +-
.../TestHoodieSnapshotExporter.java | 269 +++++------
.../TestJdbcbasedSchemaProvider.java | 16 +-
.../utilities/inline/fs/TestParquetInLining.java | 10 +-
.../TestTimestampBasedKeyGenerator.java | 45 +-
.../hudi/utilities/sources/TestCsvDFSSource.java | 11 +-
.../hudi/utilities/sources/TestDataSource.java | 1 +
.../hudi/utilities/sources/TestJsonDFSSource.java | 11 +-
.../hudi/utilities/sources/TestKafkaSource.java | 22 +-
.../utilities/sources/TestParquetDFSSource.java | 9 +-
.../{ => testutils}/UtilitiesTestBase.java | 23 +-
.../sources/AbstractBaseTestSource.java | 7 +-
.../sources/AbstractDFSSourceTestBase.java | 56 +--
.../sources/DistributedTestDataSource.java | 5 +-
.../sources/config/TestSourceConfig.java | 2 +-
.../transform/TestFlatteningTransformer.java | 4 +-
packaging/hudi-hive-sync-bundle/pom.xml | 19 +
packaging/hudi-presto-bundle/pom.xml | 18 +
pom.xml | 8 -
style/checkstyle.xml | 6 +-
273 files changed, 5248 insertions(+), 4029 deletions(-)
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestHoodieLogFileCommand.java
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestRepairsCommand.java
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/integ/ITTestHDFSParquetImportCommand.java
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/integ/ITTestRepairsCommand.java
copy hudi-cli/src/test/resources/{clean.properties => table-config.properties} (86%)
rename hudi-client/src/main/java/org/apache/hudi/execution/{CopyOnWriteLazyInsertIterable.java => LazyInsertIterable.java} (81%)
delete mode 100644 hudi-client/src/main/java/org/apache/hudi/execution/MergeOnReadLazyInsertIterable.java
copy hudi-client/src/main/java/org/apache/hudi/io/{HoodieIOHandle.java => AppendHandleFactory.java} (60%)
copy hudi-client/src/main/java/org/apache/hudi/io/{HoodieIOHandle.java => CreateHandleFactory.java} (61%)
copy hudi-client/src/main/java/org/apache/hudi/io/{HoodieIOHandle.java => WriteHandleFactory.java} (64%)
rename hudi-client/src/main/java/org/apache/hudi/table/{HoodieCommitArchiveLog.java => HoodieTimelineArchiveLog.java} (94%)
rename hudi-client/src/main/java/org/apache/hudi/table/action/{commit => }/HoodieWriteMetadata.java (98%)
create mode 100644 hudi-client/src/main/java/org/apache/hudi/table/action/compact/CompactHelpers.java
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/HoodieCompactor.java (98%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/HoodieMergeOnReadTableCompactor.java (98%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/OperationResult.java (97%)
create mode 100644 hudi-client/src/main/java/org/apache/hudi/table/action/compact/RunCompactionActionExecutor.java
create mode 100644 hudi-client/src/main/java/org/apache/hudi/table/action/compact/ScheduleCompactionActionExecutor.java
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/BoundedIOCompactionStrategy.java (97%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/BoundedPartitionAwareCompactionStrategy.java (98%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/CompactionStrategy.java (97%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/DayBasedCompactionStrategy.java (98%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/LogFileSizeBasedCompactionStrategy.java (98%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/UnBoundedCompactionStrategy.java (96%)
rename hudi-client/src/main/java/org/apache/hudi/table/{ => action}/compact/strategy/UnBoundedPartitionAwareCompactionStrategy.java (98%)
create mode 100644 hudi-client/src/main/java/org/apache/hudi/table/action/savepoint/SavepointActionExecutor.java
create mode 100644 hudi-client/src/main/java/org/apache/hudi/table/action/savepoint/SavepointHelpers.java
rename hudi-client/src/test/java/org/apache/hudi/table/{ => action}/compact/TestAsyncCompaction.java (76%)
rename hudi-client/src/test/java/org/apache/hudi/table/{ => action}/compact/TestHoodieCompactor.java (77%)
rename hudi-client/src/test/java/org/apache/hudi/table/{ => action}/compact/strategy/TestHoodieCompactionStrategy.java (86%)
rename hudi-common/src/test/java/org/apache/hudi/common/{ => testutils}/HoodieCommonTestHarness.java (90%)
delete mode 100644 hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieCommonTestHarnessJunit5.java
copy hudi-cli/src/main/java/org/apache/hudi/cli/Main.java => hudi-common/src/test/java/org/apache/hudi/common/testutils/NetworkTestUtils.java (68%)
create mode 100644 hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/UseRecordReaderFromInputFormat.java
rename hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/{InputPathHandlerTest.java => TestInputPathHandler.java} (99%)
rename hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/{realtime => hive}/TestHoodieCombineHiveInputFormat.java (95%)
rename hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/{ => testutils}/InputFormatTestUtil.java (99%)
rename hudi-hive-sync/src/test/java/org/apache/hudi/hive/{util => testutils}/HiveTestService.java (99%)
rename hudi-hive-sync/src/test/java/org/apache/hudi/hive/{ => testutils}/TestUtil.java (80%)
rename hudi-spark/src/test/java/{DataSourceUtilsTest.java => org/apache/hudi/TestDataSourceUtils.java} (98%)
rename hudi-spark/src/test/java/{ => org/apache/hudi/testutils}/DataSourceTestUtils.java (98%)
delete mode 100644 hudi-spark/src/test/scala/org/apache/hudi/HoodieSparkSqlWriterSuite.scala
rename hudi-spark/src/test/scala/{ => org/apache/hudi}/TestDataSourceDefaults.scala (99%)
create mode 100644 hudi-spark/src/test/scala/org/apache/hudi/functional/HoodieSparkSqlWriterSuite.scala
rename hudi-spark/src/test/scala/{ => org/apache/hudi/functional}/TestDataSource.scala (96%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{writer/DeltaWriter.java => DeltaWriteClient.java} (93%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{job => }/HoodieDeltaStreamerWrapper.java (98%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{job => }/HoodieTestSuiteJob.java (88%)
rename {hudi-utilities/src/main/java/org/apache/hudi/utilities => hudi-test-suite/src/main/java/org/apache/hudi/testsuite}/converter/Converter.java (96%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{DeltaInputFormat.java => reader/DeltaInputType.java} (88%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/writer/{AvroDeltaInputWriter.java => AvroFileDeltaInputWriter.java} (76%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{ => writer}/DFSDeltaWriterAdapter.java (75%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{ => writer}/DFSSparkAvroDeltaWriter.java (82%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{DeltaOutputType.java => writer/DeltaOutputMode.java} (92%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/writer/{WriteStats.java => DeltaWriteStats.java} (93%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{ => writer}/DeltaWriterAdapter.java (82%)
rename hudi-test-suite/src/main/java/org/apache/hudi/testsuite/{ => writer}/DeltaWriterFactory.java (74%)
delete mode 100644 hudi-test-suite/src/main/java/org/apache/hudi/testsuite/writer/FileDeltaInputWriter.java
rename hudi-test-suite/src/test/java/org/apache/hudi/testsuite/{TestDFSDeltaWriterAdapter.java => TestDFSDeltaWriteClientAdapter.java} (78%)
rename hudi-test-suite/src/test/java/org/apache/hudi/testsuite/writer/{TestDeltaWriter.java => TestDeltaWriteClient.java} (77%)
rename hudi-timeline-service/src/test/java/org/apache/hudi/timeline/{table/view => service/functional}/TestRemoteHoodieTableFileSystemView.java (97%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => deltastreamer}/TestSchedulerConfGenerator.java (68%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestAWSDatabaseMigrationServiceSource.java (89%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestHDFSParquetImporter.java (93%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestHoodieDeltaStreamer.java (94%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestHoodieMultiTableDeltaStreamer.java (68%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestHoodieSnapshotCopier.java (97%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestHoodieSnapshotExporter.java (51%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => functional}/TestJdbcbasedSchemaProvider.java (90%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => keygen}/TestTimestampBasedKeyGenerator.java (74%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => testutils}/UtilitiesTestBase.java (96%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => testutils}/sources/AbstractBaseTestSource.java (96%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => testutils}/sources/AbstractDFSSourceTestBase.java (82%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => testutils}/sources/DistributedTestDataSource.java (95%)
rename hudi-utilities/src/test/java/org/apache/hudi/utilities/{ => testutils}/sources/config/TestSourceConfig.java (96%)