You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by na...@apache.org on 2020/06/18 15:29:11 UTC
[hudi] branch hudi_test_suite_refactor updated (27f1517 -> 44fc2f0)
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a change to branch hudi_test_suite_refactor
in repository https://gitbox.apache.org/repos/asf/hudi.git.
discard 27f1517 addressing CR comments part 2
discard 21c7106 addressing CR comments
discard c4471f1 [HUDI-989] Support long options for prepare_integration_suite (#1699)
omit 6a0f419 [HUDI-593] Use scala_version placeholder to replace scala version hard code (#1685)
omit ffd1d02 [HUDI-394] Provide a basic implementation of test suite
add 45acccd [MINOR] Remove incubating from README
add d3edac4 HUDI-921 Remove inlineCompactionEvery method in HoodieCompactionConfig.Builder (#1654)
add f22c3e9 [HUDI-926] Removing DISCLAIMER from the repo (#1657)
add 492f324 [HUDI-938] Removing incubating/incubator from project (#1658)
add 46572d0 [MINOR] Fix PMC tag in doap file (#1666)
add 6c45095 [HUDI-690] Filter out inflight compaction in exporter (#1667)
add 9697fbf [HUDI-936] Fix fetch ordering val in HoodieSparkSqlWriter to remove unnecessary conversion to String (#1659)
add 03f1363 [HUDI-811] Restructure test packages in hudi-common (#1644)
add bde7a70 [HUDI-476]: Add hudi-examples module (#1151)
add 3574a89 [HUDI-973] RemoteHoodieTableFileSystemView supports non-partitioned table queries (#1674)
add 5a0d3f1 [HUDI-786] Fixing read beyond inline length in InlineFS (#1616)
add 7fb1251 [HUDI-980] Fixing dir path for metastore_db and derby.logs generated in hive tests (#1688)
add 1a9fef4 Fixing binary file checks and disclaimer file checks (#1691)
add 8cb86b4 Added python3 to the spark_base docker image to support pyspark (#1632)
add 7c59095 [HUDI-975] Add unit tests in TestHoodieTableFileSystemView to test view for non-partitioned table (#1692)
add 742c204 [HUDI-811] Restructure test packages in hudi-client/cli (#1689)
add a9a97d6 [HUDI-934] Add processing logic for the decimal LogicalType (#1677)
add a68180b [HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly. Fix bug in TestRollbacks. Make CLI unit tests for Hudi CLI check skip redering strings
add fb28393 [HUDI-990] Timeline API : filterCompletedAndCompactionInstants needs to handle requested state correctly. Also ensure timeline gets reloaded after we revert committed transactions
add e9cab67 [HUDI-988] Fix More Unit Test Flakiness
add e0a5e0d [HUDI-1000] Fix incremental query for COW non-partitioned table with no data (#1708)
add 2901f54 [HUDI-1002] Ignore case when setting incremental mode in hive query (#1715)
add 97ab97b [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug (#1652)
add 7d40f19 HUDI-515 Resolve API conflict for Hive 2 & Hive 3
add 9e07ceb [HUDI-974] Fix fields out of order in MOR mode when using Hive (#1711)
add 22cd824 HUDI-494 fix incorrect record size estimation
add 6318e94 [HUDI-1016] Code optimization in MergeOnReadRollbackActionExecutor(#1718)
add 3387b38 [HUDI-1005] fix NPE in HoodieWriteClient.clean
add 37838ce [HUDI-822] decouple Hudi related logics from HoodieInputFormat (#1592)
add df2e0c7 HUDI-942 Increase default value number of delta commits for inline compaction (#1664)
add a7fd331 Add unit test for snapshot reads in hadoop-mr
add fcabc8f [HUDI-1019] Clean refresh command in CLI (#1725)
add 31ef4ac [MINOR] Fix the ordered list for the hudi-examples README file (#1733)
add ede6c9b [HUDI-1006] Deltastreamer use kafkaSource with offset reset strategy:latest can't consume data (#1719)
add 043eb56 [HUDI-1003] Handle partitions correctly for syncing hudi non-parititioned table to hive (#1720)
add 2a04647 [MINOR] Updating doap file for 0.5.3 release (#1740)
add 5099a91 [HUDI-709] Add unit test for UtilsCommand (#1686)
add f3a7017 [HUDI-696] Add unit test for CommitsCommand (#1724)
add 44fc2f0 [HUDI-394] Provide a basic implementation of test suite
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (27f1517)
\
N -- N -- N refs/heads/hudi_test_suite_refactor (44fc2f0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
DISCLAIMER | 10 -
NOTICE | 2 +-
README.md | 10 +-
doap_HUDI.rdf | 15 +-
docker/demo/compaction.commands | 2 +-
docker/hoodie/hadoop/spark_base/Dockerfile | 6 +
.../apache/hudi/cli/HoodieTableHeaderFields.java | 31 +-
.../apache/hudi/cli/commands/CleansCommand.java | 6 -
.../apache/hudi/cli/commands/CommitsCommand.java | 92 +++---
.../apache/hudi/cli/commands/RepairsCommand.java | 2 +-
.../apache/hudi/cli/commands/RollbacksCommand.java | 2 +-
.../hudi/cli/commands/SavepointsCommand.java | 12 +-
.../org/apache/hudi/cli/commands/SparkMain.java | 6 +-
.../org/apache/hudi/cli/commands/TableCommand.java | 10 +
.../org/apache/hudi/cli/commands/UtilsCommand.java | 15 +-
.../cli/commands/TestArchivedCommitsCommand.java | 18 +-
.../hudi/cli/commands/TestCleansCommand.java | 12 +-
.../hudi/cli/commands/TestCommitsCommand.java | 320 +++++++++++++++++++++
.../cli/commands/TestFileSystemViewCommand.java | 16 +-
.../cli/commands/TestHoodieLogFileCommand.java | 39 +--
.../hudi/cli/commands/TestRepairsCommand.java | 39 +--
.../hudi/cli/commands/TestRollbacksCommand.java | 20 +-
.../hudi/cli/commands/TestSavepointsCommand.java | 10 +-
.../hudi/cli/commands/TestSparkEnvCommand.java | 10 +-
.../apache/hudi/cli/commands/TestStatsCommand.java | 24 +-
.../apache/hudi/cli/commands/TestTableCommand.java | 54 +++-
.../apache/hudi/cli/commands/TestUtilsCommand.java | 77 +++++
.../apache/hudi/cli/integ/ITTestCleansCommand.java | 4 +-
.../hudi/cli/integ/ITTestCommitsCommand.java | 98 +++++++
.../cli/integ/ITTestHDFSParquetImportCommand.java | 15 +-
.../hudi/cli/integ/ITTestRepairsCommand.java | 19 +-
.../hudi/cli/integ/ITTestSavepointsCommand.java | 5 +-
.../AbstractShellIntegrationTest.java | 13 +-
.../HoodieTestCommitMetadataGenerator.java | 6 +-
.../HoodieTestCommitUtilities.java | 2 +-
.../org/apache/hudi/client/HoodieWriteClient.java | 9 +-
.../client/embedded/EmbeddedTimelineService.java | 4 +-
.../apache/hudi/config/HoodieCompactionConfig.java | 20 +-
.../org/apache/hudi/config/HoodieWriteConfig.java | 4 +
.../apache/hudi/table/HoodieCopyOnWriteTable.java | 31 --
.../table/action/commit/UpsertPartitioner.java | 9 +-
.../CopyOnWriteRollbackActionExecutor.java | 2 +
.../MergeOnReadRollbackActionExecutor.java | 9 +-
hudi-client/src/test/java/HoodieClientExample.java | 144 ----------
.../org/apache/hudi/client/TestClientRollback.java | 7 +-
.../hudi/client/TestCompactionAdminClient.java | 15 +-
.../TestHoodieClientOnCopyOnWriteStorage.java | 23 +-
.../apache/hudi/client/TestHoodieReadClient.java | 3 +-
.../java/org/apache/hudi/client/TestMultiFS.java | 16 +-
.../hudi/client/TestTableSchemaEvolution.java | 37 +--
.../hudi/client/TestUpdateSchemaEvolution.java | 11 +-
.../{common => }/config/TestHoodieWriteConfig.java | 4 +-
.../hudi/execution/TestBoundedInMemoryQueue.java | 7 +-
....java => TestSparkBoundedInMemoryExecutor.java} | 8 +-
.../org/apache/hudi/index/TestHoodieIndex.java | 24 +-
.../hudi/index/bloom/TestHoodieBloomIndex.java | 10 +-
.../index/bloom/TestHoodieGlobalBloomIndex.java | 11 +-
.../TestHBaseIndex.java} | 38 ++-
.../{ => hbase}/TestHBaseQPSResourceAllocator.java | 12 +-
.../apache/hudi/io/TestHoodieCommitArchiveLog.java | 9 +-
.../hudi/io/TestHoodieKeyLocationFetchHandle.java | 16 +-
.../org/apache/hudi/io/TestHoodieMergeHandle.java | 19 +-
.../io/storage/TestHoodieStorageWriterFactory.java | 6 +-
.../java/org/apache/hudi/table/TestCleaner.java | 12 +-
.../apache/hudi/table/TestConsistencyGuard.java | 6 +-
...dTable.java => TestHoodieMergeOnReadTable.java} | 249 ++++++++--------
.../apache/hudi/table/TestHoodieRecordSizing.java | 116 --------
.../commit/TestCopyOnWriteActionExecutor.java | 52 +---
.../table/action/commit/TestUpsertPartitioner.java | 118 ++++++--
.../table/action/compact/TestAsyncCompaction.java | 14 +-
.../table/action/compact/TestHoodieCompactor.java | 18 +-
.../HoodieClientTestBase.java} | 139 ++++-----
.../HoodieClientTestHarness.java | 97 ++++++-
.../HoodieClientTestUtils.java | 4 +-
.../HoodieMergeOnReadTestUtils.java | 6 +-
.../HoodieTestDataGenerator.java | 12 +-
.../{common => testutils}/TestRawTripPayload.java | 2 +-
.../common/fs/inline/InLineFsDataInputStream.java | 26 +-
.../hudi/common/model/HoodieAvroPayload.java | 5 +
.../hudi/common/table/log/HoodieLogFileReader.java | 8 +-
.../table/timeline/HoodieDefaultTimeline.java | 6 +-
.../table/view/FileSystemViewStorageConfig.java | 21 ++
.../table/view/HoodieTableFileSystemView.java | 6 +
.../org/apache/hudi/common/fs/TestFSUtils.java | 2 +-
.../common/{storage => fs}/TestStorageSchemes.java | 4 +-
.../common/fs/inline/TestInLineFileSystem.java | 57 ++--
...java => TestInLineFileSystemHFileInLining.java} | 14 +-
.../common/fs/inline/TestInMemoryFileSystem.java | 4 +-
.../log => functional}/TestHoodieLogFormat.java | 13 +-
.../TestHoodieLogFormatAppendFailure.java | 9 +-
.../common/model/TestHoodieCommitMetadata.java | 1 +
.../apache/hudi/common/model/TestHoodieRecord.java | 3 +-
.../common/table/TestHoodieTableMetaClient.java | 3 +-
.../table/timeline/TestHoodieActiveTimeline.java | 5 +-
.../table/{ => timeline}/TestTimelineLayout.java | 5 +-
.../table/view/TestHoodieTableFileSystemView.java | 20 +-
.../view/TestPriorityBasedFileSystemView.java | 2 +-
.../table/view/TestRocksDbBasedFileSystemView.java | 3 +-
.../view/TestSpillableMapBasedFileSystemView.java | 3 +-
...TestSpillableMapBasedIncrementalFSViewSync.java | 2 +-
.../AvroBinaryTestPayload.java | 3 +-
.../{util => testutils}/CompactionTestUtils.java | 8 +-
.../inline => testutils}/FileSystemTestUtils.java | 12 +-
.../common/testutils/HoodieCommonTestHarness.java | 1 -
.../{model => testutils}/HoodieTestUtils.java | 17 +-
.../timeline => testutils}/MockHoodieTimeline.java | 6 +-
.../SampleTestRecord.java} | 8 +-
.../common/{util => testutils}/SchemaTestUtil.java | 7 +-
.../{util => testutils}/SpillableMapTestUtils.java | 3 +-
.../minicluster/HdfsTestService.java | 4 +-
.../minicluster/MiniClusterUtil.java | 2 +-
.../minicluster/ZookeeperTestService.java | 2 +-
.../hudi/common/util/TestCompactionUtils.java | 12 +-
.../util/TestDFSPropertiesConfiguration.java | 2 +-
.../apache/hudi/common/util/TestParquetUtils.java | 2 +-
.../common/util/collection/TestDiskBasedMap.java | 8 +-
.../util/collection/TestExternalSpillableMap.java | 4 +-
...TestRocksDBManager.java => TestRocksDBDAO.java} | 4 +-
.../util/collection/TestRocksDbBasedMap.java | 4 +-
hudi-examples/README.md | 45 +++
.../bin/custom-delta-streamer-example.sh | 21 +-
hudi-examples/bin/dfs-delta-streamer-example.sh | 35 +++
hudi-examples/bin/hudi-delta-streamer | 39 +++
hudi-examples/bin/kafka-delta-streamer-example.sh | 36 +++
{hudi-cli => hudi-examples}/pom.xml | 187 ++++--------
.../examples/common/ExampleDataSchemaProvider.java | 22 +-
.../common/HoodieExampleDataGenerator.java | 186 ++++++++++++
.../examples/common/HoodieExampleSparkUtils.java | 60 ++++
.../hudi/examples/common/IdentityTransformer.java | 22 +-
.../hudi/examples/common/RandomJsonSource.java | 36 +--
.../examples/spark/HoodieWriteClientExample.java | 133 +++++++++
.../delta-streamer-config/dfs/source-file.json | 10 +
.../kafka/kafka-source.properties | 20 +-
.../examples/spark/HoodieDataSourceExample.scala | 173 +++++++++++
.../hudi/hadoop/HoodieParquetInputFormat.java | 236 ++-------------
.../hudi/hadoop/HoodieROTablePathFilter.java | 3 +-
.../org/apache/hudi/hadoop/InputPathHandler.java | 4 +-
.../hudi/hadoop/config/HoodieRealtimeConfig.java | 42 +++
.../hadoop/hive/HoodieCombineHiveInputFormat.java | 43 ++-
.../realtime/AbstractRealtimeRecordReader.java | 261 +----------------
.../HoodieCombineRealtimeRecordReader.java | 3 +-
.../realtime/HoodieParquetRealtimeInputFormat.java | 106 +------
.../realtime/RealtimeCompactedRecordReader.java | 35 ++-
.../realtime/RealtimeUnmergedRecordReader.java | 8 +-
.../HoodieHiveUtils.java} | 8 +-
.../HoodieInputFormatUtils.java} | 302 ++++++++++---------
.../utils/HoodieRealtimeInputFormatUtils.java | 154 ++++++++++
.../HoodieRealtimeRecordReaderUtils.java} | 236 ++++-----------
.../hudi/hadoop/TestHoodieParquetInputFormat.java | 62 +++-
.../hudi/hadoop/TestHoodieROTablePathFilter.java | 2 +-
.../apache/hudi/hadoop/TestInputPathHandler.java | 2 +-
.../TestHoodieCombineHiveInputFormat.java | 9 +-
.../realtime/TestHoodieRealtimeRecordReader.java | 7 +-
.../hudi/hadoop/testutils/InputFormatTestUtil.java | 14 +-
.../java/org/apache/hudi/hive/HiveSyncTool.java | 6 +
.../org/apache/hudi/hive/TestHiveSyncTool.java | 255 ++++++++--------
.../hudi/hive/testutils/HiveTestService.java | 7 +-
.../testutils/{TestUtil.java => HiveTestUtil.java} | 8 +-
.../org/apache/hudi/integ/ITTestHoodieDemo.java | 2 +-
.../org/apache/hudi/HoodieSparkSqlWriter.scala | 4 +-
hudi-spark/src/test/java/HoodieJavaApp.java | 7 +-
.../src/test/java/HoodieJavaStreamingApp.java | 2 +-
.../apache/hudi/testutils/DataSourceTestUtils.java | 1 -
.../org/apache/hudi/TestDataSourceDefaults.scala | 3 +-
.../apache/hudi/functional/TestDataSource.scala | 3 +-
.../timeline/service/FileSystemViewHandler.java | 26 +-
.../hudi/utilities/HoodieSnapshotCopier.java | 4 +-
.../hudi/utilities/HoodieSnapshotExporter.java | 5 +-
.../hudi/utilities/deltastreamer/DeltaSync.java | 5 +-
.../hudi/utilities/sources/AvroKafkaSource.java | 5 +-
.../hudi/utilities/sources/JsonKafkaSource.java | 4 +-
.../utilities/sources/helpers/KafkaOffsetGen.java | 9 +-
.../TestKafkaConnectHdfsProvider.java | 2 +-
.../functional/TestHDFSParquetImporter.java | 8 +-
.../functional/TestHoodieDeltaStreamer.java | 2 +-
.../TestHoodieMultiTableDeltaStreamer.java | 2 +-
.../functional/TestHoodieSnapshotCopier.java | 4 +-
.../functional/TestHoodieSnapshotExporter.java | 4 +-
.../utilities/inline/fs/TestParquetInLining.java | 10 +-
.../keygen/TestTimestampBasedKeyGenerator.java | 2 +-
.../hudi/utilities/sources/TestKafkaSource.java | 45 ++-
.../utilities/testutils/UtilitiesTestBase.java | 8 +-
.../testutils/sources/AbstractBaseTestSource.java | 2 +-
.../sources/AbstractDFSSourceTestBase.java | 2 +-
pom.xml | 24 +-
scripts/release/cut_release_branch.sh | 12 +-
scripts/release/preparation_before_release.sh | 4 +-
scripts/release/validate_staged_release.sh | 30 +-
188 files changed, 3318 insertions(+), 2467 deletions(-)
delete mode 100644 DISCLAIMER
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestCommitsCommand.java
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestUtilsCommand.java
create mode 100644 hudi-cli/src/test/java/org/apache/hudi/cli/integ/ITTestCommitsCommand.java
rename hudi-cli/src/test/java/org/apache/hudi/cli/{ => testutils}/AbstractShellIntegrationTest.java (82%)
rename hudi-cli/src/test/java/org/apache/hudi/cli/{common => testutils}/HoodieTestCommitMetadataGenerator.java (97%)
rename hudi-cli/src/test/java/org/apache/hudi/cli/{common => testutils}/HoodieTestCommitUtilities.java (98%)
delete mode 100644 hudi-client/src/test/java/HoodieClientExample.java
rename hudi-client/src/test/java/org/apache/hudi/{common => }/config/TestHoodieWriteConfig.java (94%)
rename hudi-client/src/test/java/org/apache/hudi/execution/{TestBoundedInMemoryExecutor.java => TestSparkBoundedInMemoryExecutor.java} (93%)
rename hudi-client/src/test/java/org/apache/hudi/index/{TestHbaseIndex.java => hbase/TestHBaseIndex.java} (95%)
rename hudi-client/src/test/java/org/apache/hudi/index/{ => hbase}/TestHBaseQPSResourceAllocator.java (94%)
rename hudi-client/src/test/java/org/apache/hudi/table/{TestMergeOnReadTable.java => TestHoodieMergeOnReadTable.java} (86%)
delete mode 100644 hudi-client/src/test/java/org/apache/hudi/table/TestHoodieRecordSizing.java
rename hudi-client/src/test/java/org/apache/hudi/{client/TestHoodieClientBase.java => testutils/HoodieClientTestBase.java} (78%)
rename hudi-client/src/test/java/org/apache/hudi/{common => testutils}/HoodieClientTestHarness.java (72%)
rename hudi-client/src/test/java/org/apache/hudi/{common => testutils}/HoodieClientTestUtils.java (99%)
rename hudi-client/src/test/java/org/apache/hudi/{common => testutils}/HoodieMergeOnReadTestUtils.java (98%)
rename hudi-client/src/test/java/org/apache/hudi/{common => testutils}/HoodieTestDataGenerator.java (98%)
rename hudi-client/src/test/java/org/apache/hudi/{common => testutils}/TestRawTripPayload.java (99%)
rename hudi-common/src/test/java/org/apache/hudi/common/{storage => fs}/TestStorageSchemes.java (95%)
rename hudi-common/src/test/java/org/apache/hudi/common/fs/inline/{TestHFileInLining.java => TestInLineFileSystemHFileInLining.java} (95%)
rename hudi-common/src/test/java/org/apache/hudi/common/{table/log => functional}/TestHoodieLogFormat.java (99%)
rename hudi-common/src/test/java/org/apache/hudi/common/{table/log => functional}/TestHoodieLogFormatAppendFailure.java (95%)
rename hudi-common/src/test/java/org/apache/hudi/common/table/{ => timeline}/TestTimelineLayout.java (95%)
rename hudi-common/src/test/java/org/apache/hudi/common/{model => testutils}/AvroBinaryTestPayload.java (95%)
rename hudi-common/src/test/java/org/apache/hudi/common/{util => testutils}/CompactionTestUtils.java (97%)
rename hudi-common/src/test/java/org/apache/hudi/common/{fs/inline => testutils}/FileSystemTestUtils.java (87%)
rename hudi-common/src/test/java/org/apache/hudi/common/{model => testutils}/HoodieTestUtils.java (96%)
rename hudi-common/src/test/java/org/apache/hudi/common/{table/timeline => testutils}/MockHoodieTimeline.java (86%)
rename hudi-common/src/test/java/org/apache/hudi/common/{util/TestRecord.java => testutils/SampleTestRecord.java} (94%)
rename hudi-common/src/test/java/org/apache/hudi/common/{util => testutils}/SchemaTestUtil.java (97%)
rename hudi-common/src/test/java/org/apache/hudi/common/{util => testutils}/SpillableMapTestUtils.java (96%)
rename hudi-common/src/test/java/org/apache/hudi/common/{ => testutils}/minicluster/HdfsTestService.java (97%)
rename hudi-common/src/test/java/org/apache/hudi/common/{ => testutils}/minicluster/MiniClusterUtil.java (97%)
rename hudi-common/src/test/java/org/apache/hudi/common/{ => testutils}/minicluster/ZookeeperTestService.java (99%)
rename hudi-common/src/test/java/org/apache/hudi/common/util/collection/{TestRocksDBManager.java => TestRocksDBDAO.java} (99%)
create mode 100644 hudi-examples/README.md
copy hudi-cli/hudi-cli.sh => hudi-examples/bin/custom-delta-streamer-example.sh (52%)
create mode 100755 hudi-examples/bin/dfs-delta-streamer-example.sh
create mode 100755 hudi-examples/bin/hudi-delta-streamer
create mode 100755 hudi-examples/bin/kafka-delta-streamer-example.sh
copy {hudi-cli => hudi-examples}/pom.xml (55%)
copy hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JsonSource.java => hudi-examples/src/main/java/org/apache/hudi/examples/common/ExampleDataSchemaProvider.java (68%)
create mode 100644 hudi-examples/src/main/java/org/apache/hudi/examples/common/HoodieExampleDataGenerator.java
create mode 100644 hudi-examples/src/main/java/org/apache/hudi/examples/common/HoodieExampleSparkUtils.java
copy hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JsonSource.java => hudi-examples/src/main/java/org/apache/hudi/examples/common/IdentityTransformer.java (67%)
copy hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JsonDFSSource.java => hudi-examples/src/main/java/org/apache/hudi/examples/common/RandomJsonSource.java (54%)
create mode 100644 hudi-examples/src/main/java/org/apache/hudi/examples/spark/HoodieWriteClientExample.java
create mode 100644 hudi-examples/src/main/resources/delta-streamer-config/dfs/source-file.json
copy hudi-client/src/main/resources/log4j.properties => hudi-examples/src/main/resources/delta-streamer-config/kafka/kafka-source.properties (68%)
create mode 100644 hudi-examples/src/main/scala/org/apache/hudi/examples/spark/HoodieDataSourceExample.scala
create mode 100644 hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/config/HoodieRealtimeConfig.java
rename hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/{HoodieHiveUtil.java => utils/HoodieHiveUtils.java} (96%)
copy hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/{HoodieParquetInputFormat.java => utils/HoodieInputFormatUtils.java} (58%)
create mode 100644 hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
copy hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/{realtime/AbstractRealtimeRecordReader.java => utils/HoodieRealtimeRecordReaderUtils.java} (57%)
rename hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/{hive => functional}/TestHoodieCombineHiveInputFormat.java (95%)
rename hudi-hive-sync/src/test/java/org/apache/hudi/hive/testutils/{TestUtil.java => HiveTestUtil.java} (98%)