You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/02/15 15:25:00 UTC
[jira] [Updated] (HUDI-1619) Add tests to Multitable delta streamer
for more sources and mix of diff sources
[ https://issues.apache.org/jira/browse/HUDI-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
sivabalan narayanan updated HUDI-1619:
--------------------------------------
Labels: newbie (was: )
> Add tests to Multitable delta streamer for more sources and mix of diff sources
> -------------------------------------------------------------------------------
>
> Key: HUDI-1619
> URL: https://issues.apache.org/jira/browse/HUDI-1619
> Project: Apache Hudi
> Issue Type: Improvement
> Components: DeltaStreamer
> Reporter: sivabalan narayanan
> Priority: Major
> Labels: newbie
>
> Add more tests to Multitable delta streamer for more sources and mix of diff sources.
> Current tests cover only JsonKafkaSource and ParquetSource
> We need more coverage
> * AvroSoruce
> * AvroKafkaSource
> * CsvDFSSource
> * HiveIncrPullSource
> * HoodieIncrSource
> * JsonDFSSource
> I am not sure how much is testable. but worth covering as much as possible.
> Apart from adding tests for these sources in a homogenous manner, we also need tests in a heterogenous set up. Table1: source type1. Table2: source type2.
> For eg, ParquetDFSSource and CsvDFSSource.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)