[jira] [Updated] (HUDI-1619) Add tests to Multitable delta streamer for more sources and mix of diff sources

["Raymond Xu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raymond Xu updated HUDI-1619:
-----------------------------
    Labels:   (was: newbie)

> Add tests to Multitable delta streamer for more sources and mix of diff sources
> -------------------------------------------------------------------------------
>
>                 Key: HUDI-1619
>                 URL: https://issues.apache.org/jira/browse/HUDI-1619
>             Project: Apache Hudi
>          Issue Type: Test
>          Components: deltastreamer
>            Reporter: sivabalan narayanan
>            Assignee: Pratyaksh Sharma
>            Priority: Major
>
> Add more tests to Multitable delta streamer for more sources and mix of diff sources.
> Current tests cover only JsonKafkaSource and ParquetSource
> We need more coverage
>  * AvroSoruce
>  * AvroKafkaSource
>  * CsvDFSSource
>  * HiveIncrPullSource
>  * HoodieIncrSource
>  * JsonDFSSource
> I am not sure how much is testable. but worth covering as much as possible. 
> Recently added tests for ParquetDFSSource: [https://github.com/apache/hudi/pull/2577.] Tried my best to templatize tests. Would be nice to re-use code as much as possible. 
> Apart from adding tests for these sources in a homogenous manner, we also need tests in a heterogenous set up. Table1: source type1. Table2: source type2. 
> For eg, ParquetDFSSource and CsvDFSSource. 
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)