You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/02/15 15:25:00 UTC

[jira] [Updated] (HUDI-1619) Add tests to Multitable delta streamer for more sources and mix of diff sources

     [ https://issues.apache.org/jira/browse/HUDI-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-1619:
--------------------------------------
    Labels: newbie  (was: )

> Add tests to Multitable delta streamer for more sources and mix of diff sources
> -------------------------------------------------------------------------------
>
>                 Key: HUDI-1619
>                 URL: https://issues.apache.org/jira/browse/HUDI-1619
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: DeltaStreamer
>            Reporter: sivabalan narayanan
>            Priority: Major
>              Labels: newbie
>
> Add more tests to Multitable delta streamer for more sources and mix of diff sources.
> Current tests cover only JsonKafkaSource and ParquetSource
> We need more coverage
>  * AvroSoruce
>  * AvroKafkaSource
>  * CsvDFSSource
>  * HiveIncrPullSource
>  * HoodieIncrSource
>  * JsonDFSSource
> I am not sure how much is testable. but worth covering as much as possible. 
> Apart from adding tests for these sources in a homogenous manner, we also need tests in a heterogenous set up. Table1: source type1. Table2: source type2. 
> For eg, ParquetDFSSource and CsvDFSSource. 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)