[jira] [Commented] (HUDI-781) Re-design test utilities

["Raymond Xu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083451#comment-17083451 ] 

Raymond Xu commented on HUDI-781:
---------------------------------

[~vinothchandar] [~yanghua] Before we consider re-design some test utilities, I think it will be easier to just move classes and categorize them. I'm thinking adding these 2 packages under each module

* functional/ contains test cases that require spark context and local servers
* testutils/ contains all test utilities for that module

all other test packages should only contain pure-logic unit tests

As for RFC, guess it's not very necessary at the moment for the restructuring. WDYT?

> Re-design test utilities
> ------------------------
>
>                 Key: HUDI-781
>                 URL: https://issues.apache.org/jira/browse/HUDI-781
>             Project: Apache Hudi (incubating)
>          Issue Type: Improvement
>          Components: Testing
>            Reporter: Raymond Xu
>            Priority: Major
>
> Test utility classes are to re-designed with considerations like
>  * Use more mockings
>  * Reduce spark context setup
>  * Improve/clean up data generator
> An RFC would be preferred for illustrating the design work.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)