You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2020/06/08 17:57:00 UTC

[jira] [Commented] (HUDI-996) Use shared spark session provider

    [ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128497#comment-17128497 ] 

Raymond Xu commented on HUDI-996:
---------------------------------

Notes by [~garyli1019]

hudi-client unit tests are the most time-consuming test module and not stable. We initialize and clean up resources for every single unit test, which is inefficient. We can refactor the hudi-client test structure to run more tests in one initialization.

> Use shared spark session provider 
> ----------------------------------
>
>                 Key: HUDI-996
>                 URL: https://issues.apache.org/jira/browse/HUDI-996
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: Testing
>            Reporter: Raymond Xu
>            Priority: Major
>
> * implement a shared spark session provider to be used for test suites, setup and tear down less spark sessions and other mini servers
>  * add functional tests with similar setup logic to test suites, to make use of shared spark session



--
This message was sent by Atlassian Jira
(v8.3.4#803005)