You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2022/08/05 21:19:00 UTC

[jira] [Commented] (HUDI-4540) Cover all query types in functional tests of Spark structured streaming

    [ https://issues.apache.org/jira/browse/HUDI-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576050#comment-17576050 ] 

Ethan Guo commented on HUDI-4540:
---------------------------------

Based on the code and [https://github.com/apache/hudi/issues/3724|https://github.com/apache/hudi/issues/3724.], the Hudi source in Spark structured streaming does not really support the stream from a particular instant.  So there is nothing to add in TestStreamingSource.

> Cover all query types in functional tests of Spark structured streaming
> -----------------------------------------------------------------------
>
>                 Key: HUDI-4540
>                 URL: https://issues.apache.org/jira/browse/HUDI-4540
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: tests-ci
>            Reporter: Ethan Guo
>            Assignee: Ethan Guo
>            Priority: Blocker
>              Labels: test
>             Fix For: 0.12.0
>
>
> TestStructuredStreaming tests the streaming sink with table services.  TestStreamingSource tests the source but does not cover all query types.   We should add functional tests there to increase the coverage, so there is no need to manually test that going forward.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)