You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Shilun Fan (Jira)" <ji...@apache.org> on 2023/01/31 14:51:00 UTC

[jira] [Created] (HUDI-5664) Improve SqlQueryPreCommitValidator#queries Parallelism

Shilun Fan created HUDI-5664:
--------------------------------

             Summary: Improve SqlQueryPreCommitValidator#queries Parallelism
                 Key: HUDI-5664
                 URL: https://issues.apache.org/jira/browse/HUDI-5664
             Project: Apache Hudi
          Issue Type: Improvement
          Components: cli
            Reporter: Shilun Fan


I found that SqlQueryPreCommitValidator#validateRecordsBeforeAndAfter has a todo

// TODO run this in a thread pool to improve parallelism

I think we can improve it using List's parallelStream



--
This message was sent by Atlassian Jira
(v8.20.10#820010)