You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Tao Meng (Jira)" <ji...@apache.org> on 2022/03/29 07:03:00 UTC

[jira] [Created] (HUDI-3742) Enable parquet enableVectorizedReader for spark incremental read to prevent pef regression

Tao Meng created HUDI-3742:
------------------------------

             Summary: Enable parquet  enableVectorizedReader for spark incremental read to prevent pef regression
                 Key: HUDI-3742
                 URL: https://issues.apache.org/jira/browse/HUDI-3742
             Project: Apache Hudi
          Issue Type: Improvement
          Components: spark
            Reporter: Tao Meng
             Fix For: 0.11.0


now we disable parquet  enableVectorizedReader for mor incremental read，

and set "spark.sql.parquet.recordLevelFilter.enabled" = "true"  to achieve data filter

which is slow



--
This message was sent by Atlassian Jira
(v8.20.1#820001)