You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/11/21 17:53:00 UTC

[jira] [Created] (HUDI-5254) Revisit ExpressionPayload to avoid parsing Avro schemas for every record

Alexey Kudinkin created HUDI-5254:
-------------------------------------

             Summary: Revisit ExpressionPayload to avoid parsing Avro schemas for every record
                 Key: HUDI-5254
                 URL: https://issues.apache.org/jira/browse/HUDI-5254
             Project: Apache Hudi
          Issue Type: Bug
          Components: spark-sql
            Reporter: Alexey Kudinkin
             Fix For: 0.13.0


Currently ExpressionPayload, parses writer/reader schema for every record.

Instead we should use broadcast vars to avoid doing that for every record, and instead do it per executor



--
This message was sent by Atlassian Jira
(v8.20.10#820010)