You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "leesf (Jira)" <ji...@apache.org> on 2022/06/03 14:47:00 UTC

[jira] [Comment Edited] (HUDI-4178) HoodieSpark3Analysis does not pass schema from Spark Catalog

    [ https://issues.apache.org/jira/browse/HUDI-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545899#comment-17545899 ] 

leesf edited comment on HUDI-4178 at 6/3/22 2:46 PM:
-----------------------------------------------------

[~alexey.kudinkin] hi, `making them fetch the schema from storage (either from commit's metadata or data file) every time.` means fetch only once schema for a write operation or fetch many times for a write operation? and how much performance it affects while fetching from storage?


was (Author: xleesf):
[~alexey.kudinkin] `making them fetch the schema from storage (either from commit's metadata or data file) every time.` means fetch only once schema for a write operation or fetch many times for a write operation? and how much performance it affects while fetching from storage?

> HoodieSpark3Analysis does not pass schema from Spark Catalog
> ------------------------------------------------------------
>
>                 Key: HUDI-4178
>                 URL: https://issues.apache.org/jira/browse/HUDI-4178
>             Project: Apache Hudi
>          Issue Type: Bug
>    Affects Versions: 0.11.0
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.11.1
>
>
> Currently, HoodieSpark3Analysis rule does not pass table's schema from the Spark Catalog to Hudi's relations making them fetch the schema from storage (either from commit's metadata or data file) every time.
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)