You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Nishith Agarwal (Jira)" <ji...@apache.org> on 2020/04/22 23:19:00 UTC

[jira] [Created] (HUDI-829) Reading Hudi tables through spark-shell slow (even with spark.sql.hive.convertMetastoreParquet)

Nishith Agarwal created HUDI-829:
------------------------------------

             Summary: Reading Hudi tables through spark-shell slow (even with spark.sql.hive.convertMetastoreParquet) 
                 Key: HUDI-829
                 URL: https://issues.apache.org/jira/browse/HUDI-829
             Project: Apache Hudi (incubating)
          Issue Type: Task
          Components: Spark Integration
            Reporter: Nishith Agarwal
            Assignee: Nishith Agarwal


[~uditme] Created this ticket to track some discussion on read/query path of spark with Hudi tables. 

My understanding is that when you read Hudi tables through spark-shell, some of your queries are slower due to some sequential activity performed by spark when interacting with Hudi tables. Can you please elaborate on this ? 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)