You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/04/16 01:47:00 UTC

[jira] [Created] (HUDI-3891) Investigate Hudi vs Raw Parquet table discrepancy

Alexey Kudinkin created HUDI-3891:
-------------------------------------

             Summary: Investigate Hudi vs Raw Parquet table discrepancy
                 Key: HUDI-3891
                 URL: https://issues.apache.org/jira/browse/HUDI-3891
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Alexey Kudinkin
            Assignee: Alexey Kudinkin


While benchmarking querying raw Parquet tables against Hudi tables, i've run the test against the same (Hudi) table:
 # In one query path i'm reading it as just a raw Parquet table
 # In another, i'm reading it as Hudi RO (read_optimized) table


Surprisingly enough, those 2 diverge in the # of files being read:

 
_Raw Parquet_
!https://t18029943.p.clickup-attachments.com/t18029943/f700a129-35bc-4aaa-948c-9495392653f2/Screen%20Shot%202022-04-15%20at%205.20.41%20PM.png!
 
_Hudi_
!https://t18029943.p.clickup-attachments.com/t18029943/d063c689-a254-45cf-8ba5-07fc88b354b6/Screen%20Shot%202022-04-15%20at%205.21.33%20PM.png!



--
This message was sent by Atlassian Jira
(v8.20.1#820001)