You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/07/07 03:24:37 UTC

[GitHub] [hudi] zherenyu831 edited a comment on issue #1798: Question reading partition path with less level is more faster than what document mentioned

zherenyu831 edited a comment on issue #1798:
URL: https://github.com/apache/hudi/issues/1798#issuecomment-654575639


   @bhasudha 
   It is very simple query 
   ```
   //val df = spark.read.format("org.apache.hudi").load("s3://test/data/*/*/*/*")
   val df = spark.read.format("org.apache.hudi").load("s3://test/data/*/*/*")
   val updatedDf  = df.filter("_hoodie_commit_time between '${_hoodieCommitTimeStart}' and '${_hoodieCommitTimeEnd}'")
   ```
   and we found it cost a lot of time on resolve relation of parquet files.
   so we do the test as I mentioned 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org