You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/01/25 06:53:54 UTC

[GitHub] [hudi] vinothchandar commented on issue #1829: [SUPPORT] S3 slow file listing causes Hudi read performance.

vinothchandar commented on issue #1829:
URL: https://github.com/apache/hudi/issues/1829#issuecomment-766590769


   @rubenssoto for some code paths, it will be. if you turn on `hoodie.metadata.enable=true` on the writing, you should see improvements. Hive queries should see improvement, SparkSQL with `--conf spark.sql.hive.convertMetastoreParquet=false` and `--conf "spark.hadoop.hoodie.metadata.enable=true"` should see improvement. Spark datasource path will see modest gains for now, integration coming quickly in 0.8.0. Will include it in release highlights
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org