You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/07/23 14:22:21 UTC

[GitHub] [hudi] bhasudha commented on issue #1860: [SUPPORT] Issue when querying from Spark Datasource if COW table is being written to at the same time

bhasudha commented on issue #1860:
URL: https://github.com/apache/hudi/issues/1860#issuecomment-663036038


   I am not sure if this has to do with Spark caching the table metadata. In any case, could you try adding the  conf `spark.sql.hive.convertMetastoreParquet` to false like here - https://hudi.apache.org/docs/docker_demo.html#step-4-b-run-spark-sql-queries and try again ? 
   
   Were you specifically testing the Spark Datasource API ? Since your table is already registered to Hive, directly querying the hive table table using Spark SQL would also work. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org