You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/16 03:19:30 UTC
[GitHub] [hudi] xiarixiaoyao commented on issue #4609: [SUPPORT] Got exception while using clustering with z-order
xiarixiaoyao commented on issue #4609:
URL: https://github.com/apache/hudi/issues/4609#issuecomment-1013802412
@ravs11 could you pls check the Parquet files in yourTablePath/.hoodie/.zindex directory? This error appears to be that the schemas of these parquet files are inconsistent, which makes spark unable to read these files.
1)first pls list all the directy in yourTablePath/.hoodie/.zindex directory and paste it here
2) check all the schemas of parquets files (in yourTablePath/.hoodie/.zindex/xxxx) , you can use spark.read.load(xxx.parquet).schema to get the schema of one parquet file.
3) If possible, could you pls provide the schema of your table and one row table data? I will see if the problem can be reproduced locally.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org