You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/07/23 15:48:01 UTC
[GitHub] [hudi] bhasudha commented on issue #1854: query MOR table using spark sql error
bhasudha commented on issue #1854:
URL: https://github.com/apache/hudi/issues/1854#issuecomment-663083174
@qingyuan18 InputFormat and outputFormat for this table `xxxx.xxxx_acidtest2` does not seem to be Hudi related. The SerDe formats for MOR tables look like :
for read optimized MOR table
| # Storage Information | NULL | NULL |
| SerDe Library: | org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe | NULL |
| InputFormat: | org.apache.hudi.hadoop.HoodieParquetInputFormat | NULL |
| OutputFormat: | org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat | NULL |
and for _rt suffixed MOR table
| # Storage Information | NULL | NULL |
| SerDe Library: | org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe | NULL |
| InputFormat: | org.apache.hudi.hadoop.realtime.HoodieParquetRealtimeInputFormat | NULL |
| OutputFormat: | org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat | NULL |
Can you share more context on how this table was loaded initially? Also add your write configs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org