You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Tao Meng (Jira)" <ji...@apache.org> on 2022/02/18 10:00:00 UTC

[jira] [Commented] (HUDI-2762) Ensure hive can query insert only logs in MOR

    [ https://issues.apache.org/jira/browse/HUDI-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494502#comment-17494502 ] 

Tao Meng commented on HUDI-2762:
--------------------------------

[~alexey.kudinkin]  i This problem is hive's problem. Hive will filter out all the file which startwith .

 see org.apache.hadoop.hive.common.FileUtils in hive

 

> Ensure hive can query insert only logs in MOR
> ---------------------------------------------
>
>                 Key: HUDI-2762
>                 URL: https://issues.apache.org/jira/browse/HUDI-2762
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: hive
>            Reporter: Rajesh Mahindra
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.11.0
>
>
> Currently, we are able to query MOR tables that have base parquet files with inserts an logs files with updates. However, we are currently unable to query tables with insert only log files. Both _ro and _rt tables are returning 0 rows. However, hms does create the table and partitions for the table. 
>  
> One sample table is here:
> [https://s3.console.aws.amazon.com/s3/buckets/debug-hive-site?prefix=database/&region=us-east-2]
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)