[jira] [Commented] (IMPALA-9741) Support query iceberg table by impala

["WangSheng (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108158#comment-17108158 ] 

WangSheng commented on IMPALA-9741:
-----------------------------------

Hi [~boroknagyz][~tarmstrong], I have been thinking about how to implement query iceberg by impala recently, and here is my initial desgin. I will write a class named IcebergScanNode.java in frontend, and this class mainly contains these functions:
* Transform impala conjunts to iceberg expressions, which means we can pushdown some predicates to icebrg;
* Get specific data files from icebreg by these expressions, which stored in hdfs;
* Use these specific data files to construct related thrift struct, such as THdfsFileSplit/TScanRangerSpec;
* And then backend will.use these thrift structs to construct "SCAN HDFS" to scan data, and this way we can reuse these code in backend.

And here is a very simple desgin:
 !select-iceberg.png! 

> Support query iceberg table by impala
> -------------------------------------
>
>                 Key: IMPALA-9741
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9741
>             Project: IMPALA
>          Issue Type: Sub-task
>            Reporter: WangSheng
>            Assignee: WangSheng
>            Priority: Major
>         Attachments: select-iceberg.png
>
>
> Since we have submit an patch of supporting create iceberg table by impala in IMPALA-9688, we are preparing to implement iceberg table query by impala. But we need to read the impala and iceberg code  deeply to determine how to do this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org