[jira] [Commented] (IMPALA-9810) Support Kudu's columnar scan format (Apache Arrow)

["YifanZhang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629737#comment-17629737 ] 

YifanZhang commented on IMPALA-9810:
------------------------------------

Kudu C++ client support for the columnar format was added at https://github.com/apache/kudu/commit/fa2d4c7.

> Support Kudu's columnar scan format (Apache Arrow)
> --------------------------------------------------
>
>                 Key: IMPALA-9810
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9810
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>            Reporter: Grant Henke
>            Priority: Major
>              Labels: kudu, performance
>
> Starting in Kudu 1.12 Kudu supports a columnar wire format that is Apache Arrow compatible. This format is significantly more efficient and faster than the row based format. Impala should support the columnar format, optimally operating on the arrow/columnar format natively. 
> Of course using the columnar format natively is the best end result, but it might be beneficial enough to translate to the row based format client side. The Java client recently added a patch for this https://gerrit.cloudera.org/#/c/15983/ and Kudu could add similar C++ client functionality if needed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org