You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Jason Dere (JIRA)" <ji...@apache.org> on 2018/08/01 22:02:02 UTC
[jira] [Commented] (HIVE-20290) Lazy initialize
ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16566050#comment-16566050 ]
Jason Dere commented on HIVE-20290:
-----------------------------------
+1
> Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
> ---------------------------------------------------------------------------------------
>
> Key: HIVE-20290
> URL: https://issues.apache.org/jira/browse/HIVE-20290
> Project: Hive
> Issue Type: Bug
> Affects Versions: 3.1.0
> Reporter: Eric Wohlstadter
> Assignee: Eric Wohlstadter
> Priority: Blocker
> Attachments: HIVE-20290.1.patch
>
>
> When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for submission to {{LlapOutputFormatService}}, the physical plan generation initializes whatever SerDe is being used.
> {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and {{VectorizedRowBatch}} at this point inside HS2 which are never used.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)