You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Sahil Takiar (JIRA)" <ji...@apache.org> on 2019/07/31 19:54:00 UTC
[jira] [Resolved] (IMPALA-8784) Implement a RowBatchQueue backed by
a BufferedTupleStream
[ https://issues.apache.org/jira/browse/IMPALA-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sahil Takiar resolved IMPALA-8784.
----------------------------------
Resolution: Duplicate
> Implement a RowBatchQueue backed by a BufferedTupleStream
> ---------------------------------------------------------
>
> Key: IMPALA-8784
> URL: https://issues.apache.org/jira/browse/IMPALA-8784
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
>
> The {{BufferedPlanRootSink}} should use a {{RowBatchQueue}} backed by a {{BufferedTupleStream}}. This requires the following changes:
> * Creating a new {{SpillableRowBatchQueue}} that implements {{RowBatchQueue}} and internally uses a {{BufferedTupleStream}}
> * Changing the implementation of {{RowBatchQueue}} used by {{BufferedPlanRootSink}} to {{SpillableRowBatchQueue}}
> * Update {{PlanRootSink.java}} so that it sets a {{ResourceProfile}} that should be used by the {{BufferedPlanRootSink}}
> * Update {{DataSinks.thrift}} so that it passes {{ResourceProfile}}-s from the fe/ to the be/
> * {{BufferedPlanRootSink}} should Initialize and close a {{ReservationManager}} to be used by the {{BufferedTupleStream}}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)