You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Sahil Takiar (JIRA)" <ji...@apache.org> on 2019/07/31 19:54:00 UTC

[jira] [Resolved] (IMPALA-8784) Implement a RowBatchQueue backed by a BufferedTupleStream

     [ https://issues.apache.org/jira/browse/IMPALA-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sahil Takiar resolved IMPALA-8784.
----------------------------------
    Resolution: Duplicate

> Implement a RowBatchQueue backed by a BufferedTupleStream
> ---------------------------------------------------------
>
>                 Key: IMPALA-8784
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8784
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Backend
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>            Priority: Major
>
> The {{BufferedPlanRootSink}} should use a {{RowBatchQueue}} backed by a {{BufferedTupleStream}}. This requires the following changes:
>  * Creating a new {{SpillableRowBatchQueue}} that implements {{RowBatchQueue}} and internally uses a {{BufferedTupleStream}}
>  * Changing the implementation of {{RowBatchQueue}} used by {{BufferedPlanRootSink}} to {{SpillableRowBatchQueue}}
>  * Update {{PlanRootSink.java}} so that it sets a {{ResourceProfile}} that should be used by the {{BufferedPlanRootSink}}
>  * Update {{DataSinks.thrift}} so that it passes {{ResourceProfile}}-s from the fe/ to the be/
>  * {{BufferedPlanRootSink}} should Initialize and close a {{ReservationManager}} to be used by the {{BufferedTupleStream}}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)