You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Sahil Takiar (JIRA)" <ji...@apache.org> on 2019/07/23 19:05:00 UTC

[jira] [Created] (IMPALA-8784) Implement a RowBatchQueue backed by a BufferedTupleStream

Sahil Takiar created IMPALA-8784:
------------------------------------

             Summary: Implement a RowBatchQueue backed by a BufferedTupleStream
                 Key: IMPALA-8784
                 URL: https://issues.apache.org/jira/browse/IMPALA-8784
             Project: IMPALA
          Issue Type: Sub-task
          Components: Backend
            Reporter: Sahil Takiar
            Assignee: Sahil Takiar


The {{BufferedPlanRootSink}} should use a {{RowBatchQueue}} backed by a {{BufferedTupleStream}}. This requires the following changes:
 * Creating a new {{SpillableRowBatchQueue}} that implements {{RowBatchQueue}} and internally uses a {{BufferedTupleStream}}
 * Changing the implementation of {{RowBatchQueue}} used by {{BufferedPlanRootSink}} to {{SpillableRowBatchQueue}}
 * Update {{PlanRootSink.java}} so that it sets a {{ResourceProfile}} that should be used by the {{BufferedPlanRootSink}}
 * Update {{DataSinks.thrift}} so that it passes {{ResourceProfile}}-s from the fe/ to the be/
 * {{BufferedPlanRootSink}} should Initialize and close a {{ReservationManager}} to be used by the {{BufferedTupleStream}}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)