You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Steven Phillips (JIRA)" <ji...@apache.org> on 2014/06/22 02:49:24 UTC
[jira] [Created] (DRILL-1055) Implement ProducerConsumer operator
Steven Phillips created DRILL-1055:
--------------------------------------
Summary: Implement ProducerConsumer operator
Key: DRILL-1055
URL: https://issues.apache.org/jira/browse/DRILL-1055
Project: Apache Drill
Issue Type: Bug
Reporter: Steven Phillips
Currently, a minor fragment is run in a single thread, and parallelization is achieved by running multiple minor fragments. There are cases where we are limited in how much we can parallelize the leaf fragments due to the limited number of files/row groups. This can result in under-utilization of resources.
This operator will allow the scan operator to run in parallel with the downstream operators in the leaf fragments, thus increasing cluster utilization, and reducing the duration of the leaf fragments in certain cases.
--
This message was sent by Atlassian JIRA
(v6.2#6252)