[jira] [Commented] (TEZ-1740) Support multiple DAGs in a Tez AM

["Bikas Saha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14196960#comment-14196960 ] 

Bikas Saha commented on TEZ-1740:
---------------------------------

For cases like Hive, where DAGs tend to have a V shape in resource requirements, pipelining can be beneficial for throughput/latency by having subsequent DAGs fill out the space left behind as the current DAG draws to a close.

> Support multiple DAGs in a Tez AM
> ---------------------------------
>
>                 Key: TEZ-1740
>                 URL: https://issues.apache.org/jira/browse/TEZ-1740
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Bikas Saha
>
> Currently, the TEZ AM supports only 1 DAG submission and execution at a time. It could be enhanced to support accepting more DAGs and/or running them concurrently. Definition of concurrently needs to be defined - fair-share or FIFO or pipelined or something else.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)