[jira] [Commented] (TEZ-4662) [Cloud] Cloud-native Tez

["Butao Zhang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18038744#comment-18038744 ] 

Butao Zhang commented on TEZ-4662:
----------------------------------

Love this feature!!!  It is definitely a game changer for Hive & Tez!!!

> [Cloud] Cloud-native Tez
> ------------------------
>
>                 Key: TEZ-4662
>                 URL: https://issues.apache.org/jira/browse/TEZ-4662
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: László Bodor
>            Priority: Major
>              Labels: Kubernetes
>
> The primary goal is to decouple Tez from YARN by implementing or integrating any functionality that YARN currently provides to Tez.
> *First Approach*: Containers scheduled by an external framework
> In this model, Tez has no control over container scheduling.
> Mock ContainerLauncher:
> Assume containers are started independently and later discovered by the ApplicationMaster (AM).
> Container Discovery:
> If task containers are launched independently, a discovery mechanism must be implemented — for example, using Kubernetes or ZooKeeper.
> Resource Management:
> (To be defined — assumes limited or no direct control by Tez over resource allocation.)
> *Advanced Approach*: Pluggable Resource Management Framework
> Develop a pluggable resource management layer that can integrate with Kubernetes-based systems (or others) to perform the same responsibilities that YARN currently handles for Tez.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)