You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2021/01/29 10:34:02 UTC
[jira] [Assigned] (FLINK-13132) Allow JobClusterEntrypoints use
user main method to generate job graph
[ https://issues.apache.org/jira/browse/FLINK-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chesnay Schepler reassigned FLINK-13132:
----------------------------------------
Assignee: (was: Zhenqiu Huang)
> Allow JobClusterEntrypoints use user main method to generate job graph
> ----------------------------------------------------------------------
>
> Key: FLINK-13132
> URL: https://issues.apache.org/jira/browse/FLINK-13132
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Affects Versions: 1.8.0, 1.8.1
> Reporter: Zhenqiu Huang
> Priority: Minor
>
> We are building a service that can transparently deploy a job to different cluster management systems, such as Yarn and another internal system. It is very cost to download the jar and generate JobGraph in the client side. Thus, I want to propose an improvement to make Yarn Entrypoints can be configurable to use either FileJobGraphRetriever or ClassPathJobGraphRetriever. It is actually a long asking TODO in AbstractionYarnClusterDescriptor in line 834.
> https://github.com/apache/flink/blob/21468e0050dc5f97de5cfe39885e0d3fd648e399/flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java#L834
--
This message was sent by Atlassian Jira
(v8.3.4#803005)