You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zhenqiu Huang (JIRA)" <ji...@apache.org> on 2019/07/18 05:28:00 UTC
[jira] [Updated] (FLINK-13132) Allow JobClusterEntrypoints use user
main method to generate job graph
[ https://issues.apache.org/jira/browse/FLINK-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenqiu Huang updated FLINK-13132:
----------------------------------
Summary: Allow JobClusterEntrypoints use user main method to generate job graph (was: Allow ClusterEntrypoints use user main method to generate job graph)
> Allow JobClusterEntrypoints use user main method to generate job graph
> ----------------------------------------------------------------------
>
> Key: FLINK-13132
> URL: https://issues.apache.org/jira/browse/FLINK-13132
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Affects Versions: 1.8.0, 1.8.1
> Reporter: Zhenqiu Huang
> Assignee: Zhenqiu Huang
> Priority: Minor
>
> We are building a service that can transparently deploy a job to different cluster management systems, such as Yarn and another internal system. It is very cost to download the jar and generate JobGraph in the client side. Thus, I want to propose an improvement to make Yarn Entrypoints can be configurable to use either FileJobGraphRetriever or ClassPathJobGraphRetriever. It is actually a long asking TODO in AbstractionYarnClusterDescriptor in line 834.
> https://github.com/apache/flink/blob/21468e0050dc5f97de5cfe39885e0d3fd648e399/flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java#L834
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)