You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/03 08:31:00 UTC
[jira] [Commented] (FLINK-9554) flink scala shell doesn't work in
yarn mode
[ https://issues.apache.org/jira/browse/FLINK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16531011#comment-16531011 ]
ASF GitHub Bot commented on FLINK-9554:
---------------------------------------
Github user zentol commented on a diff in the pull request:
https://github.com/apache/flink/pull/6140#discussion_r199724031
--- Diff: flink-scala-shell/src/main/scala/org/apache/flink/api/scala/FlinkShell.scala ---
@@ -255,14 +257,25 @@ object FlinkShell {
yarnConfig.queue.foreach((queue) => args ++= Seq("-yqu", queue.toString))
yarnConfig.slots.foreach((slots) => args ++= Seq("-ys", slots.toString))
+ val customCommandLines = CliFrontend.loadCustomCommandLines(
+ configuration,configurationDirectory)
+ val commandOptions = CliFrontendParser.getRunCommandOptions
+ val customCommandLineOptions = new Options()
+ customCommandLines.asScala.foreach(cmd => {
--- End diff --
this is already done int he `CliFrontend` constructor. It may be sufficient to switch the initialization of `frontend` and `commandLine`.
> flink scala shell doesn't work in yarn mode
> -------------------------------------------
>
> Key: FLINK-9554
> URL: https://issues.apache.org/jira/browse/FLINK-9554
> Project: Flink
> Issue Type: Bug
> Components: Scala Shell
> Affects Versions: 1.5.0
> Reporter: Jeff Zhang
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.5.1
>
>
> It still try to use StandaloneCluster even I specify it using yarn mode.
>
> Command I Use: bin/start-scala-shell.sh yarn -n 1
>
> {code:java}
> Starting Flink Shell:
> 2018-06-06 12:30:02,672 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
> 2018-06-06 12:30:02,673 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
> 2018-06-06 12:30:02,674 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 1024
> 2018-06-06 12:30:02,674 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 1024
> 2018-06-06 12:30:02,674 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
> 2018-06-06 12:30:02,674 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
> 2018-06-06 12:30:02,675 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
> Exception in thread "main" java.lang.UnsupportedOperationException: Can't deploy a standalone cluster.
> at org.apache.flink.client.deployment.StandaloneClusterDescriptor.deploySessionCluster(StandaloneClusterDescriptor.java:57)
> at org.apache.flink.client.deployment.StandaloneClusterDescriptor.deploySessionCluster(StandaloneClusterDescriptor.java:31)
> at org.apache.flink.api.scala.FlinkShell$.deployNewYarnCluster(FlinkShell.scala:272)
> at org.apache.flink.api.scala.FlinkShell$.fetchConnectionInfo(FlinkShell.scala:164)
> at org.apache.flink.api.scala.FlinkShell$.liftedTree1$1(FlinkShell.scala:194)
> at org.apache.flink.api.scala.FlinkShell$.startShell(FlinkShell.scala:193)
> at org.apache.flink.api.scala.FlinkShell$.main(FlinkShell.scala:135)
> at org.apache.flink.api.scala.FlinkShell.main(FlinkShell.scala){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)