[jira] [Created] (ZEPPELIN-5516) Regression Testing:when yarn-application model, some functions cannot be work normally

["vmaster.cc (Jira)" <ji...@apache.org>]

vmaster.cc created ZEPPELIN-5516:
------------------------------------

             Summary: Regression Testing:when yarn-application model, some functions cannot be work normally
                 Key: ZEPPELIN-5516
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5516
             Project: Zeppelin
          Issue Type: Test
          Components: interpreter-setting, zeppelin-interpreter, zeppelin-server
    Affects Versions: 0.9.0
         Environment: * Run zeppelin with yarn-application mode
            Reporter: vmaster.cc
         Attachments: image-2021-09-13-14-12-55-914.png, image-2021-09-13-14-31-38-494.png

after change to yarn-application mode, some functions cannot work normally, even effect other mudules, eg:
 * when use default config of 'zeppelin.flink.uiWebUrl', it will show a strange Flink Web　URL in zeppelin paragraph running UI. eg: `zeppelin.domain`/false/#/job/jobId. or else localhost display.

!image-2021-09-13-14-31-38-494.png|width=569,height=173!

 
{code:java}
private def getDisplayedJMWebUrl(yarnAppId: String): String = {
  // `zeppelin.flink.uiWebUrl` is flink jm url template, {{applicationId}} will be replaced
  // with real yarn app id.
  val flinkUIWebUrl = properties.getProperty("zeppelin.flink.uiWebUrl")
  if (StringUtils.isNotBlank(flinkUIWebUrl)) {
    flinkUIWebUrl.replace("{{applicationId}}", yarnAppId)
  } else {
    this.jmWebUrl
  }
}

// 2
flink/flink-scala-parent/src/main/resources/interpreter-setting.json
"zeppelin.flink.uiWebUrl": {
  "envName": null,
  "propertyName": null,
  "defaultValue": false,
  "description": "User specified Flink JobManager url, it could be used in remote mode where Flink cluster is already started, or could be used as url template, e.g. https://knox-server:8443/gateway/cluster-topo/yarn/proxy/{{applicationId}}/ where {{applicationId}} would be replaced with yarn app id",
  "type": "string"
},{code}
 

 
 * when recovery is enabled, some functions different after zeppelin restarted.
 ** it will report NPE or RuntimeException　（Global shard mode only）
 ** cannot rerun conf, env it not changed, it will report :java.io.IOException: Can not change interpreter properties when interpreter process has already been launched
 ** Flink Web UI URL button lost,see follow screenshot: !image-2021-09-13-14-12-55-914.png|width=1807,height=197!

 
 * yarn model `hadoop classpath` need only, but yarn-application mode we must config HADOOP_CLASSPATH env

 

If there are problems that have not be clearly described, you can contact me at any time:

email: [aib628@dingtalk.com|mailto:v-fanrw@vmaster.cc]

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)