You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "aimahou (Jira)" <ji...@apache.org> on 2020/06/01 09:08:00 UTC
[jira] [Updated] (TEZ-4191) Tez ATS plugin init failed when enable
yarn.timeline-service without set 1.5f in property
yarn.timeline-service.versions
[ https://issues.apache.org/jira/browse/TEZ-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
aimahou updated TEZ-4191:
-------------------------
Description:
h3. *Issue:*
Tez ATS plugin init failed when enable yarn.timeline-service without set 1.5f in property yarn.timeline-service.versions
*Property in yarn-site.xml:*
<property>
<name>yarn.webapp.api-service.enable</name>
<value>true</value>
</property>
<property>
<name>yarn.timeline-service.version</name>
<value>2.0f</value>
</property>
<property>
<name>yarn.timeline-service.versions</name>
<value>2.0f</value>
</property>
*Specific exception:*
2020-05-11 16:54:39,518 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster2020-05-11 16:54:39,518 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMasterorg.apache.hadoop.service.ServiceStateException: java.io.IOException: Timeline V1 client is not properly configured. Either timeline service is not enabled or version is not set to 1.x at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:173) at org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)Caused by: java.io.IOException: Timeline V1 client is not properly configured. Either timeline service is not enabled or version is not set to 1.x at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:100) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) ... 14 more2020-05-11 16:54:39,520 [INFO] [shutdown-hook-0] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
*Related code snippet*
ATSHistoryLoggingService.java
public void serviceInit(Configuration conf) throws Exception {
...
if (conf.getBoolean(YarnConfiguration.TIMELINE_SERVICE_ENABLED,
YarnConfiguration.DEFAULT_TIMELINE_SERVICE_ENABLED)) {
timelineClient = TimelineClient.createTimelineClient();
timelineClient.init(conf);
} else {
this.timelineClient = null;
...
}
was:
h3. *Issue:*
Tez ATS plugin init failed when enable yarn.timeline-service without set 1.5f in property yarn.timeline-service.versions
*Property in yarn-site.xml:*
<property>
<name>yarn.webapp.api-service.enable</name>
<value>true</value>
</property>
<property>
<name>yarn.timeline-service.version</name>
<value>2.0f</value>
</property>
<property>
<name>yarn.timeline-service.versions</name>
<value>2.0f</value>
</property>
*Specific exception:*
2020-05-11 16:54:39,518 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster2020-05-11 16:54:39,518 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMasterorg.apache.hadoop.service.ServiceStateException: java.io.IOException: Timeline V1 client is not properly configured. Either timeline service is not enabled or version is not set to 1.x at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:173) at org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)Caused by: java.io.IOException: Timeline V1 client is not properly configured. Either timeline service is not enabled or version is not set to 1.x at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:100) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) ... 14 more2020-05-11 16:54:39,520 [INFO] [shutdown-hook-0] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
> Tez ATS plugin init failed when enable yarn.timeline-service without set 1.5f in property yarn.timeline-service.versions
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: TEZ-4191
> URL: https://issues.apache.org/jira/browse/TEZ-4191
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: aimahou
> Priority: Major
> Labels: Tez, TimeLine
>
> h3. *Issue:*
> Tez ATS plugin init failed when enable yarn.timeline-service without set 1.5f in property yarn.timeline-service.versions
> *Property in yarn-site.xml:*
> <property>
> <name>yarn.webapp.api-service.enable</name>
> <value>true</value>
> </property>
> <property>
> <name>yarn.timeline-service.version</name>
> <value>2.0f</value>
> </property>
> <property>
> <name>yarn.timeline-service.versions</name>
> <value>2.0f</value>
> </property>
> *Specific exception:*
> 2020-05-11 16:54:39,518 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster2020-05-11 16:54:39,518 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMasterorg.apache.hadoop.service.ServiceStateException: java.io.IOException: Timeline V1 client is not properly configured. Either timeline service is not enabled or version is not set to 1.x at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:173) at org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)Caused by: java.io.IOException: Timeline V1 client is not properly configured. Either timeline service is not enabled or version is not set to 1.x at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:100) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) ... 14 more2020-05-11 16:54:39,520 [INFO] [shutdown-hook-0] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
> *Related code snippet*
> ATSHistoryLoggingService.java
> public void serviceInit(Configuration conf) throws Exception {
> ...
> if (conf.getBoolean(YarnConfiguration.TIMELINE_SERVICE_ENABLED,
> YarnConfiguration.DEFAULT_TIMELINE_SERVICE_ENABLED)) {
> timelineClient = TimelineClient.createTimelineClient();
> timelineClient.init(conf);
> } else {
> this.timelineClient = null;
> ...
> }
--
This message was sent by Atlassian Jira
(v8.3.4#803005)