You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Jonathan Eagles (JIRA)" <ji...@apache.org> on 2018/05/22 14:11:00 UTC
[jira] [Commented] (TEZ-3885) Tez timeline server integration error
[ https://issues.apache.org/jira/browse/TEZ-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484010#comment-16484010 ]
Jonathan Eagles commented on TEZ-3885:
--------------------------------------
[~jerryjung], is this still an issue? Seems like we missed the alert when you created this ticket
> Tez timeline server integration error
> -------------------------------------
>
> Key: TEZ-3885
> URL: https://issues.apache.org/jira/browse/TEZ-3885
> Project: Apache Tez
> Issue Type: Bug
> Components: UI
> Affects Versions: 0.9.0
> Environment: apache hive version - 3.0.0-SNAPSHOT
> apache hadoop version - 3.0.0
> tez version - 0.9.0
> Reporter: Jerryjung
> Priority: Critical
> Labels: beginner
>
> If I configure below, I've got an error about launch hive error. I think it's a library problem, but I'm not sure how to fix it.
> <configuration>
> <property>
> <name>tez.lib.uris</name>
> <value>hdfs:///apps/tez-0.9.0/tez-0.9.0-minimal.tar.gz</value>
> </property>
> <property>
> <name>tez.use.cluster.hadoop-libs</name>
> <value>true</value>
> </property>
> <property>
> <description>Enable Tez to use the Timeline Server for History Logging</description>
> <name>tez.history.logging.service.class</name>
> <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value>
> </property>
> <property>
> <description>URL for where the Tez UI is hosted</description>
> <name>tez.tez-ui.history-url.base</name>
> <value>http://HOST:8081/tez-ui-0.9.0/</value>
> </property>
> </configuration>
> 2018-01-09 17:47:55,484 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster for applicationId=application_1515483495537_0016, attemptNum=1, AMContainerId=container_e40_1515483495537_0016_01_000001, jvmPid=127852, userFromEnv=hadoop, cliSessionOption=true, pwd=/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001, localDirs=/data1/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data2/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data3/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data4/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data6/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016, logDirs=/data1/yarn/logs/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001
> 2018-01-09 17:47:55,588 [INFO] [main] |Configuration.deprecation|: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
> 2018-01-09 17:47:55,727 [INFO] [main] |security.SecurityUtil|: Updating Configuration
> 2018-01-09 17:47:55,867 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster for application appattempt_1515483495537_0016_000001, versionInfo=[ component=tez-dag, version=0.9.0, revision=${buildNumber}, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=2018-01-09T00:23:13Z ]
> 2018-01-09 17:47:55,897 [INFO] [main] |app.DAGAppMaster|:
> /************************************************************
> [system properties]
> os.name: Linux
> os.version: 2.6.32-573.7.1.el6.x86_64
> java.home: /usr/java/jdk1.8.0_121/jre
> java.runtime.version: 1.8.0_121-b13
> java.vendor: Oracle Corporation
> java.version: 1.8.0_121
> java.vm.name: Java HotSpot(TM) 64-Bit Server VM
> java.class.path: /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/hive-exec-3.0.0-SNAPSHOT-09b95fc8eaad07546c7d390259f6a8727a4be9b13ea05b2742a0dd4dbe78b7e7.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-tests-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-ext-service-tests-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/hadoop-shim-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-api-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-job-analyzer-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-common-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-with-acls-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-dag-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/hadoop-shim-2.8-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-runtime-internals-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-history-parser-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-with-fs-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-examples-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-runtime-library-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-mapreduce-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-javadoc-tools-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-cache-plugin-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-mapreduce-client-core-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-mapreduce-client-common-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jetty-util-6.1.26.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/async-http-client-1.8.16.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jsr305-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jetty-6.1.26.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/RoaringBitmap-0.4.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jersey-client-1.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-hdfs-client-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/slf4j-api-1.7.10.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-io-2.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/guava-11.0.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jettison-1.3.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jersey-json-1.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/metrics-core-3.1.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-collections4-4.1.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-collections-3.2.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-math3-3.1.1.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/protobuf-java-2.5.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-codec-1.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-lang-2.6.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-cli-1.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/netty-3.6.2.Final.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/slf4j-log4j12-1.7.10.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/servlet-api-2.5.jar:/home/hadoop/servers/hadoop-3.0.0/etc/hadoop:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-common-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-nfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-kms-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/json-smart-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-lang3-3.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/re2j-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/avro-1.7.7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hadoop-auth-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-json-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-server-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/zookeeper-3.4.9.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-io-2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-security-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-core-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-xml-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/junit-4.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/gson-2.2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-databind-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/asm-5.0.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-util-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/xz-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-http-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/metrics-core-3.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-server-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-io-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hadoop-annotations-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-core-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/hadoop-auth-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-server-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/zookeeper-3.4.9.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-security-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-util-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/xz-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-http-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-io-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/hadoop-annotations-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/okio-1.4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-net-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-hbase-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-router-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-hbase-tests-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-api-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-registry-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jsp-2.1-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-server-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-protocol-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-hadoop2-compat-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/metrics-core-2.2.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jcodings-1.0.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-procedure-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-prefix-tree-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jasper-compiler-5.5.23.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/joni-2.1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jamon-runtime-2.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/fst-2.50.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-csv-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-common-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-math-2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jasper-runtime-5.5.23.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-annotations-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-hadoop-compat-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-client-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-el-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/guice-4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/disruptor-3.3.0.jar:
> java.io.tmpdir: /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tmp
> user.dir: /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001
> user.name: hadoop
> ************************************************************/
> 2018-01-09 17:47:55,909 [INFO] [main] |shim.HadoopShimsLoader|: Trying to locate HadoopShimProvider for hadoopVersion=3.0.0, majorVersion=3, minorVersion=0
> 2018-01-09 17:47:55,911 [INFO] [main] |shim.HadoopShimsLoader|: Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=3.0.0, majorVersion=3, minorVersion=0
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured TaskSchedulers: [0:TezYarn:null],[1:TezUber:null]
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured ContainerLaunchers: [0:TezYarn:null],[1:TezUber:null]
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured TaskCommunicators: [0:TezYarn:null],[1:TezUber:null]
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.9.0, AMVersion=0.9.0
> 2018-01-09 17:47:56,544 [INFO] [main] |app.TaskCommunicatorManager|: Creating Default Task Communicator
> 2018-01-09 17:47:56,552 [INFO] [main] |Configuration.deprecation|: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
> 2018-01-09 17:47:56,554 [INFO] [main] |Configuration.deprecation|: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
> 2018-01-09 17:47:56,555 [INFO] [main] |Configuration.deprecation|: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
> 2018-01-09 17:47:56,555 [INFO] [main] |app.TaskCommunicatorManager|: Creating Default Local Task Communicator
> 2018-01-09 17:47:56,561 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
> 2018-01-09 17:47:56,562 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
> 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
> 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
> 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
> 2018-01-09 17:47:56,563 [INFO] [main] |app.DAGAppMaster|: Using concurrent dispatcher: false
> 2018-01-09 17:47:56,564 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
> 2018-01-09 17:47:56,564 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
> 2018-01-09 17:47:56,565 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
> 2018-01-09 17:47:56,565 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
> 2018-01-09 17:47:56,583 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
> 2018-01-09 17:47:56,585 [INFO] [main] |launcher.TezContainerLauncherImpl|: Creating DefaultContainerLauncher
> 2018-01-09 17:47:56,591 [INFO] [main] |launcher.TezContainerLauncherImpl|: Upper limit on the thread pool size is 500
> 2018-01-09 17:47:56,591 [INFO] [main] |launcher.TezContainerLauncherImpl|: Creating LocalContainerLauncher
> 2018-01-09 17:47:56,599 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
> 2018-01-09 17:47:56,636 [INFO] [main] |node.AMNodeTracker|: blacklistDisablePercent is 33, blacklistingEnabled: true, maxTaskFailuresPerNode: 3, nodeUpdatesRescheduleEnabled: false
> 2018-01-09 17:47:56,637 [INFO] [main] |web.WebUIService|: Tez UI History URL: http://HOST:8081/tez-ui-0.9.0/#/tez-app/application_1515483495537_0016
> 2018-01-09 17:47:56,637 [INFO] [main] |history.HistoryEventHandler|: Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
> 2018-01-09 17:47:56,645 [INFO] [main] |impl.TimelineClientImpl|: Timeline service address: null
> 2018-01-09 17:47:56,753 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
> java.lang.IncompatibleClassChangeError: com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider and com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider$Wadl disagree on InnerClasses attribute
> at java.lang.Class.getDeclaringClass0(Native Method)
> at java.lang.Class.getDeclaringClass(Class.java:1235)
> at java.lang.Class.getEnclosingClass(Class.java:1277)
> at com.sun.jersey.core.spi.component.ComponentConstructor.getInstance(ComponentConstructor.java:170)
> at com.sun.jersey.core.spi.component.ProviderFactory.__getComponentProvider(ProviderFactory.java:166)
> at com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:137)
> at com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:283)
> at com.sun.jersey.core.spi.component.ProviderServices.getServices(ProviderServices.java:163)
> at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:176)
> at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162)
> at com.sun.jersey.api.client.Client.init(Client.java:342)
> at com.sun.jersey.api.client.Client.access$000(Client.java:118)
> at com.sun.jersey.api.client.Client$1.f(Client.java:191)
> at com.sun.jersey.api.client.Client$1.f(Client.java:187)
> at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
> at com.sun.jersey.api.client.Client.<init>(Client.java:187)
> at com.sun.jersey.api.client.Client.<init>(Client.java:170)
> at org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:122)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
> at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
> at org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960)
> at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
> at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659)
> at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)
> 2018-01-09 17:47:56,757 [INFO] [pool-1-thread-1] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
> 2018-01-09 17:47:56,757 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: Failed to do a clean initiateStop for Scheduler: [0:TezYarn]
> java.lang.NullPointerException
> at org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:688)
> at org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179)
> at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195)
> at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-09 17:47:56,758 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: Failed to do a clean initiateStop for Scheduler: [1:TezUber]
> java.lang.NullPointerException
> at org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:688)
> at org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179)
> at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195)
> at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] |history.HistoryEventHandler|: Stopping HistoryEventHandler
> 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] |ats.ATSHistoryLoggingService|: Stopping ATSService, eventQueueBacklog=0
> 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] |rm.TaskSchedulerManager|: Shutting down AppCallbackExecutor
> 2018-01-09 17:47:56,759 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: Error in TaskScheduler when checking if a scheduler has unregistered, scheduler=[0:TezYarn]
> java.lang.NullPointerException
> at org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:986)
> at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2208)
> at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-09 17:47:56,760 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: Error in TaskScheduler when checking if a scheduler has unregistered, scheduler=[1:TezUber]
> java.lang.NullPointerException
> at org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:986)
> at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2208)
> at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)