You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by guxiaobo1982 <gu...@qq.com> on 2015/02/09 12:30:42 UTC
App timeline server can't start
Hi,
In order to user Spark with Hive, I try to install the 2.1 version of HDP inside a single node using ambari, but failed to start the APP timeline server with the following errors.
stderr: /var/lib/ambari-agent/data/errors-227.txt
2015-02-09 19:26:15,636 - Error while executing command 'start': Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 123, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 42, in start service('timelineserver', action='start') File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 59, in service initial_wait=5 File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 241, in action_run raise ex Fail: Execution of 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1' returned 1.
stdout: /var/lib/ambari-agent/data/output-227.txt
2015-02-09 19:26:08,800 - Group['hadoop'] {'ignore_failures': False} 2015-02-09 19:26:08,801 - Modifying group hadoop 2015-02-09 19:26:08,838 - Group['nobody'] {'ignore_failures': False} 2015-02-09 19:26:08,838 - Modifying group nobody 2015-02-09 19:26:08,863 - Group['users'] {'ignore_failures': False} 2015-02-09 19:26:08,863 - Modifying group users 2015-02-09 19:26:08,888 - Group['nagios'] {'ignore_failures': False} 2015-02-09 19:26:08,889 - Modifying group nagios 2015-02-09 19:26:08,915 - User['hive'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:08,915 - Modifying user hive 2015-02-09 19:26:08,964 - User['oozie'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']} 2015-02-09 19:26:08,966 - Modifying user oozie 2015-02-09 19:26:08,984 - User['nobody'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'nobody']} 2015-02-09 19:26:08,985 - Modifying user nobody 2015-02-09 19:26:08,998 - User['nagios'] {'gid': 'nagios', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:08,999 - Modifying user nagios 2015-02-09 19:26:09,011 - User['ambari-qa'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']} 2015-02-09 19:26:09,011 - Modifying user ambari-qa 2015-02-09 19:26:09,025 - User['flume'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,026 - Modifying user flume 2015-02-09 19:26:09,041 - User['hdfs'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,041 - Modifying user hdfs 2015-02-09 19:26:09,056 - User['storm'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,056 - Modifying user storm 2015-02-09 19:26:09,071 - User['mapred'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,071 - Modifying user mapred 2015-02-09 19:26:09,085 - User['hbase'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,085 - Modifying user hbase 2015-02-09 19:26:09,099 - User['tez'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']} 2015-02-09 19:26:09,100 - Modifying user tez 2015-02-09 19:26:09,112 - User['zookeeper'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,112 - Modifying user zookeeper 2015-02-09 19:26:09,126 - User['sqoop'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,126 - Modifying user sqoop 2015-02-09 19:26:09,140 - User['yarn'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,140 - Modifying user yarn 2015-02-09 19:26:09,155 - User['hcat'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']} 2015-02-09 19:26:09,156 - Modifying user hcat 2015-02-09 19:26:09,170 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2015-02-09 19:26:09,171 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] {'not_if': 'test $(id -u ambari-qa) -gt 1000'} 2015-02-09 19:26:09,185 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] due to not_if 2015-02-09 19:26:09,185 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2015-02-09 19:26:09,187 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase 2>/dev/null'] {'not_if': 'test $(id -u hbase) -gt 1000'} 2015-02-09 19:26:09,199 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase 2>/dev/null'] due to not_if 2015-02-09 19:26:09,200 - Directory['/etc/hadoop/conf.empty'] {'owner': 'root', 'group': 'root', 'recursive': True} 2015-02-09 19:26:09,200 - Link['/etc/hadoop/conf'] {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'} 2015-02-09 19:26:09,212 - Skipping Link['/etc/hadoop/conf'] due to not_if 2015-02-09 19:26:09,221 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'} 2015-02-09 19:26:09,234 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'} 2015-02-09 19:26:09,261 - Directory['/var/log/hadoop'] {'owner': 'root', 'group': 'hadoop', 'mode': 0775, 'recursive': True} 2015-02-09 19:26:09,262 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True} 2015-02-09 19:26:09,262 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'recursive': True} 2015-02-09 19:26:09,266 - File['/etc/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'} 2015-02-09 19:26:09,267 - File['/etc/hadoop/conf/health_check'] {'content': Template('health_check-v2.j2'), 'owner': 'hdfs'} 2015-02-09 19:26:09,267 - File['/etc/hadoop/conf/log4j.properties'] {'content': '...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} 2015-02-09 19:26:09,271 - File['/etc/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'} 2015-02-09 19:26:09,271 - File['/etc/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755} 2015-02-09 19:26:09,271 - File['/etc/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'} 2015-02-09 19:26:09,370 - Directory['/var/run/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True} 2015-02-09 19:26:09,371 - Directory['/var/log/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True} 2015-02-09 19:26:09,371 - Directory['/var/run/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True} 2015-02-09 19:26:09,371 - Directory['/var/log/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True} 2015-02-09 19:26:09,371 - Directory['/var/log/hadoop-yarn'] {'owner': 'yarn', 'ignore_failures': True, 'recursive': True} 2015-02-09 19:26:09,372 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'hdfs', 'configurations': ...} 2015-02-09 19:26:09,379 - Generating config: /etc/hadoop/conf/core-site.xml 2015-02-09 19:26:09,379 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2015-02-09 19:26:09,380 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match 2015-02-09 19:26:09,380 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...} 2015-02-09 19:26:09,386 - Generating config: /etc/hadoop/conf/mapred-site.xml 2015-02-09 19:26:09,386 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2015-02-09 19:26:09,386 - Writing File['/etc/hadoop/conf/mapred-site.xml'] because contents don't match 2015-02-09 19:26:09,387 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1035 to yarn 2015-02-09 19:26:09,387 - XmlConfig['yarn-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...} 2015-02-09 19:26:09,392 - Generating config: /etc/hadoop/conf/yarn-site.xml 2015-02-09 19:26:09,393 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2015-02-09 19:26:09,393 - Writing File['/etc/hadoop/conf/yarn-site.xml'] because contents don't match 2015-02-09 19:26:09,393 - XmlConfig['capacity-scheduler.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...} 2015-02-09 19:26:09,399 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml 2015-02-09 19:26:09,399 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2015-02-09 19:26:09,399 - Writing File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match 2015-02-09 19:26:09,400 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1033 to yarn 2015-02-09 19:26:09,401 - Directory['/hadoop/yarn/timeline'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True} 2015-02-09 19:26:09,401 - File['/etc/hadoop/conf/yarn.exclude'] {'owner': 'yarn', 'group': 'hadoop'} 2015-02-09 19:26:09,403 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644} 2015-02-09 19:26:09,404 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644} 2015-02-09 19:26:09,407 - File['/etc/hadoop/conf/yarn-env.sh'] {'content': InlineTemplate(...), 'owner': 'yarn', 'group': 'hadoop', 'mode': 0755} 2015-02-09 19:26:09,408 - File['/etc/hadoop/conf/mapred-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'} 2015-02-09 19:26:09,410 - File['/etc/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'hdfs'} 2015-02-09 19:26:09,410 - XmlConfig['mapred-site.xml'] {'owner': 'mapred', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...} 2015-02-09 19:26:09,415 - Generating config: /etc/hadoop/conf/mapred-site.xml 2015-02-09 19:26:09,415 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'mapred', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2015-02-09 19:26:09,416 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1040 to mapred 2015-02-09 19:26:09,416 - XmlConfig['capacity-scheduler.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...} 2015-02-09 19:26:09,421 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml 2015-02-09 19:26:09,421 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2015-02-09 19:26:09,421 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1040 to hdfs 2015-02-09 19:26:09,422 - File['/etc/hadoop/conf/ssl-client.xml.example'] {'owner': 'mapred', 'group': 'hadoop'} 2015-02-09 19:26:09,422 - File['/etc/hadoop/conf/ssl-server.xml.example'] {'owner': 'mapred', 'group': 'hadoop'} 2015-02-09 19:26:09,423 - File['/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid'] {'action': ['delete'], 'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1'} 2015-02-09 19:26:09,464 - Deleting File['/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid'] 2015-02-09 19:26:09,464 - Execute['ulimit -c unlimited; export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh --config /etc/hadoop/conf start timelineserver'] {'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1', 'user': 'yarn'} 2015-02-09 19:26:10,556 - Execute['ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1'] {'initial_wait': 5, 'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1', 'user': 'yarn'} 2015-02-09 19:26:15,636 - Error while executing command 'start': Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 123, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 42, in start service('timelineserver', action='start') File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 59, in service initial_wait=5 File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 241, in action_run raise ex Fail: Execution of 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1' returned 1.
Re: App timeline server can't start
Posted by Alejandro Fernandez <af...@hortonworks.com>.
Hi ,
In Ambari 1.7.0, the pid file /var/run/hadoop-yarn/yarn/yarn-yarn-historyserver.pid was deprecated in favor of /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid to be consistent.
You may want to run ps on the timeline server process, kill it, and delete both pid files above, then attempt to start it again.
Let me know if this works.
Thanks,
Alejandro
From: guxiaobo1982 <gu...@qq.com>>
Reply-To: user <us...@ambari.apache.org>>
Date: Monday, February 9, 2015 at 3:30 AM
To: user <us...@ambari.apache.org>>
Subject: App timeline server can't start
Hi,
In order to user Spark with Hive, I try to install the 2.1 version of HDP inside a single node using ambari, but failed to start the APP timeline server with the following errors.
stderr: /var/lib/ambari-agent/data/errors-227.txt
2015-02-09 19:26:15,636 - Error while executing command 'start':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 123, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 42, in start
service('timelineserver', action='start')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 59, in service
initial_wait=5
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 241, in action_run
raise ex
Fail: Execution of 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1' returned 1.
stdout: /var/lib/ambari-agent/data/output-227.txt
2015-02-09 19:26:08,800 - Group['hadoop'] {'ignore_failures': False}
2015-02-09 19:26:08,801 - Modifying group hadoop
2015-02-09 19:26:08,838 - Group['nobody'] {'ignore_failures': False}
2015-02-09 19:26:08,838 - Modifying group nobody
2015-02-09 19:26:08,863 - Group['users'] {'ignore_failures': False}
2015-02-09 19:26:08,863 - Modifying group users
2015-02-09 19:26:08,888 - Group['nagios'] {'ignore_failures': False}
2015-02-09 19:26:08,889 - Modifying group nagios
2015-02-09 19:26:08,915 - User['hive'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:08,915 - Modifying user hive
2015-02-09 19:26:08,964 - User['oozie'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2015-02-09 19:26:08,966 - Modifying user oozie
2015-02-09 19:26:08,984 - User['nobody'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'nobody']}
2015-02-09 19:26:08,985 - Modifying user nobody
2015-02-09 19:26:08,998 - User['nagios'] {'gid': 'nagios', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:08,999 - Modifying user nagios
2015-02-09 19:26:09,011 - User['ambari-qa'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2015-02-09 19:26:09,011 - Modifying user ambari-qa
2015-02-09 19:26:09,025 - User['flume'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,026 - Modifying user flume
2015-02-09 19:26:09,041 - User['hdfs'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,041 - Modifying user hdfs
2015-02-09 19:26:09,056 - User['storm'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,056 - Modifying user storm
2015-02-09 19:26:09,071 - User['mapred'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,071 - Modifying user mapred
2015-02-09 19:26:09,085 - User['hbase'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,085 - Modifying user hbase
2015-02-09 19:26:09,099 - User['tez'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2015-02-09 19:26:09,100 - Modifying user tez
2015-02-09 19:26:09,112 - User['zookeeper'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,112 - Modifying user zookeeper
2015-02-09 19:26:09,126 - User['sqoop'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,126 - Modifying user sqoop
2015-02-09 19:26:09,140 - User['yarn'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,140 - Modifying user yarn
2015-02-09 19:26:09,155 - User['hcat'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-09 19:26:09,156 - Modifying user hcat
2015-02-09 19:26:09,170 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-02-09 19:26:09,171 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] {'not_if': 'test $(id -u ambari-qa) -gt 1000'}
2015-02-09 19:26:09,185 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] due to not_if
2015-02-09 19:26:09,185 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-02-09 19:26:09,187 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase 2>/dev/null'] {'not_if': 'test $(id -u hbase) -gt 1000'}
2015-02-09 19:26:09,199 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase 2>/dev/null'] due to not_if
2015-02-09 19:26:09,200 - Directory['/etc/hadoop/conf.empty'] {'owner': 'root', 'group': 'root', 'recursive': True}
2015-02-09 19:26:09,200 - Link['/etc/hadoop/conf'] {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}
2015-02-09 19:26:09,212 - Skipping Link['/etc/hadoop/conf'] due to not_if
2015-02-09 19:26:09,221 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'}
2015-02-09 19:26:09,234 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
2015-02-09 19:26:09,261 - Directory['/var/log/hadoop'] {'owner': 'root', 'group': 'hadoop', 'mode': 0775, 'recursive': True}
2015-02-09 19:26:09,262 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True}
2015-02-09 19:26:09,262 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'recursive': True}
2015-02-09 19:26:09,266 - File['/etc/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2015-02-09 19:26:09,267 - File['/etc/hadoop/conf/health_check'] {'content': Template('health_check-v2.j2'), 'owner': 'hdfs'}
2015-02-09 19:26:09,267 - File['/etc/hadoop/conf/log4j.properties'] {'content': '...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2015-02-09 19:26:09,271 - File['/etc/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
2015-02-09 19:26:09,271 - File['/etc/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2015-02-09 19:26:09,271 - File['/etc/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2015-02-09 19:26:09,370 - Directory['/var/run/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
2015-02-09 19:26:09,371 - Directory['/var/log/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
2015-02-09 19:26:09,371 - Directory['/var/run/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
2015-02-09 19:26:09,371 - Directory['/var/log/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
2015-02-09 19:26:09,371 - Directory['/var/log/hadoop-yarn'] {'owner': 'yarn', 'ignore_failures': True, 'recursive': True}
2015-02-09 19:26:09,372 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'hdfs', 'configurations': ...}
2015-02-09 19:26:09,379 - Generating config: /etc/hadoop/conf/core-site.xml
2015-02-09 19:26:09,379 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2015-02-09 19:26:09,380 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
2015-02-09 19:26:09,380 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
2015-02-09 19:26:09,386 - Generating config: /etc/hadoop/conf/mapred-site.xml
2015-02-09 19:26:09,386 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2015-02-09 19:26:09,386 - Writing File['/etc/hadoop/conf/mapred-site.xml'] because contents don't match
2015-02-09 19:26:09,387 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1035 to yarn
2015-02-09 19:26:09,387 - XmlConfig['yarn-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
2015-02-09 19:26:09,392 - Generating config: /etc/hadoop/conf/yarn-site.xml
2015-02-09 19:26:09,393 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2015-02-09 19:26:09,393 - Writing File['/etc/hadoop/conf/yarn-site.xml'] because contents don't match
2015-02-09 19:26:09,393 - XmlConfig['capacity-scheduler.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
2015-02-09 19:26:09,399 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2015-02-09 19:26:09,399 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2015-02-09 19:26:09,399 - Writing File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match
2015-02-09 19:26:09,400 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1033 to yarn
2015-02-09 19:26:09,401 - Directory['/hadoop/yarn/timeline'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
2015-02-09 19:26:09,401 - File['/etc/hadoop/conf/yarn.exclude'] {'owner': 'yarn', 'group': 'hadoop'}
2015-02-09 19:26:09,403 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644}
2015-02-09 19:26:09,404 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644}
2015-02-09 19:26:09,407 - File['/etc/hadoop/conf/yarn-env.sh'] {'content': InlineTemplate(...), 'owner': 'yarn', 'group': 'hadoop', 'mode': 0755}
2015-02-09 19:26:09,408 - File['/etc/hadoop/conf/mapred-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'}
2015-02-09 19:26:09,410 - File['/etc/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'hdfs'}
2015-02-09 19:26:09,410 - XmlConfig['mapred-site.xml'] {'owner': 'mapred', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
2015-02-09 19:26:09,415 - Generating config: /etc/hadoop/conf/mapred-site.xml
2015-02-09 19:26:09,415 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'mapred', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2015-02-09 19:26:09,416 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1040 to mapred
2015-02-09 19:26:09,416 - XmlConfig['capacity-scheduler.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
2015-02-09 19:26:09,421 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2015-02-09 19:26:09,421 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2015-02-09 19:26:09,421 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1040 to hdfs
2015-02-09 19:26:09,422 - File['/etc/hadoop/conf/ssl-client.xml.example'] {'owner': 'mapred', 'group': 'hadoop'}
2015-02-09 19:26:09,422 - File['/etc/hadoop/conf/ssl-server.xml.example'] {'owner': 'mapred', 'group': 'hadoop'}
2015-02-09 19:26:09,423 - File['/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid'] {'action': ['delete'], 'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1'}
2015-02-09 19:26:09,464 - Deleting File['/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid']
2015-02-09 19:26:09,464 - Execute['ulimit -c unlimited; export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh --config /etc/hadoop/conf start timelineserver'] {'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1', 'user': 'yarn'}
2015-02-09 19:26:10,556 - Execute['ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1'] {'initial_wait': 5, 'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1', 'user': 'yarn'}
2015-02-09 19:26:15,636 - Error while executing command 'start':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 123, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 42, in start
service('timelineserver', action='start')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 59, in service
initial_wait=5
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 241, in action_run
raise ex
Fail: Execution of 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1' returned 1.
回复: mvn install error
Posted by TTS2沉默天使 <85...@qq.com>.
(build_cube_with_engine)说这个编译错误 我又不知道这是什么------------------ 原始邮件 ------------------
发件人: "85546017"<85...@qq.com>
发送时间: 2016年6月13日(星期一) 晚上6:11
收件人: "dev"<de...@kylin.apache.org>;
主题: 回复: mvn install error
我编译的环境是jdk1.7的------------------ 原始邮件 ------------------
发件人: "Li Yang"<li...@apache.org>
发送时间: 2016年6月13日(星期一) 下午5:13
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: mvn install error
Kylin requires JDK 7. Seems you are on JDK 6.
On Sat, Jun 11, 2016 at 11:43 AM, TTS2沉默天使 <85...@qq.com> wrote:
> [INFO] --- exec-maven-plugin:1.4.0:exec (build_cube_with_engine) @
> kylin-it ---
> Exception in thread "main" java.lang.UnsupportedClassVersionError:
> org/apache/kylin/provision/BuildCubeWithEngine : Unsupported major.minor
> version 51.0
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
> at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
> Could not find the main class:
> org.apache.kylin.provision.BuildCubeWithEngine. Program will exit.
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 01:34 min
> [INFO] Finished at: 2016-06-11T11:22:50+08:00
> [INFO] Final Memory: 39M/372M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.4.0:exec (build_cube_with_engine) on
> project kylin-it: Command execution failed. Process exited with an error: 1
> (Exit value: 1) -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "TTS2沉默天使";<85...@qq.com>;
> 发送时间: 2016年6月11日(星期六) 中午11:42
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: mvn install error
>
>
>
> Kylin-it:Mvn install error
> POM:<hbase-hadoop2.version>1.2.1</hbase-hadoop2.version>
>
回复: mvn install error
Posted by TTS2沉默天使 <85...@qq.com>.
我编译的环境是jdk1.7的------------------ 原始邮件 ------------------
发件人: "Li Yang"<li...@apache.org>
发送时间: 2016年6月13日(星期一) 下午5:13
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: mvn install error
Kylin requires JDK 7. Seems you are on JDK 6.
On Sat, Jun 11, 2016 at 11:43 AM, TTS2沉默天使 <85...@qq.com> wrote:
> [INFO] --- exec-maven-plugin:1.4.0:exec (build_cube_with_engine) @
> kylin-it ---
> Exception in thread "main" java.lang.UnsupportedClassVersionError:
> org/apache/kylin/provision/BuildCubeWithEngine : Unsupported major.minor
> version 51.0
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
> at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
> Could not find the main class:
> org.apache.kylin.provision.BuildCubeWithEngine. Program will exit.
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 01:34 min
> [INFO] Finished at: 2016-06-11T11:22:50+08:00
> [INFO] Final Memory: 39M/372M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.4.0:exec (build_cube_with_engine) on
> project kylin-it: Command execution failed. Process exited with an error: 1
> (Exit value: 1) -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "TTS2沉默天使";<85...@qq.com>;
> 发送时间: 2016年6月11日(星期六) 中午11:42
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: mvn install error
>
>
>
> Kylin-it:Mvn install error
> POM:<hbase-hadoop2.version>1.2.1</hbase-hadoop2.version>
>
Re: mvn install error
Posted by Li Yang <li...@apache.org>.
Kylin requires JDK 7. Seems you are on JDK 6.
On Sat, Jun 11, 2016 at 11:43 AM, TTS2沉默天使 <85...@qq.com> wrote:
> [INFO] --- exec-maven-plugin:1.4.0:exec (build_cube_with_engine) @
> kylin-it ---
> Exception in thread "main" java.lang.UnsupportedClassVersionError:
> org/apache/kylin/provision/BuildCubeWithEngine : Unsupported major.minor
> version 51.0
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
> at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
> Could not find the main class:
> org.apache.kylin.provision.BuildCubeWithEngine. Program will exit.
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 01:34 min
> [INFO] Finished at: 2016-06-11T11:22:50+08:00
> [INFO] Final Memory: 39M/372M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.4.0:exec (build_cube_with_engine) on
> project kylin-it: Command execution failed. Process exited with an error: 1
> (Exit value: 1) -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "TTS2沉默天使";<85...@qq.com>;
> 发送时间: 2016年6月11日(星期六) 中午11:42
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: mvn install error
>
>
>
> Kylin-it:Mvn install error
> POM:<hbase-hadoop2.version>1.2.1</hbase-hadoop2.version>
>