You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2015/03/10 12:49:38 UTC
[jira] [Commented] (AMBARI-9992) Could not start Storm after Ambari
only upgrade from 1.5.1 to 2.0.0
[ https://issues.apache.org/jira/browse/AMBARI-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354788#comment-14354788 ]
Hadoop QA commented on AMBARI-9992:
-----------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12703636/AMBARI-9992.patch
against trunk revision .
{color:red}-1 patch{color}. Top-level trunk compilation may be broken.
Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/1981//console
This message is automatically generated.
> Could not start Storm after Ambari only upgrade from 1.5.1 to 2.0.0
> -------------------------------------------------------------------
>
> Key: AMBARI-9992
> URL: https://issues.apache.org/jira/browse/AMBARI-9992
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.0.0
> Environment: ambari-server version: ambari-server-2.0.0-123 ambari-server --hash: e6c791affb7583f1fcb5c428b1816d2d4874540d
> HDP Stack: 2.1
> Ambari DB: :PostgreSQL
> Oozie/Hive DB: MySQL/MySQL
> Security:no
> OS: SUSE Linux Enterprise Server 11
> Reporter: Dmytro Sen
> Assignee: Dmytro Sen
> Fix For: 2.0.0
>
> Attachments: AMBARI-9992.patch
>
>
> STR:
> 1)Deploy old version with all services
> 2)Make ambari only upgrade to 2.0.0
> Expected result:
> All services are started
> Actual result
> Could not start Storm after Ambari only upgrade from 1.5.1 to 2.0.0
> {code}
> {
> "href" : "http://172.18.145.49:8080/api/v1/clusters/cl1/requests/9/tasks/287",
> "Tasks" : {
> "attempt_cnt" : 1,
> "cluster_name" : "cl1",
> "command" : "START",
> "command_detail" : "STORM_REST_API START",
> "end_time" : 1425897713322,
> "error_log" : "/var/lib/ambari-agent/data/errors-287.txt",
> "exit_code" : 1,
> "host_name" : "amb-upg151-sles113postgres1425889596-10.cs1cloud.internal",
> "id" : 287,
> "output_log" : "/var/lib/ambari-agent/data/output-287.txt",
> "request_id" : 9,
> "role" : "STORM_REST_API",
> "stage_id" : 0,
> "start_time" : 1425897642009,
> "status" : "FAILED",
> "stderr" : "2015-03-09 10:41:53,130 - Error while executing command 'start':\nTraceback (most recent call last):\n File \"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py\", line 214, in execute\n method(env)\n File \"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1.2.1/package/scripts/rest_api.py\", line 60, in start\n service(\"rest_api\", action=\"start\")\n File \"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1.2.1/package/scripts/service.py\", line 72, in service\n path=params.storm_bin_dir\n File \"/usr/lib/python2.6/site-packages/resource_management/core/base.py\", line 148, in __init__\n self.env.run()\n File \"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", line 152, in run\n self.run_action(resource, action)\n File \"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", line 118, in run_action\n provider_action()\n File \"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py\", line 274, in action_run\n raise ex\nFail: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1.",
> "stdout" : "2015-03-09 10:40:48,803 - u\"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']\" {'recursive': True}\n2015-03-09 10:40:48,977 - u\"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']\" {'content': DownloadSource('http://amb-upg151-sles113postgres1425889596-4.cs1cloud.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip')}\n2015-03-09 10:40:49,067 - Not downloading the file from http://amb-upg151-sles113postgres1425889596-4.cs1cloud.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip, because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already exists\n2015-03-09 10:40:49,227 - u\"Group['hadoop']\" {'ignore_failures': False}\n2015-03-09 10:40:49,228 - Modifying group hadoop\n2015-03-09 10:40:49,278 - u\"Group['nobody']\" {'ignore_failures': False}\n2015-03-09 10:40:49,279 - Modifying group nobody\n2015-03-09 10:40:49,325 - u\"Group['users']\" {'ignore_failures': False}\n2015-03-09 10:40:49,326 - Modifying group users\n2015-03-09 10:40:49,374 - u\"User['hive']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:49,374 - Modifying user hive\n2015-03-09 10:40:49,566 - u\"User['oozie']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}\n2015-03-09 10:40:49,568 - Modifying user oozie\n2015-03-09 10:40:49,737 - u\"User['nobody']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'nobody']}\n2015-03-09 10:40:49,739 - Modifying user nobody\n2015-03-09 10:40:49,911 - u\"User['ambari-qa']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}\n2015-03-09 10:40:49,912 - Modifying user ambari-qa\n2015-03-09 10:40:50,084 - u\"User['hdfs']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,085 - Modifying user hdfs\n2015-03-09 10:40:50,239 - u\"User['storm']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,240 - Modifying user storm\n2015-03-09 10:40:50,313 - u\"User['mapred']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,315 - Modifying user mapred\n2015-03-09 10:40:50,382 - u\"User['hbase']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,383 - Modifying user hbase\n2015-03-09 10:40:50,453 - u\"User['tez']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}\n2015-03-09 10:40:50,455 - Modifying user tez\n2015-03-09 10:40:50,623 - u\"User['zookeeper']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,625 - Modifying user zookeeper\n2015-03-09 10:40:50,858 - u\"User['false']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,859 - Modifying user false\n2015-03-09 10:40:50,971 - u\"User['falcon']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:50,972 - Modifying user falcon\n2015-03-09 10:40:51,029 - u\"User['sqoop']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:51,030 - Modifying user sqoop\n2015-03-09 10:40:51,178 - u\"User['yarn']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:51,179 - Modifying user yarn\n2015-03-09 10:40:51,292 - u\"User['hcat']\" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}\n2015-03-09 10:40:51,293 - Modifying user hcat\n2015-03-09 10:40:51,450 - u\"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']\" {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}\n2015-03-09 10:40:51,733 - u\"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']\" {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}\n2015-03-09 10:40:51,778 - Skipping u\"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']\" due to not_if\n2015-03-09 10:40:51,778 - u\"Directory['/grid/0/hadoop/hbase']\" {'owner': 'hbase', 'recursive': True, 'mode': 0775, 'cd_access': 'a'}\n2015-03-09 10:40:52,310 - u\"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']\" {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}\n2015-03-09 10:40:52,606 - u\"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']\" {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}\n2015-03-09 10:40:52,651 - Skipping u\"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']\" due to not_if\n2015-03-09 10:40:52,652 - u\"Group['hdfs']\" {'ignore_failures': False}\n2015-03-09 10:40:52,653 - Modifying group hdfs\n2015-03-09 10:40:52,700 - u\"User['hdfs']\" {'ignore_failures': False, 'groups': [u'hadoop', 'hdfs', u'hdfs']}\n2015-03-09 10:40:52,702 - Modifying user hdfs\n2015-03-09 10:40:52,888 - u\"Directory['/etc/hadoop']\" {'mode': 0755}\n2015-03-09 10:40:53,038 - u\"Directory['/etc/hadoop/conf.empty']\" {'owner': 'hdfs', 'group': 'hadoop', 'recursive': True}\n2015-03-09 10:40:53,200 - u\"Link['/etc/hadoop/conf']\" {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}\n2015-03-09 10:40:53,248 - Skipping u\"Link['/etc/hadoop/conf']\" due to not_if\n2015-03-09 10:40:53,275 - u\"File['/etc/hadoop/conf/hadoop-env.sh']\" {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}\n2015-03-09 10:40:53,540 - u\"Execute['('setenforce', '0')']\" {'sudo': True, 'only_if': 'test -f /selinux/enforce'}\n2015-03-09 10:40:53,606 - Skipping u\"Execute['('setenforce', '0')']\" due to only_if\n2015-03-09 10:40:53,607 - u\"Directory['/var/opt/teradata/log/hadoop']\" {'owner': 'root', 'mode': 0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}\n2015-03-09 10:40:54,226 - u\"Directory['/var/run/hadoop']\" {'owner': 'root', 'group': 'root', 'recursive': True, 'cd_access': 'a'}\n2015-03-09 10:40:54,662 - u\"Directory['/tmp/hadoop-hdfs']\" {'owner': 'hdfs', 'recursive': True, 'cd_access': 'a'}\n2015-03-09 10:40:55,001 - u\"File['/etc/hadoop/conf/commons-logging.properties']\" {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}\n2015-03-09 10:40:55,252 - u\"File['/etc/hadoop/conf/health_check']\" {'content': Template('health_check-v2.j2'), 'owner': 'hdfs'}\n2015-03-09 10:40:55,499 - u\"File['/etc/hadoop/conf/log4j.properties']\" {'content': '...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}\n2015-03-09 10:40:55,754 - u\"File['/etc/hadoop/conf/hadoop-metrics2.properties']\" {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}\n2015-03-09 10:40:56,002 - u\"File['/etc/hadoop/conf/task-log4j.properties']\" {'content': StaticFile('task-log4j.properties'), 'mode': 0755}\n2015-03-09 10:40:56,297 - u\"File['/etc/hadoop/conf/configuration.xsl']\" {'owner': 'hdfs', 'group': 'hadoop'}\n2015-03-09 10:40:56,745 - u\"Directory['/var/log/storm']\" {'owner': 'storm', 'group': 'hadoop', 'recursive': True, 'mode': 0775}\n2015-03-09 10:40:56,917 - u\"Directory['/var/run/storm']\" {'owner': 'storm', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}\n2015-03-09 10:40:57,345 - u\"Directory['/grid/0/hadoop/storm']\" {'owner': 'storm', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}\n2015-03-09 10:40:57,874 - u\"Directory['/etc/storm/conf']\" {'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}\n2015-03-09 10:40:58,031 - Changing group for /etc/storm/conf from 0 to hadoop\n2015-03-09 10:40:58,361 - u\"File['/etc/storm/conf/config.yaml']\" {'owner': 'storm', 'content': Template('config.yaml.j2'), 'group': 'hadoop'}\n2015-03-09 10:40:58,625 - u\"File['/etc/storm/conf/storm.yaml']\" {'owner': 'storm', 'content': Template('storm.yaml.j2'), 'group': 'hadoop'}\n2015-03-09 10:40:58,884 - u\"File['/etc/storm/conf/storm-env.sh']\" {'content': InlineTemplate(...), 'owner': 'storm'}\n2015-03-09 10:40:59,141 - u\"Execute['source /etc/storm/conf/storm-env.sh ; export PATH=$PATH:$JAVA_HOME/bin ; java -jar /usr/lib/storm/contrib/storm-rest/`ls /usr/lib/storm/contrib/storm-rest | grep -wE storm-rest-[0-9.-]+\\\\.jar` server /etc/storm/conf/config.yaml > /var/log/storm/restapi.log 2>&1']\" {'wait_for_finish': False, 'path': ['/usr/bin'], 'user': 'storm', 'not_if': 'ls /var/run/storm/restapi.pid >/dev/null 2>&1 && ps -p `cat /var/run/storm/restapi.pid` >/dev/null 2>&1'}\n2015-03-09 10:40:59,193 - u\"Execute['/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid']\" {'logoutput': True, 'path': ['/usr/bin'], 'tries': 6, 'user': 'storm', 'try_sleep': 10}\n2015-03-09 10:40:59,691 - Retrying after 10 seconds. Reason: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1. \n2015-03-09 10:41:10,149 - Retrying after 10 seconds. Reason: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1. \n2015-03-09 10:41:20,599 - Retrying after 10 seconds. Reason: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1. \n2015-03-09 10:41:32,211 - Retrying after 10 seconds. Reason: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1. \n2015-03-09 10:41:42,671 - Retrying after 10 seconds. Reason: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1. \n2015-03-09 10:41:53,130 - Error while executing command 'start':\nTraceback (most recent call last):\n File \"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py\", line 214, in execute\n method(env)\n File \"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1.2.1/package/scripts/rest_api.py\", line 60, in start\n service(\"rest_api\", action=\"start\")\n File \"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1.2.1/package/scripts/service.py\", line 72, in service\n path=params.storm_bin_dir\n File \"/usr/lib/python2.6/site-packages/resource_management/core/base.py\", line 148, in __init__\n self.env.run()\n File \"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", line 152, in run\n self.run_action(resource, action)\n File \"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", line 118, in run_action\n provider_action()\n File \"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py\", line 274, in action_run\n raise ex\nFail: Execution of '/usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ && /usr/jdk64/jdk1.7.0_45/bin/jps -l | grep /usr/lib/storm/contrib/storm-rest/storm-rest-.*\\.jar$ | awk {'print $1'} > /var/run/storm/restapi.pid' returned 1.",
> "structured_out" : { }
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)