You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "jun aoki (JIRA)" <ji...@apache.org> on 2014/10/02 02:26:35 UTC

[jira] [Created] (AMBARI-7604) How to build Ambari wiki missing ambari-log4j rpm

jun aoki created AMBARI-7604:
--------------------------------

             Summary: How to build Ambari wiki missing ambari-log4j rpm 
                 Key: AMBARI-7604
                 URL: https://issues.apache.org/jira/browse/AMBARI-7604
             Project: Ambari
          Issue Type: Bug
            Reporter: jun aoki
            Assignee: jun aoki


When you are building from the source code, installing ambari-server,  registering ambari-agent manually and deploying a cluster. 
It fails due to ambari-log4j package

{code}
INFO 2014-10-01 20:04:42,867 PythonExecutor.py:117 - Result: {'structuredOut': {}, 'stdout': '2014-10-01 20:04:02,799 - Execute[\'mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://ip-172-31-44-91.us-west-2.compute.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip\'] {\'environment\': ..., \'not_if\': \'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip\', \'ignore_failures\': True, \'path\': [\'/bin\', \'/usr/bin/\']}\n2014-10-01 20:04:02,945 - Group[\'hadoop\'] {\'ignore_failures\': False}\n2014-10-01 20:04:02,947 - Adding group Group[\'hadoop\']\n2014-10-01 20:04:03,038 - Group[\'nobody\'] {\'ignore_failures\': False}\n2014-10-01 20:04:03,039 - Modifying group nobody\n2014-10-01 20:04:03,100 - Group[\'users\'] {\'ignore_failures\': False}\n2014-10-01 20:04:03,100 - Modifying group users\n2014-10-01 20:04:03,159 - Group[\'nagios\'] {\'ignore_failures\': False}\n2014-10-01 20:04:03,160 - Adding group Group[\'nagios\']\n2014-10-01 20:04:03,225 - User[\'nobody\'] {\'gid\': \'hadoop\', \'ignore_failures\': False, \'groups\': [u\'nobody\']}\n2014-10-01 20:04:03,225 - Modifying user nobody\n2014-10-01 20:04:03,355 - User[\'mapred\'] {\'gid\': \'hadoop\', \'ignore_failures\': False, \'groups\': [u\'hadoop\']}\n2014-10-01 20:04:03,355 - Adding user User[\'mapred\']\n2014-10-01 20:04:03,626 - User[\'nagios\'] {\'gid\': \'nagios\', \'ignore_failures\': False, \'groups\': [u\'hadoop\']}\n2014-10-01 20:04:03,627 - Adding user User[\'nagios\']\n2014-10-01 20:04:03,929 - User[\'ambari-qa\'] {\'gid\': \'hadoop\', \'ignore_failures\': False, \'groups\': [u\'users\']}\n2014-10-01 20:04:03,930 - Adding user User[\'ambari-qa\']\n2014-10-01 20:04:04,182 - User[\'zookeeper\'] {\'gid\': \'hadoop\', \'ignore_failures\': False, \'groups\': [u\'hadoop\']}\n2014-10-01 20:04:04,182 - Adding user User[\'zookeeper\']\n2014-10-01 20:04:04,435 - User[\'hdfs\'] {\'gid\': \'hadoop\', \'ignore_failures\': False, \'groups\': [u\'hadoop\']}\n2014-10-01 20:04:04,435 - Adding user User[\'hdfs\']\n2014-10-01 20:04:04,686 - User[\'yarn\'] {\'gid\': \'hadoop\', \'ignore_failures\': False, \'groups\': [u\'hadoop\']}\n2014-10-01 20:04:04,687 - Adding user User[\'yarn\']\n2014-10-01 20:04:04,950 - File[\'/var/lib/ambari-agent/data/tmp/changeUid.sh\'] {\'content\': StaticFile(\'changeToSecureUid.sh\'), \'mode\': 0555}\n2014-10-01 20:04:04,951 - Writing File[\'/var/lib/ambari-agent/data/tmp/changeUid.sh\'] because it doesn\'t exist\n2014-10-01 20:04:04,951 - Changing permission for /var/lib/ambari-agent/data/tmp/changeUid.sh from 644 to 555\n2014-10-01 20:04:04,952 - Execute[\'/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null\'] {\'not_if\': \'test $(id -u ambari-qa) -gt 1000\'}\n2014-10-01 20:04:05,275 - Directory[\'/etc/hadoop/conf.empty\'] {\'owner\': \'root\', \'group\': \'root\', \'recursive\': True}\n2014-10-01 20:04:05,276 - Creating directory Directory[\'/etc/hadoop/conf.empty\']\n2014-10-01 20:04:05,277 - Link[\'/etc/hadoop/conf\'] {\'not_if\': \'ls /etc/hadoop/conf\', \'to\': \'/etc/hadoop/conf.empty\'}\n2014-10-01 20:04:05,339 - Creating symbolic Link[\'/etc/hadoop/conf\']\n2014-10-01 20:04:05,360 - File[\'/etc/hadoop/conf/hadoop-env.sh\'] {\'content\': InlineTemplate(...), \'owner\': \'hdfs\'}\n2014-10-01 20:04:05,361 - Writing File[\'/etc/hadoop/conf/hadoop-env.sh\'] because it doesn\'t exist\n2014-10-01 20:04:05,361 - Changing owner for /etc/hadoop/conf/hadoop-env.sh from 0 to hdfs\n2014-10-01 20:04:05,400 - Repository[\'HDP-2.0.6\'] {\'base_url\': \'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.0.6.1\', \'action\': [\'create\'], \'components\': [u\'HDP\', \'main\'], \'repo_template\': \'repo_suse_rhel.j2\', \'repo_file_name\': \'HDP\', \'mirror_list\': None}\n2014-10-01 20:04:05,418 - File[\'/etc/yum.repos.d/HDP.repo\'] {\'content\': Template(\'repo_suse_rhel.j2\')}\n2014-10-01 20:04:05,419 - Writing File[\'/etc/yum.repos.d/HDP.repo\'] because it doesn\'t exist\n2014-10-01 20:04:05,419 - Repository[\'HDP-UTILS-1.1.0.17\'] {\'base_url\': \'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.17/repos/centos6\', \'action\': [\'create\'], \'components\': [u\'HDP-UTILS\', \'main\'], \'repo_template\': \'repo_suse_rhel.j2\', \'repo_file_name\': \'HDP-UTILS\', \'mirror_list\': None}\n2014-10-01 20:04:05,422 - File[\'/etc/yum.repos.d/HDP-UTILS.repo\'] {\'content\': Template(\'repo_suse_rhel.j2\')}\n2014-10-01 20:04:05,430 - Writing File[\'/etc/yum.repos.d/HDP-UTILS.repo\'] because it doesn\'t exist\n2014-10-01 20:04:05,431 - Package[\'unzip\'] {}\n2014-10-01 20:04:05,535 - Skipping installing existent package unzip\n2014-10-01 20:04:05,544 - Package[\'curl\'] {}\n2014-10-01 20:04:05,615 - Skipping installing existent package curl\n2014-10-01 20:04:05,625 - Execute[\'mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/ ;   curl -kf -x ""   --retry 10 http://ip-172-31-44-91.us-west-2.compute.internal:8080/resources//jdk-7u67-linux-x64.tar.gz -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz\'] {\'environment\': ..., \'not_if\': \'test -e /usr/jdk64/jdk1.7.0_67/bin/java\', \'path\': [\'/bin\', \'/usr/bin/\']}\n2014-10-01 20:04:05,675 - Skipping Execute[\'mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/ ;   curl -kf -x ""   --retry 10 http://ip-172-31-44-91.us-west-2.compute.internal:8080/resources//jdk-7u67-linux-x64.tar.gz -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz\'] due to not_if\n2014-10-01 20:04:05,676 - Execute[\'mkdir -p /usr/jdk64 ; cd /usr/jdk64 ; tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz > /dev/null 2>&1\'] {\'not_if\': \'test -e /usr/jdk64/jdk1.7.0_67/bin/java\', \'path\': [\'/bin\', \'/usr/bin/\']}\n2014-10-01 20:04:05,729 - Skipping Execute[\'mkdir -p /usr/jdk64 ; cd /usr/jdk64 ; tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz > /dev/null 2>&1\'] due to not_if\n2014-10-01 20:04:06,006 - Package[\'hadoop\'] {}\n2014-10-01 20:04:06,085 - Installing package hadoop (\'/usr/bin/yum -d 0 -e 0 -y install hadoop\')\n2014-10-01 20:04:25,386 - Package[\'snappy\'] {}\n2014-10-01 20:04:25,473 - Skipping installing existent package snappy\n2014-10-01 20:04:25,474 - Package[\'snappy-devel\'] {}\n2014-10-01 20:04:25,551 - Installing package snappy-devel (\'/usr/bin/yum -d 0 -e 0 -y install snappy-devel\')\n2014-10-01 20:04:28,904 - Package[\'hadoop-libhdfs\'] {}\n2014-10-01 20:04:28,979 - Installing package hadoop-libhdfs (\'/usr/bin/yum -d 0 -e 0 -y install hadoop-libhdfs\')\n2014-10-01 20:04:41,192 - Package[\'ambari-log4j\'] {}\n2014-10-01 20:04:41,286 - Installing package ambari-log4j (\'/usr/bin/yum -d 0 -e 0 -y install ambari-log4j\')\n2014-10-01 20:04:42,815 - Error while executing command \'install\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/HDFS/package/scripts/datanode.py", line 29, in install\n    self.install_packages(env, params.exclude_packages)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 187, in install_packages\n    Package(name)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__\n    self.env.run()\n  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run\n    self.run_action(resource, action)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action\n    provider_action()\n  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 40, in action_install\n    self.install_package(package_name)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 36, in install_package\n    shell.checked_call(cmd)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 36, in checked_call\n    return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 96, in _call\n    raise Fail(err_msg)\nFail: Execution of \'/usr/bin/yum -d 0 -e 0 -y install ambari-log4j\' returned 1. Error: Nothing to do', 'stderr': '/usr/lib/python2.6/site-packages/resource_management/libraries/functions/file_system.py:40: SyntaxWarning: name \'mounts\' is used prior to global declaration\n  global mounts\n2014-10-01 20:04:42,815 - Error while executing command \'install\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/HDFS/package/scripts/datanode.py", line 29, in install\n    self.install_packages(env, params.exclude_packages)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 187, in install_packages\n    Package(name)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__\n    self.env.run()\n  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run\n    self.run_action(resource, action)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action\n    provider_action()\n  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 40, in action_install\n    self.install_package(package_name)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 36, in install_package\n    shell.checked_call(cmd)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 36, in checked_call\n    return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path)\n  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 96, in _call\n    raise Fail(err_msg)\nFail: Execution of \'/usr/bin/yum -d 0 -e 0 -y install ambari-log4j\' returned 1. Error: Nothing to do', 'exitcode': 1}INFO 2014-10-01 20:04:42,879 ActionQueue.py:203 - Executing command with id = 17-1 for role = GANGLIA_MONITOR of cluster aaa.
INFO 2014-10-01 20:04:42,919 PythonExecutor.py:84 - Running command ['/usr/bin/python2.6',
 u'/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py',
 u'INSTALL',
 '/var/lib/ambari-agent/data/command-4.json',
 u'/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL',
 '/var/lib/ambari-agent/data/structured-out-4.json',
 'INFO',
 '/var/lib/ambari-agent/data/tmp']
{code}

The following snippet should be added to the build from source document .
https://cwiki.apache.org/confluence/display/AMBARI/Build+and+install+Ambari+1.6.1+from+Source

{code}
cd contrib/ambari-log4j
mvn package rpm:rpm -DskipTests
sudo yum install -y  target/rpm/ambari-log4j/RPMS/noarch/ambari-log4j-1.2.1-SNAPSHOT20141002001512.noarch.rpm
{code}

Could anyone give me a wiki access so that I can add?




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)