You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/10/21 23:28:00 UTC

[jira] [Commented] (METRON-1839) Install Elasticsearch MPack Step in Ansible Not Idempotent

    [ https://issues.apache.org/jira/browse/METRON-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658431#comment-16658431 ] 

ASF GitHub Bot commented on METRON-1839:
----------------------------------------

Github user anandsubbu commented on the issue:

    https://github.com/apache/metron/pull/1244
  
    Hey @nickwallen , I am seeing an error at the `ambari_gather_facts : Ask Ambari: core_site_tag` step when trying to validate the fix. 
    
    1. Re-created the problem first by:
    a) Running `vagrant up`
    b) Then attempting `vagrant provision` again
    c) Noticed the following error:
    ```
    TASK [ambari_master : Install Elasticsearch MPack on Ambari Host] **************
    fatal: [node1]: FAILED! => {"changed": true, "cmd": "ambari-server install-mpack --mpack=/tmp/elasticsearch_mpack-0.6.1.0.tar.gz", "delta": "0:00:00.433435", "end": "2018-10-21 18:12:29.939320", "msg": "non-zero return code", "rc": 255, "start": "2018-10-21 18:12:29.505885", "stderr": "", "stderr_lines": [], "stdout": "Using python  /usr/bin/python\nInstalling management pack\nERROR: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!\nERROR: Exiting with exit code -1. \nREASON: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!", "stdout_lines": ["Using python  /usr/bin/python", "Installing management pack", "ERROR: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!", "ERROR: Exiting with exit code -1. ", "REASON: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!"]}
    	to retry, use: --limit @/Users/asubramanian/Desktop/Metron/anand-metron-fork/metron-latest/metron/metron-deployment/development/centos6/ansible/playbook.retry
    ```
    
    2. Destroyed the VM, applied the fix and 
    a) Running `vagrant up`
    b) Then ran `vagrant --ansible-skip-tags="build,sensors" provision` after which I am seeing the below error:
    ```
    <snip>
    TASK [ambari_gather_facts : Ask Ambari: namenode_host] *************************
    changed: [node1]
    
    TASK [ambari_gather_facts : set_fact] ******************************************
    ok: [node1]
    
    TASK [ambari_gather_facts : Ask Ambari: core_site_tag] *************************
    fatal: [node1]: FAILED! => {"changed": true, "cmd": "curl -s -u admin:admin -X GET -H \"X-Requested-By: ambari\" 'http://node1:8080/api/v1/clusters/metron_cluster/hosts/node1/host_components/NAMENODE' | python -c 'import sys, json; print json.load(sys.stdin)[\"HostRoles\"][\"actual_configs\"][\"core-site\"][\"default\"]'", "delta": "0:00:00.060271", "end": "2018-10-21 23:19:31.928568", "msg": "non-zero return code", "rc": 1, "start": "2018-10-21 23:19:31.868297", "stderr": "Traceback (most recent call last):\n  File \"<string>\", line 1, in <module>\nKeyError: 'core-site'", "stderr_lines": ["Traceback (most recent call last):", "  File \"<string>\", line 1, in <module>", "KeyError: 'core-site'"], "stdout": "", "stdout_lines": []}
    	to retry, use: --limit @/Users/asubramanian/Desktop/Metron/anand-metron-fork/metron-latest/metron/metron-deployment/development/centos6/ansible/playbook.retry
    ```
    
    Am I missing something?


> Install Elasticsearch MPack Step in Ansible Not Idempotent
> ----------------------------------------------------------
>
>                 Key: METRON-1839
>                 URL: https://issues.apache.org/jira/browse/METRON-1839
>             Project: Metron
>          Issue Type: Bug
>            Reporter: Nick Allen
>            Assignee: Nick Allen
>            Priority: Major
>
> When re-provisioning the development environment, the "Install Elasticsearch MPack on Ambari Host" step will fail.  This step needs to be idempotent so it succeeds when re-provisioned.
>  
> Steps to Replicate:
> 1. Start the development environment.
> {code:java}
> cd metron-deployment/development/centos6
> vagrant up{code}
> 2. Re-provision the environment.
> {code:java}
> vagrant provision{code}
> This will fail with the following error message.
> {code:java}
> TASK [ambari_master : Install Elasticsearch MPack on Ambari Host] **************
> fatal: [node1]: FAILED! => {"changed": true, "cmd": "ambari-server install-mpack --mpack=/tmp/elasticsearch_mpack-0.6.1.0.tar.gz", "delta": "0:00:00.360554", "end": "2018-10-20 17:13:54.836885", "msg": "non-zero return code", "rc": 255, "start": "2018-10-20 17:13:54.476331", "stderr": "", "stderr_lines": [], "stdout": "Using python /usr/bin/python\nInstalling management pack\nERROR: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!\nERROR: Exiting with exit code -1. \nREASON: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!", "stdout_lines": ["Using python /usr/bin/python", "Installing management pack", "ERROR: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!", "ERROR: Exiting with exit code -1. ", "REASON: Management pack elasticsearch-ambari.mpack-5.6.2 already installed!"]}
> to retry, use: --limit @/Users/nallen/tmp/metron-pr1238/metron-deployment/development/centos6/ansible/playbook.retry
> PLAY RECAP *********************************************************************
> node1 : ok=36 changed=5 unreachable=0 failed=1
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)