You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by "Seiffert, Kurt A" <se...@iu.edu> on 2016/06/30 21:34:28 UTC

Error adding Elasticsearch templates for quick-dev-platform install

Hi,

I”m trying to get a development instance of Metron up.

Everything compiled fine and the ansible scripts were running along fine until they try to add the elasticsearch templates. I then get the following errors.

Any suggestions?

Thanks.

> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] ***
> failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 2464, in <module>\r\n    main()\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 340, in uri\r\n    resp, content = h.request(url, method=method, body=body, headers=headers)     \r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n    (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n    self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 2464, in <module>\r\n    main()\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 340, in uri\r\n    resp, content = h.request(url, method=method, body=body, headers=headers)     \r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n    (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n    self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 2464, in <module>\r\n    main()\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 340, in uri\r\n    resp, content = h.request(url, method=method, body=body, headers=headers)     \r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n    (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n    self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> 	to retry, use: --limit @../../playbooks/metron_full_install.retry
> 
> PLAY RECAP *********************************************************************
> node1                      : ok=43   changed=10   unreachable=0    failed=1
> 
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.


Kurt A. Seiffert, GCFA
University Information Security Office
Indiana University
seiffert@iu.edu

Wisdom consists in being able to distinguish among dangers and make a choice of the least harmful. — Niccolo Machiavelli, The Prince


RE: Error adding Elasticsearch templates for quick-dev-platform install

Posted by Keiko Murakami <k....@nanaroq.com>.
In my vagrant host, ansible’s version is 2.2, is this version is suitable to run metron vagrant?

$ ansible --version
ansible 2.2.0 (devel 1b29c87936) last updated 2016/06/27 10:55:25 (GMT +900)

Keiko

-------
From: Nick Allen [mailto:nick@nickallen.org] 
Sent: Friday, July 1, 2016 7:15 AM
To: user@metron.incubator.apache.org
Subject: Re: Error adding Elasticsearch templates for quick-dev-platform install

You probably have the wrong version of Ansible.  Newer versions of Ansible have a bug in them that causes this problem.  You need to be running Ansible 2.0.0.2.  You can follow these instructions.

https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible

On Thu, Jun 30, 2016 at 2:34 PM, Seiffert, Kurt A <se...@iu.edu> wrote:
Hi,

I”m trying to get a development instance of Metron up. 

Everything compiled fine and the ansible scripts were running along fine until they try to add the elasticsearch templates. I then get the following errors. 

Any suggestions?

Thanks.

TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] ***
failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 2464, in <module>\r\n    main()\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 340, in uri\r\n    resp, content = h.request(url, method=method, body=body, headers=headers)     \r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n    (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n    self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 2464, in <module>\r\n    main()\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 340, in uri\r\n    resp, content = h.request(url, method=method, body=body, headers=headers)     \r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n    (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n    self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 2464, in <module>\r\n    main()\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n  File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 340, in uri\r\n    resp, content = h.request(url, method=method, body=body, headers=headers)     \r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n    (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n  File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n    self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
to retry, use: --limit @../../playbooks/metron_full_install.retry

PLAY RECAP *********************************************************************
node1                      : ok=43   changed=10   unreachable=0    failed=1   

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.


Kurt A. Seiffert, GCFA
University Information Security Office
Indiana University
seiffert@iu.edu

Wisdom consists in being able to distinguish among dangers and make a choice of the least harmful. — Niccolo Machiavelli, The Prince





-- 
Nick Allen <ni...@nickallen.org>


Re: Error adding Elasticsearch templates for quick-dev-platform install

Posted by Nick Allen <ni...@nickallen.org>.
You probably have the wrong version of Ansible.  Newer versions of Ansible
have a bug in them that causes this problem.  You need to be running
Ansible 2.0.0.2.  You can follow these instructions.

https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible

On Thu, Jun 30, 2016 at 2:34 PM, Seiffert, Kurt A <se...@iu.edu> wrote:

> Hi,
>
> I”m trying to get a development instance of Metron up.
>
> Everything compiled fine and the ansible scripts were running along fine
> until they try to add the elasticsearch templates. I then get the following
> errors.
>
> Any suggestions?
>
> Thanks.
>
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies] ***
> failed: [node1] =>
> (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template)
> => {"failed": true, "item":
> "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template",
> "module_stderr": "", "module_stdout": "Traceback (most recent call
> last):\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\",
> line 2464, in <module>\r\n    main()\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\",
> line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user,
> password, body, body_format, method, dict_headers, redirects,
> socket_timeout, validate_certs)\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\",
> line 340, in uri\r\n    resp, content = h.request(url, method=method,
> body=body, headers=headers)     \r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in
> request\r\n    (response, content) = self._request(conn, authority, uri,
> request_uri, method, body, headers, redirections, cachekey)\r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in
> _request\r\n    (response, content) = self._conn_request(conn, request_uri,
> method, body, headers)\r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in
> _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n
> File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n
> self._send_request(method, url, body, headers)\r\n  File
> \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n
> self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in
> send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in
> sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not
> dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] =>
> (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template)
> => {"failed": true, "item":
> "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template",
> "module_stderr": "", "module_stdout": "Traceback (most recent call
> last):\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\",
> line 2464, in <module>\r\n    main()\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\",
> line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user,
> password, body, body_format, method, dict_headers, redirects,
> socket_timeout, validate_certs)\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\",
> line 340, in uri\r\n    resp, content = h.request(url, method=method,
> body=body, headers=headers)     \r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in
> request\r\n    (response, content) = self._request(conn, authority, uri,
> request_uri, method, body, headers, redirections, cachekey)\r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in
> _request\r\n    (response, content) = self._conn_request(conn, request_uri,
> method, body, headers)\r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in
> _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n
> File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n
> self._send_request(method, url, body, headers)\r\n  File
> \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n
> self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in
> send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in
> sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not
> dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] =>
> (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template)
> => {"failed": true, "item":
> "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template",
> "module_stderr": "", "module_stdout": "Traceback (most recent call
> last):\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\",
> line 2464, in <module>\r\n    main()\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\",
> line 453, in main\r\n    resp, content, dest = uri(module, url, dest, user,
> password, body, body_format, method, dict_headers, redirects,
> socket_timeout, validate_certs)\r\n  File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\",
> line 340, in uri\r\n    resp, content = h.request(url, method=method,
> body=body, headers=headers)     \r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in
> request\r\n    (response, content) = self._request(conn, authority, uri,
> request_uri, method, body, headers, redirections, cachekey)\r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in
> _request\r\n    (response, content) = self._conn_request(conn, request_uri,
> method, body, headers)\r\n  File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in
> _conn_request\r\n    conn.request(method, request_uri, body, headers)\r\n
> File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n
> self._send_request(method, url, body, headers)\r\n  File
> \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n
> self.send(body)\r\n  File \"/usr/lib64/python2.6/httplib.py\", line 781, in
> send\r\n    self.sock.sendall(str)\r\n  File \"<string>\", line 1, in
> sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not
> dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> to retry, use: --limit @../../playbooks/metron_full_install.retry
>
> PLAY RECAP
> *********************************************************************
> node1                      : ok=43   changed=10   unreachable=0
> failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
>
>
>
> Kurt A. Seiffert, GCFA
> University Information Security Office
> Indiana University
> seiffert@iu.edu
>
> Wisdom consists in being able to distinguish among dangers and make a
> choice of the least harmful. — Niccolo Machiavelli, The Prince
>
>


-- 
Nick Allen <ni...@nickallen.org>