You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by "Seiffert, Kurt A" <se...@iu.edu> on 2016/06/30 21:34:28 UTC
Error adding Elasticsearch templates for quick-dev-platform install
Hi,
I”m trying to get a development instance of Metron up.
Everything compiled fine and the ansible scripts were running along fine until they try to add the elasticsearch templates. I then get the following errors.
Any suggestions?
Thanks.
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] ***
> failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 2464, in <module>\r\n main()\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 453, in main\r\n resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 340, in uri\r\n resp, content = h.request(url, method=method, body=body, headers=headers) \r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n self._send_request(method, url, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 2464, in <module>\r\n main()\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 453, in main\r\n resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 340, in uri\r\n resp, content = h.request(url, method=method, body=body, headers=headers) \r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n self._send_request(method, url, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 2464, in <module>\r\n main()\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 453, in main\r\n resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 340, in uri\r\n resp, content = h.request(url, method=method, body=body, headers=headers) \r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n self._send_request(method, url, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> to retry, use: --limit @../../playbooks/metron_full_install.retry
>
> PLAY RECAP *********************************************************************
> node1 : ok=43 changed=10 unreachable=0 failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
Kurt A. Seiffert, GCFA
University Information Security Office
Indiana University
seiffert@iu.edu
Wisdom consists in being able to distinguish among dangers and make a choice of the least harmful. — Niccolo Machiavelli, The Prince
RE: Error adding Elasticsearch templates for quick-dev-platform install
Posted by Keiko Murakami <k....@nanaroq.com>.
In my vagrant host, ansible’s version is 2.2, is this version is suitable to run metron vagrant?
$ ansible --version
ansible 2.2.0 (devel 1b29c87936) last updated 2016/06/27 10:55:25 (GMT +900)
Keiko
-------
From: Nick Allen [mailto:nick@nickallen.org]
Sent: Friday, July 1, 2016 7:15 AM
To: user@metron.incubator.apache.org
Subject: Re: Error adding Elasticsearch templates for quick-dev-platform install
You probably have the wrong version of Ansible. Newer versions of Ansible have a bug in them that causes this problem. You need to be running Ansible 2.0.0.2. You can follow these instructions.
https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible
On Thu, Jun 30, 2016 at 2:34 PM, Seiffert, Kurt A <se...@iu.edu> wrote:
Hi,
I”m trying to get a development instance of Metron up.
Everything compiled fine and the ansible scripts were running along fine until they try to add the elasticsearch templates. I then get the following errors.
Any suggestions?
Thanks.
TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] ***
failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 2464, in <module>\r\n main()\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 453, in main\r\n resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\", line 340, in uri\r\n resp, content = h.request(url, method=method, body=body, headers=headers) \r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n self._send_request(method, url, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 2464, in <module>\r\n main()\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 453, in main\r\n resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\", line 340, in uri\r\n resp, content = h.request(url, method=method, body=body, headers=headers) \r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n self._send_request(method, url, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
failed: [node1] => (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template) => {"failed": true, "item": "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template", "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 2464, in <module>\r\n main()\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 453, in main\r\n resp, content, dest = uri(module, url, dest, user, password, body, body_format, method, dict_headers, redirects, socket_timeout, validate_certs)\r\n File \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\", line 340, in uri\r\n resp, content = h.request(url, method=method, body=body, headers=headers) \r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in request\r\n (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in _request\r\n (response, content) = self._conn_request(conn, request_uri, method, body, headers)\r\n File \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n self._send_request(method, url, body, headers)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
to retry, use: --limit @../../playbooks/metron_full_install.retry
PLAY RECAP *********************************************************************
node1 : ok=43 changed=10 unreachable=0 failed=1
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.
Kurt A. Seiffert, GCFA
University Information Security Office
Indiana University
seiffert@iu.edu
Wisdom consists in being able to distinguish among dangers and make a choice of the least harmful. — Niccolo Machiavelli, The Prince
--
Nick Allen <ni...@nickallen.org>
Re: Error adding Elasticsearch templates for quick-dev-platform install
Posted by Nick Allen <ni...@nickallen.org>.
You probably have the wrong version of Ansible. Newer versions of Ansible
have a bug in them that causes this problem. You need to be running
Ansible 2.0.0.2. You can follow these instructions.
https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible
On Thu, Jun 30, 2016 at 2:34 PM, Seiffert, Kurt A <se...@iu.edu> wrote:
> Hi,
>
> I”m trying to get a development instance of Metron up.
>
> Everything compiled fine and the ansible scripts were running along fine
> until they try to add the elasticsearch templates. I then get the following
> errors.
>
> Any suggestions?
>
> Thanks.
>
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies] ***
> failed: [node1] =>
> (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template)
> => {"failed": true, "item":
> "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template",
> "module_stderr": "", "module_stdout": "Traceback (most recent call
> last):\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\",
> line 2464, in <module>\r\n main()\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\",
> line 453, in main\r\n resp, content, dest = uri(module, url, dest, user,
> password, body, body_format, method, dict_headers, redirects,
> socket_timeout, validate_certs)\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.56-117767327161454/uri\",
> line 340, in uri\r\n resp, content = h.request(url, method=method,
> body=body, headers=headers) \r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in
> request\r\n (response, content) = self._request(conn, authority, uri,
> request_uri, method, body, headers, redirections, cachekey)\r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in
> _request\r\n (response, content) = self._conn_request(conn, request_uri,
> method, body, headers)\r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in
> _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n
> File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n
> self._send_request(method, url, body, headers)\r\n File
> \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n
> self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in
> send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in
> sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not
> dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] =>
> (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template)
> => {"failed": true, "item":
> "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template",
> "module_stderr": "", "module_stdout": "Traceback (most recent call
> last):\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\",
> line 2464, in <module>\r\n main()\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\",
> line 453, in main\r\n resp, content, dest = uri(module, url, dest, user,
> password, body, body_format, method, dict_headers, redirects,
> socket_timeout, validate_certs)\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318397.89-242405299152993/uri\",
> line 340, in uri\r\n resp, content = h.request(url, method=method,
> body=body, headers=headers) \r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in
> request\r\n (response, content) = self._request(conn, authority, uri,
> request_uri, method, body, headers, redirections, cachekey)\r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in
> _request\r\n (response, content) = self._conn_request(conn, request_uri,
> method, body, headers)\r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in
> _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n
> File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n
> self._send_request(method, url, body, headers)\r\n File
> \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n
> self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in
> send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in
> sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not
> dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> failed: [node1] =>
> (item=/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template)
> => {"failed": true, "item":
> "/Users/seiffert/devops/incubator-metron/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template",
> "module_stderr": "", "module_stdout": "Traceback (most recent call
> last):\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\",
> line 2464, in <module>\r\n main()\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\",
> line 453, in main\r\n resp, content, dest = uri(module, url, dest, user,
> password, body, body_format, method, dict_headers, redirects,
> socket_timeout, validate_certs)\r\n File
> \"/home/vagrant/.ansible/tmp/ansible-tmp-1467318398.13-193209219489933/uri\",
> line 340, in uri\r\n resp, content = h.request(url, method=method,
> body=body, headers=headers) \r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1609, in
> request\r\n (response, content) = self._request(conn, authority, uri,
> request_uri, method, body, headers, redirections, cachekey)\r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1351, in
> _request\r\n (response, content) = self._conn_request(conn, request_uri,
> method, body, headers)\r\n File
> \"/usr/lib/python2.6/site-packages/httplib2/__init__.py\", line 1273, in
> _conn_request\r\n conn.request(method, request_uri, body, headers)\r\n
> File \"/usr/lib64/python2.6/httplib.py\", line 936, in request\r\n
> self._send_request(method, url, body, headers)\r\n File
> \"/usr/lib64/python2.6/httplib.py\", line 976, in _send_request\r\n
> self.send(body)\r\n File \"/usr/lib64/python2.6/httplib.py\", line 781, in
> send\r\n self.sock.sendall(str)\r\n File \"<string>\", line 1, in
> sendall\r\nTypeError: sendall() argument 1 must be string or buffer, not
> dict\r\n", "msg": "MODULE FAILURE", "parsed": false}
> to retry, use: --limit @../../playbooks/metron_full_install.retry
>
> PLAY RECAP
> *********************************************************************
> node1 : ok=43 changed=10 unreachable=0
> failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
>
>
>
> Kurt A. Seiffert, GCFA
> University Information Security Office
> Indiana University
> seiffert@iu.edu
>
> Wisdom consists in being able to distinguish among dangers and make a
> choice of the least harmful. — Niccolo Machiavelli, The Prince
>
>
--
Nick Allen <ni...@nickallen.org>