You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by Matt Foley <ma...@apache.org> on 2016/11/18 21:34:03 UTC

problem with vagrant launch

Hi,
I'm trying to launch vanilla vagrant single-node test env for Metron on a Mac, via
“vagrant up” in metron-deployment/vagrant/full-dev-platform
 
The Ambari install all goes fine, then the Elastic Search install
but when it comes to
TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies]
it fails on all three (bro, snort, yaf indexes) with
"Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict"
 
Launching from metron-deployment/vagrant/quick-dev-platform had the same failure point.
 
All three *_index.template files are present in the specified directory.
 
Does anyone recognize this problem?  Have people been running the vagrant test env lately?
Any suggestions for debugging?

Thanks,
--Matt

Cmd line output:
…
TASK [metron_elasticsearch_templates : Wait for Index to Become Available] *****
ok: [node1]

TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] ***
failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template) => {"content": "", "failed": true, "item": "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template", "msg": "Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict", "redirected": false, "status": -1, "url": "http://node1:9200/_template/bro_index"}
failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template) => {"content": "", "failed": true, "item": "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template", "msg": "Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict", "redirected": false, "status": -1, "url": "http://node1:9200/_template/snort_index"}
failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template) => {"content": "", "failed": true, "item": "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template", "msg": "Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict", "redirected": false, "status": -1, "url": "http://node1:9200/_template/yaf_index"}

NO MORE HOSTS LEFT *************************************************************
	to retry, use: --limit @/Users/mfoley/projects/Metron/metron532/metron-deployment/playbooks/metron_full_install.retry

PLAY RECAP *********************************************************************
node1                      : ok=44   changed=12   unreachable=0    failed=1   

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.





Re: problem with vagrant launch

Posted by Matt Foley <ma...@apache.org>.
Thanks everybody, looks like the smoking gun.
--Matt


On 11/21/16, 11:04 AM, "Nick Allen" <ni...@nickallen.org> wrote:

    https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible
    
    
    On Mon, Nov 21, 2016 at 1:58 PM, Otto Fowler <ot...@gmail.com>
    wrote:
    
    > Matt,
    > They have to be EXACTLY the versions.
    >
    >
    >
    > On November 21, 2016 at 13:27:49, Matt Foley (mattf@apache.org) wrote:
    >
    > I had checked them, and they are all >= the specified requirement in
    > https://github.com/apache/incubator-metron/tree/master/
    > metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites
    > :
    > Ansible 2.1.2.0
    > Vagrant 1.8.6
    > Virtualbox 5.0.24
    > Python 2.7.12
    > Maven 3.3.9
    >
    > The only one significantly different is Ansible; the requirement is
    > 2.0.0.2.
    > Is Ansible 2.1 not compatible with Ansible 2.0? I let homebrew install the
    > latest version.
    > Thanks,
    > --Matt
    >
    > From: Otto Fowler <ot...@gmail.com>
    > Date: Saturday, November 19, 2016 at 5:18 AM
    > To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>,
    > Matt Foley <ma...@apache.org>
    > Subject: Re: problem with vagrant launch
    >
    > What versions of ansible, vagrant, virtualbox and python do you have?
    >
    >
    >
    > On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
    > Hi,
    > I'm trying to launch vanilla vagrant single-node test env for Metron on a
    > Mac, via
    > “vagrant up” in metron-deployment/vagrant/full-dev-platform
    >
    > The Ambari install all goes fine, then the Elastic Search install
    > but when it comes to
    > TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
    > topologies]
    > it fails on all three (bro, snort, yaf indexes) with
    > "Status code was not [200]: An unknown error occurred: sendall() argument 1
    > must be string or buffer, not dict"
    >
    > Launching from metron-deployment/vagrant/quick-dev-platform had the same
    > failure point.
    >
    > All three *_index.template files are present in the specified directory.
    >
    > Does anyone recognize this problem? Have people been running the vagrant
    > test env lately?
    > Any suggestions for debugging?
    >
    > Thanks,
    > --Matt
    >
    > Cmd line output:
    > …
    > TASK [metron_elasticsearch_templates : Wait for Index to Become Available]
    > *****
    > ok: [node1]
    >
    > TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
    > topologies] ***
    > failed: [node1]
    > (item=/Users/mfoley/projects/Metron/metron532/metron-
    > deployment/roles/metron_elasticsearch_templates/files/
    > es_templates/bro_index.template)
    > => {"content": "", "failed": true, "item":
    > "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_
    > elasticsearch_templates/files/es_templates/bro_index.template",
    > "msg": "Status code was not [200]: An unknown error occurred: sendall()
    > argument 1 must be string or buffer, not dict", "redirected": false,
    > "status": -1, "url": "http://node1:9200/_template/bro_index"}
    > failed: [node1]
    > (item=/Users/mfoley/projects/Metron/metron532/metron-
    > deployment/roles/metron_elasticsearch_templates/files/
    > es_templates/snort_index.template)
    > => {"content": "", "failed": true, "item":
    > "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_
    > elasticsearch_templates/files/es_templates/snort_index.template",
    > "msg": "Status code was not [200]: An unknown error occurred: sendall()
    > argument 1 must be string or buffer, not dict", "redirected": false,
    > "status": -1, "url": "http://node1:9200/_template/snort_index"}
    > failed: [node1]
    > (item=/Users/mfoley/projects/Metron/metron532/metron-
    > deployment/roles/metron_elasticsearch_templates/files/
    > es_templates/yaf_index.template)
    > => {"content": "", "failed": true, "item":
    > "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_
    > elasticsearch_templates/files/es_templates/yaf_index.template",
    > "msg": "Status code was not [200]: An unknown error occurred: sendall()
    > argument 1 must be string or buffer, not dict", "redirected": false,
    > "status": -1, "url": "http://node1:9200/_template/yaf_index"}
    >
    > NO MORE HOSTS LEFT
    > *************************************************************
    > to retry, use: --limit
    > @/Users/mfoley/projects/Metron/metron532/metron-
    > deployment/playbooks/metron_full_install.retry
    >
    >
    > PLAY RECAP
    > *********************************************************************
    > node1                      : ok=44   changed=12   unreachable=0
    > failed=1
    >
    > Ansible failed to complete successfully. Any error output should be
    > visible above. Please fix these errors and try again.
    >
    
    
    
    -- 
    Nick Allen <ni...@nickallen.org>
    



Re: problem with vagrant launch

Posted by Nick Allen <ni...@nickallen.org>.
https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible


On Mon, Nov 21, 2016 at 1:58 PM, Otto Fowler <ot...@gmail.com>
wrote:

> Matt,
> They have to be EXACTLY the versions.
>
>
>
> On November 21, 2016 at 13:27:49, Matt Foley (mattf@apache.org) wrote:
>
> I had checked them, and they are all >= the specified requirement in
> https://github.com/apache/incubator-metron/tree/master/
> metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites
> :
> Ansible 2.1.2.0
> Vagrant 1.8.6
> Virtualbox 5.0.24
> Python 2.7.12
> Maven 3.3.9
>
> The only one significantly different is Ansible; the requirement is
> 2.0.0.2.
> Is Ansible 2.1 not compatible with Ansible 2.0? I let homebrew install the
> latest version.
> Thanks,
> --Matt
>
> From: Otto Fowler <ot...@gmail.com>
> Date: Saturday, November 19, 2016 at 5:18 AM
> To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>,
> Matt Foley <ma...@apache.org>
> Subject: Re: problem with vagrant launch
>
> What versions of ansible, vagrant, virtualbox and python do you have?
>
>
>
> On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
> Hi,
> I'm trying to launch vanilla vagrant single-node test env for Metron on a
> Mac, via
> “vagrant up” in metron-deployment/vagrant/full-dev-platform
>
> The Ambari install all goes fine, then the Elastic Search install
> but when it comes to
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies]
> it fails on all three (bro, snort, yaf indexes) with
> "Status code was not [200]: An unknown error occurred: sendall() argument 1
> must be string or buffer, not dict"
>
> Launching from metron-deployment/vagrant/quick-dev-platform had the same
> failure point.
>
> All three *_index.template files are present in the specified directory.
>
> Does anyone recognize this problem? Have people been running the vagrant
> test env lately?
> Any suggestions for debugging?
>
> Thanks,
> --Matt
>
> Cmd line output:
> …
> TASK [metron_elasticsearch_templates : Wait for Index to Become Available]
> *****
> ok: [node1]
>
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies] ***
> failed: [node1]
> (item=/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/bro_index.template)
> => {"content": "", "failed": true, "item":
> "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_
> elasticsearch_templates/files/es_templates/bro_index.template",
> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/bro_index"}
> failed: [node1]
> (item=/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/snort_index.template)
> => {"content": "", "failed": true, "item":
> "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_
> elasticsearch_templates/files/es_templates/snort_index.template",
> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/snort_index"}
> failed: [node1]
> (item=/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/yaf_index.template)
> => {"content": "", "failed": true, "item":
> "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_
> elasticsearch_templates/files/es_templates/yaf_index.template",
> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/yaf_index"}
>
> NO MORE HOSTS LEFT
> *************************************************************
> to retry, use: --limit
> @/Users/mfoley/projects/Metron/metron532/metron-
> deployment/playbooks/metron_full_install.retry
>
>
> PLAY RECAP
> *********************************************************************
> node1                      : ok=44   changed=12   unreachable=0
> failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
>



-- 
Nick Allen <ni...@nickallen.org>

Re: problem with vagrant launch

Posted by Otto Fowler <ot...@gmail.com>.
The wiki page on deploying metron to an ambari cluster references a docker
solution as well.
I don’t use this docker image for dev, but I _do_ use it for deployment
builds etc.

https://cwiki.apache.org/confluence/display/METRON/Metron+Installation+on+an+Ambari-Managed+Cluster


On November 21, 2016 at 14:25:08, Zeolla@GMail.com (zeolla@gmail.com) wrote:

Yeah, those version dependencies can be a bit of a pain. I ended up
hacking together a script
<https://github.com/JonZeolla/Development/blob/master/Bash/setupMetron.sh>
to make sure I pull down exactly the right versions, but it's only really
helpful for CentOS 6.8 right now (because that's what I use). In theory it
works, but I didn't finish my testing, so YMMV. Feel free to rip some of
the guts out if it's helpful.

Jon

On Mon, Nov 21, 2016 at 1:58 PM Otto Fowler <ot...@gmail.com>
wrote:

> Matt,
> They have to be EXACTLY the versions.
>
>
>
> On November 21, 2016 at 13:27:49, Matt Foley (mattf@apache.org) wrote:
>
> I had checked them, and they are all >= the specified requirement in
>
>
https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites
> :
> Ansible 2.1.2.0
> Vagrant 1.8.6
> Virtualbox 5.0.24
> Python 2.7.12
> Maven 3.3.9
>
> The only one significantly different is Ansible; the requirement is
> 2.0.0.2.
> Is Ansible 2.1 not compatible with Ansible 2.0? I let homebrew install
the
> latest version.
> Thanks,
> --Matt
>
> From: Otto Fowler <ot...@gmail.com>
> Date: Saturday, November 19, 2016 at 5:18 AM
> To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>,
> Matt Foley <ma...@apache.org>
> Subject: Re: problem with vagrant launch
>
> What versions of ansible, vagrant, virtualbox and python do you have?
>
>
>
> On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
> Hi,
> I'm trying to launch vanilla vagrant single-node test env for Metron on a
> Mac, via
> “vagrant up” in metron-deployment/vagrant/full-dev-platform
>
> The Ambari install all goes fine, then the Elastic Search install
> but when it comes to
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies]
> it fails on all three (bro, snort, yaf indexes) with
> "Status code was not [200]: An unknown error occurred: sendall() argument
1
> must be string or buffer, not dict"
>
> Launching from metron-deployment/vagrant/quick-dev-platform had the same
> failure point.
>
> All three *_index.template files are present in the specified directory.
>
> Does anyone recognize this problem? Have people been running the vagrant
> test env lately?
> Any suggestions for debugging?
>
> Thanks,
> --Matt
>
> Cmd line output:
> …
> TASK [metron_elasticsearch_templates : Wait for Index to Become
Available]
> *****
> ok: [node1]
>
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies] ***
> failed: [node1]
>
>
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template)

> => {"content": "", "failed": true, "item":
>
>
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template",

> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/bro_index"}
> failed: [node1]
>
>
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template)

> => {"content": "", "failed": true, "item":
>
>
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template",

> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/snort_index"}
> failed: [node1]
>
>
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template)

> => {"content": "", "failed": true, "item":
>
>
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template",

> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/yaf_index"}
>
> NO MORE HOSTS LEFT
> *************************************************************
> to retry, use: --limit
>
>
@/Users/mfoley/projects/Metron/metron532/metron-deployment/playbooks/metron_full_install.retry

>
>
> PLAY RECAP
> *********************************************************************
> node1 : ok=44 changed=12 unreachable=0
> failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
>
-- 

Jon

Sent from my mobile device

Re: problem with vagrant launch

Posted by "Zeolla@GMail.com" <ze...@gmail.com>.
Yeah, those version dependencies can be a bit of a pain.  I ended up
hacking together a script
<https://github.com/JonZeolla/Development/blob/master/Bash/setupMetron.sh>
to make sure I pull down exactly the right versions, but it's only really
helpful for CentOS 6.8 right now (because that's what I use).  In theory it
works, but I didn't finish my testing, so YMMV.  Feel free to rip some of
the guts out if it's helpful.

Jon

On Mon, Nov 21, 2016 at 1:58 PM Otto Fowler <ot...@gmail.com> wrote:

> Matt,
> They have to be EXACTLY the versions.
>
>
>
> On November 21, 2016 at 13:27:49, Matt Foley (mattf@apache.org) wrote:
>
> I had checked them, and they are all >= the specified requirement in
>
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites
> :
> Ansible 2.1.2.0
> Vagrant 1.8.6
> Virtualbox 5.0.24
> Python 2.7.12
> Maven 3.3.9
>
> The only one significantly different is Ansible; the requirement is
> 2.0.0.2.
> Is Ansible 2.1 not compatible with Ansible 2.0? I let homebrew install the
> latest version.
> Thanks,
> --Matt
>
> From: Otto Fowler <ot...@gmail.com>
> Date: Saturday, November 19, 2016 at 5:18 AM
> To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>,
> Matt Foley <ma...@apache.org>
> Subject: Re: problem with vagrant launch
>
> What versions of ansible, vagrant, virtualbox and python do you have?
>
>
>
> On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
> Hi,
> I'm trying to launch vanilla vagrant single-node test env for Metron on a
> Mac, via
> “vagrant up” in metron-deployment/vagrant/full-dev-platform
>
> The Ambari install all goes fine, then the Elastic Search install
> but when it comes to
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies]
> it fails on all three (bro, snort, yaf indexes) with
> "Status code was not [200]: An unknown error occurred: sendall() argument 1
> must be string or buffer, not dict"
>
> Launching from metron-deployment/vagrant/quick-dev-platform had the same
> failure point.
>
> All three *_index.template files are present in the specified directory.
>
> Does anyone recognize this problem? Have people been running the vagrant
> test env lately?
> Any suggestions for debugging?
>
> Thanks,
> --Matt
>
> Cmd line output:
> …
> TASK [metron_elasticsearch_templates : Wait for Index to Become Available]
> *****
> ok: [node1]
>
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies] ***
> failed: [node1]
>
> (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template)
> => {"content": "", "failed": true, "item":
>
> "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template",
> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/bro_index"}
> failed: [node1]
>
> (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template)
> => {"content": "", "failed": true, "item":
>
> "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template",
> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/snort_index"}
> failed: [node1]
>
> (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template)
> => {"content": "", "failed": true, "item":
>
> "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template",
> "msg": "Status code was not [200]: An unknown error occurred: sendall()
> argument 1 must be string or buffer, not dict", "redirected": false,
> "status": -1, "url": "http://node1:9200/_template/yaf_index"}
>
> NO MORE HOSTS LEFT
> *************************************************************
> to retry, use: --limit
>
> @/Users/mfoley/projects/Metron/metron532/metron-deployment/playbooks/metron_full_install.retry
>
>
> PLAY RECAP
> *********************************************************************
> node1                      : ok=44   changed=12   unreachable=0
> failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
>
-- 

Jon

Sent from my mobile device

Re: problem with vagrant launch

Posted by Otto Fowler <ot...@gmail.com>.
Matt,
They have to be EXACTLY the versions.



On November 21, 2016 at 13:27:49, Matt Foley (mattf@apache.org) wrote:

I had checked them, and they are all >= the specified requirement in
https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites
:
Ansible 2.1.2.0
Vagrant 1.8.6
Virtualbox 5.0.24
Python 2.7.12
Maven 3.3.9

The only one significantly different is Ansible; the requirement is
2.0.0.2.
Is Ansible 2.1 not compatible with Ansible 2.0? I let homebrew install the
latest version.
Thanks,
--Matt

From: Otto Fowler <ot...@gmail.com>
Date: Saturday, November 19, 2016 at 5:18 AM
To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>,
Matt Foley <ma...@apache.org>
Subject: Re: problem with vagrant launch

What versions of ansible, vagrant, virtualbox and python do you have?



On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
Hi,
I'm trying to launch vanilla vagrant single-node test env for Metron on a
Mac, via
“vagrant up” in metron-deployment/vagrant/full-dev-platform

The Ambari install all goes fine, then the Elastic Search install
but when it comes to
TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
topologies]
it fails on all three (bro, snort, yaf indexes) with
"Status code was not [200]: An unknown error occurred: sendall() argument 1
must be string or buffer, not dict"

Launching from metron-deployment/vagrant/quick-dev-platform had the same
failure point.

All three *_index.template files are present in the specified directory.

Does anyone recognize this problem? Have people been running the vagrant
test env lately?
Any suggestions for debugging?

Thanks,
--Matt

Cmd line output:
…
TASK [metron_elasticsearch_templates : Wait for Index to Become Available]
*****
ok: [node1]

TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
topologies] ***
failed: [node1]
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template)
=> {"content": "", "failed": true, "item":
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template",
"msg": "Status code was not [200]: An unknown error occurred: sendall()
argument 1 must be string or buffer, not dict", "redirected": false,
"status": -1, "url": "http://node1:9200/_template/bro_index"}
failed: [node1]
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template)
=> {"content": "", "failed": true, "item":
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template",
"msg": "Status code was not [200]: An unknown error occurred: sendall()
argument 1 must be string or buffer, not dict", "redirected": false,
"status": -1, "url": "http://node1:9200/_template/snort_index"}
failed: [node1]
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template)
=> {"content": "", "failed": true, "item":
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template",
"msg": "Status code was not [200]: An unknown error occurred: sendall()
argument 1 must be string or buffer, not dict", "redirected": false,
"status": -1, "url": "http://node1:9200/_template/yaf_index"}

NO MORE HOSTS LEFT
*************************************************************
to retry, use: --limit
@/Users/mfoley/projects/Metron/metron532/metron-deployment/playbooks/metron_full_install.retry


PLAY RECAP
*********************************************************************
node1                      : ok=44   changed=12   unreachable=0
failed=1

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

Re: problem with vagrant launch

Posted by Ryan Merriman <me...@gmail.com>.
Matt,

Ansible is probably the most fragile of all those with respect to
versions.  That is likely your problem.

Ryan Merriman

On Mon, Nov 21, 2016 at 12:27 PM, Matt Foley <ma...@apache.org> wrote:

> I had checked them, and they are all >= the specified requirement in
> https://github.com/apache/incubator-metron/tree/master/
> metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites :
> Ansible 2.1.2.0
> Vagrant 1.8.6
> Virtualbox 5.0.24
> Python 2.7.12
> Maven 3.3.9
>
> The only one significantly different is Ansible; the requirement is
> 2.0.0.2.
> Is Ansible 2.1 not compatible with Ansible 2.0?  I let homebrew install
> the latest version.
> Thanks,
> --Matt
>
> From: Otto Fowler <ot...@gmail.com>
> Date: Saturday, November 19, 2016 at 5:18 AM
> To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>,
> Matt Foley <ma...@apache.org>
> Subject: Re: problem with vagrant launch
>
> What versions of ansible, vagrant, virtualbox and python do you have?
>
>
>
> On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
> Hi,
> I'm trying to launch vanilla vagrant single-node test env for Metron on a
> Mac, via
> “vagrant up” in metron-deployment/vagrant/full-dev-platform
>
> The Ambari install all goes fine, then the Elastic Search install
> but when it comes to
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies]
> it fails on all three (bro, snort, yaf indexes) with
> "Status code was not [200]: An unknown error occurred: sendall() argument
> 1 must be string or buffer, not dict"
>
> Launching from metron-deployment/vagrant/quick-dev-platform had the same
> failure point.
>
> All three *_index.template files are present in the specified directory.
>
> Does anyone recognize this problem? Have people been running the vagrant
> test env lately?
> Any suggestions for debugging?
>
> Thanks,
> --Matt
>
> Cmd line output:
> …
> TASK [metron_elasticsearch_templates : Wait for Index to Become
> Available] *****
> ok: [node1]
>
> TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
> topologies] ***
> failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/bro_index.template) => {"content": "", "failed": true,
> "item": "/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/bro_index.template", "msg": "Status code was not [200]: An
> unknown error occurred: sendall() argument 1 must be string or buffer, not
> dict", "redirected": false, "status": -1, "url": "
> http://node1:9200/_template/bro_index"}
> failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/snort_index.template) => {"content": "", "failed": true,
> "item": "/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/snort_index.template", "msg": "Status code was not [200]: An
> unknown error occurred: sendall() argument 1 must be string or buffer, not
> dict", "redirected": false, "status": -1, "url": "
> http://node1:9200/_template/snort_index"}
> failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/yaf_index.template) => {"content": "", "failed": true,
> "item": "/Users/mfoley/projects/Metron/metron532/metron-
> deployment/roles/metron_elasticsearch_templates/files/
> es_templates/yaf_index.template", "msg": "Status code was not [200]: An
> unknown error occurred: sendall() argument 1 must be string or buffer, not
> dict", "redirected": false, "status": -1, "url": "
> http://node1:9200/_template/yaf_index"}
>
> NO MORE HOSTS LEFT ******************************
> *******************************
> to retry, use: --limit @/Users/mfoley/projects/Metron/metron532/metron-
> deployment/playbooks/metron_full_install.retry
>
> PLAY RECAP ************************************************************
> *********
> node1                      : ok=44   changed=12   unreachable=0
> failed=1
>
> Ansible failed to complete successfully. Any error output should be
> visible above. Please fix these errors and try again.
>
>
>
>
>
>
>

Re: problem with vagrant launch

Posted by Matt Foley <ma...@apache.org>.
I had checked them, and they are all >= the specified requirement in https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#user-content-prerequisites :
Ansible 2.1.2.0
Vagrant 1.8.6
Virtualbox 5.0.24
Python 2.7.12
Maven 3.3.9

The only one significantly different is Ansible; the requirement is 2.0.0.2.  
Is Ansible 2.1 not compatible with Ansible 2.0?  I let homebrew install the latest version.
Thanks,
--Matt

From: Otto Fowler <ot...@gmail.com>
Date: Saturday, November 19, 2016 at 5:18 AM
To: "dev@metron.incubator.apache.org" <de...@metron.incubator.apache.org>, Matt Foley <ma...@apache.org>
Subject: Re: problem with vagrant launch

What versions of ansible, vagrant, virtualbox and python do you have?



On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:
Hi, 
I'm trying to launch vanilla vagrant single-node test env for Metron on a Mac, via 
“vagrant up” in metron-deployment/vagrant/full-dev-platform 
  
The Ambari install all goes fine, then the Elastic Search install 
but when it comes to 
TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] 
it fails on all three (bro, snort, yaf indexes) with 
"Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict" 
  
Launching from metron-deployment/vagrant/quick-dev-platform had the same failure point. 
  
All three *_index.template files are present in the specified directory. 
  
Does anyone recognize this problem? Have people been running the vagrant test env lately? 
Any suggestions for debugging? 

Thanks, 
--Matt 

Cmd line output: 
… 
TASK [metron_elasticsearch_templates : Wait for Index to Become Available] ***** 
ok: [node1] 

TASK [metron_elasticsearch_templates : Add Elasticsearch templates for topologies] *** 
failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template) => {"content": "", "failed": true, "item": "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template", "msg": "Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict", "redirected": false, "status": -1, "url": "http://node1:9200/_template/bro_index"} 
failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template) => {"content": "", "failed": true, "item": "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template", "msg": "Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict", "redirected": false, "status": -1, "url": "http://node1:9200/_template/snort_index"} 
failed: [node1] (item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template) => {"content": "", "failed": true, "item": "/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template", "msg": "Status code was not [200]: An unknown error occurred: sendall() argument 1 must be string or buffer, not dict", "redirected": false, "status": -1, "url": "http://node1:9200/_template/yaf_index"} 

NO MORE HOSTS LEFT ************************************************************* 
to retry, use: --limit @/Users/mfoley/projects/Metron/metron532/metron-deployment/playbooks/metron_full_install.retry 

PLAY RECAP ********************************************************************* 
node1                      : ok=44   changed=12   unreachable=0    failed=1    

Ansible failed to complete successfully. Any error output should be 
visible above. Please fix these errors and try again. 







Re: problem with vagrant launch

Posted by Otto Fowler <ot...@gmail.com>.
What versions of ansible, vagrant, virtualbox and python do you have?



On November 18, 2016 at 16:34:08, Matt Foley (mattf@apache.org) wrote:

Hi,
I'm trying to launch vanilla vagrant single-node test env for Metron on a
Mac, via
“vagrant up” in metron-deployment/vagrant/full-dev-platform

The Ambari install all goes fine, then the Elastic Search install
but when it comes to
TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
topologies]
it fails on all three (bro, snort, yaf indexes) with
"Status code was not [200]: An unknown error occurred: sendall() argument 1
must be string or buffer, not dict"

Launching from metron-deployment/vagrant/quick-dev-platform had the same
failure point.

All three *_index.template files are present in the specified directory.

Does anyone recognize this problem? Have people been running the vagrant
test env lately?
Any suggestions for debugging?

Thanks,
--Matt

Cmd line output:
…
TASK [metron_elasticsearch_templates : Wait for Index to Become Available]
*****
ok: [node1]

TASK [metron_elasticsearch_templates : Add Elasticsearch templates for
topologies] ***
failed: [node1]
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template)
=> {"content": "", "failed": true, "item":
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/bro_index.template",
"msg": "Status code was not [200]: An unknown error occurred: sendall()
argument 1 must be string or buffer, not dict", "redirected": false,
"status": -1, "url": "http://node1:9200/_template/bro_index"}
failed: [node1]
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template)
=> {"content": "", "failed": true, "item":
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/snort_index.template",
"msg": "Status code was not [200]: An unknown error occurred: sendall()
argument 1 must be string or buffer, not dict", "redirected": false,
"status": -1, "url": "http://node1:9200/_template/snort_index"}
failed: [node1]
(item=/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template)
=> {"content": "", "failed": true, "item":
"/Users/mfoley/projects/Metron/metron532/metron-deployment/roles/metron_elasticsearch_templates/files/es_templates/yaf_index.template",
"msg": "Status code was not [200]: An unknown error occurred: sendall()
argument 1 must be string or buffer, not dict", "redirected": false,
"status": -1, "url": "http://node1:9200/_template/yaf_index"}

NO MORE HOSTS LEFT
*************************************************************
to retry, use: --limit
@/Users/mfoley/projects/Metron/metron532/metron-deployment/playbooks/metron_full_install.retry


PLAY RECAP
*********************************************************************
node1                      : ok=44   changed=12   unreachable=0
failed=1

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.