You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by Yazan Boshmaf <bo...@ece.ubc.ca> on 2016/05/29 13:43:32 UTC

Quick start deployment error

Hello!

I'm going through the single-node deployment guide (
https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform)
and the playbook fails at the following task. Any ideas?

The main services seems to be up and running (see screen grab). Thanks![image:
Inline image 1]

All the best,
Yazan



TASK [elasticsearch : Add Elasticsearch templates for topologies]
**************

failed: [node1] (item={u'sensor': u'bro', u'file': {'mappings': {'bro_doc':
{'_timestamp': {'enabled': True}, 'properties':
{'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
'bro_index*'}}) => {"content": "", "content_length": "450", "content_type":
"application/json; charset=UTF-8", "failed": true, "item": {"file":
{"mappings": {"bro_doc": {"_timestamp": {"enabled": true}, "properties":
{"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
"timestamp": {"format": "epoch_millis", "type": "date"}}}}, "template":
"bro_index*"}, "sensor": "bro"}, "msg": "Status code was not [200]: HTTP
Error 400: Bad Request", "redirected": false, "status": 400, "url": "
http://node1:9200/_template/template_bro"}
failed: [node1] (item={u'sensor': u'yaf', u'file': {'mappings': {'yaf_doc':
{'_timestamp': {'enabled': True}, 'properties': {'uflags': {'type':
'string'}, 'pkt': {'type': 'string'}, 'app': {'type': 'string'}, 'rtt':
{'type': 'string'}, 'tag': {'type': 'string'}, 'duration': {'type':
'string'}, 'riflags': {'type': 'string'}, 'sip': {'type': 'string'},
'proto': {'type': 'string'}, 'rtag': {'type': 'string'}, 'oct': {'type':
'string'}, 'risn': {'type': 'string'}, 'end-time': {'type': 'string'},
'end-reason': {'type': 'string'}, 'timestamp': {'type': 'date', 'format':
'epoch_millis'}, 'dp': {'type': 'string'},
'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
'roct': {'type': 'string'}, 'sp': {'type': 'string'}, 'iflags': {'type':
'string'}, 'isn': {'type': 'string'}, 'ruflags': {'type': 'string'},
'rpkt': {'type': 'string'}, 'dip': {'type': 'string'}}}}, 'template':
'yaf_index*'}}) => {"content": "", "content_length": "450", "content_type":
"application/json; charset=UTF-8", "failed": true, "item": {"file":
{"mappings": {"yaf_doc": {"_timestamp": {"enabled": true}, "properties":
{"app": {"type": "string"}, "dip": {"type": "string"}, "dp": {"type":
"string"}, "duration": {"type": "string"}, "end-reason": {"type":
"string"}, "end-time": {"type": "string"},
"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
"iflags": {"type": "string"}, "isn": {"type": "string"}, "oct": {"type":
"string"}, "pkt": {"type": "string"}, "proto": {"type": "string"},
"riflags": {"type": "string"}, "risn": {"type": "string"}, "roct": {"type":
"string"}, "rpkt": {"type": "string"}, "rtag": {"type": "string"}, "rtt":
{"type": "string"}, "ruflags": {"type": "string"}, "sip": {"type":
"string"}, "sp": {"type": "string"}, "tag": {"type": "string"},
"timestamp": {"format": "epoch_millis", "type": "date"}, "uflags": {"type":
"string"}}}}, "template": "yaf_index*"}, "sensor": "yaf"}, "msg": "Status
code was not [200]: HTTP Error 400: Bad Request", "redirected": false,
"status": 400, "url": "http://node1:9200/_template/template_yaf"}
failed: [node1] (item={u'sensor': u'snort', u'file': {'mappings':
{'snort_doc': {'_timestamp': {'enabled': True}, 'properties':
{'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
'snort_index*'}}) => {"content": "", "content_length": "450",
"content_type": "application/json; charset=UTF-8", "failed": true, "item":
{"file": {"mappings": {"snort_doc": {"_timestamp": {"enabled": true},
"properties": {"enrichments:geo:ip_dst_addr:location_point": {"type":
"geo_point"}, "timestamp": {"format": "epoch_millis", "type": "date"}}}},
"template": "snort_index*"}, "sensor": "snort"}, "msg": "Status code was
not [200]: HTTP Error 400: Bad Request", "redirected": false, "status":
400, "url": "http://node1:9200/_template/template_snort"}
to retry, use: --limit @../../playbooks/metron_full_install.retry

PLAY RECAP
*********************************************************************

node1                      : ok=70   changed=4    unreachable=0    failed=1

Re: Quick start deployment error

Posted by David Lyle <dl...@gmail.com>.
Hi Yazan,

Thanks for giving Metron a try. We've seen this before when the Ansible
version is not 2.0.0.2. Any chance that is the case for you?

-David...


On Sun, May 29, 2016 at 9:43 AM, Yazan Boshmaf <bo...@ece.ubc.ca> wrote:

> Hello!
>
> I'm going through the single-node deployment guide (
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform)
> and the playbook fails at the following task. Any ideas?
>
> The main services seems to be up and running (see screen grab). Thanks![image:
> Inline image 1]
>
> All the best,
> Yazan
>
>
>
> TASK [elasticsearch : Add Elasticsearch templates for topologies]
> **************
>
> failed: [node1] (item={u'sensor': u'bro', u'file': {'mappings':
> {'bro_doc': {'_timestamp': {'enabled': True}, 'properties':
> {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
> 'bro_index*'}}) => {"content": "", "content_length": "450", "content_type":
> "application/json; charset=UTF-8", "failed": true, "item": {"file":
> {"mappings": {"bro_doc": {"_timestamp": {"enabled": true}, "properties":
> {"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> "timestamp": {"format": "epoch_millis", "type": "date"}}}}, "template":
> "bro_index*"}, "sensor": "bro"}, "msg": "Status code was not [200]: HTTP
> Error 400: Bad Request", "redirected": false, "status": 400, "url": "
> http://node1:9200/_template/template_bro"}
> failed: [node1] (item={u'sensor': u'yaf', u'file': {'mappings':
> {'yaf_doc': {'_timestamp': {'enabled': True}, 'properties': {'uflags':
> {'type': 'string'}, 'pkt': {'type': 'string'}, 'app': {'type': 'string'},
> 'rtt': {'type': 'string'}, 'tag': {'type': 'string'}, 'duration': {'type':
> 'string'}, 'riflags': {'type': 'string'}, 'sip': {'type': 'string'},
> 'proto': {'type': 'string'}, 'rtag': {'type': 'string'}, 'oct': {'type':
> 'string'}, 'risn': {'type': 'string'}, 'end-time': {'type': 'string'},
> 'end-reason': {'type': 'string'}, 'timestamp': {'type': 'date', 'format':
> 'epoch_millis'}, 'dp': {'type': 'string'},
> 'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> 'roct': {'type': 'string'}, 'sp': {'type': 'string'}, 'iflags': {'type':
> 'string'}, 'isn': {'type': 'string'}, 'ruflags': {'type': 'string'},
> 'rpkt': {'type': 'string'}, 'dip': {'type': 'string'}}}}, 'template':
> 'yaf_index*'}}) => {"content": "", "content_length": "450", "content_type":
> "application/json; charset=UTF-8", "failed": true, "item": {"file":
> {"mappings": {"yaf_doc": {"_timestamp": {"enabled": true}, "properties":
> {"app": {"type": "string"}, "dip": {"type": "string"}, "dp": {"type":
> "string"}, "duration": {"type": "string"}, "end-reason": {"type":
> "string"}, "end-time": {"type": "string"},
> "enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> "iflags": {"type": "string"}, "isn": {"type": "string"}, "oct": {"type":
> "string"}, "pkt": {"type": "string"}, "proto": {"type": "string"},
> "riflags": {"type": "string"}, "risn": {"type": "string"}, "roct": {"type":
> "string"}, "rpkt": {"type": "string"}, "rtag": {"type": "string"}, "rtt":
> {"type": "string"}, "ruflags": {"type": "string"}, "sip": {"type":
> "string"}, "sp": {"type": "string"}, "tag": {"type": "string"},
> "timestamp": {"format": "epoch_millis", "type": "date"}, "uflags": {"type":
> "string"}}}}, "template": "yaf_index*"}, "sensor": "yaf"}, "msg": "Status
> code was not [200]: HTTP Error 400: Bad Request", "redirected": false,
> "status": 400, "url": "http://node1:9200/_template/template_yaf"}
> failed: [node1] (item={u'sensor': u'snort', u'file': {'mappings':
> {'snort_doc': {'_timestamp': {'enabled': True}, 'properties':
> {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
> 'snort_index*'}}) => {"content": "", "content_length": "450",
> "content_type": "application/json; charset=UTF-8", "failed": true, "item":
> {"file": {"mappings": {"snort_doc": {"_timestamp": {"enabled": true},
> "properties": {"enrichments:geo:ip_dst_addr:location_point": {"type":
> "geo_point"}, "timestamp": {"format": "epoch_millis", "type": "date"}}}},
> "template": "snort_index*"}, "sensor": "snort"}, "msg": "Status code was
> not [200]: HTTP Error 400: Bad Request", "redirected": false, "status":
> 400, "url": "http://node1:9200/_template/template_snort"}
> to retry, use: --limit @../../playbooks/metron_full_install.retry
>
> PLAY RECAP
> *********************************************************************
>
> node1                      : ok=70   changed=4    unreachable=0    failed=1
>

Re: Quick start deployment error

Posted by Yazan Boshmaf <bo...@ece.ubc.ca>.
Thanks, James :)

All the best,
Yazan

On Tue, May 31, 2016 at 11:20 PM, James Sirota <js...@apache.org> wrote:

> Hi Yazan,
>
> We have a FAQ article on how to downgrade Ansible:
> https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible'
>
> 29.05.2016, 08:21, "Yazan Boshmaf" <bo...@ece.ubc.ca>:
> > Yes, it turns out I had a new version of Ansible. Downgrading to 2.0.0.2
> > resolved the issues.
> >
> > Here's the direct link, which you might want to include in the README.md
> > file: http://releases.ansible.com/ansible/ansible-2.0.0.2.tar.gz
> >
> > Thanks,
> > Yazan
> >
> > On Sun, May 29, 2016 at 5:24 PM, Nick Allen <ni...@nickallen.org> wrote:
> >
> >>  The issue is probably due to an unsupported version of Ansible. We have
> >>  had more than a few issues trying to address bugs that get
> (re)introduced
> >>  in different versions of Ansible.
> >>
> >>  Run the following script. Make sure that all of the versions match the
> >>  supported versions defined in the README
> >>  <
> >>
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#prerequisites
> >>  >
> >>  .
> >>
> >>  ./metron-deployment/scripts/platform-info.sh
> >>
> >>  If you're still having issues, send the output of that script to the
> >>  mailing list so that we can help further.
> >>
> >>  Thanks!
> >>
> >>  On Sun, May 29, 2016 at 9:43 AM, Yazan Boshmaf <bo...@ece.ubc.ca>
> wrote:
> >>
> >>  > Hello!
> >>  >
> >>  > I'm going through the single-node deployment guide (
> >>  >
> >>
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform
> >>  )
> >>  > and the playbook fails at the following task. Any ideas?
> >>  >
> >>  > The main services seems to be up and running (see screen grab).
> >>  Thanks![image:
> >>  > Inline image 1]
> >>  >
> >>  > All the best,
> >>  > Yazan
> >>  >
> >>  >
> >>  >
> >>  > TASK [elasticsearch : Add Elasticsearch templates for topologies]
> >>  > **************
> >>  >
> >>  > failed: [node1] (item={u'sensor': u'bro', u'file': {'mappings':
> >>  > {'bro_doc': {'_timestamp': {'enabled': True}, 'properties':
> >>  > {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> >>  > 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}},
> 'template':
> >>  > 'bro_index*'}}) => {"content": "", "content_length": "450",
> >>  "content_type":
> >>  > "application/json; charset=UTF-8", "failed": true, "item": {"file":
> >>  > {"mappings": {"bro_doc": {"_timestamp": {"enabled": true},
> "properties":
> >>  > {"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> >>  > "timestamp": {"format": "epoch_millis", "type": "date"}}}},
> "template":
> >>  > "bro_index*"}, "sensor": "bro"}, "msg": "Status code was not [200]:
> HTTP
> >>  > Error 400: Bad Request", "redirected": false, "status": 400, "url": "
> >>  > http://node1:9200/_template/template_bro"}
> >>  > failed: [node1] (item={u'sensor': u'yaf', u'file': {'mappings':
> >>  > {'yaf_doc': {'_timestamp': {'enabled': True}, 'properties':
> {'uflags':
> >>  > {'type': 'string'}, 'pkt': {'type': 'string'}, 'app': {'type':
> 'string'},
> >>  > 'rtt': {'type': 'string'}, 'tag': {'type': 'string'}, 'duration':
> >>  {'type':
> >>  > 'string'}, 'riflags': {'type': 'string'}, 'sip': {'type': 'string'},
> >>  > 'proto': {'type': 'string'}, 'rtag': {'type': 'string'}, 'oct':
> {'type':
> >>  > 'string'}, 'risn': {'type': 'string'}, 'end-time': {'type':
> 'string'},
> >>  > 'end-reason': {'type': 'string'}, 'timestamp': {'type': 'date',
> 'format':
> >>  > 'epoch_millis'}, 'dp': {'type': 'string'},
> >>  > 'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> >>  > 'roct': {'type': 'string'}, 'sp': {'type': 'string'}, 'iflags':
> {'type':
> >>  > 'string'}, 'isn': {'type': 'string'}, 'ruflags': {'type': 'string'},
> >>  > 'rpkt': {'type': 'string'}, 'dip': {'type': 'string'}}}}, 'template':
> >>  > 'yaf_index*'}}) => {"content": "", "content_length": "450",
> >>  "content_type":
> >>  > "application/json; charset=UTF-8", "failed": true, "item": {"file":
> >>  > {"mappings": {"yaf_doc": {"_timestamp": {"enabled": true},
> "properties":
> >>  > {"app": {"type": "string"}, "dip": {"type": "string"}, "dp": {"type":
> >>  > "string"}, "duration": {"type": "string"}, "end-reason": {"type":
> >>  > "string"}, "end-time": {"type": "string"},
> >>  > "enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> >>  > "iflags": {"type": "string"}, "isn": {"type": "string"}, "oct":
> {"type":
> >>  > "string"}, "pkt": {"type": "string"}, "proto": {"type": "string"},
> >>  > "riflags": {"type": "string"}, "risn": {"type": "string"}, "roct":
> >>  {"type":
> >>  > "string"}, "rpkt": {"type": "string"}, "rtag": {"type": "string"},
> "rtt":
> >>  > {"type": "string"}, "ruflags": {"type": "string"}, "sip": {"type":
> >>  > "string"}, "sp": {"type": "string"}, "tag": {"type": "string"},
> >>  > "timestamp": {"format": "epoch_millis", "type": "date"}, "uflags":
> >>  {"type":
> >>  > "string"}}}}, "template": "yaf_index*"}, "sensor": "yaf"}, "msg":
> "Status
> >>  > code was not [200]: HTTP Error 400: Bad Request", "redirected":
> false,
> >>  > "status": 400, "url": "http://node1:9200/_template/template_yaf"}
> >>  > failed: [node1] (item={u'sensor': u'snort', u'file': {'mappings':
> >>  > {'snort_doc': {'_timestamp': {'enabled': True}, 'properties':
> >>  > {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> >>  > 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}},
> 'template':
> >>  > 'snort_index*'}}) => {"content": "", "content_length": "450",
> >>  > "content_type": "application/json; charset=UTF-8", "failed": true,
> >>  "item":
> >>  > {"file": {"mappings": {"snort_doc": {"_timestamp": {"enabled": true},
> >>  > "properties": {"enrichments:geo:ip_dst_addr:location_point": {"type":
> >>  > "geo_point"}, "timestamp": {"format": "epoch_millis", "type":
> "date"}}}},
> >>  > "template": "snort_index*"}, "sensor": "snort"}, "msg": "Status code
> was
> >>  > not [200]: HTTP Error 400: Bad Request", "redirected": false,
> "status":
> >>  > 400, "url": "http://node1:9200/_template/template_snort"}
> >>  > to retry, use: --limit @../../playbooks/metron_full_install.retry
> >>  >
> >>  > PLAY RECAP
> >>  > *********************************************************************
> >>  >
> >>  > node1 : ok=70 changed=4 unreachable=0
> >>  failed=1
> >>  >
> >>
> >>  --
> >>  Nick Allen <ni...@nickallen.org>
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>

Re: Quick start deployment error

Posted by James Sirota <js...@apache.org>.
Hi Yazan,

We have a FAQ article on how to downgrade Ansible:
https://cwiki.apache.org/confluence/display/METRON/Downgrade+Ansible'

29.05.2016, 08:21, "Yazan Boshmaf" <bo...@ece.ubc.ca>:
> Yes, it turns out I had a new version of Ansible. Downgrading to 2.0.0.2
> resolved the issues.
>
> Here's the direct link, which you might want to include in the README.md
> file: http://releases.ansible.com/ansible/ansible-2.0.0.2.tar.gz
>
> Thanks,
> Yazan
>
> On Sun, May 29, 2016 at 5:24 PM, Nick Allen <ni...@nickallen.org> wrote:
>
>> The issue is probably due to an unsupported version of Ansible. We have
>> had more than a few issues trying to address bugs that get (re)introduced
>> in different versions of Ansible.
>>
>> Run the following script. Make sure that all of the versions match the
>> supported versions defined in the README
>> <
>> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#prerequisites
>> >
>> .
>>
>> ./metron-deployment/scripts/platform-info.sh
>>
>> If you're still having issues, send the output of that script to the
>> mailing list so that we can help further.
>>
>> Thanks!
>>
>> On Sun, May 29, 2016 at 9:43 AM, Yazan Boshmaf <bo...@ece.ubc.ca> wrote:
>>
>> > Hello!
>> >
>> > I'm going through the single-node deployment guide (
>> >
>> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform
>> )
>> > and the playbook fails at the following task. Any ideas?
>> >
>> > The main services seems to be up and running (see screen grab).
>> Thanks![image:
>> > Inline image 1]
>> >
>> > All the best,
>> > Yazan
>> >
>> >
>> >
>> > TASK [elasticsearch : Add Elasticsearch templates for topologies]
>> > **************
>> >
>> > failed: [node1] (item={u'sensor': u'bro', u'file': {'mappings':
>> > {'bro_doc': {'_timestamp': {'enabled': True}, 'properties':
>> > {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
>> > 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
>> > 'bro_index*'}}) => {"content": "", "content_length": "450",
>> "content_type":
>> > "application/json; charset=UTF-8", "failed": true, "item": {"file":
>> > {"mappings": {"bro_doc": {"_timestamp": {"enabled": true}, "properties":
>> > {"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
>> > "timestamp": {"format": "epoch_millis", "type": "date"}}}}, "template":
>> > "bro_index*"}, "sensor": "bro"}, "msg": "Status code was not [200]: HTTP
>> > Error 400: Bad Request", "redirected": false, "status": 400, "url": "
>> > http://node1:9200/_template/template_bro"}
>> > failed: [node1] (item={u'sensor': u'yaf', u'file': {'mappings':
>> > {'yaf_doc': {'_timestamp': {'enabled': True}, 'properties': {'uflags':
>> > {'type': 'string'}, 'pkt': {'type': 'string'}, 'app': {'type': 'string'},
>> > 'rtt': {'type': 'string'}, 'tag': {'type': 'string'}, 'duration':
>> {'type':
>> > 'string'}, 'riflags': {'type': 'string'}, 'sip': {'type': 'string'},
>> > 'proto': {'type': 'string'}, 'rtag': {'type': 'string'}, 'oct': {'type':
>> > 'string'}, 'risn': {'type': 'string'}, 'end-time': {'type': 'string'},
>> > 'end-reason': {'type': 'string'}, 'timestamp': {'type': 'date', 'format':
>> > 'epoch_millis'}, 'dp': {'type': 'string'},
>> > 'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
>> > 'roct': {'type': 'string'}, 'sp': {'type': 'string'}, 'iflags': {'type':
>> > 'string'}, 'isn': {'type': 'string'}, 'ruflags': {'type': 'string'},
>> > 'rpkt': {'type': 'string'}, 'dip': {'type': 'string'}}}}, 'template':
>> > 'yaf_index*'}}) => {"content": "", "content_length": "450",
>> "content_type":
>> > "application/json; charset=UTF-8", "failed": true, "item": {"file":
>> > {"mappings": {"yaf_doc": {"_timestamp": {"enabled": true}, "properties":
>> > {"app": {"type": "string"}, "dip": {"type": "string"}, "dp": {"type":
>> > "string"}, "duration": {"type": "string"}, "end-reason": {"type":
>> > "string"}, "end-time": {"type": "string"},
>> > "enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
>> > "iflags": {"type": "string"}, "isn": {"type": "string"}, "oct": {"type":
>> > "string"}, "pkt": {"type": "string"}, "proto": {"type": "string"},
>> > "riflags": {"type": "string"}, "risn": {"type": "string"}, "roct":
>> {"type":
>> > "string"}, "rpkt": {"type": "string"}, "rtag": {"type": "string"}, "rtt":
>> > {"type": "string"}, "ruflags": {"type": "string"}, "sip": {"type":
>> > "string"}, "sp": {"type": "string"}, "tag": {"type": "string"},
>> > "timestamp": {"format": "epoch_millis", "type": "date"}, "uflags":
>> {"type":
>> > "string"}}}}, "template": "yaf_index*"}, "sensor": "yaf"}, "msg": "Status
>> > code was not [200]: HTTP Error 400: Bad Request", "redirected": false,
>> > "status": 400, "url": "http://node1:9200/_template/template_yaf"}
>> > failed: [node1] (item={u'sensor': u'snort', u'file': {'mappings':
>> > {'snort_doc': {'_timestamp': {'enabled': True}, 'properties':
>> > {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
>> > 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
>> > 'snort_index*'}}) => {"content": "", "content_length": "450",
>> > "content_type": "application/json; charset=UTF-8", "failed": true,
>> "item":
>> > {"file": {"mappings": {"snort_doc": {"_timestamp": {"enabled": true},
>> > "properties": {"enrichments:geo:ip_dst_addr:location_point": {"type":
>> > "geo_point"}, "timestamp": {"format": "epoch_millis", "type": "date"}}}},
>> > "template": "snort_index*"}, "sensor": "snort"}, "msg": "Status code was
>> > not [200]: HTTP Error 400: Bad Request", "redirected": false, "status":
>> > 400, "url": "http://node1:9200/_template/template_snort"}
>> > to retry, use: --limit @../../playbooks/metron_full_install.retry
>> >
>> > PLAY RECAP
>> > *********************************************************************
>> >
>> > node1 : ok=70 changed=4 unreachable=0
>> failed=1
>> >
>>
>> --
>> Nick Allen <ni...@nickallen.org>

-------------------
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org

Re: Quick start deployment error

Posted by Yazan Boshmaf <bo...@ece.ubc.ca>.
Yes, it turns out I had a new version of Ansible. Downgrading to 2.0.0.2
resolved the issues.

Here's the direct link, which you might want to include in the README.md
file: http://releases.ansible.com/ansible/ansible-2.0.0.2.tar.gz

Thanks,
Yazan

On Sun, May 29, 2016 at 5:24 PM, Nick Allen <ni...@nickallen.org> wrote:

> The issue is probably due to an unsupported version of Ansible.  We have
> had more than a few issues trying to address bugs that get (re)introduced
> in different versions of Ansible.
>
> Run the following script.  Make sure that all of the versions match the
> supported versions defined in the README
> <
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#prerequisites
> >
> .
>
> ./metron-deployment/scripts/platform-info.sh
>
>
> If you're still having issues, send the output of that script to the
> mailing list so that we can help further.
>
> Thanks!
>
>
>
> On Sun, May 29, 2016 at 9:43 AM, Yazan Boshmaf <bo...@ece.ubc.ca> wrote:
>
> > Hello!
> >
> > I'm going through the single-node deployment guide (
> >
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform
> )
> > and the playbook fails at the following task. Any ideas?
> >
> > The main services seems to be up and running (see screen grab).
> Thanks![image:
> > Inline image 1]
> >
> > All the best,
> > Yazan
> >
> >
> >
> > TASK [elasticsearch : Add Elasticsearch templates for topologies]
> > **************
> >
> > failed: [node1] (item={u'sensor': u'bro', u'file': {'mappings':
> > {'bro_doc': {'_timestamp': {'enabled': True}, 'properties':
> > {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> > 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
> > 'bro_index*'}}) => {"content": "", "content_length": "450",
> "content_type":
> > "application/json; charset=UTF-8", "failed": true, "item": {"file":
> > {"mappings": {"bro_doc": {"_timestamp": {"enabled": true}, "properties":
> > {"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> > "timestamp": {"format": "epoch_millis", "type": "date"}}}}, "template":
> > "bro_index*"}, "sensor": "bro"}, "msg": "Status code was not [200]: HTTP
> > Error 400: Bad Request", "redirected": false, "status": 400, "url": "
> > http://node1:9200/_template/template_bro"}
> > failed: [node1] (item={u'sensor': u'yaf', u'file': {'mappings':
> > {'yaf_doc': {'_timestamp': {'enabled': True}, 'properties': {'uflags':
> > {'type': 'string'}, 'pkt': {'type': 'string'}, 'app': {'type': 'string'},
> > 'rtt': {'type': 'string'}, 'tag': {'type': 'string'}, 'duration':
> {'type':
> > 'string'}, 'riflags': {'type': 'string'}, 'sip': {'type': 'string'},
> > 'proto': {'type': 'string'}, 'rtag': {'type': 'string'}, 'oct': {'type':
> > 'string'}, 'risn': {'type': 'string'}, 'end-time': {'type': 'string'},
> > 'end-reason': {'type': 'string'}, 'timestamp': {'type': 'date', 'format':
> > 'epoch_millis'}, 'dp': {'type': 'string'},
> > 'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> > 'roct': {'type': 'string'}, 'sp': {'type': 'string'}, 'iflags': {'type':
> > 'string'}, 'isn': {'type': 'string'}, 'ruflags': {'type': 'string'},
> > 'rpkt': {'type': 'string'}, 'dip': {'type': 'string'}}}}, 'template':
> > 'yaf_index*'}}) => {"content": "", "content_length": "450",
> "content_type":
> > "application/json; charset=UTF-8", "failed": true, "item": {"file":
> > {"mappings": {"yaf_doc": {"_timestamp": {"enabled": true}, "properties":
> > {"app": {"type": "string"}, "dip": {"type": "string"}, "dp": {"type":
> > "string"}, "duration": {"type": "string"}, "end-reason": {"type":
> > "string"}, "end-time": {"type": "string"},
> > "enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> > "iflags": {"type": "string"}, "isn": {"type": "string"}, "oct": {"type":
> > "string"}, "pkt": {"type": "string"}, "proto": {"type": "string"},
> > "riflags": {"type": "string"}, "risn": {"type": "string"}, "roct":
> {"type":
> > "string"}, "rpkt": {"type": "string"}, "rtag": {"type": "string"}, "rtt":
> > {"type": "string"}, "ruflags": {"type": "string"}, "sip": {"type":
> > "string"}, "sp": {"type": "string"}, "tag": {"type": "string"},
> > "timestamp": {"format": "epoch_millis", "type": "date"}, "uflags":
> {"type":
> > "string"}}}}, "template": "yaf_index*"}, "sensor": "yaf"}, "msg": "Status
> > code was not [200]: HTTP Error 400: Bad Request", "redirected": false,
> > "status": 400, "url": "http://node1:9200/_template/template_yaf"}
> > failed: [node1] (item={u'sensor': u'snort', u'file': {'mappings':
> > {'snort_doc': {'_timestamp': {'enabled': True}, 'properties':
> > {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> > 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
> > 'snort_index*'}}) => {"content": "", "content_length": "450",
> > "content_type": "application/json; charset=UTF-8", "failed": true,
> "item":
> > {"file": {"mappings": {"snort_doc": {"_timestamp": {"enabled": true},
> > "properties": {"enrichments:geo:ip_dst_addr:location_point": {"type":
> > "geo_point"}, "timestamp": {"format": "epoch_millis", "type": "date"}}}},
> > "template": "snort_index*"}, "sensor": "snort"}, "msg": "Status code was
> > not [200]: HTTP Error 400: Bad Request", "redirected": false, "status":
> > 400, "url": "http://node1:9200/_template/template_snort"}
> > to retry, use: --limit @../../playbooks/metron_full_install.retry
> >
> > PLAY RECAP
> > *********************************************************************
> >
> > node1                      : ok=70   changed=4    unreachable=0
> failed=1
> >
>
>
>
> --
> Nick Allen <ni...@nickallen.org>
>

Re: Quick start deployment error

Posted by Nick Allen <ni...@nickallen.org>.
The issue is probably due to an unsupported version of Ansible.  We have
had more than a few issues trying to address bugs that get (re)introduced
in different versions of Ansible.

Run the following script.  Make sure that all of the versions match the
supported versions defined in the README
<https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform#prerequisites>
.

./metron-deployment/scripts/platform-info.sh


If you're still having issues, send the output of that script to the
mailing list so that we can help further.

Thanks!



On Sun, May 29, 2016 at 9:43 AM, Yazan Boshmaf <bo...@ece.ubc.ca> wrote:

> Hello!
>
> I'm going through the single-node deployment guide (
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/vagrant/quick-dev-platform)
> and the playbook fails at the following task. Any ideas?
>
> The main services seems to be up and running (see screen grab). Thanks![image:
> Inline image 1]
>
> All the best,
> Yazan
>
>
>
> TASK [elasticsearch : Add Elasticsearch templates for topologies]
> **************
>
> failed: [node1] (item={u'sensor': u'bro', u'file': {'mappings':
> {'bro_doc': {'_timestamp': {'enabled': True}, 'properties':
> {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
> 'bro_index*'}}) => {"content": "", "content_length": "450", "content_type":
> "application/json; charset=UTF-8", "failed": true, "item": {"file":
> {"mappings": {"bro_doc": {"_timestamp": {"enabled": true}, "properties":
> {"enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> "timestamp": {"format": "epoch_millis", "type": "date"}}}}, "template":
> "bro_index*"}, "sensor": "bro"}, "msg": "Status code was not [200]: HTTP
> Error 400: Bad Request", "redirected": false, "status": 400, "url": "
> http://node1:9200/_template/template_bro"}
> failed: [node1] (item={u'sensor': u'yaf', u'file': {'mappings':
> {'yaf_doc': {'_timestamp': {'enabled': True}, 'properties': {'uflags':
> {'type': 'string'}, 'pkt': {'type': 'string'}, 'app': {'type': 'string'},
> 'rtt': {'type': 'string'}, 'tag': {'type': 'string'}, 'duration': {'type':
> 'string'}, 'riflags': {'type': 'string'}, 'sip': {'type': 'string'},
> 'proto': {'type': 'string'}, 'rtag': {'type': 'string'}, 'oct': {'type':
> 'string'}, 'risn': {'type': 'string'}, 'end-time': {'type': 'string'},
> 'end-reason': {'type': 'string'}, 'timestamp': {'type': 'date', 'format':
> 'epoch_millis'}, 'dp': {'type': 'string'},
> 'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> 'roct': {'type': 'string'}, 'sp': {'type': 'string'}, 'iflags': {'type':
> 'string'}, 'isn': {'type': 'string'}, 'ruflags': {'type': 'string'},
> 'rpkt': {'type': 'string'}, 'dip': {'type': 'string'}}}}, 'template':
> 'yaf_index*'}}) => {"content": "", "content_length": "450", "content_type":
> "application/json; charset=UTF-8", "failed": true, "item": {"file":
> {"mappings": {"yaf_doc": {"_timestamp": {"enabled": true}, "properties":
> {"app": {"type": "string"}, "dip": {"type": "string"}, "dp": {"type":
> "string"}, "duration": {"type": "string"}, "end-reason": {"type":
> "string"}, "end-time": {"type": "string"},
> "enrichments:geo:ip_dst_addr:location_point": {"type": "geo_point"},
> "iflags": {"type": "string"}, "isn": {"type": "string"}, "oct": {"type":
> "string"}, "pkt": {"type": "string"}, "proto": {"type": "string"},
> "riflags": {"type": "string"}, "risn": {"type": "string"}, "roct": {"type":
> "string"}, "rpkt": {"type": "string"}, "rtag": {"type": "string"}, "rtt":
> {"type": "string"}, "ruflags": {"type": "string"}, "sip": {"type":
> "string"}, "sp": {"type": "string"}, "tag": {"type": "string"},
> "timestamp": {"format": "epoch_millis", "type": "date"}, "uflags": {"type":
> "string"}}}}, "template": "yaf_index*"}, "sensor": "yaf"}, "msg": "Status
> code was not [200]: HTTP Error 400: Bad Request", "redirected": false,
> "status": 400, "url": "http://node1:9200/_template/template_yaf"}
> failed: [node1] (item={u'sensor': u'snort', u'file': {'mappings':
> {'snort_doc': {'_timestamp': {'enabled': True}, 'properties':
> {'enrichments:geo:ip_dst_addr:location_point': {'type': 'geo_point'},
> 'timestamp': {'type': 'date', 'format': 'epoch_millis'}}}}, 'template':
> 'snort_index*'}}) => {"content": "", "content_length": "450",
> "content_type": "application/json; charset=UTF-8", "failed": true, "item":
> {"file": {"mappings": {"snort_doc": {"_timestamp": {"enabled": true},
> "properties": {"enrichments:geo:ip_dst_addr:location_point": {"type":
> "geo_point"}, "timestamp": {"format": "epoch_millis", "type": "date"}}}},
> "template": "snort_index*"}, "sensor": "snort"}, "msg": "Status code was
> not [200]: HTTP Error 400: Bad Request", "redirected": false, "status":
> 400, "url": "http://node1:9200/_template/template_snort"}
> to retry, use: --limit @../../playbooks/metron_full_install.retry
>
> PLAY RECAP
> *********************************************************************
>
> node1                      : ok=70   changed=4    unreachable=0    failed=1
>



-- 
Nick Allen <ni...@nickallen.org>