You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by Ali Nazemian <al...@gmail.com> on 2017/10/08 13:05:53 UTC
Metron 0.4.2 release date
Hi all,
I was wondering when Metron 0.4.2 will be released and whether it includes
Metron-777 and Elasticsearch 5.x or not?
Cheers,
Ali
Re: Metron 0.4.2 release date
Posted by Otto Fowler <ot...@gmail.com>.
Support for ES 5 and support for ES 5 that exists outside the mpack may be
separate issues
On October 11, 2017 at 06:37:32, Ali Nazemian (alinazemian@gmail.com) wrote:
Hi Michael,
My entire concern regarding ES 5.x upgrade is to be able to use Alert-UI
and Metron indexing on ES 5.x. Basically, as a proof of concept, we have
started using ES 5.x in parallel with using Nifi flow for the Metron
indexing to investigate Elasticsearch capabilities regarding Graph
visualisation/analytics as well as Anomaly Detection. Clearly, we don't
expect to go to production with this condition and I wanted to plan for the
version of Metron that can support this matter. However, I am not expecting
to include ES 5.x as a part of Ambari mpack. As long as Metron can support
it, I am fine.
Regards,
Ali
On Tue, Oct 10, 2017 at 3:33 AM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> Hey Ali, I'm currently deep in ES 5.x migration work. If you have any
> specific concerns or requests that have not yet been covered on the
mailing
> list, please feel free to comment.
>
> Best,
> Mike
>
> On Mon, Oct 9, 2017 at 9:05 AM, James Sirota <js...@apache.org> wrote:
>
> > I would expect ES 5.x support to be in the next version of Metron
> >
> > 08.10.2017, 18:18, "Zeolla@GMail.com" <ze...@gmail.com>:
> > > There's an ongoing conversation regarding client support in Metron
here
> > > <https://lists.apache.org/thread.html/0c5a837c901dd057420dd8c6b673dc
> > 33ba88a8d97545d5b58856cfe8@%3Cdev.metron.apache.org%3E>
> > > .
> > >
> > > Jon
> > >
> > > On Sun, Oct 8, 2017 at 9:02 PM Ali Nazemian <al...@gmail.com>
> > wrote:
> > >
> > >> Hi Jon,
> > >>
> > >> For the Elasticsearch, I am looking for the support from the client
> > side
> > >> rather than a full Metron mpack that includes ES 5.x. As long as
> Metron
> > >> Alert-UI and indexing can support ES 5, I am fine. Is that the scope
> of
> > >> Metron-939?
> > >>
> > >> Cheers,
> > >> Ali
> > >>
> > >> On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <ze...@gmail.com>
> > >> wrote:
> > >>
> > >> > As of right now I'm not aware of any discussions regarding a next
> > >> release,
> > >> > and I believe the METRON-777 features are at least a few months
out
> > from
> > >> > being reviewed and merged in (There is a fair amount of work in
> > chunking
> > >> it
> > >> > up to be reviewed, then work to review and merge it in). ES 5.x is
> > also
> > >> in
> > >> > progress but not even open as a PR yet, let alone in master and
> > ready to
> > >> be
> > >> > included in a release. I'm really looking forward to those
> > >> > changes/improvements as well, but I wouldn't be expecting them in
> the
> > >> next
> > >> > few months, and trying to look further into the future than that
at
> > this
> > >> > point would be difficult.
> > >> >
> > >> > That said, if anybody else has a more detailed timeline in mind, I
> > would
> > >> > love to hear more.
> > >> >
> > >> > Jon
> > >> >
> > >> > On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com>
> > wrote:
> > >> >
> > >> > > Hi all,
> > >> > >
> > >> > > I was wondering when Metron 0.4.2 will be released and whether
it
> > >> > includes
> > >> > > Metron-777 and Elasticsearch 5.x or not?
> > >> > >
> > >> > > Cheers,
> > >> > > Ali
> > >> > >
> > >> > --
> > >> >
> > >> > Jon
> > >> >
> > >>
> > >> --
> > >> A.Nazemian
> > > --
> > >
> > > Jon
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
--
A.Nazemian
Re: Metron 0.4.2 release date
Posted by Michael Miklavcic <mi...@gmail.com>.
My current work is upping the ES versions in both the core Metron code and
the MPack code. Once this change occurs, we will no longer support ES <5.x.
Best,
Mike
On Wed, Oct 11, 2017 at 4:37 AM, Ali Nazemian <al...@gmail.com> wrote:
> Hi Michael,
>
> My entire concern regarding ES 5.x upgrade is to be able to use Alert-UI
> and Metron indexing on ES 5.x. Basically, as a proof of concept, we have
> started using ES 5.x in parallel with using Nifi flow for the Metron
> indexing to investigate Elasticsearch capabilities regarding Graph
> visualisation/analytics as well as Anomaly Detection. Clearly, we don't
> expect to go to production with this condition and I wanted to plan for the
> version of Metron that can support this matter. However, I am not expecting
> to include ES 5.x as a part of Ambari mpack. As long as Metron can support
> it, I am fine.
>
> Regards,
> Ali
>
> On Tue, Oct 10, 2017 at 3:33 AM, Michael Miklavcic <
> michael.miklavcic@gmail.com> wrote:
>
> > Hey Ali, I'm currently deep in ES 5.x migration work. If you have any
> > specific concerns or requests that have not yet been covered on the
> mailing
> > list, please feel free to comment.
> >
> > Best,
> > Mike
> >
> > On Mon, Oct 9, 2017 at 9:05 AM, James Sirota <js...@apache.org> wrote:
> >
> > > I would expect ES 5.x support to be in the next version of Metron
> > >
> > > 08.10.2017, 18:18, "Zeolla@GMail.com" <ze...@gmail.com>:
> > > > There's an ongoing conversation regarding client support in Metron
> here
> > > > <https://lists.apache.org/thread.html/0c5a837c901dd057420dd8c6b673dc
> > > 33ba88a8d97545d5b58856cfe8@%3Cdev.metron.apache.org%3E>
> > > > .
> > > >
> > > > Jon
> > > >
> > > > On Sun, Oct 8, 2017 at 9:02 PM Ali Nazemian <al...@gmail.com>
> > > wrote:
> > > >
> > > >> Hi Jon,
> > > >>
> > > >> For the Elasticsearch, I am looking for the support from the client
> > > side
> > > >> rather than a full Metron mpack that includes ES 5.x. As long as
> > Metron
> > > >> Alert-UI and indexing can support ES 5, I am fine. Is that the
> scope
> > of
> > > >> Metron-939?
> > > >>
> > > >> Cheers,
> > > >> Ali
> > > >>
> > > >> On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <
> zeolla@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > As of right now I'm not aware of any discussions regarding a next
> > > >> release,
> > > >> > and I believe the METRON-777 features are at least a few months
> out
> > > from
> > > >> > being reviewed and merged in (There is a fair amount of work in
> > > chunking
> > > >> it
> > > >> > up to be reviewed, then work to review and merge it in). ES 5.x
> is
> > > also
> > > >> in
> > > >> > progress but not even open as a PR yet, let alone in master and
> > > ready to
> > > >> be
> > > >> > included in a release. I'm really looking forward to those
> > > >> > changes/improvements as well, but I wouldn't be expecting them in
> > the
> > > >> next
> > > >> > few months, and trying to look further into the future than that
> at
> > > this
> > > >> > point would be difficult.
> > > >> >
> > > >> > That said, if anybody else has a more detailed timeline in mind,
> I
> > > would
> > > >> > love to hear more.
> > > >> >
> > > >> > Jon
> > > >> >
> > > >> > On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com>
> > > wrote:
> > > >> >
> > > >> > > Hi all,
> > > >> > >
> > > >> > > I was wondering when Metron 0.4.2 will be released and whether
> it
> > > >> > includes
> > > >> > > Metron-777 and Elasticsearch 5.x or not?
> > > >> > >
> > > >> > > Cheers,
> > > >> > > Ali
> > > >> > >
> > > >> > --
> > > >> >
> > > >> > Jon
> > > >> >
> > > >>
> > > >> --
> > > >> A.Nazemian
> > > > --
> > > >
> > > > Jon
> > >
> > > -------------------
> > > Thank you,
> > >
> > > James Sirota
> > > PPMC- Apache Metron (Incubating)
> > > jsirota AT apache DOT org
> > >
> >
>
>
>
> --
> A.Nazemian
>
Re: Metron 0.4.2 release date
Posted by Ali Nazemian <al...@gmail.com>.
Hi Michael,
My entire concern regarding ES 5.x upgrade is to be able to use Alert-UI
and Metron indexing on ES 5.x. Basically, as a proof of concept, we have
started using ES 5.x in parallel with using Nifi flow for the Metron
indexing to investigate Elasticsearch capabilities regarding Graph
visualisation/analytics as well as Anomaly Detection. Clearly, we don't
expect to go to production with this condition and I wanted to plan for the
version of Metron that can support this matter. However, I am not expecting
to include ES 5.x as a part of Ambari mpack. As long as Metron can support
it, I am fine.
Regards,
Ali
On Tue, Oct 10, 2017 at 3:33 AM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> Hey Ali, I'm currently deep in ES 5.x migration work. If you have any
> specific concerns or requests that have not yet been covered on the mailing
> list, please feel free to comment.
>
> Best,
> Mike
>
> On Mon, Oct 9, 2017 at 9:05 AM, James Sirota <js...@apache.org> wrote:
>
> > I would expect ES 5.x support to be in the next version of Metron
> >
> > 08.10.2017, 18:18, "Zeolla@GMail.com" <ze...@gmail.com>:
> > > There's an ongoing conversation regarding client support in Metron here
> > > <https://lists.apache.org/thread.html/0c5a837c901dd057420dd8c6b673dc
> > 33ba88a8d97545d5b58856cfe8@%3Cdev.metron.apache.org%3E>
> > > .
> > >
> > > Jon
> > >
> > > On Sun, Oct 8, 2017 at 9:02 PM Ali Nazemian <al...@gmail.com>
> > wrote:
> > >
> > >> Hi Jon,
> > >>
> > >> For the Elasticsearch, I am looking for the support from the client
> > side
> > >> rather than a full Metron mpack that includes ES 5.x. As long as
> Metron
> > >> Alert-UI and indexing can support ES 5, I am fine. Is that the scope
> of
> > >> Metron-939?
> > >>
> > >> Cheers,
> > >> Ali
> > >>
> > >> On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <ze...@gmail.com>
> > >> wrote:
> > >>
> > >> > As of right now I'm not aware of any discussions regarding a next
> > >> release,
> > >> > and I believe the METRON-777 features are at least a few months out
> > from
> > >> > being reviewed and merged in (There is a fair amount of work in
> > chunking
> > >> it
> > >> > up to be reviewed, then work to review and merge it in). ES 5.x is
> > also
> > >> in
> > >> > progress but not even open as a PR yet, let alone in master and
> > ready to
> > >> be
> > >> > included in a release. I'm really looking forward to those
> > >> > changes/improvements as well, but I wouldn't be expecting them in
> the
> > >> next
> > >> > few months, and trying to look further into the future than that at
> > this
> > >> > point would be difficult.
> > >> >
> > >> > That said, if anybody else has a more detailed timeline in mind, I
> > would
> > >> > love to hear more.
> > >> >
> > >> > Jon
> > >> >
> > >> > On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com>
> > wrote:
> > >> >
> > >> > > Hi all,
> > >> > >
> > >> > > I was wondering when Metron 0.4.2 will be released and whether it
> > >> > includes
> > >> > > Metron-777 and Elasticsearch 5.x or not?
> > >> > >
> > >> > > Cheers,
> > >> > > Ali
> > >> > >
> > >> > --
> > >> >
> > >> > Jon
> > >> >
> > >>
> > >> --
> > >> A.Nazemian
> > > --
> > >
> > > Jon
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
--
A.Nazemian
Re: Metron 0.4.2 release date
Posted by Michael Miklavcic <mi...@gmail.com>.
Hey Ali, I'm currently deep in ES 5.x migration work. If you have any
specific concerns or requests that have not yet been covered on the mailing
list, please feel free to comment.
Best,
Mike
On Mon, Oct 9, 2017 at 9:05 AM, James Sirota <js...@apache.org> wrote:
> I would expect ES 5.x support to be in the next version of Metron
>
> 08.10.2017, 18:18, "Zeolla@GMail.com" <ze...@gmail.com>:
> > There's an ongoing conversation regarding client support in Metron here
> > <https://lists.apache.org/thread.html/0c5a837c901dd057420dd8c6b673dc
> 33ba88a8d97545d5b58856cfe8@%3Cdev.metron.apache.org%3E>
> > .
> >
> > Jon
> >
> > On Sun, Oct 8, 2017 at 9:02 PM Ali Nazemian <al...@gmail.com>
> wrote:
> >
> >> Hi Jon,
> >>
> >> For the Elasticsearch, I am looking for the support from the client
> side
> >> rather than a full Metron mpack that includes ES 5.x. As long as Metron
> >> Alert-UI and indexing can support ES 5, I am fine. Is that the scope of
> >> Metron-939?
> >>
> >> Cheers,
> >> Ali
> >>
> >> On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <ze...@gmail.com>
> >> wrote:
> >>
> >> > As of right now I'm not aware of any discussions regarding a next
> >> release,
> >> > and I believe the METRON-777 features are at least a few months out
> from
> >> > being reviewed and merged in (There is a fair amount of work in
> chunking
> >> it
> >> > up to be reviewed, then work to review and merge it in). ES 5.x is
> also
> >> in
> >> > progress but not even open as a PR yet, let alone in master and
> ready to
> >> be
> >> > included in a release. I'm really looking forward to those
> >> > changes/improvements as well, but I wouldn't be expecting them in the
> >> next
> >> > few months, and trying to look further into the future than that at
> this
> >> > point would be difficult.
> >> >
> >> > That said, if anybody else has a more detailed timeline in mind, I
> would
> >> > love to hear more.
> >> >
> >> > Jon
> >> >
> >> > On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com>
> wrote:
> >> >
> >> > > Hi all,
> >> > >
> >> > > I was wondering when Metron 0.4.2 will be released and whether it
> >> > includes
> >> > > Metron-777 and Elasticsearch 5.x or not?
> >> > >
> >> > > Cheers,
> >> > > Ali
> >> > >
> >> > --
> >> >
> >> > Jon
> >> >
> >>
> >> --
> >> A.Nazemian
> > --
> >
> > Jon
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
Re: Metron 0.4.2 release date
Posted by James Sirota <js...@apache.org>.
I would expect ES 5.x support to be in the next version of Metron
08.10.2017, 18:18, "Zeolla@GMail.com" <ze...@gmail.com>:
> There's an ongoing conversation regarding client support in Metron here
> <https://lists.apache.org/thread.html/0c5a837c901dd057420dd8c6b673dc33ba88a8d97545d5b58856cfe8@%3Cdev.metron.apache.org%3E>
> .
>
> Jon
>
> On Sun, Oct 8, 2017 at 9:02 PM Ali Nazemian <al...@gmail.com> wrote:
>
>> Hi Jon,
>>
>> For the Elasticsearch, I am looking for the support from the client side
>> rather than a full Metron mpack that includes ES 5.x. As long as Metron
>> Alert-UI and indexing can support ES 5, I am fine. Is that the scope of
>> Metron-939?
>>
>> Cheers,
>> Ali
>>
>> On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <ze...@gmail.com>
>> wrote:
>>
>> > As of right now I'm not aware of any discussions regarding a next
>> release,
>> > and I believe the METRON-777 features are at least a few months out from
>> > being reviewed and merged in (There is a fair amount of work in chunking
>> it
>> > up to be reviewed, then work to review and merge it in). ES 5.x is also
>> in
>> > progress but not even open as a PR yet, let alone in master and ready to
>> be
>> > included in a release. I'm really looking forward to those
>> > changes/improvements as well, but I wouldn't be expecting them in the
>> next
>> > few months, and trying to look further into the future than that at this
>> > point would be difficult.
>> >
>> > That said, if anybody else has a more detailed timeline in mind, I would
>> > love to hear more.
>> >
>> > Jon
>> >
>> > On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com> wrote:
>> >
>> > > Hi all,
>> > >
>> > > I was wondering when Metron 0.4.2 will be released and whether it
>> > includes
>> > > Metron-777 and Elasticsearch 5.x or not?
>> > >
>> > > Cheers,
>> > > Ali
>> > >
>> > --
>> >
>> > Jon
>> >
>>
>> --
>> A.Nazemian
> --
>
> Jon
-------------------
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: Metron 0.4.2 release date
Posted by "Zeolla@GMail.com" <ze...@gmail.com>.
There's an ongoing conversation regarding client support in Metron here
<https://lists.apache.org/thread.html/0c5a837c901dd057420dd8c6b673dc33ba88a8d97545d5b58856cfe8@%3Cdev.metron.apache.org%3E>
.
Jon
On Sun, Oct 8, 2017 at 9:02 PM Ali Nazemian <al...@gmail.com> wrote:
> Hi Jon,
>
> For the Elasticsearch, I am looking for the support from the client side
> rather than a full Metron mpack that includes ES 5.x. As long as Metron
> Alert-UI and indexing can support ES 5, I am fine. Is that the scope of
> Metron-939?
>
> Cheers,
> Ali
>
> On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <ze...@gmail.com>
> wrote:
>
> > As of right now I'm not aware of any discussions regarding a next
> release,
> > and I believe the METRON-777 features are at least a few months out from
> > being reviewed and merged in (There is a fair amount of work in chunking
> it
> > up to be reviewed, then work to review and merge it in). ES 5.x is also
> in
> > progress but not even open as a PR yet, let alone in master and ready to
> be
> > included in a release. I'm really looking forward to those
> > changes/improvements as well, but I wouldn't be expecting them in the
> next
> > few months, and trying to look further into the future than that at this
> > point would be difficult.
> >
> > That said, if anybody else has a more detailed timeline in mind, I would
> > love to hear more.
> >
> > Jon
> >
> > On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com> wrote:
> >
> > > Hi all,
> > >
> > > I was wondering when Metron 0.4.2 will be released and whether it
> > includes
> > > Metron-777 and Elasticsearch 5.x or not?
> > >
> > > Cheers,
> > > Ali
> > >
> > --
> >
> > Jon
> >
>
>
>
> --
> A.Nazemian
>
--
Jon
Re: Metron 0.4.2 release date
Posted by Ali Nazemian <al...@gmail.com>.
Hi Jon,
For the Elasticsearch, I am looking for the support from the client side
rather than a full Metron mpack that includes ES 5.x. As long as Metron
Alert-UI and indexing can support ES 5, I am fine. Is that the scope of
Metron-939?
Cheers,
Ali
On Mon, Oct 9, 2017 at 11:04 AM, Zeolla@GMail.com <ze...@gmail.com> wrote:
> As of right now I'm not aware of any discussions regarding a next release,
> and I believe the METRON-777 features are at least a few months out from
> being reviewed and merged in (There is a fair amount of work in chunking it
> up to be reviewed, then work to review and merge it in). ES 5.x is also in
> progress but not even open as a PR yet, let alone in master and ready to be
> included in a release. I'm really looking forward to those
> changes/improvements as well, but I wouldn't be expecting them in the next
> few months, and trying to look further into the future than that at this
> point would be difficult.
>
> That said, if anybody else has a more detailed timeline in mind, I would
> love to hear more.
>
> Jon
>
> On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com> wrote:
>
> > Hi all,
> >
> > I was wondering when Metron 0.4.2 will be released and whether it
> includes
> > Metron-777 and Elasticsearch 5.x or not?
> >
> > Cheers,
> > Ali
> >
> --
>
> Jon
>
--
A.Nazemian
Re: Metron 0.4.2 release date
Posted by "Zeolla@GMail.com" <ze...@gmail.com>.
As of right now I'm not aware of any discussions regarding a next release,
and I believe the METRON-777 features are at least a few months out from
being reviewed and merged in (There is a fair amount of work in chunking it
up to be reviewed, then work to review and merge it in). ES 5.x is also in
progress but not even open as a PR yet, let alone in master and ready to be
included in a release. I'm really looking forward to those
changes/improvements as well, but I wouldn't be expecting them in the next
few months, and trying to look further into the future than that at this
point would be difficult.
That said, if anybody else has a more detailed timeline in mind, I would
love to hear more.
Jon
On Sun, Oct 8, 2017, 09:05 Ali Nazemian <al...@gmail.com> wrote:
> Hi all,
>
> I was wondering when Metron 0.4.2 will be released and whether it includes
> Metron-777 and Elasticsearch 5.x or not?
>
> Cheers,
> Ali
>
--
Jon