You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by "Zeolla@GMail.com" <ze...@gmail.com> on 2017/09/02 02:14:29 UTC
Re: [DISCUSS] Metron release 0.4.1
Looks like METRON-1134 made it in already and I just gave METRON-1129
a +1. Just waiting on Ryan's feedback to merge it in.
Jon
On Thu, Aug 31, 2017 at 3:11 PM Matt Foley <mf...@hortonworks.com> wrote:
> Please mark them 0.4.1, as that’s what the community says we want to call
> the upcoming release, and everything that’s there when I throw the switch
> will be included.
>
> Jon and Anand, will they be in by end/day Friday?
> Thanks,
> --Matt
>
> On 8/31/17, 7:45 AM, "Nick Allen" <ni...@nickallen.org> wrote:
>
> Matt, et al - For JIRAs that are going into master, should we be
> marking
> these as "Next + 1" or "0.4.1" ?
>
> On Thu, Aug 31, 2017 at 8:17 AM Zeolla@GMail.com <ze...@gmail.com>
> wrote:
>
> > Can I advocate to get METRON-1129 in the RC, and throw in a second
> vote for
> > METRON-1134? Both in an attempt to better support of prod/offline
> use.
> > Happy to provide testing cycles for the former.
> >
> > Jon
> >
> > On Wed, Aug 30, 2017 at 11:41 AM Anand Subramanian <
> > asubramanian@hortonworks.com> wrote:
> >
> > > Hi Matt,
> > >
> > > This defect needs to be included as a follow-on to METRON-1122:
> > > * METRON-1141 (https://github.com/apache/metron/pull/723)
> > >
> > >
> > > Thanks,
> > > Anand
> > >
> > >
> > >
> > > On 8/30/17, 8:57 PM, "Michael Miklavcic" <
> michael.miklavcic@gmail.com>
> > > wrote:
> > >
> > > >I have some work around fixing how we handle config with Ambari
> that I'd
> > > >like to see go in. No PR yet, but coming soon. I expect to have
> this by
> > > the
> > > >RC deadline.
> > > >
> > > >Mike
> > > >
> > > >On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <ni...@nickallen.org>
> wrote:
> > > >
> > > >> The following PRs are usability enhancements for the Profiler.
> They
> > are
> > > >> fairly simple and I think are very helpful for
> troubleshooting. I
> > don't
> > > >> want to hold up the release, but it would be a "nice to have"
> to get
> > > these
> > > >> in.
> > > >>
> > > >> If anyone has cycles, I would appreciate some reviews of these
> PRs.
> > > >> https://github.com/apache/metron/pull/721
> > > >> https://github.com/apache/metron/pull/716
> > > >>
> > > >>
> > > >>
> > > >> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <ma...@apache.org>
> wrote:
> > > >>
> > > >> > Okay, just to be clear, you’re requesting we wait until
> Friday, if
> > > >> > necessary, to cut an RC with 717 in it?
> > > >> > Thanks,
> > > >> > --Matt
> > > >> >
> > > >> > On 8/29/17, 11:45 AM, "Casey Stella" <ce...@gmail.com>
> wrote:
> > > >> >
> > > >> > 709 is in and 717 is under concerted review by Otto. I'd
> like
> > to
> > > see
> > > >> > it in
> > > >> > by Friday.
> > > >> >
> > > >> > On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <
> mattf@apache.org>
> > > >> wrote:
> > > >> >
> > > >> > > Hi all,
> > > >> > > Thanks for your inputs. The three PRs Nick mentioned
> have
> > been
> > > >> > > successfully closed.
> > > >> > > Casey, do you have an ETA for these two PRs? (PR#709
> and 717)
> > > >> > > Thanks,
> > > >> > > --Matt
> > > >> > >
> > > >> > > On 8/29/17, 9:34 AM, "Casey Stella" <cestella@gmail.com
> >
> > wrote:
> > > >> > >
> > > >> > > For my PRs, I'd vote for METRON-1122 being in
> (commit very
> > > >> > imminent).
> > > >> > > I'd very much like METRON-1134 to be in as well.
> > > >> > >
> > > >> > > Beyond that, I'm ok
> > > >> > >
> > > >> > > On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen <
> > > >> nick@nickallen.org>
> > > >> > > wrote:
> > > >> > >
> > > >> > > > Thanks for starting the process, Matt.
> > > >> > > >
> > > >> > > > These are my own open PRs that I would most like
> to see
> > > get
> > > >> in.
> > > >> > > They all
> > > >> > > > relate to the Profiler. My other outstanding PRs
> are
> > less
> > > >> > important.
> > > >> > > >
> > > >> > > > - https://github.com/apache/metron/pull/705
> > > >> > > > - https://github.com/apache/metron/pull/707
> > > >> > > > - https://github.com/apache/metron/pull/708
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <
> > > mattf@apache.org
> > > >> >
> > > >> > wrote:
> > > >> > > >
> > > >> > > > > Hello all,
> > > >> > > > > At the meeting this morning, the community
> expressed
> > the
> > > >> > wish to
> > > >> > > create a
> > > >> > > > > new release, to be a point release and not
> including
> > > >> > METRON-777.
> > > >> > > > >
> > > >> > > > > Therefore, I propose to create release 0.4.1
> from
> > Metron
> > > >> > master
> > > >> > > branch,
> > > >> > > > > with whatever additional commits the community
> > considers
> > > >> > vital and
> > > >> > > can
> > > >> > > > get
> > > >> > > > > in in the next few days.
> > > >> > > > >
> > > >> > > > > There have been 74 commits since the 0.4.0
> release
> > (list
> > > >> > appended
> > > >> > > to end
> > > >> > > > > of this message).
> > > >> > > > > I have not yet done a compare to make sure all
> 74
> > > completed
> > > >> > > commits have
> > > >> > > > > closed their Jiras, but I will follow up with
> that
> > info.
> > > >> > > > >
> > > >> > > > > There are 35 open PRs, see
> > > >> > https://github.com/apache/metron/pulls
> > > >> > > ,
> > > >> > > > which
> > > >> > > > > is getting a little clunky. Surely not all of
> them
> > can
> > > get
> > > >> > in in
> > > >> > > the
> > > >> > > > next
> > > >> > > > > few days, but do we want to try to close and
> include
> > > some
> > > >> of
> > > >> > them?
> > > >> > > > >
> > > >> > > > > Please respond to the list with your requests to
> > include
> > > >> > specific
> > > >> > > > > additional PRs before we cut the 0.4.1 release
> > > candidate.
> > > >> > Let’s
> > > >> > > keep it
> > > >> > > > > practical so we don’t delay more than a week or
> so.
> > > >> > > > >
> > > >> > > > > TIMEFRAME: Tentatively I would like to start
> the
> > > process
> > > >> of
> > > >> > > cutting an
> > > >> > > > RC
> > > >> > > > > this coming Monday 28 August. If we have too
> many PRs
> > > >> > required to
> > > >> > > be in,
> > > >> > > > > we may have to slip that. Likewise, if there
> is need
> > > for
> > > >> > urgency,
> > > >> > > I can
> > > >> > > > > start as soon as tomorrow. We will be guided
> by your
> > > >> > responses.
> > > >> > > > >
> > > >> > > > > Thanks,
> > > >> > > > > --Matt
> > > >> > > > > (Release Manager)
> > > >> > > > >
> > > >> > > > > COMPLETED PRs as of 22 Aug 2017:
> > > >> > > > > METRON-1115 Jackson is not properly
> serializing
> > > >> > readMetadata
> > > >> > > and
> > > >> > > > > mergeMetadata SensorParserConfig properties
> > (merrimanr)
> > > >> > closes
> > > >> > > > > apache/metron#703
> > > >> > > > > METRON-1047 REST should use core-site.xml
> for
> > Hadoop
> > > >> > > configuration
> > > >> > > > > (merrimanr) closes apache/metron#672
> > > >> > > > > METRON-1111 Mislabeled Configuration
> Property in
> > > Ambari
> > > >> > > (nickwallen)
> > > >> > > > > closes apache/metron#698
> > > >> > > > > METRON-1113 UpdateControllerIntegrationTest
> fails
> > > with
> > > >> > 500
> > > >> > > error
> > > >> > > > > (merrimanr) closes apache/metron#701
> > > >> > > > > METRON-711 StellarShell assigns variables
> even if
> > an
> > > >> > exception
> > > >> > > was
> > > >> > > > > thrown in the statement. (ottobackwards) closes
> > > >> > apache/metron#686
> > > >> > > > > METRON-1110 REST jvm flags property is being
> > > >> overwritten
> > > >> > when
> > > >> > > > Kerberos
> > > >> > > > > is enabled (merrimanr) closes apache/metron#697
> > > >> > > > > METRON-739 Create Local Profile Runner
> > (nickwallen)
> > > >> > closes
> > > >> > > > > apache/metron#693
> > > >> > > > > METRON-1109 Indexing topology fails to
> start after
> > > >> > Kerberos is
> > > >> > > > enabled
> > > >> > > > > (merrimanr) closes apache/metron#696
> > > >> > > > > METRON-1108 Metron configuration tabs are
> not
> > > showing
> > > >> up
> > > >> > in
> > > >> > > Ambari
> > > >> > > > > this closes apache/incubator-metron#695
> > > >> > > > > METRON-1078 Metron Indexing fails to stop
> during
> > > >> > "Stop All
> > > >> > > > > Services" (dlyle65535) closes
> apache/metron#680
> > > >> > > > > METRON-1104 Build Failure - Due to Bootstrap
> > version
> > > >> > change
> > > >> > > > > (iraghumitra via justinleet) closes
> apache/metron#691
> > > >> > > > > METRON-1094 MaaS will not start due to
> classpath
> > > error
> > > >> > > relating to
> > > >> > > > > Yarn closes apache/incubator-metron#688
> > > >> > > > > METRON-1102 Add support for ingesting cybox
> URI
> > > >> > observables
> > > >> > > from
> > > >> > > > taxii
> > > >> > > > > feeds closes apache/incubator-metron#689
> > > >> > > > > METRON-838 Incorrect set of ts in FireEye
> parser
> > > >> (bjigmp
> > > >> > via
> > > >> > > > > justinleet) closes apache/metron#528
> > > >> > > > > METRON-322 Global Batching and Flushing
> > > (mattf-horton)
> > > >> > closes
> > > >> > > > > apache/metron#481
> > > >> > > > > METRON-988 UI for viewing alerts generated
> by
> > Metron
> > > >> > > (iraghumitra
> > > >> > > > via
> > > >> > > > > nickwallen) closes apache/metron#620
> > > >> > > > > METRON-1084 Management UI web server license
> > should
> > > be
> > > >> > Apache
> > > >> > > > > (merrimanr) closes apache/metron#683
> > > >> > > > > METRON-1026 threatintel_taxii_load.sh throws
> > > exception
> > > >> > closes
> > > >> > > > > apache/incubator-metron#643
> > > >> > > > > METRON-1051 Enable the ability to update
> indexed
> > > >> messages
> > > >> > > closes
> > > >> > > > > apache/incubator-metron#666
> > > >> > > > > METRON-1069 Ambari MPack documentation
> around
> > > >> development
> > > >> > > strategies
> > > >> > > > > (justinleet) closes apache/metron#1069
> > > >> > > > > METRON-1069 Ambari MPack documentation
> around
> > > >> development
> > > >> > > strategies
> > > >> > > > > (merrimanr via justinleet) closes
> apache/metron#1069
> > > >> > > > > METRON-1069 Ambari MPack documentation
> around
> > > >> development
> > > >> > > strategies
> > > >> > > > > (justinleet) closes apache/metron#1069
> > > >> > > > > METRON-1076 Management UI status check
> always
> > > reports
> > > >> the
> > > >> > > service as
> > > >> > > > > running (merrimanr) closes apache/metron#678
> > > >> > > > > METRON-1075 Add faceted search capabilities
> > > (merrimanr)
> > > >> > closes
> > > >> > > > > apache/metron#679
> > > >> > > > > METRON-379 Stellar - No Error When Adding
> > Variables
> > > >> That
> > > >> > Do
> > > >> > > Not Exist
> > > >> > > > > (ottobackwards) closes apache/metron#675
> > > >> > > > > METRON-1038 Stellar should have a better
> > collection
> > > of
> > > >> > basic
> > > >> > > math
> > > >> > > > > operations closes apache/incubator-metron#650
> > > >> > > > > METRON-1072 Cleanup Maven build warnings
> > (mmiklavc)
> > > >> > closes
> > > >> > > > > apache/metron#676
> > > >> > > > > METRON-1056 Get field types from
> Elasticsearch
> > > >> > (merrimanr)
> > > >> > > closes
> > > >> > > > > apache/metron#662
> > > >> > > > > METRON-1011 Stellar ENRICHMENT functions
> should
> > > enforce
> > > >> > > submission of
> > > >> > > > > 4 parameters (jasper-k via ottobackwards) closes
> > > >> > apache/metron#628
> > > >> > > > > METRON-975 Normalize logging and switch to
> common
> > > idiom
> > > >> > with
> > > >> > > SLF4J
> > > >> > > > > (mmiklavc) closes apache/metron#599
> > > >> > > > > METRON-681 CSVConverter should trim values
> (basvdl
> > > via
> > > >> > > ottobackwards)
> > > >> > > > > closes apache/metron#674
> > > >> > > > > METRON-746 Build Custom Checkstyle and IDE
> > > formatting
> > > >> > settings
> > > >> > > > > (justinleet via mmiklavc) closes
> apache/metron#577
> > > >> > > > > METRON-1060 Add performance timing logging
> to
> > > >> enrichment
> > > >> > > topology
> > > >> > > > > (mmiklavc) closes apache/metron#665
> > > >> > > > > METRON-982 REST STORM Support for supervisor
> > summary
> > > >> > > (ottobackwards)
> > > >> > > > > closes apache/metron#607
> > > >> > > > > METRON-1064 Make init script OS-agnostic
> > (merrimanr)
> > > >> > closes
> > > >> > > > > apache/metron#669
> > > >> > > > > METRON-984 Create STELLAR Decoding Functions
> > > >> > (ottobackwards)
> > > >> > > closes
> > > >> > > > > apache/metron#642
> > > >> > > > > METRON-1067 Minor typo in documentation
> > > (spencer-hanson
> > > >> > via
> > > >> > > > > justinleet) closes apache/metron#671
> > > >> > > > > METRON-1018 Integration tests should
> reference
> > flux
> > > >> yaml
> > > >> > and
> > > >> > > property
> > > >> > > > > files deployed by Ambari (merrimanr) closes
> > > >> apache/metron#635
> > > >> > > > > METRON-1050 Improve Docs of
> > > `profiler.period.duration`
> > > >> > > (nickwallen)
> > > >> > > > > closes apache/metron#656
> > > >> > > > > METRON-1043 Profiler Should be Less
> Dramatic When
> > > >> Missing
> > > >> > > > > Configuration (nickwallen) closes
> apache/metron#655
> > > >> > > > > METRON-1053 Relocate Metron Docker
> (nickwallen)
> > > closes
> > > >> > > > > apache/metron#659
> > > >> > > > > METRON-1058 address checkstyle warnings for
> > > >> > UnusedImports in
> > > >> > > > > metron-stellar (dbist via ottobackwards) closes
> > > >> > apache/metron#663
> > > >> > > > > METRON-1035 Added SUM to the rules triage
> > > aggregation
> > > >> > docs
> > > >> > > closes
> > > >> > > > > apache/incubator-metron#649
> > > >> > > > > METRON-1039 Add ZIP function to Stellar
> closes
> > > >> > > > > apache/incubator-metron#652
> > > >> > > > > METRON-1054 Ambari Mpack Attempts to Kill
> > Topologies
> > > >> > That Are
> > > >> > > Not
> > > >> > > > > Running (nickwallen) closes apache/metron#660
> > > >> > > > > METRON-992: Create performance tuning guide
> > > (mmiklavc)
> > > >> > closes
> > > >> > > > > apache/metron#614
> > > >> > > > > METRON-1044 Disabled writers are not acking
> > messages
> > > >> > > (merrimanr)
> > > >> > > > > closes apache/metron#654
> > > >> > > > > METRON-1022 Elasticsearch REST endpoint this
> > closes
> > > >> > > > > apache/incubator-metron#636
> > > >> > > > > METRON-1048 Intermittent Test Failure for
> > > >> > > > > SimpleHBaseEnrichmentWriterLoggingTest
> (nickwallen)
> > > closes
> > > >> > > > apache/metron#658
> > > >> > > > > METRON-1029 Topology worker opts are not
> being set
> > > when
> > > >> > > Kerberos is
> > > >> > > > > enabled (merrimanr) closes apache/metron#645
> > > >> > > > > METRON-1031 Management UI Cannot Start
> Topologies
> > in
> > > >> > Kerberized
> > > >> > > > > Environment (nickwallen) closes
> apache/metron#647
> > > >> > > > > METRON-1008 Migrate Travis build to use
> Trusty
> > > (jjmeyer
> > > >> > via
> > > >> > > > > justinleet) closes apache/metron#633
> > > >> > > > > METRON-633 Create better logging for
> > > >> > HbaseEnrichmentWriter
> > > >> > > (zezutom
> > > >> > > > > via justinleet) closes apache/metron#572
> > > >> > > > > METRON-1003 ParserUtil parses dates
> incorrect
> > > (bjigmp
> > > >> via
> > > >> > > justinleet)
> > > >> > > > > closes apache/metron#623
> > > >> > > > > METRON-1040 Create Installation
> Instructions for
> > the
> > > >> > Profiler
> > > >> > > > > (nickwallen) closes apache/metron#653
> > > >> > > > > METRON-833 Update MaaS documentation to
> explain
> > how
> > > it
> > > >> > > interacts with
> > > >> > > > > kerberos (cestella via justinleet) closes
> > > apache/metron#520
> > > >> > > > > METRON-1033 Profiler example uses incorrect
> units
> > > for
> > > >> > expires
> > > >> > > > > (simonellistonball via nickwallen) closes
> > > apache/metron#648
> > > >> > > > > METRON-1019 Metron 0.4.0 manual
> installation guide
> > > for
> > > >> > CentOS 6
> > > >> > > > > (lvets via ottobackwards) closes
> apache/metron#631
> > > >> > > > > METRON-1013 StellarShell does not validate
> > > parameters
> > > >> > > (ottobackwards)
> > > >> > > > > closes apache/metron#639
> > > >> > > > > METRON-1017 Ambari components should be
> separate
> > > >> > (merrimanr)
> > > >> > > closes
> > > >> > > > > apache/metron#634
> > > >> > > > > METRON-933 STELLAR support for setting
> fields to
> > > regex
> > > >> > match
> > > >> > > captures
> > > >> > > > > (ottobackwards) closes apache/metron#638
> > > >> > > > > METRON-1001 Allow metron to ingest parser
> metadata
> > > >> along
> > > >> > with
> > > >> > > data
> > > >> > > > > closes apache/incubator-metron#621
> > > >> > > > > METRON-1027 Errant Log Message When No
> GeoIP Hit
> > on
> > > >> > Valid,
> > > >> > > External
> > > >> > > > > IPv4 Address (nickwallen) closes
> apache/metron#644
> > > >> > > > > METRON-1025 Metron github pr template
> should not
> > > >> > reference
> > > >> > > incubator
> > > >> > > > > (ottobackwards) closes apache/metron#640
> > > >> > > > > METRON-1021 increment metron version number
> to
> > > 0.4.1 in
> > > >> > poms
> > > >> > > etc
> > > >> > > > > (mattf-horton) closes apache/metron#637
> > > >> > > > > METRON-986 Enhance Fastcapa to Support
> Intel X520
> > > >> > (nickwallen)
> > > >> > > closes
> > > >> > > > > apache/metron#608
> > > >> > > > > METRON-1012 Update Metron public web site
> for
> > 0.4.0
> > > >> > release
> > > >> > > > > (mattf-horton) closes apache/metron#629
> > > >> > > > > METRON-1014 StellarShell class name typo
> > > (mattf-horton)
> > > >> > closes
> > > >> > > > > apache/metron#630
> > > >> > > > > METRON-990 Clean up and organize flux
> properties
> > > >> > (merrimanr)
> > > >> > > closes
> > > >> > > > > apache/metron#613
> > > >> > > > > METRON-508 Expand Elasticsearch templates to
> > support
> > > >> the
> > > >> > > standard bro
> > > >> > > > > logs (JonZeolla) closes apache/metron#586
> > > >> > > > > METRON-1007 Ship the metron-management jar
> as part
> > > of
> > > >> > the mpack
> > > >> > > > > install (ottobackwards) closes apache/metron#627
> > > >> > > > > METRON-877 Extract core implementation and
> UDF
> > > support,
> > > >> > create
> > > >> > > > > metron-stellar module (mattf-horton) closes
> > > >> apache/metron#616
> > > >> > > > > METRON-1004 Travis CI - Job Exceeded
> Maximum Time
> > > Limit
> > > >> > > (justinleet)
> > > >> > > > > closes apache/metron#624
> > > >> > > > > METRON-999 Add virtualization support
> checks to
> > > >> > > platform-info.sh
> > > >> > > > > (JonZeolla via jonzeolla) closes
> apache/metron#618
> > > >> > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >>
> > >
> > --
> >
> > Jon
> >
>
>
> --
Jon