You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by Michael Miklavcic <mi...@gmail.com> on 2016/09/27 15:41:27 UTC
Re: [DISCUSS] Upcoming Metron Build
Also need this Jira to bump the version.
https://issues.apache.org/jira/browse/METRON-398
On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <js...@apache.org> wrote:
> We are preparing the next release (will be put up for a vote within the
> next few days) with the following list of Jiras. Do you feel there are any
> other Jiras that should go into this release or are there any critical bugs
> that anyone knows of that we should address before releasing? Please
> comment on this thread. Otherwise, we will put up the release for a vote
> shortly.
>
> METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> cestella) closes apache/incubator-metron#274
> METRON-449 JSONMapParser should unfold maps to arbitrary depths closes
> apache/incubator-metron#271
> METRON-453: Add a stellar shell function to open an external editor
> and return the editor's contents closes apache/incubator-metron#272
> METRON-452: Add rudimentary configuration management functions to
> Stellar closes apache/incubator-metron#269
> METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
> LICENSE where appropriate closes apache/incubator-metron#229
> METRON-427 Create Ambari Management Pack for Metron Installation
> closes apache/incubator-metron#266
> METRON-434: JSON Parser closes apache/incubator-metron#261
> METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> (nickwallen) closes apache/incubator-metron#264
> METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> nickwallen) closes apache/incubator-metron#267
> METRON-438: Back the Stellar REPL with a readline implementation
> closes apache/incubator-metron#265
> METRON-426: Stellar does not support scientific notation as a literal
> closes apache/incubator-metron#257
> METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> apache/incubator-metron#262
> METRON-436: Updated architecture diagrams for Metron READMEs
> (anandsubbu via cestella) closes apache/incubator-metron#263
> METRON-433: Documentation update closes apache/incubator-metron#260
> METRON-428: Allow a kafka offset to be passed to the ParserTopology
> CLI closes apache/incubator-metron#258
> METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> (nickwallen) closes apache/incubator-metron#259
> METRON-384 Deployment fails at task "Wait for Elasticsearch Host
> to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
> METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
> via cestella) closes apache/incubator-metron#256
> METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
> apache/incubator-metron#254
> METRON-413 Allow Start/End Time Range Search in Profiler Client API
> (nickwallen) closes apache/incubator-metron#249
> METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
> closes apache/incubator-metron#252
> METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> apache/incubator-metron#255
> METRON-418 Set TTL on HBase Puts (nickwallen) closes
> apache/incubator-metron#251
> METRON-415: Allow a Profile to Store Any Type as its Value closes
> apache/incubator-metron#253
> METRON-411 Support Greater Range of Profile Periods (nickwallen)
> closes apache/incubator-metron#246
> METRON-416: Provide the ability to store mergeable data structures for
> summarizing data on-line closes apache/incubator-metron#250
> METRON-397: Add a stellar function to interact with the HBase
> enrichment table closes apache/incubator-metron#234
> METRON-391 Create Stellar Function to Read Profile Data for Model
> Scoring (nickwallen via cestella) closes apache/incubator-metron#242
> METRON-414 Kibana Ansible Install Fails with SSL Error closes
> apache/incubator-metron#248
> METRON-407: We currently do not provide defaults if the Stix
> Observable does not specify a condition closes apache/incubator-metron#244
> METRON-406: Stellar variable resolution does not resolve variables
> with ':' in them closes apache/incubator-metron#243
> METRON-399 Stellar Date Functions Should Default to Current Time
> (nickwallen) closes apache/incubator-metron#237
> METRON-389 Create Java API to Read Profile Data During Model Scoring
> (nickwallen) closes apache/incubator-metron#236
> METRON-385 Create Ambari Service Definition for Indexing (justinleet
> via cestella) closes apache/incubator-metron#222
> METRON-395 Fix Metron Bro parser not parsing some timestamp values
> (mmiklavc via cestella) closes apache/incubator-metron#232
> METRON-400 Deploy Probes to running Docker Container closes
> apache/incubator-metron#241
> METRON-408 Intermittent Failures of Profile Integration Tests
> (nickwallen via cestella) closes apache/incubator-metron#245
> METRON-381: Add support for multiple reducers in pcap_query.sh closes
> apache/incubator-metron#217
> METRON-404 Stellar Compiler Hides Function Initialization Errors
> (nickwallen) closes apache/incubator-metron#240
> METRON-392 Allow User to Define Custom 'Group By' for a Profile
> (nickwallen) closes apache/incubator-metron#230
> METRON-383: Create Ambari Service Definition for Metron Parsers
> (mmiklavc via cestella) closes apache/incubator-metron#218
> METRON-396: Make Stellar function resolution happen via an annotation
> and classpath search closes apache/incubator-metron#233
> METRON-400 Deploy Probes to running Docker Container closes
> apache/incubator-metron#238
> METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
> via cestella) closes apache/incubator-metron#239
> METRON-394 Create Stellar Date Functions to Use with Profile 'Group
> By' (nickwallen) closes apache/incubator-metron#231
> METRON-390: Stellar functions should initialize upon use, rather than
> all at once closes apache/incubator-metron#228
> METRON-386 Create Ambari Service Definition for Elasticsearch
> (justinleet via dlyle65535) closes apache/incubator-metron#223
> METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
> (nickwallen) closes apache/incubator-metron#226
> METRON-372 Enhance Statistical Operations Available for Use with the
> Profiler (nickwallen) closes apache/incubator-metron#225
> METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> closes apache/incubator-metron#227
> METRON-341: Create stellar enrichment adapter closes
> apache/incubator-metron#216
> METRON-368 Simplify Profile Configuration with Sensible Defaults
> (nickwallen) closes apache/incubator-metron#213
> METRON-367 Enhance Profiler to Support Multiple Numeric Types
> (nickwallen) closes apache/incubator-metron#212
> METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
> via cestella) closes apache/incubator-metron#211
> METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> closes apache/incubator-metron#224
> METRON-309 Created a Normalcy Profiler (nickwallen) closes
> apache/incubator-metron#208
> METRON-366: Add MODEL_APPLY to Stellar closes
> apache/incubator-metron#210
> METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
> via cestella) closes apache/incubator-metron#203
> METRON-362: Unify the Stellar Languages closes
> apache/incubator-metron#207
> METRON-339: Create YARN app to deploy endpoints closes
> apache/incubator-metron#205
> METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> dlyle65535) closes apache/incubator-metron#206
> METRON-356 Modify Storm topology.classpath via configuration (mmiklavc
> via cestella) closes apache/incubator-metron#204
> METRON-242 remove Squid pattern closes apache/incubator-metron#202
> METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> apache/incubator-metron#199
> METRON-336 Update README.md to use brew instead of pip for ansible
> 2.0.0.2 install (jfrazee via dlyle65535) closes apache/incubator-metron#198
> METRON-314 Kibana Default Dashboard - Map Broken closes
> apache/incubator-metron#193
> METRON-284 SensorParserConfig object cannot be serialized with the
> default Jackson ObjectMapper (cestella via dlyle65535) closes
> apache/incubator-metron#184
> METRON-338 Remove flux from metron-parsers and RPM builds and add
> metron-indexing (mmiklavc via dlyle65535) closes apache/incubator-metron#201
> METRON-334 Travis CI cache Maven dependencies (justinleet via
> dlyle65535) closes apache/incubator-metron#196
> METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet via
> dlyle65535 ) closes apache/incubator-metron#191
> METRON-304 Add PCAP backend rpm packaging
> METRON-300 Adding Enrichment Subpackage to RPM spec
> METRON-305: Adding Solr Subpackage to RPM spec
> METRON-303 Adding Data Management Subpackage to RPM spec
> METRON-301: Adding Elasticsearch Subpackage to RPM spec
> METRON-299 Adding Parsers Subpackage to RPM spec
> METRON-302 Add rpm spec file
> METRON-306: Create Docker container for RPM creation (dlyle65535 via
> cestella) closes apache/incubator-metron#190
> METRON-154: Decouple enrichment and indexing closes
> apache/incubator-metron#192
> METRON-294 Refactor parser topology builder (nickwallen via cestella)
> closes apache/incubator-metron#185
> METRON-266 Remove duplicate entries of sniff_interface (nickwallen via
> cestella) closes apache/incubator-metron#183
> METRON-225 Amazon-ec2 run script continues running on Maven build
> error (nickwallen via cestella) closes apache/incubator-metron#182
> METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
> (nickwallen via cestella) closes apache/incubator-metron#181
> METRON-281 Simplify deployment to alternative AWS region (nickwallen
> via cestella) closes apache/incubator-metron#180
> METRON-117 Deployment Report Created for All Deployments (nickwallen
> via cestella) closes apache/incubator-metron#179
> METRON-262 Update codelab image scripts closes
> apache/incubator-metron#177
> METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
> apache/incubator-metron#187
>
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
Re: [DISCUSS] Upcoming Metron Build
Posted by James Sirota <js...@apache.org>.
Ok. Lets get the build out today and then we'll send 474 for the next build
29.09.2016, 09:50, "Otto Fowler" <ot...@gmail.com>:
> METRON-474 is going to build on top of 466\u2019s functionality. I am testing
> it now and should have a PR later today, although I\u2019m not sure it is worth
> waiting for. Just mentioning it.
>
> On September 29, 2016 at 12:20:38, Casey Stella (cestella@gmail.com) wrote:
>
> Ok, with METRON-466 and METRON-398 being committed, I think we have
> everything in.
>
> On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
> michael.miklavcic@gmail.com> wrote:
>
>> �https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
>> �committed
>>
>> �On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
>>
>> �> Sounds like we are still debating METRON-466. I want to make sure we
>
> get
>> �> consensus on it before we wend up the build. Lets wait a day until we
>> �get
>> �> resolution
>> �>
>> �> 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
>> �> > No. METRON-466 is in review.
>> �> >
>> �> > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
>> �> wrote:
>> �> >
>> �> >> Do we now have everything we wanted in there?
>> �> >>
>> �> >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com
>> �<javascript:;>>:
>> �> >> > I'd like to hold out for https://issues.apache.org/
>> �> >> jira/browse/METRON-466.
>> �> >> > I'm testing this now, so am a few hours out.
>> �> >> >
>> �> >> > -D...
>> �> >> >
>> �> >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
>> �> >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
>> �> >> >
>> �> >> >> Also need this Jira to bump the version.
>> �> >> >>
>> �> >> >> https://issues.apache.org/jira/browse/METRON-398
>> �> >> >>
>> �> >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
>> �jsirota@apache.org
>> �> >> <javascript:;>> wrote:
>> �> >> >>
>> �> >> >> > We are preparing the next release (will be put up for a vote
>> �> within
>> �> >> the
>> �> >> >> > next few days) with the following list of Jiras. Do you feel
>> �there
>> �> >> are
>> �> >> >> any
>> �> >> >> > other Jiras that should go into this release or are there any
>> �> >> critical
>> �> >> >> bugs
>> �> >> >> > that anyone knows of that we should address before releasing?
>> �> Please
>> �> >> >> > comment on this thread. Otherwise, we will put up the release
>> �for
>> �> a
>> �> >> vote
>> �> >> >> > shortly.
>> �> >> >> >
>> �> >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
>> �via
>> �> >> >> > cestella) closes apache/incubator-metron#274
>> �> >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
>> �> >> >> closes
>> �> >> >> > apache/incubator-metron#271
>> �> >> >> > METRON-453: Add a stellar shell function to open an external
>> �> editor
>> �> >> >> > and return the editor's contents closes
>> �> apache/incubator-metron#272
>> �> >> >> > METRON-452: Add rudimentary configuration management functions
>> �to
>> �> >> >> > Stellar closes apache/incubator-metron#269
>> �> >> >> > METRON-374: Add appropriate bundled 3rd party licenses to
>
> NOTICE
>> �> and
>> �> >> >> > LICENSE where appropriate closes apache/incubator-metron#229
>> �> >> >> > METRON-427 Create Ambari Management Pack for Metron
>
> Installation
>> �> >> >> > closes apache/incubator-metron#266
>> �> >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
>> �> >> >> > METRON-437 Profile Definition's 'inputTopic' field is
>
> Extraneous
>> �> >> >> > (nickwallen) closes apache/incubator-metron#264
>> �> >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>> �> >> >> > nickwallen) closes apache/incubator-metron#267
>> �> >> >> > METRON-438: Back the Stellar REPL with a readline
>
> implementation
>> �> >> >> > closes apache/incubator-metron#265
>> �> >> >> > METRON-426: Stellar does not support scientific notation as a
>> �> literal
>> �> >> >> > closes apache/incubator-metron#257
>> �> >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella)
>
> closes
>> �> >> >> > apache/incubator-metron#262
>> �> >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
>> �> >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
>> �> >> >> > METRON-433: Documentation update closes
>> �> apache/incubator-metron#260
>> �> >> >> > METRON-428: Allow a kafka offset to be passed to the
>> �> ParserTopology
>> �> >> >> > CLI closes apache/incubator-metron#258
>> �> >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>> �> >> >> > (nickwallen) closes apache/incubator-metron#259
>> �> >> >> > METRON-384 Deployment fails at task "Wait for
>
> Elasticsearch
>> �> >> >> Host
>> �> >> >> > to Start" (2xyo via dlyle65535) closes
>> �> >> apache/incubator-metron#221
>> �> >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
>> �> (mmiklavc
>> �> >> >> > via cestella) closes apache/incubator-metron#256
>> �> >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
>> �> closes
>> �> >> >> > apache/incubator-metron#254
>> �> >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
>> �> API
>> �> >> >> > (nickwallen) closes apache/incubator-metron#249
>> �> >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
>> �> (nickwallen)
>> �> >> >> > closes apache/incubator-metron#252
>> �> >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen)
>
> closes
>> �> >> >> > apache/incubator-metron#255
>> �> >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
>> �> >> >> > apache/incubator-metron#251
>> �> >> >> > METRON-415: Allow a Profile to Store Any Type as its Value
>> �closes
>> �> >> >> > apache/incubator-metron#253
>> �> >> >> > METRON-411 Support Greater Range of Profile Periods
>
> (nickwallen)
>> �> >> >> > closes apache/incubator-metron#246
>> �> >> >> > METRON-416: Provide the ability to store mergeable data
>> �structures
>> �> >> >> for
>> �> >> >> > summarizing data on-line closes apache/incubator-metron#250
>> �> >> >> > METRON-397: Add a stellar function to interact with the HBase
>> �> >> >> > enrichment table closes apache/incubator-metron#234
>> �> >> >> > METRON-391 Create Stellar Function to Read Profile Data for
>> �Model
>> �> >> >> > Scoring (nickwallen via cestella) closes
>> �> apache/incubator-metron#242
>> �> >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
>> �> >> >> > apache/incubator-metron#248
>> �> >> >> > METRON-407: We currently do not provide defaults if the Stix
>> �> >> >> > Observable does not specify a condition closes
>> �> >> >> apache/incubator-metron#244
>> �> >> >> > METRON-406: Stellar variable resolution does not resolve
>> �variables
>> �> >> >> > with ':' in them closes apache/incubator-metron#243
>> �> >> >> > METRON-399 Stellar Date Functions Should Default to Current
>
> Time
>> �> >> >> > (nickwallen) closes apache/incubator-metron#237
>> �> >> >> > METRON-389 Create Java API to Read Profile Data During Model
>> �> Scoring
>> �> >> >> > (nickwallen) closes apache/incubator-metron#236
>> �> >> >> > METRON-385 Create Ambari Service Definition for Indexing
>> �> (justinleet
>> �> >> >> > via cestella) closes apache/incubator-metron#222
>> �> >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp
>> �values
>> �> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
>> �> >> >> > METRON-400 Deploy Probes to running Docker Container closes
>> �> >> >> > apache/incubator-metron#241
>> �> >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
>> �> >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
>> �> >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
>> �> closes
>> �> >> >> > apache/incubator-metron#217
>> �> >> >> > METRON-404 Stellar Compiler Hides Function Initialization
>
> Errors
>> �> >> >> > (nickwallen) closes apache/incubator-metron#240
>> �> >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
>> �> >> >> > (nickwallen) closes apache/incubator-metron#230
>> �> >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
>> �> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
>> �> >> >> > METRON-396: Make Stellar function resolution happen via an
>> �> annotation
>> �> >> >> > and classpath search closes apache/incubator-metron#233
>> �> >> >> > METRON-400 Deploy Probes to running Docker Container closes
>> �> >> >> > apache/incubator-metron#238
>> �> >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
>> �> (nickwallen
>> �> >> >> > via cestella) closes apache/incubator-metron#239
>> �> >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
>> �> 'Group
>> �> >> >> > By' (nickwallen) closes apache/incubator-metron#231
>> �> >> >> > METRON-390: Stellar functions should initialize upon use,
>
> rather
>> �> than
>> �> >> >> > all at once closes apache/incubator-metron#228
>> �> >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
>> �> >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
>> �> >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
>> �> Functions
>> �> >> >> > (nickwallen) closes apache/incubator-metron#226
>> �> >> >> > METRON-372 Enhance Statistical Operations Available for Use
>
> with
>> �> the
>> �> >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
>> �> >> >> > METRON-388: Stellar - Unable to Operate on Result of
>> �If-Then-Else
>> �> >> >> > closes apache/incubator-metron#227
>> �> >> >> > METRON-341: Create stellar enrichment adapter closes
>> �> >> >> > apache/incubator-metron#216
>> �> >> >> > METRON-368 Simplify Profile Configuration with Sensible
>
> Defaults
>> �> >> >> > (nickwallen) closes apache/incubator-metron#213
>> �> >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
>> �> >> >> > (nickwallen) closes apache/incubator-metron#212
>> �> >> >> > METRON-365: Load demo dashboard on Kibana Service install
>> �> (dlyle65535
>> �> >> >> > via cestella) closes apache/incubator-metron#211
>> �> >> >> > METRON-387 Build Failure - Bad Merge with METRON-309
>> �(nickwallen)
>> �> >> >> > closes apache/incubator-metron#224
>> �> >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
>> �> >> >> > apache/incubator-metron#208
>> �> >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
>> �> >> >> > apache/incubator-metron#210
>> �> >> >> > METRON-357: Create Ambari Service Definition for Kibana
>> �> (dlyle65535
>> �> >> >> > via cestella) closes apache/incubator-metron#203
>> �> >> >> > METRON-362: Unify the Stellar Languages closes
>> �> >> >> > apache/incubator-metron#207
>> �> >> >> > METRON-339: Create YARN app to deploy endpoints closes
>> �> >> >> > apache/incubator-metron#205
>> �> >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0
>
> via
>> �> >> >> > dlyle65535) closes apache/incubator-metron#206
>> �> >> >> > METRON-356 Modify Storm topology.classpath via configuration
>> �> >> >> (mmiklavc
>> �> >> >> > via cestella) closes apache/incubator-metron#204
>> �> >> >> > METRON-242 remove Squid pattern closes
>> �apache/incubator-metron#202
>> �> >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535)
>> �closes
>> �> >> >> > apache/incubator-metron#199
>> �> >> >> > METRON-336 Update README.md to use brew instead of pip for
>> �ansible
>> �> >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
>> �> >> >> apache/incubator-metron#198
>> �> >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
>> �> >> >> > apache/incubator-metron#193
>> �> >> >> > METRON-284 SensorParserConfig object cannot be serialized with
>> �the
>> �> >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
>> �> >> >> > apache/incubator-metron#184
>> �> >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and
>> �add
>> �> >> >> > metron-indexing (mmiklavc via dlyle65535) closes
>> �> >> >> apache/incubator-metron#201
>> �> >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
>> �> >> >> > dlyle65535) closes apache/incubator-metron#196
>> �> >> >> > METRON-214: Build RPM Packages for Deployment
>> �(mmiklavc,justinleet
>> �> >> >> via
>> �> >> >> > dlyle65535 ) closes apache/incubator-metron#191
>> �> >> >> > METRON-304 Add PCAP backend rpm packaging
>> �> >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
>> �> >> >> > METRON-305: Adding Solr Subpackage to RPM spec
>> �> >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
>> �> >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
>> �> >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
>> �> >> >> > METRON-302 Add rpm spec file
>> �> >> >> > METRON-306: Create Docker container for RPM creation
>
> (dlyle65535
>> �> via
>> �> >> >> > cestella) closes apache/incubator-metron#190
>> �> >> >> > METRON-154: Decouple enrichment and indexing closes
>> �> >> >> > apache/incubator-metron#192
>> �> >> >> > METRON-294 Refactor parser topology builder (nickwallen via
>> �> cestella)
>> �> >> >> > closes apache/incubator-metron#185
>> �> >> >> > METRON-266 Remove duplicate entries of sniff_interface
>> �(nickwallen
>> �> >> >> via
>> �> >> >> > cestella) closes apache/incubator-metron#183
>> �> >> >> > METRON-225 Amazon-ec2 run script continues running on Maven
>> �build
>> �> >> >> > error (nickwallen via cestella) closes
>> �apache/incubator-metron#182
>> �> >> >> > METRON-279 Removed duplicative roles; metron-kafka and
>> �> metron-hbase
>> �> >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
>> �> >> >> > METRON-281 Simplify deployment to alternative AWS region
>> �> (nickwallen
>> �> >> >> > via cestella) closes apache/incubator-metron#180
>> �> >> >> > METRON-117 Deployment Report Created for All Deployments
>> �> (nickwallen
>> �> >> >> > via cestella) closes apache/incubator-metron#179
>> �> >> >> > METRON-262 Update codelab image scripts closes
>> �> >> >> > apache/incubator-metron#177
>> �> >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
>> �> closes
>> �> >> >> > apache/incubator-metron#187
>> �> >> >> >
>> �> >> >> >
>> �> >> >> > -------------------
>> �> >> >> > Thank you,
>> �> >> >> >
>> �> >> >> > James Sirota
>> �> >> >> > PPMC- Apache Metron (Incubating)
>> �> >> >> > jsirota AT apache DOT org
>> �> >> >> >
>> �> >>
>> �> >> -------------------
>> �> >> Thank you,
>> �> >>
>> �> >> James Sirota
>> �> >> PPMC- Apache Metron (Incubating)
>> �> >> jsirota AT apache DOT org
>> �>
>> �> -------------------
>> �> Thank you,
>> �>
>> �> James Sirota
>> �> PPMC- Apache Metron (Incubating)
>> �> jsirota AT apache DOT org
>> �>
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by Otto Fowler <ot...@gmail.com>.
METRON-474 is going to build on top of 466’s functionality. I am testing
it now and should have a PR later today, although I’m not sure it is worth
waiting for. Just mentioning it.
On September 29, 2016 at 12:20:38, Casey Stella (cestella@gmail.com) wrote:
Ok, with METRON-466 and METRON-398 being committed, I think we have
everything in.
On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
> committed
>
>
> On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
>
> > Sounds like we are still debating METRON-466. I want to make sure we
get
> > consensus on it before we wend up the build. Lets wait a day until we
> get
> > resolution
> >
> > 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> > > No. METRON-466 is in review.
> > >
> > > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
> > wrote:
> > >
> > >> Do we now have everything we wanted in there?
> > >>
> > >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com
> <javascript:;>>:
> > >> > I'd like to hold out for https://issues.apache.org/
> > >> jira/browse/METRON-466.
> > >> > I'm testing this now, so am a few hours out.
> > >> >
> > >> > -D...
> > >> >
> > >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> > >> >
> > >> >> Also need this Jira to bump the version.
> > >> >>
> > >> >> https://issues.apache.org/jira/browse/METRON-398
> > >> >>
> > >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
> jsirota@apache.org
> > >> <javascript:;>> wrote:
> > >> >>
> > >> >> > We are preparing the next release (will be put up for a vote
> > within
> > >> the
> > >> >> > next few days) with the following list of Jiras. Do you feel
> there
> > >> are
> > >> >> any
> > >> >> > other Jiras that should go into this release or are there any
> > >> critical
> > >> >> bugs
> > >> >> > that anyone knows of that we should address before releasing?
> > Please
> > >> >> > comment on this thread. Otherwise, we will put up the release
> for
> > a
> > >> vote
> > >> >> > shortly.
> > >> >> >
> > >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
> via
> > >> >> > cestella) closes apache/incubator-metron#274
> > >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> > >> >> closes
> > >> >> > apache/incubator-metron#271
> > >> >> > METRON-453: Add a stellar shell function to open an external
> > editor
> > >> >> > and return the editor's contents closes
> > apache/incubator-metron#272
> > >> >> > METRON-452: Add rudimentary configuration management functions
> to
> > >> >> > Stellar closes apache/incubator-metron#269
> > >> >> > METRON-374: Add appropriate bundled 3rd party licenses to
NOTICE
> > and
> > >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> > >> >> > METRON-427 Create Ambari Management Pack for Metron
Installation
> > >> >> > closes apache/incubator-metron#266
> > >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > >> >> > METRON-437 Profile Definition's 'inputTopic' field is
Extraneous
> > >> >> > (nickwallen) closes apache/incubator-metron#264
> > >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > >> >> > nickwallen) closes apache/incubator-metron#267
> > >> >> > METRON-438: Back the Stellar REPL with a readline
implementation
> > >> >> > closes apache/incubator-metron#265
> > >> >> > METRON-426: Stellar does not support scientific notation as a
> > literal
> > >> >> > closes apache/incubator-metron#257
> > >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella)
closes
> > >> >> > apache/incubator-metron#262
> > >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> > >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > >> >> > METRON-433: Documentation update closes
> > apache/incubator-metron#260
> > >> >> > METRON-428: Allow a kafka offset to be passed to the
> > ParserTopology
> > >> >> > CLI closes apache/incubator-metron#258
> > >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > >> >> > (nickwallen) closes apache/incubator-metron#259
> > >> >> > METRON-384 Deployment fails at task "Wait for
Elasticsearch
> > >> >> Host
> > >> >> > to Start" (2xyo via dlyle65535) closes
> > >> apache/incubator-metron#221
> > >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> > (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#256
> > >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> > closes
> > >> >> > apache/incubator-metron#254
> > >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> > API
> > >> >> > (nickwallen) closes apache/incubator-metron#249
> > >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> > (nickwallen)
> > >> >> > closes apache/incubator-metron#252
> > >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen)
closes
> > >> >> > apache/incubator-metron#255
> > >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > >> >> > apache/incubator-metron#251
> > >> >> > METRON-415: Allow a Profile to Store Any Type as its Value
> closes
> > >> >> > apache/incubator-metron#253
> > >> >> > METRON-411 Support Greater Range of Profile Periods
(nickwallen)
> > >> >> > closes apache/incubator-metron#246
> > >> >> > METRON-416: Provide the ability to store mergeable data
> structures
> > >> >> for
> > >> >> > summarizing data on-line closes apache/incubator-metron#250
> > >> >> > METRON-397: Add a stellar function to interact with the HBase
> > >> >> > enrichment table closes apache/incubator-metron#234
> > >> >> > METRON-391 Create Stellar Function to Read Profile Data for
> Model
> > >> >> > Scoring (nickwallen via cestella) closes
> > apache/incubator-metron#242
> > >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> > >> >> > apache/incubator-metron#248
> > >> >> > METRON-407: We currently do not provide defaults if the Stix
> > >> >> > Observable does not specify a condition closes
> > >> >> apache/incubator-metron#244
> > >> >> > METRON-406: Stellar variable resolution does not resolve
> variables
> > >> >> > with ':' in them closes apache/incubator-metron#243
> > >> >> > METRON-399 Stellar Date Functions Should Default to Current
Time
> > >> >> > (nickwallen) closes apache/incubator-metron#237
> > >> >> > METRON-389 Create Java API to Read Profile Data During Model
> > Scoring
> > >> >> > (nickwallen) closes apache/incubator-metron#236
> > >> >> > METRON-385 Create Ambari Service Definition for Indexing
> > (justinleet
> > >> >> > via cestella) closes apache/incubator-metron#222
> > >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp
> values
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#241
> > >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> > >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
> > closes
> > >> >> > apache/incubator-metron#217
> > >> >> > METRON-404 Stellar Compiler Hides Function Initialization
Errors
> > >> >> > (nickwallen) closes apache/incubator-metron#240
> > >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> > >> >> > (nickwallen) closes apache/incubator-metron#230
> > >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> > >> >> > METRON-396: Make Stellar function resolution happen via an
> > annotation
> > >> >> > and classpath search closes apache/incubator-metron#233
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#238
> > >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#239
> > >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
> > 'Group
> > >> >> > By' (nickwallen) closes apache/incubator-metron#231
> > >> >> > METRON-390: Stellar functions should initialize upon use,
rather
> > than
> > >> >> > all at once closes apache/incubator-metron#228
> > >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> > >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> > >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
> > Functions
> > >> >> > (nickwallen) closes apache/incubator-metron#226
> > >> >> > METRON-372 Enhance Statistical Operations Available for Use
with
> > the
> > >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> > >> >> > METRON-388: Stellar - Unable to Operate on Result of
> If-Then-Else
> > >> >> > closes apache/incubator-metron#227
> > >> >> > METRON-341: Create stellar enrichment adapter closes
> > >> >> > apache/incubator-metron#216
> > >> >> > METRON-368 Simplify Profile Configuration with Sensible
Defaults
> > >> >> > (nickwallen) closes apache/incubator-metron#213
> > >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> > >> >> > (nickwallen) closes apache/incubator-metron#212
> > >> >> > METRON-365: Load demo dashboard on Kibana Service install
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#211
> > >> >> > METRON-387 Build Failure - Bad Merge with METRON-309
> (nickwallen)
> > >> >> > closes apache/incubator-metron#224
> > >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> > >> >> > apache/incubator-metron#208
> > >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> > >> >> > apache/incubator-metron#210
> > >> >> > METRON-357: Create Ambari Service Definition for Kibana
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#203
> > >> >> > METRON-362: Unify the Stellar Languages closes
> > >> >> > apache/incubator-metron#207
> > >> >> > METRON-339: Create YARN app to deploy endpoints closes
> > >> >> > apache/incubator-metron#205
> > >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0
via
> > >> >> > dlyle65535) closes apache/incubator-metron#206
> > >> >> > METRON-356 Modify Storm topology.classpath via configuration
> > >> >> (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#204
> > >> >> > METRON-242 remove Squid pattern closes
> apache/incubator-metron#202
> > >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535)
> closes
> > >> >> > apache/incubator-metron#199
> > >> >> > METRON-336 Update README.md to use brew instead of pip for
> ansible
> > >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> > >> >> apache/incubator-metron#198
> > >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> > >> >> > apache/incubator-metron#193
> > >> >> > METRON-284 SensorParserConfig object cannot be serialized with
> the
> > >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> > >> >> > apache/incubator-metron#184
> > >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and
> add
> > >> >> > metron-indexing (mmiklavc via dlyle65535) closes
> > >> >> apache/incubator-metron#201
> > >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> > >> >> > dlyle65535) closes apache/incubator-metron#196
> > >> >> > METRON-214: Build RPM Packages for Deployment
> (mmiklavc,justinleet
> > >> >> via
> > >> >> > dlyle65535 ) closes apache/incubator-metron#191
> > >> >> > METRON-304 Add PCAP backend rpm packaging
> > >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> > >> >> > METRON-305: Adding Solr Subpackage to RPM spec
> > >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> > >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> > >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> > >> >> > METRON-302 Add rpm spec file
> > >> >> > METRON-306: Create Docker container for RPM creation
(dlyle65535
> > via
> > >> >> > cestella) closes apache/incubator-metron#190
> > >> >> > METRON-154: Decouple enrichment and indexing closes
> > >> >> > apache/incubator-metron#192
> > >> >> > METRON-294 Refactor parser topology builder (nickwallen via
> > cestella)
> > >> >> > closes apache/incubator-metron#185
> > >> >> > METRON-266 Remove duplicate entries of sniff_interface
> (nickwallen
> > >> >> via
> > >> >> > cestella) closes apache/incubator-metron#183
> > >> >> > METRON-225 Amazon-ec2 run script continues running on Maven
> build
> > >> >> > error (nickwallen via cestella) closes
> apache/incubator-metron#182
> > >> >> > METRON-279 Removed duplicative roles; metron-kafka and
> > metron-hbase
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> > >> >> > METRON-281 Simplify deployment to alternative AWS region
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#180
> > >> >> > METRON-117 Deployment Report Created for All Deployments
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#179
> > >> >> > METRON-262 Update codelab image scripts closes
> > >> >> > apache/incubator-metron#177
> > >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
> > closes
> > >> >> > apache/incubator-metron#187
> > >> >> >
> > >> >> >
> > >> >> > -------------------
> > >> >> > Thank you,
> > >> >> >
> > >> >> > James Sirota
> > >> >> > PPMC- Apache Metron (Incubating)
> > >> >> > jsirota AT apache DOT org
> > >> >> >
> > >>
> > >> -------------------
> > >> Thank you,
> > >>
> > >> James Sirota
> > >> PPMC- Apache Metron (Incubating)
> > >> jsirota AT apache DOT org
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
Re: [DISCUSS] Upcoming Metron Build
Posted by Casey Stella <ce...@gmail.com>.
Ok, with METRON-466 and METRON-398 being committed, I think we have
everything in.
On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
> committed
>
>
> On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
>
> > Sounds like we are still debating METRON-466. I want to make sure we get
> > consensus on it before we wend up the build. Lets wait a day until we
> get
> > resolution
> >
> > 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> > > No. METRON-466 is in review.
> > >
> > > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
> > wrote:
> > >
> > >> Do we now have everything we wanted in there?
> > >>
> > >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com
> <javascript:;>>:
> > >> > I'd like to hold out for https://issues.apache.org/
> > >> jira/browse/METRON-466.
> > >> > I'm testing this now, so am a few hours out.
> > >> >
> > >> > -D...
> > >> >
> > >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> > >> >
> > >> >> Also need this Jira to bump the version.
> > >> >>
> > >> >> https://issues.apache.org/jira/browse/METRON-398
> > >> >>
> > >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
> jsirota@apache.org
> > >> <javascript:;>> wrote:
> > >> >>
> > >> >> > We are preparing the next release (will be put up for a vote
> > within
> > >> the
> > >> >> > next few days) with the following list of Jiras. Do you feel
> there
> > >> are
> > >> >> any
> > >> >> > other Jiras that should go into this release or are there any
> > >> critical
> > >> >> bugs
> > >> >> > that anyone knows of that we should address before releasing?
> > Please
> > >> >> > comment on this thread. Otherwise, we will put up the release
> for
> > a
> > >> vote
> > >> >> > shortly.
> > >> >> >
> > >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
> via
> > >> >> > cestella) closes apache/incubator-metron#274
> > >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> > >> >> closes
> > >> >> > apache/incubator-metron#271
> > >> >> > METRON-453: Add a stellar shell function to open an external
> > editor
> > >> >> > and return the editor's contents closes
> > apache/incubator-metron#272
> > >> >> > METRON-452: Add rudimentary configuration management functions
> to
> > >> >> > Stellar closes apache/incubator-metron#269
> > >> >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE
> > and
> > >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> > >> >> > METRON-427 Create Ambari Management Pack for Metron Installation
> > >> >> > closes apache/incubator-metron#266
> > >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > >> >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> > >> >> > (nickwallen) closes apache/incubator-metron#264
> > >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > >> >> > nickwallen) closes apache/incubator-metron#267
> > >> >> > METRON-438: Back the Stellar REPL with a readline implementation
> > >> >> > closes apache/incubator-metron#265
> > >> >> > METRON-426: Stellar does not support scientific notation as a
> > literal
> > >> >> > closes apache/incubator-metron#257
> > >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> > >> >> > apache/incubator-metron#262
> > >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> > >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > >> >> > METRON-433: Documentation update closes
> > apache/incubator-metron#260
> > >> >> > METRON-428: Allow a kafka offset to be passed to the
> > ParserTopology
> > >> >> > CLI closes apache/incubator-metron#258
> > >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > >> >> > (nickwallen) closes apache/incubator-metron#259
> > >> >> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> > >> >> Host
> > >> >> > to Start" (2xyo via dlyle65535) closes
> > >> apache/incubator-metron#221
> > >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> > (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#256
> > >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> > closes
> > >> >> > apache/incubator-metron#254
> > >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> > API
> > >> >> > (nickwallen) closes apache/incubator-metron#249
> > >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> > (nickwallen)
> > >> >> > closes apache/incubator-metron#252
> > >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> > >> >> > apache/incubator-metron#255
> > >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > >> >> > apache/incubator-metron#251
> > >> >> > METRON-415: Allow a Profile to Store Any Type as its Value
> closes
> > >> >> > apache/incubator-metron#253
> > >> >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> > >> >> > closes apache/incubator-metron#246
> > >> >> > METRON-416: Provide the ability to store mergeable data
> structures
> > >> >> for
> > >> >> > summarizing data on-line closes apache/incubator-metron#250
> > >> >> > METRON-397: Add a stellar function to interact with the HBase
> > >> >> > enrichment table closes apache/incubator-metron#234
> > >> >> > METRON-391 Create Stellar Function to Read Profile Data for
> Model
> > >> >> > Scoring (nickwallen via cestella) closes
> > apache/incubator-metron#242
> > >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> > >> >> > apache/incubator-metron#248
> > >> >> > METRON-407: We currently do not provide defaults if the Stix
> > >> >> > Observable does not specify a condition closes
> > >> >> apache/incubator-metron#244
> > >> >> > METRON-406: Stellar variable resolution does not resolve
> variables
> > >> >> > with ':' in them closes apache/incubator-metron#243
> > >> >> > METRON-399 Stellar Date Functions Should Default to Current Time
> > >> >> > (nickwallen) closes apache/incubator-metron#237
> > >> >> > METRON-389 Create Java API to Read Profile Data During Model
> > Scoring
> > >> >> > (nickwallen) closes apache/incubator-metron#236
> > >> >> > METRON-385 Create Ambari Service Definition for Indexing
> > (justinleet
> > >> >> > via cestella) closes apache/incubator-metron#222
> > >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp
> values
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#241
> > >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> > >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
> > closes
> > >> >> > apache/incubator-metron#217
> > >> >> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> > >> >> > (nickwallen) closes apache/incubator-metron#240
> > >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> > >> >> > (nickwallen) closes apache/incubator-metron#230
> > >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> > >> >> > METRON-396: Make Stellar function resolution happen via an
> > annotation
> > >> >> > and classpath search closes apache/incubator-metron#233
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#238
> > >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#239
> > >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
> > 'Group
> > >> >> > By' (nickwallen) closes apache/incubator-metron#231
> > >> >> > METRON-390: Stellar functions should initialize upon use, rather
> > than
> > >> >> > all at once closes apache/incubator-metron#228
> > >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> > >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> > >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
> > Functions
> > >> >> > (nickwallen) closes apache/incubator-metron#226
> > >> >> > METRON-372 Enhance Statistical Operations Available for Use with
> > the
> > >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> > >> >> > METRON-388: Stellar - Unable to Operate on Result of
> If-Then-Else
> > >> >> > closes apache/incubator-metron#227
> > >> >> > METRON-341: Create stellar enrichment adapter closes
> > >> >> > apache/incubator-metron#216
> > >> >> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> > >> >> > (nickwallen) closes apache/incubator-metron#213
> > >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> > >> >> > (nickwallen) closes apache/incubator-metron#212
> > >> >> > METRON-365: Load demo dashboard on Kibana Service install
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#211
> > >> >> > METRON-387 Build Failure - Bad Merge with METRON-309
> (nickwallen)
> > >> >> > closes apache/incubator-metron#224
> > >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> > >> >> > apache/incubator-metron#208
> > >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> > >> >> > apache/incubator-metron#210
> > >> >> > METRON-357: Create Ambari Service Definition for Kibana
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#203
> > >> >> > METRON-362: Unify the Stellar Languages closes
> > >> >> > apache/incubator-metron#207
> > >> >> > METRON-339: Create YARN app to deploy endpoints closes
> > >> >> > apache/incubator-metron#205
> > >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> > >> >> > dlyle65535) closes apache/incubator-metron#206
> > >> >> > METRON-356 Modify Storm topology.classpath via configuration
> > >> >> (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#204
> > >> >> > METRON-242 remove Squid pattern closes
> apache/incubator-metron#202
> > >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535)
> closes
> > >> >> > apache/incubator-metron#199
> > >> >> > METRON-336 Update README.md to use brew instead of pip for
> ansible
> > >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> > >> >> apache/incubator-metron#198
> > >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> > >> >> > apache/incubator-metron#193
> > >> >> > METRON-284 SensorParserConfig object cannot be serialized with
> the
> > >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> > >> >> > apache/incubator-metron#184
> > >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and
> add
> > >> >> > metron-indexing (mmiklavc via dlyle65535) closes
> > >> >> apache/incubator-metron#201
> > >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> > >> >> > dlyle65535) closes apache/incubator-metron#196
> > >> >> > METRON-214: Build RPM Packages for Deployment
> (mmiklavc,justinleet
> > >> >> via
> > >> >> > dlyle65535 ) closes apache/incubator-metron#191
> > >> >> > METRON-304 Add PCAP backend rpm packaging
> > >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> > >> >> > METRON-305: Adding Solr Subpackage to RPM spec
> > >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> > >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> > >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> > >> >> > METRON-302 Add rpm spec file
> > >> >> > METRON-306: Create Docker container for RPM creation (dlyle65535
> > via
> > >> >> > cestella) closes apache/incubator-metron#190
> > >> >> > METRON-154: Decouple enrichment and indexing closes
> > >> >> > apache/incubator-metron#192
> > >> >> > METRON-294 Refactor parser topology builder (nickwallen via
> > cestella)
> > >> >> > closes apache/incubator-metron#185
> > >> >> > METRON-266 Remove duplicate entries of sniff_interface
> (nickwallen
> > >> >> via
> > >> >> > cestella) closes apache/incubator-metron#183
> > >> >> > METRON-225 Amazon-ec2 run script continues running on Maven
> build
> > >> >> > error (nickwallen via cestella) closes
> apache/incubator-metron#182
> > >> >> > METRON-279 Removed duplicative roles; metron-kafka and
> > metron-hbase
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> > >> >> > METRON-281 Simplify deployment to alternative AWS region
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#180
> > >> >> > METRON-117 Deployment Report Created for All Deployments
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#179
> > >> >> > METRON-262 Update codelab image scripts closes
> > >> >> > apache/incubator-metron#177
> > >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
> > closes
> > >> >> > apache/incubator-metron#187
> > >> >> >
> > >> >> >
> > >> >> > -------------------
> > >> >> > Thank you,
> > >> >> >
> > >> >> > James Sirota
> > >> >> > PPMC- Apache Metron (Incubating)
> > >> >> > jsirota AT apache DOT org
> > >> >> >
> > >>
> > >> -------------------
> > >> Thank you,
> > >>
> > >> James Sirota
> > >> PPMC- Apache Metron (Incubating)
> > >> jsirota AT apache DOT org
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
Re: [DISCUSS] Upcoming Metron Build
Posted by Michael Miklavcic <mi...@gmail.com>.
https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
committed
On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
> Sounds like we are still debating METRON-466. I want to make sure we get
> consensus on it before we wend up the build. Lets wait a day until we get
> resolution
>
> 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> > No. METRON-466 is in review.
> >
> > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
> wrote:
> >
> >> Do we now have everything we wanted in there?
> >>
> >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com <javascript:;>>:
> >> > I'd like to hold out for https://issues.apache.org/
> >> jira/browse/METRON-466.
> >> > I'm testing this now, so am a few hours out.
> >> >
> >> > -D...
> >> >
> >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> >> >
> >> >> Also need this Jira to bump the version.
> >> >>
> >> >> https://issues.apache.org/jira/browse/METRON-398
> >> >>
> >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <jsirota@apache.org
> >> <javascript:;>> wrote:
> >> >>
> >> >> > We are preparing the next release (will be put up for a vote
> within
> >> the
> >> >> > next few days) with the following list of Jiras. Do you feel there
> >> are
> >> >> any
> >> >> > other Jiras that should go into this release or are there any
> >> critical
> >> >> bugs
> >> >> > that anyone knows of that we should address before releasing?
> Please
> >> >> > comment on this thread. Otherwise, we will put up the release for
> a
> >> vote
> >> >> > shortly.
> >> >> >
> >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> >> >> > cestella) closes apache/incubator-metron#274
> >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> >> >> closes
> >> >> > apache/incubator-metron#271
> >> >> > METRON-453: Add a stellar shell function to open an external
> editor
> >> >> > and return the editor's contents closes
> apache/incubator-metron#272
> >> >> > METRON-452: Add rudimentary configuration management functions to
> >> >> > Stellar closes apache/incubator-metron#269
> >> >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE
> and
> >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> >> >> > METRON-427 Create Ambari Management Pack for Metron Installation
> >> >> > closes apache/incubator-metron#266
> >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> >> >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> >> >> > (nickwallen) closes apache/incubator-metron#264
> >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> >> >> > nickwallen) closes apache/incubator-metron#267
> >> >> > METRON-438: Back the Stellar REPL with a readline implementation
> >> >> > closes apache/incubator-metron#265
> >> >> > METRON-426: Stellar does not support scientific notation as a
> literal
> >> >> > closes apache/incubator-metron#257
> >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> >> >> > apache/incubator-metron#262
> >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> >> >> > METRON-433: Documentation update closes
> apache/incubator-metron#260
> >> >> > METRON-428: Allow a kafka offset to be passed to the
> ParserTopology
> >> >> > CLI closes apache/incubator-metron#258
> >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> >> >> > (nickwallen) closes apache/incubator-metron#259
> >> >> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> >> >> Host
> >> >> > to Start" (2xyo via dlyle65535) closes
> >> apache/incubator-metron#221
> >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> (mmiklavc
> >> >> > via cestella) closes apache/incubator-metron#256
> >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> closes
> >> >> > apache/incubator-metron#254
> >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> API
> >> >> > (nickwallen) closes apache/incubator-metron#249
> >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> (nickwallen)
> >> >> > closes apache/incubator-metron#252
> >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> >> >> > apache/incubator-metron#255
> >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> >> >> > apache/incubator-metron#251
> >> >> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> >> >> > apache/incubator-metron#253
> >> >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> >> >> > closes apache/incubator-metron#246
> >> >> > METRON-416: Provide the ability to store mergeable data structures
> >> >> for
> >> >> > summarizing data on-line closes apache/incubator-metron#250
> >> >> > METRON-397: Add a stellar function to interact with the HBase
> >> >> > enrichment table closes apache/incubator-metron#234
> >> >> > METRON-391 Create Stellar Function to Read Profile Data for Model
> >> >> > Scoring (nickwallen via cestella) closes
> apache/incubator-metron#242
> >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> >> >> > apache/incubator-metron#248
> >> >> > METRON-407: We currently do not provide defaults if the Stix
> >> >> > Observable does not specify a condition closes
> >> >> apache/incubator-metron#244
> >> >> > METRON-406: Stellar variable resolution does not resolve variables
> >> >> > with ':' in them closes apache/incubator-metron#243
> >> >> > METRON-399 Stellar Date Functions Should Default to Current Time
> >> >> > (nickwallen) closes apache/incubator-metron#237
> >> >> > METRON-389 Create Java API to Read Profile Data During Model
> Scoring
> >> >> > (nickwallen) closes apache/incubator-metron#236
> >> >> > METRON-385 Create Ambari Service Definition for Indexing
> (justinleet
> >> >> > via cestella) closes apache/incubator-metron#222
> >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> >> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> >> > apache/incubator-metron#241
> >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
> closes
> >> >> > apache/incubator-metron#217
> >> >> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> >> >> > (nickwallen) closes apache/incubator-metron#240
> >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> >> >> > (nickwallen) closes apache/incubator-metron#230
> >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> >> >> > METRON-396: Make Stellar function resolution happen via an
> annotation
> >> >> > and classpath search closes apache/incubator-metron#233
> >> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> >> > apache/incubator-metron#238
> >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
> (nickwallen
> >> >> > via cestella) closes apache/incubator-metron#239
> >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
> 'Group
> >> >> > By' (nickwallen) closes apache/incubator-metron#231
> >> >> > METRON-390: Stellar functions should initialize upon use, rather
> than
> >> >> > all at once closes apache/incubator-metron#228
> >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
> Functions
> >> >> > (nickwallen) closes apache/incubator-metron#226
> >> >> > METRON-372 Enhance Statistical Operations Available for Use with
> the
> >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> >> >> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> >> >> > closes apache/incubator-metron#227
> >> >> > METRON-341: Create stellar enrichment adapter closes
> >> >> > apache/incubator-metron#216
> >> >> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> >> >> > (nickwallen) closes apache/incubator-metron#213
> >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> >> >> > (nickwallen) closes apache/incubator-metron#212
> >> >> > METRON-365: Load demo dashboard on Kibana Service install
> (dlyle65535
> >> >> > via cestella) closes apache/incubator-metron#211
> >> >> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> >> >> > closes apache/incubator-metron#224
> >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> >> >> > apache/incubator-metron#208
> >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> >> >> > apache/incubator-metron#210
> >> >> > METRON-357: Create Ambari Service Definition for Kibana
> (dlyle65535
> >> >> > via cestella) closes apache/incubator-metron#203
> >> >> > METRON-362: Unify the Stellar Languages closes
> >> >> > apache/incubator-metron#207
> >> >> > METRON-339: Create YARN app to deploy endpoints closes
> >> >> > apache/incubator-metron#205
> >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> >> >> > dlyle65535) closes apache/incubator-metron#206
> >> >> > METRON-356 Modify Storm topology.classpath via configuration
> >> >> (mmiklavc
> >> >> > via cestella) closes apache/incubator-metron#204
> >> >> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
> >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> >> >> > apache/incubator-metron#199
> >> >> > METRON-336 Update README.md to use brew instead of pip for ansible
> >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> >> >> apache/incubator-metron#198
> >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> >> >> > apache/incubator-metron#193
> >> >> > METRON-284 SensorParserConfig object cannot be serialized with the
> >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> >> >> > apache/incubator-metron#184
> >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and add
> >> >> > metron-indexing (mmiklavc via dlyle65535) closes
> >> >> apache/incubator-metron#201
> >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> >> >> > dlyle65535) closes apache/incubator-metron#196
> >> >> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
> >> >> via
> >> >> > dlyle65535 ) closes apache/incubator-metron#191
> >> >> > METRON-304 Add PCAP backend rpm packaging
> >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> >> >> > METRON-305: Adding Solr Subpackage to RPM spec
> >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> >> >> > METRON-302 Add rpm spec file
> >> >> > METRON-306: Create Docker container for RPM creation (dlyle65535
> via
> >> >> > cestella) closes apache/incubator-metron#190
> >> >> > METRON-154: Decouple enrichment and indexing closes
> >> >> > apache/incubator-metron#192
> >> >> > METRON-294 Refactor parser topology builder (nickwallen via
> cestella)
> >> >> > closes apache/incubator-metron#185
> >> >> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
> >> >> via
> >> >> > cestella) closes apache/incubator-metron#183
> >> >> > METRON-225 Amazon-ec2 run script continues running on Maven build
> >> >> > error (nickwallen via cestella) closes apache/incubator-metron#182
> >> >> > METRON-279 Removed duplicative roles; metron-kafka and
> metron-hbase
> >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> >> >> > METRON-281 Simplify deployment to alternative AWS region
> (nickwallen
> >> >> > via cestella) closes apache/incubator-metron#180
> >> >> > METRON-117 Deployment Report Created for All Deployments
> (nickwallen
> >> >> > via cestella) closes apache/incubator-metron#179
> >> >> > METRON-262 Update codelab image scripts closes
> >> >> > apache/incubator-metron#177
> >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
> closes
> >> >> > apache/incubator-metron#187
> >> >> >
> >> >> >
> >> >> > -------------------
> >> >> > Thank you,
> >> >> >
> >> >> > James Sirota
> >> >> > PPMC- Apache Metron (Incubating)
> >> >> > jsirota AT apache DOT org
> >> >> >
> >>
> >> -------------------
> >> Thank you,
> >>
> >> James Sirota
> >> PPMC- Apache Metron (Incubating)
> >> jsirota AT apache DOT org
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
Re: [DISCUSS] Upcoming Metron Build
Posted by James Sirota <js...@apache.org>.
Sounds like we are still debating METRON-466. I want to make sure we get consensus on it before we wend up the build. Lets wait a day until we get resolution
28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> No. METRON-466 is in review.
>
> On Wednesday, September 28, 2016, James Sirota <js...@apache.org> wrote:
>
>> �Do we now have everything we wanted in there?
>>
>> �27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com <javascript:;>>:
>> �> I'd like to hold out for https://issues.apache.org/
>> �jira/browse/METRON-466.
>> �> I'm testing this now, so am a few hours out.
>> �>
>> �> -D...
>> �>
>> �> On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
>> �> michael.miklavcic@gmail.com <javascript:;>> wrote:
>> �>
>> �>> Also need this Jira to bump the version.
>> �>>
>> �>> https://issues.apache.org/jira/browse/METRON-398
>> �>>
>> �>> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <jsirota@apache.org
>> �<javascript:;>> wrote:
>> �>>
>> �>> > We are preparing the next release (will be put up for a vote within
>> �the
>> �>> > next few days) with the following list of Jiras. Do you feel there
>> �are
>> �>> any
>> �>> > other Jiras that should go into this release or are there any
>> �critical
>> �>> bugs
>> �>> > that anyone knows of that we should address before releasing? Please
>> �>> > comment on this thread. Otherwise, we will put up the release for a
>> �vote
>> �>> > shortly.
>> �>> >
>> �>> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
>> �>> > cestella) closes apache/incubator-metron#274
>> �>> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
>> �>> closes
>> �>> > apache/incubator-metron#271
>> �>> > METRON-453: Add a stellar shell function to open an external editor
>> �>> > and return the editor's contents closes apache/incubator-metron#272
>> �>> > METRON-452: Add rudimentary configuration management functions to
>> �>> > Stellar closes apache/incubator-metron#269
>> �>> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
>> �>> > LICENSE where appropriate closes apache/incubator-metron#229
>> �>> > METRON-427 Create Ambari Management Pack for Metron Installation
>> �>> > closes apache/incubator-metron#266
>> �>> > METRON-434: JSON Parser closes apache/incubator-metron#261
>> �>> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
>> �>> > (nickwallen) closes apache/incubator-metron#264
>> �>> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>> �>> > nickwallen) closes apache/incubator-metron#267
>> �>> > METRON-438: Back the Stellar REPL with a readline implementation
>> �>> > closes apache/incubator-metron#265
>> �>> > METRON-426: Stellar does not support scientific notation as a literal
>> �>> > closes apache/incubator-metron#257
>> �>> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
>> �>> > apache/incubator-metron#262
>> �>> > METRON-436: Updated architecture diagrams for Metron READMEs
>> �>> > (anandsubbu via cestella) closes apache/incubator-metron#263
>> �>> > METRON-433: Documentation update closes apache/incubator-metron#260
>> �>> > METRON-428: Allow a kafka offset to be passed to the ParserTopology
>> �>> > CLI closes apache/incubator-metron#258
>> �>> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>> �>> > (nickwallen) closes apache/incubator-metron#259
>> �>> > METRON-384 Deployment fails at task "Wait for Elasticsearch
>> �>> Host
>> �>> > to Start" (2xyo via dlyle65535) closes
>> �apache/incubator-metron#221
>> �>> > METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
>> �>> > via cestella) closes apache/incubator-metron#256
>> �>> > METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
>> �>> > apache/incubator-metron#254
>> �>> > METRON-413 Allow Start/End Time Range Search in Profiler Client API
>> �>> > (nickwallen) closes apache/incubator-metron#249
>> �>> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
>> �>> > closes apache/incubator-metron#252
>> �>> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
>> �>> > apache/incubator-metron#255
>> �>> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
>> �>> > apache/incubator-metron#251
>> �>> > METRON-415: Allow a Profile to Store Any Type as its Value closes
>> �>> > apache/incubator-metron#253
>> �>> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
>> �>> > closes apache/incubator-metron#246
>> �>> > METRON-416: Provide the ability to store mergeable data structures
>> �>> for
>> �>> > summarizing data on-line closes apache/incubator-metron#250
>> �>> > METRON-397: Add a stellar function to interact with the HBase
>> �>> > enrichment table closes apache/incubator-metron#234
>> �>> > METRON-391 Create Stellar Function to Read Profile Data for Model
>> �>> > Scoring (nickwallen via cestella) closes apache/incubator-metron#242
>> �>> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
>> �>> > apache/incubator-metron#248
>> �>> > METRON-407: We currently do not provide defaults if the Stix
>> �>> > Observable does not specify a condition closes
>> �>> apache/incubator-metron#244
>> �>> > METRON-406: Stellar variable resolution does not resolve variables
>> �>> > with ':' in them closes apache/incubator-metron#243
>> �>> > METRON-399 Stellar Date Functions Should Default to Current Time
>> �>> > (nickwallen) closes apache/incubator-metron#237
>> �>> > METRON-389 Create Java API to Read Profile Data During Model Scoring
>> �>> > (nickwallen) closes apache/incubator-metron#236
>> �>> > METRON-385 Create Ambari Service Definition for Indexing (justinleet
>> �>> > via cestella) closes apache/incubator-metron#222
>> �>> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
>> �>> > (mmiklavc via cestella) closes apache/incubator-metron#232
>> �>> > METRON-400 Deploy Probes to running Docker Container closes
>> �>> > apache/incubator-metron#241
>> �>> > METRON-408 Intermittent Failures of Profile Integration Tests
>> �>> > (nickwallen via cestella) closes apache/incubator-metron#245
>> �>> > METRON-381: Add support for multiple reducers in pcap_query.sh closes
>> �>> > apache/incubator-metron#217
>> �>> > METRON-404 Stellar Compiler Hides Function Initialization Errors
>> �>> > (nickwallen) closes apache/incubator-metron#240
>> �>> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
>> �>> > (nickwallen) closes apache/incubator-metron#230
>> �>> > METRON-383: Create Ambari Service Definition for Metron Parsers
>> �>> > (mmiklavc via cestella) closes apache/incubator-metron#218
>> �>> > METRON-396: Make Stellar function resolution happen via an annotation
>> �>> > and classpath search closes apache/incubator-metron#233
>> �>> > METRON-400 Deploy Probes to running Docker Container closes
>> �>> > apache/incubator-metron#238
>> �>> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
>> �>> > via cestella) closes apache/incubator-metron#239
>> �>> > METRON-394 Create Stellar Date Functions to Use with Profile 'Group
>> �>> > By' (nickwallen) closes apache/incubator-metron#231
>> �>> > METRON-390: Stellar functions should initialize upon use, rather than
>> �>> > all at once closes apache/incubator-metron#228
>> �>> > METRON-386 Create Ambari Service Definition for Elasticsearch
>> �>> > (justinleet via dlyle65535) closes apache/incubator-metron#223
>> �>> > METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
>> �>> > (nickwallen) closes apache/incubator-metron#226
>> �>> > METRON-372 Enhance Statistical Operations Available for Use with the
>> �>> > Profiler (nickwallen) closes apache/incubator-metron#225
>> �>> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
>> �>> > closes apache/incubator-metron#227
>> �>> > METRON-341: Create stellar enrichment adapter closes
>> �>> > apache/incubator-metron#216
>> �>> > METRON-368 Simplify Profile Configuration with Sensible Defaults
>> �>> > (nickwallen) closes apache/incubator-metron#213
>> �>> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
>> �>> > (nickwallen) closes apache/incubator-metron#212
>> �>> > METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
>> �>> > via cestella) closes apache/incubator-metron#211
>> �>> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
>> �>> > closes apache/incubator-metron#224
>> �>> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
>> �>> > apache/incubator-metron#208
>> �>> > METRON-366: Add MODEL_APPLY to Stellar closes
>> �>> > apache/incubator-metron#210
>> �>> > METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
>> �>> > via cestella) closes apache/incubator-metron#203
>> �>> > METRON-362: Unify the Stellar Languages closes
>> �>> > apache/incubator-metron#207
>> �>> > METRON-339: Create YARN app to deploy endpoints closes
>> �>> > apache/incubator-metron#205
>> �>> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
>> �>> > dlyle65535) closes apache/incubator-metron#206
>> �>> > METRON-356 Modify Storm topology.classpath via configuration
>> �>> (mmiklavc
>> �>> > via cestella) closes apache/incubator-metron#204
>> �>> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
>> �>> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
>> �>> > apache/incubator-metron#199
>> �>> > METRON-336 Update README.md to use brew instead of pip for ansible
>> �>> > 2.0.0.2 install (jfrazee via dlyle65535) closes
>> �>> apache/incubator-metron#198
>> �>> > METRON-314 Kibana Default Dashboard - Map Broken closes
>> �>> > apache/incubator-metron#193
>> �>> > METRON-284 SensorParserConfig object cannot be serialized with the
>> �>> > default Jackson ObjectMapper (cestella via dlyle65535) closes
>> �>> > apache/incubator-metron#184
>> �>> > METRON-338 Remove flux from metron-parsers and RPM builds and add
>> �>> > metron-indexing (mmiklavc via dlyle65535) closes
>> �>> apache/incubator-metron#201
>> �>> > METRON-334 Travis CI cache Maven dependencies (justinleet via
>> �>> > dlyle65535) closes apache/incubator-metron#196
>> �>> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
>> �>> via
>> �>> > dlyle65535 ) closes apache/incubator-metron#191
>> �>> > METRON-304 Add PCAP backend rpm packaging
>> �>> > METRON-300 Adding Enrichment Subpackage to RPM spec
>> �>> > METRON-305: Adding Solr Subpackage to RPM spec
>> �>> > METRON-303 Adding Data Management Subpackage to RPM spec
>> �>> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
>> �>> > METRON-299 Adding Parsers Subpackage to RPM spec
>> �>> > METRON-302 Add rpm spec file
>> �>> > METRON-306: Create Docker container for RPM creation (dlyle65535 via
>> �>> > cestella) closes apache/incubator-metron#190
>> �>> > METRON-154: Decouple enrichment and indexing closes
>> �>> > apache/incubator-metron#192
>> �>> > METRON-294 Refactor parser topology builder (nickwallen via cestella)
>> �>> > closes apache/incubator-metron#185
>> �>> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
>> �>> via
>> �>> > cestella) closes apache/incubator-metron#183
>> �>> > METRON-225 Amazon-ec2 run script continues running on Maven build
>> �>> > error (nickwallen via cestella) closes apache/incubator-metron#182
>> �>> > METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
>> �>> > (nickwallen via cestella) closes apache/incubator-metron#181
>> �>> > METRON-281 Simplify deployment to alternative AWS region (nickwallen
>> �>> > via cestella) closes apache/incubator-metron#180
>> �>> > METRON-117 Deployment Report Created for All Deployments (nickwallen
>> �>> > via cestella) closes apache/incubator-metron#179
>> �>> > METRON-262 Update codelab image scripts closes
>> �>> > apache/incubator-metron#177
>> �>> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
>> �>> > apache/incubator-metron#187
>> �>> >
>> �>> >
>> �>> > -------------------
>> �>> > Thank you,
>> �>> >
>> �>> > James Sirota
>> �>> > PPMC- Apache Metron (Incubating)
>> �>> > jsirota AT apache DOT org
>> �>> >
>>
>> �-------------------
>> �Thank you,
>>
>> �James Sirota
>> �PPMC- Apache Metron (Incubating)
>> �jsirota AT apache DOT org
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by David Lyle <dl...@gmail.com>.
No. METRON-466 is in review.
On Wednesday, September 28, 2016, James Sirota <js...@apache.org> wrote:
> Do we now have everything we wanted in there?
>
> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com <javascript:;>>:
> > I'd like to hold out for https://issues.apache.org/
> jira/browse/METRON-466.
> > I'm testing this now, so am a few hours out.
> >
> > -D...
> >
> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> >
> >> Also need this Jira to bump the version.
> >>
> >> https://issues.apache.org/jira/browse/METRON-398
> >>
> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <jsirota@apache.org
> <javascript:;>> wrote:
> >>
> >> > We are preparing the next release (will be put up for a vote within
> the
> >> > next few days) with the following list of Jiras. Do you feel there
> are
> >> any
> >> > other Jiras that should go into this release or are there any
> critical
> >> bugs
> >> > that anyone knows of that we should address before releasing? Please
> >> > comment on this thread. Otherwise, we will put up the release for a
> vote
> >> > shortly.
> >> >
> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> >> > cestella) closes apache/incubator-metron#274
> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> >> closes
> >> > apache/incubator-metron#271
> >> > METRON-453: Add a stellar shell function to open an external editor
> >> > and return the editor's contents closes apache/incubator-metron#272
> >> > METRON-452: Add rudimentary configuration management functions to
> >> > Stellar closes apache/incubator-metron#269
> >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
> >> > LICENSE where appropriate closes apache/incubator-metron#229
> >> > METRON-427 Create Ambari Management Pack for Metron Installation
> >> > closes apache/incubator-metron#266
> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> >> > (nickwallen) closes apache/incubator-metron#264
> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> >> > nickwallen) closes apache/incubator-metron#267
> >> > METRON-438: Back the Stellar REPL with a readline implementation
> >> > closes apache/incubator-metron#265
> >> > METRON-426: Stellar does not support scientific notation as a literal
> >> > closes apache/incubator-metron#257
> >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> >> > apache/incubator-metron#262
> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> >> > METRON-433: Documentation update closes apache/incubator-metron#260
> >> > METRON-428: Allow a kafka offset to be passed to the ParserTopology
> >> > CLI closes apache/incubator-metron#258
> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> >> > (nickwallen) closes apache/incubator-metron#259
> >> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> >> Host
> >> > to Start" (2xyo via dlyle65535) closes
> apache/incubator-metron#221
> >> > METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
> >> > via cestella) closes apache/incubator-metron#256
> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
> >> > apache/incubator-metron#254
> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client API
> >> > (nickwallen) closes apache/incubator-metron#249
> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
> >> > closes apache/incubator-metron#252
> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> >> > apache/incubator-metron#255
> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> >> > apache/incubator-metron#251
> >> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> >> > apache/incubator-metron#253
> >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> >> > closes apache/incubator-metron#246
> >> > METRON-416: Provide the ability to store mergeable data structures
> >> for
> >> > summarizing data on-line closes apache/incubator-metron#250
> >> > METRON-397: Add a stellar function to interact with the HBase
> >> > enrichment table closes apache/incubator-metron#234
> >> > METRON-391 Create Stellar Function to Read Profile Data for Model
> >> > Scoring (nickwallen via cestella) closes apache/incubator-metron#242
> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> >> > apache/incubator-metron#248
> >> > METRON-407: We currently do not provide defaults if the Stix
> >> > Observable does not specify a condition closes
> >> apache/incubator-metron#244
> >> > METRON-406: Stellar variable resolution does not resolve variables
> >> > with ':' in them closes apache/incubator-metron#243
> >> > METRON-399 Stellar Date Functions Should Default to Current Time
> >> > (nickwallen) closes apache/incubator-metron#237
> >> > METRON-389 Create Java API to Read Profile Data During Model Scoring
> >> > (nickwallen) closes apache/incubator-metron#236
> >> > METRON-385 Create Ambari Service Definition for Indexing (justinleet
> >> > via cestella) closes apache/incubator-metron#222
> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> > apache/incubator-metron#241
> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> >> > METRON-381: Add support for multiple reducers in pcap_query.sh closes
> >> > apache/incubator-metron#217
> >> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> >> > (nickwallen) closes apache/incubator-metron#240
> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> >> > (nickwallen) closes apache/incubator-metron#230
> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> >> > METRON-396: Make Stellar function resolution happen via an annotation
> >> > and classpath search closes apache/incubator-metron#233
> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> > apache/incubator-metron#238
> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
> >> > via cestella) closes apache/incubator-metron#239
> >> > METRON-394 Create Stellar Date Functions to Use with Profile 'Group
> >> > By' (nickwallen) closes apache/incubator-metron#231
> >> > METRON-390: Stellar functions should initialize upon use, rather than
> >> > all at once closes apache/incubator-metron#228
> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
> >> > (nickwallen) closes apache/incubator-metron#226
> >> > METRON-372 Enhance Statistical Operations Available for Use with the
> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> >> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> >> > closes apache/incubator-metron#227
> >> > METRON-341: Create stellar enrichment adapter closes
> >> > apache/incubator-metron#216
> >> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> >> > (nickwallen) closes apache/incubator-metron#213
> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> >> > (nickwallen) closes apache/incubator-metron#212
> >> > METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
> >> > via cestella) closes apache/incubator-metron#211
> >> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> >> > closes apache/incubator-metron#224
> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> >> > apache/incubator-metron#208
> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> >> > apache/incubator-metron#210
> >> > METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
> >> > via cestella) closes apache/incubator-metron#203
> >> > METRON-362: Unify the Stellar Languages closes
> >> > apache/incubator-metron#207
> >> > METRON-339: Create YARN app to deploy endpoints closes
> >> > apache/incubator-metron#205
> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> >> > dlyle65535) closes apache/incubator-metron#206
> >> > METRON-356 Modify Storm topology.classpath via configuration
> >> (mmiklavc
> >> > via cestella) closes apache/incubator-metron#204
> >> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> >> > apache/incubator-metron#199
> >> > METRON-336 Update README.md to use brew instead of pip for ansible
> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> >> apache/incubator-metron#198
> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> >> > apache/incubator-metron#193
> >> > METRON-284 SensorParserConfig object cannot be serialized with the
> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> >> > apache/incubator-metron#184
> >> > METRON-338 Remove flux from metron-parsers and RPM builds and add
> >> > metron-indexing (mmiklavc via dlyle65535) closes
> >> apache/incubator-metron#201
> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> >> > dlyle65535) closes apache/incubator-metron#196
> >> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
> >> via
> >> > dlyle65535 ) closes apache/incubator-metron#191
> >> > METRON-304 Add PCAP backend rpm packaging
> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> >> > METRON-305: Adding Solr Subpackage to RPM spec
> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> >> > METRON-302 Add rpm spec file
> >> > METRON-306: Create Docker container for RPM creation (dlyle65535 via
> >> > cestella) closes apache/incubator-metron#190
> >> > METRON-154: Decouple enrichment and indexing closes
> >> > apache/incubator-metron#192
> >> > METRON-294 Refactor parser topology builder (nickwallen via cestella)
> >> > closes apache/incubator-metron#185
> >> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
> >> via
> >> > cestella) closes apache/incubator-metron#183
> >> > METRON-225 Amazon-ec2 run script continues running on Maven build
> >> > error (nickwallen via cestella) closes apache/incubator-metron#182
> >> > METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> >> > METRON-281 Simplify deployment to alternative AWS region (nickwallen
> >> > via cestella) closes apache/incubator-metron#180
> >> > METRON-117 Deployment Report Created for All Deployments (nickwallen
> >> > via cestella) closes apache/incubator-metron#179
> >> > METRON-262 Update codelab image scripts closes
> >> > apache/incubator-metron#177
> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
> >> > apache/incubator-metron#187
> >> >
> >> >
> >> > -------------------
> >> > Thank you,
> >> >
> >> > James Sirota
> >> > PPMC- Apache Metron (Incubating)
> >> > jsirota AT apache DOT org
> >> >
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
Re: [DISCUSS] Upcoming Metron Build
Posted by James Sirota <js...@apache.org>.
Do we now have everything we wanted in there?
27.09.2016, 08:59, "David Lyle" <dl...@gmail.com>:
> I'd like to hold out for https://issues.apache.org/jira/browse/METRON-466.
> I'm testing this now, so am a few hours out.
>
> -D...
>
> On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> michael.miklavcic@gmail.com> wrote:
>
>> �Also need this Jira to bump the version.
>>
>> �https://issues.apache.org/jira/browse/METRON-398
>>
>> �On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <js...@apache.org> wrote:
>>
>> �> We are preparing the next release (will be put up for a vote within the
>> �> next few days) with the following list of Jiras. Do you feel there are
>> �any
>> �> other Jiras that should go into this release or are there any critical
>> �bugs
>> �> that anyone knows of that we should address before releasing? Please
>> �> comment on this thread. Otherwise, we will put up the release for a vote
>> �> shortly.
>> �>
>> �> METRON-457 Correct GrokParser logging spelling error (mmiklavc via
>> �> cestella) closes apache/incubator-metron#274
>> �> METRON-449 JSONMapParser should unfold maps to arbitrary depths
>> �closes
>> �> apache/incubator-metron#271
>> �> METRON-453: Add a stellar shell function to open an external editor
>> �> and return the editor's contents closes apache/incubator-metron#272
>> �> METRON-452: Add rudimentary configuration management functions to
>> �> Stellar closes apache/incubator-metron#269
>> �> METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
>> �> LICENSE where appropriate closes apache/incubator-metron#229
>> �> METRON-427 Create Ambari Management Pack for Metron Installation
>> �> closes apache/incubator-metron#266
>> �> METRON-434: JSON Parser closes apache/incubator-metron#261
>> �> METRON-437 Profile Definition's 'inputTopic' field is Extraneous
>> �> (nickwallen) closes apache/incubator-metron#264
>> �> METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>> �> nickwallen) closes apache/incubator-metron#267
>> �> METRON-438: Back the Stellar REPL with a readline implementation
>> �> closes apache/incubator-metron#265
>> �> METRON-426: Stellar does not support scientific notation as a literal
>> �> closes apache/incubator-metron#257
>> �> METRON-435: Create Stellar REPL (nickwallen via cestella) closes
>> �> apache/incubator-metron#262
>> �> METRON-436: Updated architecture diagrams for Metron READMEs
>> �> (anandsubbu via cestella) closes apache/incubator-metron#263
>> �> METRON-433: Documentation update closes apache/incubator-metron#260
>> �> METRON-428: Allow a kafka offset to be passed to the ParserTopology
>> �> CLI closes apache/incubator-metron#258
>> �> METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>> �> (nickwallen) closes apache/incubator-metron#259
>> �> METRON-384 Deployment fails at task "Wait for Elasticsearch
>> �Host
>> �> to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
>> �> METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
>> �> via cestella) closes apache/incubator-metron#256
>> �> METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
>> �> apache/incubator-metron#254
>> �> METRON-413 Allow Start/End Time Range Search in Profiler Client API
>> �> (nickwallen) closes apache/incubator-metron#249
>> �> METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
>> �> closes apache/incubator-metron#252
>> �> METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
>> �> apache/incubator-metron#255
>> �> METRON-418 Set TTL on HBase Puts (nickwallen) closes
>> �> apache/incubator-metron#251
>> �> METRON-415: Allow a Profile to Store Any Type as its Value closes
>> �> apache/incubator-metron#253
>> �> METRON-411 Support Greater Range of Profile Periods (nickwallen)
>> �> closes apache/incubator-metron#246
>> �> METRON-416: Provide the ability to store mergeable data structures
>> �for
>> �> summarizing data on-line closes apache/incubator-metron#250
>> �> METRON-397: Add a stellar function to interact with the HBase
>> �> enrichment table closes apache/incubator-metron#234
>> �> METRON-391 Create Stellar Function to Read Profile Data for Model
>> �> Scoring (nickwallen via cestella) closes apache/incubator-metron#242
>> �> METRON-414 Kibana Ansible Install Fails with SSL Error closes
>> �> apache/incubator-metron#248
>> �> METRON-407: We currently do not provide defaults if the Stix
>> �> Observable does not specify a condition closes
>> �apache/incubator-metron#244
>> �> METRON-406: Stellar variable resolution does not resolve variables
>> �> with ':' in them closes apache/incubator-metron#243
>> �> METRON-399 Stellar Date Functions Should Default to Current Time
>> �> (nickwallen) closes apache/incubator-metron#237
>> �> METRON-389 Create Java API to Read Profile Data During Model Scoring
>> �> (nickwallen) closes apache/incubator-metron#236
>> �> METRON-385 Create Ambari Service Definition for Indexing (justinleet
>> �> via cestella) closes apache/incubator-metron#222
>> �> METRON-395 Fix Metron Bro parser not parsing some timestamp values
>> �> (mmiklavc via cestella) closes apache/incubator-metron#232
>> �> METRON-400 Deploy Probes to running Docker Container closes
>> �> apache/incubator-metron#241
>> �> METRON-408 Intermittent Failures of Profile Integration Tests
>> �> (nickwallen via cestella) closes apache/incubator-metron#245
>> �> METRON-381: Add support for multiple reducers in pcap_query.sh closes
>> �> apache/incubator-metron#217
>> �> METRON-404 Stellar Compiler Hides Function Initialization Errors
>> �> (nickwallen) closes apache/incubator-metron#240
>> �> METRON-392 Allow User to Define Custom 'Group By' for a Profile
>> �> (nickwallen) closes apache/incubator-metron#230
>> �> METRON-383: Create Ambari Service Definition for Metron Parsers
>> �> (mmiklavc via cestella) closes apache/incubator-metron#218
>> �> METRON-396: Make Stellar function resolution happen via an annotation
>> �> and classpath search closes apache/incubator-metron#233
>> �> METRON-400 Deploy Probes to running Docker Container closes
>> �> apache/incubator-metron#238
>> �> METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
>> �> via cestella) closes apache/incubator-metron#239
>> �> METRON-394 Create Stellar Date Functions to Use with Profile 'Group
>> �> By' (nickwallen) closes apache/incubator-metron#231
>> �> METRON-390: Stellar functions should initialize upon use, rather than
>> �> all at once closes apache/incubator-metron#228
>> �> METRON-386 Create Ambari Service Definition for Elasticsearch
>> �> (justinleet via dlyle65535) closes apache/incubator-metron#223
>> �> METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
>> �> (nickwallen) closes apache/incubator-metron#226
>> �> METRON-372 Enhance Statistical Operations Available for Use with the
>> �> Profiler (nickwallen) closes apache/incubator-metron#225
>> �> METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
>> �> closes apache/incubator-metron#227
>> �> METRON-341: Create stellar enrichment adapter closes
>> �> apache/incubator-metron#216
>> �> METRON-368 Simplify Profile Configuration with Sensible Defaults
>> �> (nickwallen) closes apache/incubator-metron#213
>> �> METRON-367 Enhance Profiler to Support Multiple Numeric Types
>> �> (nickwallen) closes apache/incubator-metron#212
>> �> METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
>> �> via cestella) closes apache/incubator-metron#211
>> �> METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
>> �> closes apache/incubator-metron#224
>> �> METRON-309 Created a Normalcy Profiler (nickwallen) closes
>> �> apache/incubator-metron#208
>> �> METRON-366: Add MODEL_APPLY to Stellar closes
>> �> apache/incubator-metron#210
>> �> METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
>> �> via cestella) closes apache/incubator-metron#203
>> �> METRON-362: Unify the Stellar Languages closes
>> �> apache/incubator-metron#207
>> �> METRON-339: Create YARN app to deploy endpoints closes
>> �> apache/incubator-metron#205
>> �> METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
>> �> dlyle65535) closes apache/incubator-metron#206
>> �> METRON-356 Modify Storm topology.classpath via configuration
>> �(mmiklavc
>> �> via cestella) closes apache/incubator-metron#204
>> �> METRON-242 remove Squid pattern closes apache/incubator-metron#202
>> �> METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
>> �> apache/incubator-metron#199
>> �> METRON-336 Update README.md to use brew instead of pip for ansible
>> �> 2.0.0.2 install (jfrazee via dlyle65535) closes
>> �apache/incubator-metron#198
>> �> METRON-314 Kibana Default Dashboard - Map Broken closes
>> �> apache/incubator-metron#193
>> �> METRON-284 SensorParserConfig object cannot be serialized with the
>> �> default Jackson ObjectMapper (cestella via dlyle65535) closes
>> �> apache/incubator-metron#184
>> �> METRON-338 Remove flux from metron-parsers and RPM builds and add
>> �> metron-indexing (mmiklavc via dlyle65535) closes
>> �apache/incubator-metron#201
>> �> METRON-334 Travis CI cache Maven dependencies (justinleet via
>> �> dlyle65535) closes apache/incubator-metron#196
>> �> METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
>> �via
>> �> dlyle65535 ) closes apache/incubator-metron#191
>> �> METRON-304 Add PCAP backend rpm packaging
>> �> METRON-300 Adding Enrichment Subpackage to RPM spec
>> �> METRON-305: Adding Solr Subpackage to RPM spec
>> �> METRON-303 Adding Data Management Subpackage to RPM spec
>> �> METRON-301: Adding Elasticsearch Subpackage to RPM spec
>> �> METRON-299 Adding Parsers Subpackage to RPM spec
>> �> METRON-302 Add rpm spec file
>> �> METRON-306: Create Docker container for RPM creation (dlyle65535 via
>> �> cestella) closes apache/incubator-metron#190
>> �> METRON-154: Decouple enrichment and indexing closes
>> �> apache/incubator-metron#192
>> �> METRON-294 Refactor parser topology builder (nickwallen via cestella)
>> �> closes apache/incubator-metron#185
>> �> METRON-266 Remove duplicate entries of sniff_interface (nickwallen
>> �via
>> �> cestella) closes apache/incubator-metron#183
>> �> METRON-225 Amazon-ec2 run script continues running on Maven build
>> �> error (nickwallen via cestella) closes apache/incubator-metron#182
>> �> METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
>> �> (nickwallen via cestella) closes apache/incubator-metron#181
>> �> METRON-281 Simplify deployment to alternative AWS region (nickwallen
>> �> via cestella) closes apache/incubator-metron#180
>> �> METRON-117 Deployment Report Created for All Deployments (nickwallen
>> �> via cestella) closes apache/incubator-metron#179
>> �> METRON-262 Update codelab image scripts closes
>> �> apache/incubator-metron#177
>> �> METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
>> �> apache/incubator-metron#187
>> �>
>> �>
>> �> -------------------
>> �> Thank you,
>> �>
>> �> James Sirota
>> �> PPMC- Apache Metron (Incubating)
>> �> jsirota AT apache DOT org
>> �>
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by David Lyle <dl...@gmail.com>.
I'd like to hold out for https://issues.apache.org/jira/browse/METRON-466.
I'm testing this now, so am a few hours out.
-D...
On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> Also need this Jira to bump the version.
>
> https://issues.apache.org/jira/browse/METRON-398
>
> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <js...@apache.org> wrote:
>
> > We are preparing the next release (will be put up for a vote within the
> > next few days) with the following list of Jiras. Do you feel there are
> any
> > other Jiras that should go into this release or are there any critical
> bugs
> > that anyone knows of that we should address before releasing? Please
> > comment on this thread. Otherwise, we will put up the release for a vote
> > shortly.
> >
> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> > cestella) closes apache/incubator-metron#274
> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> closes
> > apache/incubator-metron#271
> > METRON-453: Add a stellar shell function to open an external editor
> > and return the editor's contents closes apache/incubator-metron#272
> > METRON-452: Add rudimentary configuration management functions to
> > Stellar closes apache/incubator-metron#269
> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
> > LICENSE where appropriate closes apache/incubator-metron#229
> > METRON-427 Create Ambari Management Pack for Metron Installation
> > closes apache/incubator-metron#266
> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> > (nickwallen) closes apache/incubator-metron#264
> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > nickwallen) closes apache/incubator-metron#267
> > METRON-438: Back the Stellar REPL with a readline implementation
> > closes apache/incubator-metron#265
> > METRON-426: Stellar does not support scientific notation as a literal
> > closes apache/incubator-metron#257
> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> > apache/incubator-metron#262
> > METRON-436: Updated architecture diagrams for Metron READMEs
> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > METRON-433: Documentation update closes apache/incubator-metron#260
> > METRON-428: Allow a kafka offset to be passed to the ParserTopology
> > CLI closes apache/incubator-metron#258
> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > (nickwallen) closes apache/incubator-metron#259
> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> Host
> > to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
> > METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
> > via cestella) closes apache/incubator-metron#256
> > METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
> > apache/incubator-metron#254
> > METRON-413 Allow Start/End Time Range Search in Profiler Client API
> > (nickwallen) closes apache/incubator-metron#249
> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
> > closes apache/incubator-metron#252
> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> > apache/incubator-metron#255
> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > apache/incubator-metron#251
> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> > apache/incubator-metron#253
> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> > closes apache/incubator-metron#246
> > METRON-416: Provide the ability to store mergeable data structures
> for
> > summarizing data on-line closes apache/incubator-metron#250
> > METRON-397: Add a stellar function to interact with the HBase
> > enrichment table closes apache/incubator-metron#234
> > METRON-391 Create Stellar Function to Read Profile Data for Model
> > Scoring (nickwallen via cestella) closes apache/incubator-metron#242
> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> > apache/incubator-metron#248
> > METRON-407: We currently do not provide defaults if the Stix
> > Observable does not specify a condition closes
> apache/incubator-metron#244
> > METRON-406: Stellar variable resolution does not resolve variables
> > with ':' in them closes apache/incubator-metron#243
> > METRON-399 Stellar Date Functions Should Default to Current Time
> > (nickwallen) closes apache/incubator-metron#237
> > METRON-389 Create Java API to Read Profile Data During Model Scoring
> > (nickwallen) closes apache/incubator-metron#236
> > METRON-385 Create Ambari Service Definition for Indexing (justinleet
> > via cestella) closes apache/incubator-metron#222
> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
> > (mmiklavc via cestella) closes apache/incubator-metron#232
> > METRON-400 Deploy Probes to running Docker Container closes
> > apache/incubator-metron#241
> > METRON-408 Intermittent Failures of Profile Integration Tests
> > (nickwallen via cestella) closes apache/incubator-metron#245
> > METRON-381: Add support for multiple reducers in pcap_query.sh closes
> > apache/incubator-metron#217
> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> > (nickwallen) closes apache/incubator-metron#240
> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> > (nickwallen) closes apache/incubator-metron#230
> > METRON-383: Create Ambari Service Definition for Metron Parsers
> > (mmiklavc via cestella) closes apache/incubator-metron#218
> > METRON-396: Make Stellar function resolution happen via an annotation
> > and classpath search closes apache/incubator-metron#233
> > METRON-400 Deploy Probes to running Docker Container closes
> > apache/incubator-metron#238
> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
> > via cestella) closes apache/incubator-metron#239
> > METRON-394 Create Stellar Date Functions to Use with Profile 'Group
> > By' (nickwallen) closes apache/incubator-metron#231
> > METRON-390: Stellar functions should initialize upon use, rather than
> > all at once closes apache/incubator-metron#228
> > METRON-386 Create Ambari Service Definition for Elasticsearch
> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> > METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
> > (nickwallen) closes apache/incubator-metron#226
> > METRON-372 Enhance Statistical Operations Available for Use with the
> > Profiler (nickwallen) closes apache/incubator-metron#225
> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> > closes apache/incubator-metron#227
> > METRON-341: Create stellar enrichment adapter closes
> > apache/incubator-metron#216
> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> > (nickwallen) closes apache/incubator-metron#213
> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> > (nickwallen) closes apache/incubator-metron#212
> > METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
> > via cestella) closes apache/incubator-metron#211
> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> > closes apache/incubator-metron#224
> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> > apache/incubator-metron#208
> > METRON-366: Add MODEL_APPLY to Stellar closes
> > apache/incubator-metron#210
> > METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
> > via cestella) closes apache/incubator-metron#203
> > METRON-362: Unify the Stellar Languages closes
> > apache/incubator-metron#207
> > METRON-339: Create YARN app to deploy endpoints closes
> > apache/incubator-metron#205
> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> > dlyle65535) closes apache/incubator-metron#206
> > METRON-356 Modify Storm topology.classpath via configuration
> (mmiklavc
> > via cestella) closes apache/incubator-metron#204
> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> > apache/incubator-metron#199
> > METRON-336 Update README.md to use brew instead of pip for ansible
> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> apache/incubator-metron#198
> > METRON-314 Kibana Default Dashboard - Map Broken closes
> > apache/incubator-metron#193
> > METRON-284 SensorParserConfig object cannot be serialized with the
> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> > apache/incubator-metron#184
> > METRON-338 Remove flux from metron-parsers and RPM builds and add
> > metron-indexing (mmiklavc via dlyle65535) closes
> apache/incubator-metron#201
> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> > dlyle65535) closes apache/incubator-metron#196
> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
> via
> > dlyle65535 ) closes apache/incubator-metron#191
> > METRON-304 Add PCAP backend rpm packaging
> > METRON-300 Adding Enrichment Subpackage to RPM spec
> > METRON-305: Adding Solr Subpackage to RPM spec
> > METRON-303 Adding Data Management Subpackage to RPM spec
> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> > METRON-299 Adding Parsers Subpackage to RPM spec
> > METRON-302 Add rpm spec file
> > METRON-306: Create Docker container for RPM creation (dlyle65535 via
> > cestella) closes apache/incubator-metron#190
> > METRON-154: Decouple enrichment and indexing closes
> > apache/incubator-metron#192
> > METRON-294 Refactor parser topology builder (nickwallen via cestella)
> > closes apache/incubator-metron#185
> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
> via
> > cestella) closes apache/incubator-metron#183
> > METRON-225 Amazon-ec2 run script continues running on Maven build
> > error (nickwallen via cestella) closes apache/incubator-metron#182
> > METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
> > (nickwallen via cestella) closes apache/incubator-metron#181
> > METRON-281 Simplify deployment to alternative AWS region (nickwallen
> > via cestella) closes apache/incubator-metron#180
> > METRON-117 Deployment Report Created for All Deployments (nickwallen
> > via cestella) closes apache/incubator-metron#179
> > METRON-262 Update codelab image scripts closes
> > apache/incubator-metron#177
> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
> > apache/incubator-metron#187
> >
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>