You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by James Sirota <js...@apache.org> on 2016/09/27 15:38:20 UTC
[DISCUSS] Upcoming Metron Build
We are preparing the next release (will be put up for a vote within the next few days) with the following list of Jiras. Do you feel there are any other Jiras that should go into this release or are there any critical bugs that anyone knows of that we should address before releasing? Please comment on this thread. Otherwise, we will put up the release for a vote shortly.
METRON-457 Correct GrokParser logging spelling error (mmiklavc via cestella) closes apache/incubator-metron#274
METRON-449 JSONMapParser should unfold maps to arbitrary depths closes apache/incubator-metron#271
METRON-453: Add a stellar shell function to open an external editor and return the editor's contents closes apache/incubator-metron#272
METRON-452: Add rudimentary configuration management functions to Stellar closes apache/incubator-metron#269
METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and LICENSE where appropriate closes apache/incubator-metron#229
METRON-427 Create Ambari Management Pack for Metron Installation closes apache/incubator-metron#266
METRON-434: JSON Parser closes apache/incubator-metron#261
METRON-437 Profile Definition's 'inputTopic' field is Extraneous (nickwallen) closes apache/incubator-metron#264
METRON-445 Fix typos in metron-deployment roles (JonZeolla via nickwallen) closes apache/incubator-metron#267
METRON-438: Back the Stellar REPL with a readline implementation closes apache/incubator-metron#265
METRON-426: Stellar does not support scientific notation as a literal closes apache/incubator-metron#257
METRON-435: Create Stellar REPL (nickwallen via cestella) closes apache/incubator-metron#262
METRON-436: Updated architecture diagrams for Metron READMEs (anandsubbu via cestella) closes apache/incubator-metron#263
METRON-433: Documentation update closes apache/incubator-metron#260
METRON-428: Allow a kafka offset to be passed to the ParserTopology CLI closes apache/incubator-metron#258
METRON-429 Profiler Missing Dependencies When Uber Jar Deployed (nickwallen) closes apache/incubator-metron#259
METRON-384 Deployment fails at task "Wait for Elasticsearch Host to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc via cestella) closes apache/incubator-metron#256
METRON-420 Add Expiration to a Profile Definition (nickwallen) closes apache/incubator-metron#254
METRON-413 Allow Start/End Time Range Search in Profiler Client API (nickwallen) closes apache/incubator-metron#249
METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen) closes apache/incubator-metron#252
METRON-422 Remove bluecoat.json (cestella via nickwallen) closes apache/incubator-metron#255
METRON-418 Set TTL on HBase Puts (nickwallen) closes apache/incubator-metron#251
METRON-415: Allow a Profile to Store Any Type as its Value closes apache/incubator-metron#253
METRON-411 Support Greater Range of Profile Periods (nickwallen) closes apache/incubator-metron#246
METRON-416: Provide the ability to store mergeable data structures for summarizing data on-line closes apache/incubator-metron#250
METRON-397: Add a stellar function to interact with the HBase enrichment table closes apache/incubator-metron#234
METRON-391 Create Stellar Function to Read Profile Data for Model Scoring (nickwallen via cestella) closes apache/incubator-metron#242
METRON-414 Kibana Ansible Install Fails with SSL Error closes apache/incubator-metron#248
METRON-407: We currently do not provide defaults if the Stix Observable does not specify a condition closes apache/incubator-metron#244
METRON-406: Stellar variable resolution does not resolve variables with ':' in them closes apache/incubator-metron#243
METRON-399 Stellar Date Functions Should Default to Current Time (nickwallen) closes apache/incubator-metron#237
METRON-389 Create Java API to Read Profile Data During Model Scoring (nickwallen) closes apache/incubator-metron#236
METRON-385 Create Ambari Service Definition for Indexing (justinleet via cestella) closes apache/incubator-metron#222
METRON-395 Fix Metron Bro parser not parsing some timestamp values (mmiklavc via cestella) closes apache/incubator-metron#232
METRON-400 Deploy Probes to running Docker Container closes apache/incubator-metron#241
METRON-408 Intermittent Failures of Profile Integration Tests (nickwallen via cestella) closes apache/incubator-metron#245
METRON-381: Add support for multiple reducers in pcap_query.sh closes apache/incubator-metron#217
METRON-404 Stellar Compiler Hides Function Initialization Errors (nickwallen) closes apache/incubator-metron#240
METRON-392 Allow User to Define Custom 'Group By' for a Profile (nickwallen) closes apache/incubator-metron#230
METRON-383: Create Ambari Service Definition for Metron Parsers (mmiklavc via cestella) closes apache/incubator-metron#218
METRON-396: Make Stellar function resolution happen via an annotation and classpath search closes apache/incubator-metron#233
METRON-400 Deploy Probes to running Docker Container closes apache/incubator-metron#238
METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen via cestella) closes apache/incubator-metron#239
METRON-394 Create Stellar Date Functions to Use with Profile 'Group By' (nickwallen) closes apache/incubator-metron#231
METRON-390: Stellar functions should initialize upon use, rather than all at once closes apache/incubator-metron#228
METRON-386 Create Ambari Service Definition for Elasticsearch (justinleet via dlyle65535) closes apache/incubator-metron#223
METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions (nickwallen) closes apache/incubator-metron#226
METRON-372 Enhance Statistical Operations Available for Use with the Profiler (nickwallen) closes apache/incubator-metron#225
METRON-388: Stellar - Unable to Operate on Result of If-Then-Else closes apache/incubator-metron#227
METRON-341: Create stellar enrichment adapter closes apache/incubator-metron#216
METRON-368 Simplify Profile Configuration with Sensible Defaults (nickwallen) closes apache/incubator-metron#213
METRON-367 Enhance Profiler to Support Multiple Numeric Types (nickwallen) closes apache/incubator-metron#212
METRON-365: Load demo dashboard on Kibana Service install (dlyle65535 via cestella) closes apache/incubator-metron#211
METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen) closes apache/incubator-metron#224
METRON-309 Created a Normalcy Profiler (nickwallen) closes apache/incubator-metron#208
METRON-366: Add MODEL_APPLY to Stellar closes apache/incubator-metron#210
METRON-357: Create Ambari Service Definition for Kibana (dlyle65535 via cestella) closes apache/incubator-metron#203
METRON-362: Unify the Stellar Languages closes apache/incubator-metron#207
METRON-339: Create YARN app to deploy endpoints closes apache/incubator-metron#205
METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via dlyle65535) closes apache/incubator-metron#206
METRON-356 Modify Storm topology.classpath via configuration (mmiklavc via cestella) closes apache/incubator-metron#204
METRON-242 remove Squid pattern closes apache/incubator-metron#202
METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes apache/incubator-metron#199
METRON-336 Update README.md to use brew instead of pip for ansible 2.0.0.2 install (jfrazee via dlyle65535) closes apache/incubator-metron#198
METRON-314 Kibana Default Dashboard - Map Broken closes apache/incubator-metron#193
METRON-284 SensorParserConfig object cannot be serialized with the default Jackson ObjectMapper (cestella via dlyle65535) closes apache/incubator-metron#184
METRON-338 Remove flux from metron-parsers and RPM builds and add metron-indexing (mmiklavc via dlyle65535) closes apache/incubator-metron#201
METRON-334 Travis CI cache Maven dependencies (justinleet via dlyle65535) closes apache/incubator-metron#196
METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet via dlyle65535 ) closes apache/incubator-metron#191
METRON-304 Add PCAP backend rpm packaging
METRON-300 Adding Enrichment Subpackage to RPM spec
METRON-305: Adding Solr Subpackage to RPM spec
METRON-303 Adding Data Management Subpackage to RPM spec
METRON-301: Adding Elasticsearch Subpackage to RPM spec
METRON-299 Adding Parsers Subpackage to RPM spec
METRON-302 Add rpm spec file
METRON-306: Create Docker container for RPM creation (dlyle65535 via cestella) closes apache/incubator-metron#190
METRON-154: Decouple enrichment and indexing closes apache/incubator-metron#192
METRON-294 Refactor parser topology builder (nickwallen via cestella) closes apache/incubator-metron#185
METRON-266 Remove duplicate entries of sniff_interface (nickwallen via cestella) closes apache/incubator-metron#183
METRON-225 Amazon-ec2 run script continues running on Maven build error (nickwallen via cestella) closes apache/incubator-metron#182
METRON-279 Removed duplicative roles; metron-kafka and metron-hbase (nickwallen via cestella) closes apache/incubator-metron#181
METRON-281 Simplify deployment to alternative AWS region (nickwallen via cestella) closes apache/incubator-metron#180
METRON-117 Deployment Report Created for All Deployments (nickwallen via cestella) closes apache/incubator-metron#179
METRON-262 Update codelab image scripts closes apache/incubator-metron#177
METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes apache/incubator-metron#187
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by James Sirota <js...@apache.org>.
Ok. Lets get the build out today and then we'll send 474 for the next build
29.09.2016, 09:50, "Otto Fowler" <ot...@gmail.com>:
> METRON-474 is going to build on top of 466\u2019s functionality. I am testing
> it now and should have a PR later today, although I\u2019m not sure it is worth
> waiting for. Just mentioning it.
>
> On September 29, 2016 at 12:20:38, Casey Stella (cestella@gmail.com) wrote:
>
> Ok, with METRON-466 and METRON-398 being committed, I think we have
> everything in.
>
> On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
> michael.miklavcic@gmail.com> wrote:
>
>> �https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
>> �committed
>>
>> �On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
>>
>> �> Sounds like we are still debating METRON-466. I want to make sure we
>
> get
>> �> consensus on it before we wend up the build. Lets wait a day until we
>> �get
>> �> resolution
>> �>
>> �> 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
>> �> > No. METRON-466 is in review.
>> �> >
>> �> > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
>> �> wrote:
>> �> >
>> �> >> Do we now have everything we wanted in there?
>> �> >>
>> �> >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com
>> �<javascript:;>>:
>> �> >> > I'd like to hold out for https://issues.apache.org/
>> �> >> jira/browse/METRON-466.
>> �> >> > I'm testing this now, so am a few hours out.
>> �> >> >
>> �> >> > -D...
>> �> >> >
>> �> >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
>> �> >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
>> �> >> >
>> �> >> >> Also need this Jira to bump the version.
>> �> >> >>
>> �> >> >> https://issues.apache.org/jira/browse/METRON-398
>> �> >> >>
>> �> >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
>> �jsirota@apache.org
>> �> >> <javascript:;>> wrote:
>> �> >> >>
>> �> >> >> > We are preparing the next release (will be put up for a vote
>> �> within
>> �> >> the
>> �> >> >> > next few days) with the following list of Jiras. Do you feel
>> �there
>> �> >> are
>> �> >> >> any
>> �> >> >> > other Jiras that should go into this release or are there any
>> �> >> critical
>> �> >> >> bugs
>> �> >> >> > that anyone knows of that we should address before releasing?
>> �> Please
>> �> >> >> > comment on this thread. Otherwise, we will put up the release
>> �for
>> �> a
>> �> >> vote
>> �> >> >> > shortly.
>> �> >> >> >
>> �> >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
>> �via
>> �> >> >> > cestella) closes apache/incubator-metron#274
>> �> >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
>> �> >> >> closes
>> �> >> >> > apache/incubator-metron#271
>> �> >> >> > METRON-453: Add a stellar shell function to open an external
>> �> editor
>> �> >> >> > and return the editor's contents closes
>> �> apache/incubator-metron#272
>> �> >> >> > METRON-452: Add rudimentary configuration management functions
>> �to
>> �> >> >> > Stellar closes apache/incubator-metron#269
>> �> >> >> > METRON-374: Add appropriate bundled 3rd party licenses to
>
> NOTICE
>> �> and
>> �> >> >> > LICENSE where appropriate closes apache/incubator-metron#229
>> �> >> >> > METRON-427 Create Ambari Management Pack for Metron
>
> Installation
>> �> >> >> > closes apache/incubator-metron#266
>> �> >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
>> �> >> >> > METRON-437 Profile Definition's 'inputTopic' field is
>
> Extraneous
>> �> >> >> > (nickwallen) closes apache/incubator-metron#264
>> �> >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>> �> >> >> > nickwallen) closes apache/incubator-metron#267
>> �> >> >> > METRON-438: Back the Stellar REPL with a readline
>
> implementation
>> �> >> >> > closes apache/incubator-metron#265
>> �> >> >> > METRON-426: Stellar does not support scientific notation as a
>> �> literal
>> �> >> >> > closes apache/incubator-metron#257
>> �> >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella)
>
> closes
>> �> >> >> > apache/incubator-metron#262
>> �> >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
>> �> >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
>> �> >> >> > METRON-433: Documentation update closes
>> �> apache/incubator-metron#260
>> �> >> >> > METRON-428: Allow a kafka offset to be passed to the
>> �> ParserTopology
>> �> >> >> > CLI closes apache/incubator-metron#258
>> �> >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>> �> >> >> > (nickwallen) closes apache/incubator-metron#259
>> �> >> >> > METRON-384 Deployment fails at task "Wait for
>
> Elasticsearch
>> �> >> >> Host
>> �> >> >> > to Start" (2xyo via dlyle65535) closes
>> �> >> apache/incubator-metron#221
>> �> >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
>> �> (mmiklavc
>> �> >> >> > via cestella) closes apache/incubator-metron#256
>> �> >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
>> �> closes
>> �> >> >> > apache/incubator-metron#254
>> �> >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
>> �> API
>> �> >> >> > (nickwallen) closes apache/incubator-metron#249
>> �> >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
>> �> (nickwallen)
>> �> >> >> > closes apache/incubator-metron#252
>> �> >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen)
>
> closes
>> �> >> >> > apache/incubator-metron#255
>> �> >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
>> �> >> >> > apache/incubator-metron#251
>> �> >> >> > METRON-415: Allow a Profile to Store Any Type as its Value
>> �closes
>> �> >> >> > apache/incubator-metron#253
>> �> >> >> > METRON-411 Support Greater Range of Profile Periods
>
> (nickwallen)
>> �> >> >> > closes apache/incubator-metron#246
>> �> >> >> > METRON-416: Provide the ability to store mergeable data
>> �structures
>> �> >> >> for
>> �> >> >> > summarizing data on-line closes apache/incubator-metron#250
>> �> >> >> > METRON-397: Add a stellar function to interact with the HBase
>> �> >> >> > enrichment table closes apache/incubator-metron#234
>> �> >> >> > METRON-391 Create Stellar Function to Read Profile Data for
>> �Model
>> �> >> >> > Scoring (nickwallen via cestella) closes
>> �> apache/incubator-metron#242
>> �> >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
>> �> >> >> > apache/incubator-metron#248
>> �> >> >> > METRON-407: We currently do not provide defaults if the Stix
>> �> >> >> > Observable does not specify a condition closes
>> �> >> >> apache/incubator-metron#244
>> �> >> >> > METRON-406: Stellar variable resolution does not resolve
>> �variables
>> �> >> >> > with ':' in them closes apache/incubator-metron#243
>> �> >> >> > METRON-399 Stellar Date Functions Should Default to Current
>
> Time
>> �> >> >> > (nickwallen) closes apache/incubator-metron#237
>> �> >> >> > METRON-389 Create Java API to Read Profile Data During Model
>> �> Scoring
>> �> >> >> > (nickwallen) closes apache/incubator-metron#236
>> �> >> >> > METRON-385 Create Ambari Service Definition for Indexing
>> �> (justinleet
>> �> >> >> > via cestella) closes apache/incubator-metron#222
>> �> >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp
>> �values
>> �> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
>> �> >> >> > METRON-400 Deploy Probes to running Docker Container closes
>> �> >> >> > apache/incubator-metron#241
>> �> >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
>> �> >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
>> �> >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
>> �> closes
>> �> >> >> > apache/incubator-metron#217
>> �> >> >> > METRON-404 Stellar Compiler Hides Function Initialization
>
> Errors
>> �> >> >> > (nickwallen) closes apache/incubator-metron#240
>> �> >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
>> �> >> >> > (nickwallen) closes apache/incubator-metron#230
>> �> >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
>> �> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
>> �> >> >> > METRON-396: Make Stellar function resolution happen via an
>> �> annotation
>> �> >> >> > and classpath search closes apache/incubator-metron#233
>> �> >> >> > METRON-400 Deploy Probes to running Docker Container closes
>> �> >> >> > apache/incubator-metron#238
>> �> >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
>> �> (nickwallen
>> �> >> >> > via cestella) closes apache/incubator-metron#239
>> �> >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
>> �> 'Group
>> �> >> >> > By' (nickwallen) closes apache/incubator-metron#231
>> �> >> >> > METRON-390: Stellar functions should initialize upon use,
>
> rather
>> �> than
>> �> >> >> > all at once closes apache/incubator-metron#228
>> �> >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
>> �> >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
>> �> >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
>> �> Functions
>> �> >> >> > (nickwallen) closes apache/incubator-metron#226
>> �> >> >> > METRON-372 Enhance Statistical Operations Available for Use
>
> with
>> �> the
>> �> >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
>> �> >> >> > METRON-388: Stellar - Unable to Operate on Result of
>> �If-Then-Else
>> �> >> >> > closes apache/incubator-metron#227
>> �> >> >> > METRON-341: Create stellar enrichment adapter closes
>> �> >> >> > apache/incubator-metron#216
>> �> >> >> > METRON-368 Simplify Profile Configuration with Sensible
>
> Defaults
>> �> >> >> > (nickwallen) closes apache/incubator-metron#213
>> �> >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
>> �> >> >> > (nickwallen) closes apache/incubator-metron#212
>> �> >> >> > METRON-365: Load demo dashboard on Kibana Service install
>> �> (dlyle65535
>> �> >> >> > via cestella) closes apache/incubator-metron#211
>> �> >> >> > METRON-387 Build Failure - Bad Merge with METRON-309
>> �(nickwallen)
>> �> >> >> > closes apache/incubator-metron#224
>> �> >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
>> �> >> >> > apache/incubator-metron#208
>> �> >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
>> �> >> >> > apache/incubator-metron#210
>> �> >> >> > METRON-357: Create Ambari Service Definition for Kibana
>> �> (dlyle65535
>> �> >> >> > via cestella) closes apache/incubator-metron#203
>> �> >> >> > METRON-362: Unify the Stellar Languages closes
>> �> >> >> > apache/incubator-metron#207
>> �> >> >> > METRON-339: Create YARN app to deploy endpoints closes
>> �> >> >> > apache/incubator-metron#205
>> �> >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0
>
> via
>> �> >> >> > dlyle65535) closes apache/incubator-metron#206
>> �> >> >> > METRON-356 Modify Storm topology.classpath via configuration
>> �> >> >> (mmiklavc
>> �> >> >> > via cestella) closes apache/incubator-metron#204
>> �> >> >> > METRON-242 remove Squid pattern closes
>> �apache/incubator-metron#202
>> �> >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535)
>> �closes
>> �> >> >> > apache/incubator-metron#199
>> �> >> >> > METRON-336 Update README.md to use brew instead of pip for
>> �ansible
>> �> >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
>> �> >> >> apache/incubator-metron#198
>> �> >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
>> �> >> >> > apache/incubator-metron#193
>> �> >> >> > METRON-284 SensorParserConfig object cannot be serialized with
>> �the
>> �> >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
>> �> >> >> > apache/incubator-metron#184
>> �> >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and
>> �add
>> �> >> >> > metron-indexing (mmiklavc via dlyle65535) closes
>> �> >> >> apache/incubator-metron#201
>> �> >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
>> �> >> >> > dlyle65535) closes apache/incubator-metron#196
>> �> >> >> > METRON-214: Build RPM Packages for Deployment
>> �(mmiklavc,justinleet
>> �> >> >> via
>> �> >> >> > dlyle65535 ) closes apache/incubator-metron#191
>> �> >> >> > METRON-304 Add PCAP backend rpm packaging
>> �> >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
>> �> >> >> > METRON-305: Adding Solr Subpackage to RPM spec
>> �> >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
>> �> >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
>> �> >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
>> �> >> >> > METRON-302 Add rpm spec file
>> �> >> >> > METRON-306: Create Docker container for RPM creation
>
> (dlyle65535
>> �> via
>> �> >> >> > cestella) closes apache/incubator-metron#190
>> �> >> >> > METRON-154: Decouple enrichment and indexing closes
>> �> >> >> > apache/incubator-metron#192
>> �> >> >> > METRON-294 Refactor parser topology builder (nickwallen via
>> �> cestella)
>> �> >> >> > closes apache/incubator-metron#185
>> �> >> >> > METRON-266 Remove duplicate entries of sniff_interface
>> �(nickwallen
>> �> >> >> via
>> �> >> >> > cestella) closes apache/incubator-metron#183
>> �> >> >> > METRON-225 Amazon-ec2 run script continues running on Maven
>> �build
>> �> >> >> > error (nickwallen via cestella) closes
>> �apache/incubator-metron#182
>> �> >> >> > METRON-279 Removed duplicative roles; metron-kafka and
>> �> metron-hbase
>> �> >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
>> �> >> >> > METRON-281 Simplify deployment to alternative AWS region
>> �> (nickwallen
>> �> >> >> > via cestella) closes apache/incubator-metron#180
>> �> >> >> > METRON-117 Deployment Report Created for All Deployments
>> �> (nickwallen
>> �> >> >> > via cestella) closes apache/incubator-metron#179
>> �> >> >> > METRON-262 Update codelab image scripts closes
>> �> >> >> > apache/incubator-metron#177
>> �> >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
>> �> closes
>> �> >> >> > apache/incubator-metron#187
>> �> >> >> >
>> �> >> >> >
>> �> >> >> > -------------------
>> �> >> >> > Thank you,
>> �> >> >> >
>> �> >> >> > James Sirota
>> �> >> >> > PPMC- Apache Metron (Incubating)
>> �> >> >> > jsirota AT apache DOT org
>> �> >> >> >
>> �> >>
>> �> >> -------------------
>> �> >> Thank you,
>> �> >>
>> �> >> James Sirota
>> �> >> PPMC- Apache Metron (Incubating)
>> �> >> jsirota AT apache DOT org
>> �>
>> �> -------------------
>> �> Thank you,
>> �>
>> �> James Sirota
>> �> PPMC- Apache Metron (Incubating)
>> �> jsirota AT apache DOT org
>> �>
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by Otto Fowler <ot...@gmail.com>.
METRON-474 is going to build on top of 466’s functionality. I am testing
it now and should have a PR later today, although I’m not sure it is worth
waiting for. Just mentioning it.
On September 29, 2016 at 12:20:38, Casey Stella (cestella@gmail.com) wrote:
Ok, with METRON-466 and METRON-398 being committed, I think we have
everything in.
On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
> committed
>
>
> On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
>
> > Sounds like we are still debating METRON-466. I want to make sure we
get
> > consensus on it before we wend up the build. Lets wait a day until we
> get
> > resolution
> >
> > 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> > > No. METRON-466 is in review.
> > >
> > > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
> > wrote:
> > >
> > >> Do we now have everything we wanted in there?
> > >>
> > >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com
> <javascript:;>>:
> > >> > I'd like to hold out for https://issues.apache.org/
> > >> jira/browse/METRON-466.
> > >> > I'm testing this now, so am a few hours out.
> > >> >
> > >> > -D...
> > >> >
> > >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> > >> >
> > >> >> Also need this Jira to bump the version.
> > >> >>
> > >> >> https://issues.apache.org/jira/browse/METRON-398
> > >> >>
> > >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
> jsirota@apache.org
> > >> <javascript:;>> wrote:
> > >> >>
> > >> >> > We are preparing the next release (will be put up for a vote
> > within
> > >> the
> > >> >> > next few days) with the following list of Jiras. Do you feel
> there
> > >> are
> > >> >> any
> > >> >> > other Jiras that should go into this release or are there any
> > >> critical
> > >> >> bugs
> > >> >> > that anyone knows of that we should address before releasing?
> > Please
> > >> >> > comment on this thread. Otherwise, we will put up the release
> for
> > a
> > >> vote
> > >> >> > shortly.
> > >> >> >
> > >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
> via
> > >> >> > cestella) closes apache/incubator-metron#274
> > >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> > >> >> closes
> > >> >> > apache/incubator-metron#271
> > >> >> > METRON-453: Add a stellar shell function to open an external
> > editor
> > >> >> > and return the editor's contents closes
> > apache/incubator-metron#272
> > >> >> > METRON-452: Add rudimentary configuration management functions
> to
> > >> >> > Stellar closes apache/incubator-metron#269
> > >> >> > METRON-374: Add appropriate bundled 3rd party licenses to
NOTICE
> > and
> > >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> > >> >> > METRON-427 Create Ambari Management Pack for Metron
Installation
> > >> >> > closes apache/incubator-metron#266
> > >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > >> >> > METRON-437 Profile Definition's 'inputTopic' field is
Extraneous
> > >> >> > (nickwallen) closes apache/incubator-metron#264
> > >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > >> >> > nickwallen) closes apache/incubator-metron#267
> > >> >> > METRON-438: Back the Stellar REPL with a readline
implementation
> > >> >> > closes apache/incubator-metron#265
> > >> >> > METRON-426: Stellar does not support scientific notation as a
> > literal
> > >> >> > closes apache/incubator-metron#257
> > >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella)
closes
> > >> >> > apache/incubator-metron#262
> > >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> > >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > >> >> > METRON-433: Documentation update closes
> > apache/incubator-metron#260
> > >> >> > METRON-428: Allow a kafka offset to be passed to the
> > ParserTopology
> > >> >> > CLI closes apache/incubator-metron#258
> > >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > >> >> > (nickwallen) closes apache/incubator-metron#259
> > >> >> > METRON-384 Deployment fails at task "Wait for
Elasticsearch
> > >> >> Host
> > >> >> > to Start" (2xyo via dlyle65535) closes
> > >> apache/incubator-metron#221
> > >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> > (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#256
> > >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> > closes
> > >> >> > apache/incubator-metron#254
> > >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> > API
> > >> >> > (nickwallen) closes apache/incubator-metron#249
> > >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> > (nickwallen)
> > >> >> > closes apache/incubator-metron#252
> > >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen)
closes
> > >> >> > apache/incubator-metron#255
> > >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > >> >> > apache/incubator-metron#251
> > >> >> > METRON-415: Allow a Profile to Store Any Type as its Value
> closes
> > >> >> > apache/incubator-metron#253
> > >> >> > METRON-411 Support Greater Range of Profile Periods
(nickwallen)
> > >> >> > closes apache/incubator-metron#246
> > >> >> > METRON-416: Provide the ability to store mergeable data
> structures
> > >> >> for
> > >> >> > summarizing data on-line closes apache/incubator-metron#250
> > >> >> > METRON-397: Add a stellar function to interact with the HBase
> > >> >> > enrichment table closes apache/incubator-metron#234
> > >> >> > METRON-391 Create Stellar Function to Read Profile Data for
> Model
> > >> >> > Scoring (nickwallen via cestella) closes
> > apache/incubator-metron#242
> > >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> > >> >> > apache/incubator-metron#248
> > >> >> > METRON-407: We currently do not provide defaults if the Stix
> > >> >> > Observable does not specify a condition closes
> > >> >> apache/incubator-metron#244
> > >> >> > METRON-406: Stellar variable resolution does not resolve
> variables
> > >> >> > with ':' in them closes apache/incubator-metron#243
> > >> >> > METRON-399 Stellar Date Functions Should Default to Current
Time
> > >> >> > (nickwallen) closes apache/incubator-metron#237
> > >> >> > METRON-389 Create Java API to Read Profile Data During Model
> > Scoring
> > >> >> > (nickwallen) closes apache/incubator-metron#236
> > >> >> > METRON-385 Create Ambari Service Definition for Indexing
> > (justinleet
> > >> >> > via cestella) closes apache/incubator-metron#222
> > >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp
> values
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#241
> > >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> > >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
> > closes
> > >> >> > apache/incubator-metron#217
> > >> >> > METRON-404 Stellar Compiler Hides Function Initialization
Errors
> > >> >> > (nickwallen) closes apache/incubator-metron#240
> > >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> > >> >> > (nickwallen) closes apache/incubator-metron#230
> > >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> > >> >> > METRON-396: Make Stellar function resolution happen via an
> > annotation
> > >> >> > and classpath search closes apache/incubator-metron#233
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#238
> > >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#239
> > >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
> > 'Group
> > >> >> > By' (nickwallen) closes apache/incubator-metron#231
> > >> >> > METRON-390: Stellar functions should initialize upon use,
rather
> > than
> > >> >> > all at once closes apache/incubator-metron#228
> > >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> > >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> > >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
> > Functions
> > >> >> > (nickwallen) closes apache/incubator-metron#226
> > >> >> > METRON-372 Enhance Statistical Operations Available for Use
with
> > the
> > >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> > >> >> > METRON-388: Stellar - Unable to Operate on Result of
> If-Then-Else
> > >> >> > closes apache/incubator-metron#227
> > >> >> > METRON-341: Create stellar enrichment adapter closes
> > >> >> > apache/incubator-metron#216
> > >> >> > METRON-368 Simplify Profile Configuration with Sensible
Defaults
> > >> >> > (nickwallen) closes apache/incubator-metron#213
> > >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> > >> >> > (nickwallen) closes apache/incubator-metron#212
> > >> >> > METRON-365: Load demo dashboard on Kibana Service install
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#211
> > >> >> > METRON-387 Build Failure - Bad Merge with METRON-309
> (nickwallen)
> > >> >> > closes apache/incubator-metron#224
> > >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> > >> >> > apache/incubator-metron#208
> > >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> > >> >> > apache/incubator-metron#210
> > >> >> > METRON-357: Create Ambari Service Definition for Kibana
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#203
> > >> >> > METRON-362: Unify the Stellar Languages closes
> > >> >> > apache/incubator-metron#207
> > >> >> > METRON-339: Create YARN app to deploy endpoints closes
> > >> >> > apache/incubator-metron#205
> > >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0
via
> > >> >> > dlyle65535) closes apache/incubator-metron#206
> > >> >> > METRON-356 Modify Storm topology.classpath via configuration
> > >> >> (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#204
> > >> >> > METRON-242 remove Squid pattern closes
> apache/incubator-metron#202
> > >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535)
> closes
> > >> >> > apache/incubator-metron#199
> > >> >> > METRON-336 Update README.md to use brew instead of pip for
> ansible
> > >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> > >> >> apache/incubator-metron#198
> > >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> > >> >> > apache/incubator-metron#193
> > >> >> > METRON-284 SensorParserConfig object cannot be serialized with
> the
> > >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> > >> >> > apache/incubator-metron#184
> > >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and
> add
> > >> >> > metron-indexing (mmiklavc via dlyle65535) closes
> > >> >> apache/incubator-metron#201
> > >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> > >> >> > dlyle65535) closes apache/incubator-metron#196
> > >> >> > METRON-214: Build RPM Packages for Deployment
> (mmiklavc,justinleet
> > >> >> via
> > >> >> > dlyle65535 ) closes apache/incubator-metron#191
> > >> >> > METRON-304 Add PCAP backend rpm packaging
> > >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> > >> >> > METRON-305: Adding Solr Subpackage to RPM spec
> > >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> > >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> > >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> > >> >> > METRON-302 Add rpm spec file
> > >> >> > METRON-306: Create Docker container for RPM creation
(dlyle65535
> > via
> > >> >> > cestella) closes apache/incubator-metron#190
> > >> >> > METRON-154: Decouple enrichment and indexing closes
> > >> >> > apache/incubator-metron#192
> > >> >> > METRON-294 Refactor parser topology builder (nickwallen via
> > cestella)
> > >> >> > closes apache/incubator-metron#185
> > >> >> > METRON-266 Remove duplicate entries of sniff_interface
> (nickwallen
> > >> >> via
> > >> >> > cestella) closes apache/incubator-metron#183
> > >> >> > METRON-225 Amazon-ec2 run script continues running on Maven
> build
> > >> >> > error (nickwallen via cestella) closes
> apache/incubator-metron#182
> > >> >> > METRON-279 Removed duplicative roles; metron-kafka and
> > metron-hbase
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> > >> >> > METRON-281 Simplify deployment to alternative AWS region
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#180
> > >> >> > METRON-117 Deployment Report Created for All Deployments
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#179
> > >> >> > METRON-262 Update codelab image scripts closes
> > >> >> > apache/incubator-metron#177
> > >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
> > closes
> > >> >> > apache/incubator-metron#187
> > >> >> >
> > >> >> >
> > >> >> > -------------------
> > >> >> > Thank you,
> > >> >> >
> > >> >> > James Sirota
> > >> >> > PPMC- Apache Metron (Incubating)
> > >> >> > jsirota AT apache DOT org
> > >> >> >
> > >>
> > >> -------------------
> > >> Thank you,
> > >>
> > >> James Sirota
> > >> PPMC- Apache Metron (Incubating)
> > >> jsirota AT apache DOT org
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
Re: [DISCUSS] Upcoming Metron Build
Posted by Casey Stella <ce...@gmail.com>.
Ok, with METRON-466 and METRON-398 being committed, I think we have
everything in.
On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
> committed
>
>
> On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
>
> > Sounds like we are still debating METRON-466. I want to make sure we get
> > consensus on it before we wend up the build. Lets wait a day until we
> get
> > resolution
> >
> > 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> > > No. METRON-466 is in review.
> > >
> > > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
> > wrote:
> > >
> > >> Do we now have everything we wanted in there?
> > >>
> > >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com
> <javascript:;>>:
> > >> > I'd like to hold out for https://issues.apache.org/
> > >> jira/browse/METRON-466.
> > >> > I'm testing this now, so am a few hours out.
> > >> >
> > >> > -D...
> > >> >
> > >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> > >> >
> > >> >> Also need this Jira to bump the version.
> > >> >>
> > >> >> https://issues.apache.org/jira/browse/METRON-398
> > >> >>
> > >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
> jsirota@apache.org
> > >> <javascript:;>> wrote:
> > >> >>
> > >> >> > We are preparing the next release (will be put up for a vote
> > within
> > >> the
> > >> >> > next few days) with the following list of Jiras. Do you feel
> there
> > >> are
> > >> >> any
> > >> >> > other Jiras that should go into this release or are there any
> > >> critical
> > >> >> bugs
> > >> >> > that anyone knows of that we should address before releasing?
> > Please
> > >> >> > comment on this thread. Otherwise, we will put up the release
> for
> > a
> > >> vote
> > >> >> > shortly.
> > >> >> >
> > >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
> via
> > >> >> > cestella) closes apache/incubator-metron#274
> > >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> > >> >> closes
> > >> >> > apache/incubator-metron#271
> > >> >> > METRON-453: Add a stellar shell function to open an external
> > editor
> > >> >> > and return the editor's contents closes
> > apache/incubator-metron#272
> > >> >> > METRON-452: Add rudimentary configuration management functions
> to
> > >> >> > Stellar closes apache/incubator-metron#269
> > >> >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE
> > and
> > >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> > >> >> > METRON-427 Create Ambari Management Pack for Metron Installation
> > >> >> > closes apache/incubator-metron#266
> > >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > >> >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> > >> >> > (nickwallen) closes apache/incubator-metron#264
> > >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > >> >> > nickwallen) closes apache/incubator-metron#267
> > >> >> > METRON-438: Back the Stellar REPL with a readline implementation
> > >> >> > closes apache/incubator-metron#265
> > >> >> > METRON-426: Stellar does not support scientific notation as a
> > literal
> > >> >> > closes apache/incubator-metron#257
> > >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> > >> >> > apache/incubator-metron#262
> > >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> > >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > >> >> > METRON-433: Documentation update closes
> > apache/incubator-metron#260
> > >> >> > METRON-428: Allow a kafka offset to be passed to the
> > ParserTopology
> > >> >> > CLI closes apache/incubator-metron#258
> > >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > >> >> > (nickwallen) closes apache/incubator-metron#259
> > >> >> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> > >> >> Host
> > >> >> > to Start" (2xyo via dlyle65535) closes
> > >> apache/incubator-metron#221
> > >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> > (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#256
> > >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> > closes
> > >> >> > apache/incubator-metron#254
> > >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> > API
> > >> >> > (nickwallen) closes apache/incubator-metron#249
> > >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> > (nickwallen)
> > >> >> > closes apache/incubator-metron#252
> > >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> > >> >> > apache/incubator-metron#255
> > >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > >> >> > apache/incubator-metron#251
> > >> >> > METRON-415: Allow a Profile to Store Any Type as its Value
> closes
> > >> >> > apache/incubator-metron#253
> > >> >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> > >> >> > closes apache/incubator-metron#246
> > >> >> > METRON-416: Provide the ability to store mergeable data
> structures
> > >> >> for
> > >> >> > summarizing data on-line closes apache/incubator-metron#250
> > >> >> > METRON-397: Add a stellar function to interact with the HBase
> > >> >> > enrichment table closes apache/incubator-metron#234
> > >> >> > METRON-391 Create Stellar Function to Read Profile Data for
> Model
> > >> >> > Scoring (nickwallen via cestella) closes
> > apache/incubator-metron#242
> > >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> > >> >> > apache/incubator-metron#248
> > >> >> > METRON-407: We currently do not provide defaults if the Stix
> > >> >> > Observable does not specify a condition closes
> > >> >> apache/incubator-metron#244
> > >> >> > METRON-406: Stellar variable resolution does not resolve
> variables
> > >> >> > with ':' in them closes apache/incubator-metron#243
> > >> >> > METRON-399 Stellar Date Functions Should Default to Current Time
> > >> >> > (nickwallen) closes apache/incubator-metron#237
> > >> >> > METRON-389 Create Java API to Read Profile Data During Model
> > Scoring
> > >> >> > (nickwallen) closes apache/incubator-metron#236
> > >> >> > METRON-385 Create Ambari Service Definition for Indexing
> > (justinleet
> > >> >> > via cestella) closes apache/incubator-metron#222
> > >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp
> values
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#241
> > >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> > >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
> > closes
> > >> >> > apache/incubator-metron#217
> > >> >> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> > >> >> > (nickwallen) closes apache/incubator-metron#240
> > >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> > >> >> > (nickwallen) closes apache/incubator-metron#230
> > >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> > >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> > >> >> > METRON-396: Make Stellar function resolution happen via an
> > annotation
> > >> >> > and classpath search closes apache/incubator-metron#233
> > >> >> > METRON-400 Deploy Probes to running Docker Container closes
> > >> >> > apache/incubator-metron#238
> > >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#239
> > >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
> > 'Group
> > >> >> > By' (nickwallen) closes apache/incubator-metron#231
> > >> >> > METRON-390: Stellar functions should initialize upon use, rather
> > than
> > >> >> > all at once closes apache/incubator-metron#228
> > >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> > >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> > >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
> > Functions
> > >> >> > (nickwallen) closes apache/incubator-metron#226
> > >> >> > METRON-372 Enhance Statistical Operations Available for Use with
> > the
> > >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> > >> >> > METRON-388: Stellar - Unable to Operate on Result of
> If-Then-Else
> > >> >> > closes apache/incubator-metron#227
> > >> >> > METRON-341: Create stellar enrichment adapter closes
> > >> >> > apache/incubator-metron#216
> > >> >> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> > >> >> > (nickwallen) closes apache/incubator-metron#213
> > >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> > >> >> > (nickwallen) closes apache/incubator-metron#212
> > >> >> > METRON-365: Load demo dashboard on Kibana Service install
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#211
> > >> >> > METRON-387 Build Failure - Bad Merge with METRON-309
> (nickwallen)
> > >> >> > closes apache/incubator-metron#224
> > >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> > >> >> > apache/incubator-metron#208
> > >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> > >> >> > apache/incubator-metron#210
> > >> >> > METRON-357: Create Ambari Service Definition for Kibana
> > (dlyle65535
> > >> >> > via cestella) closes apache/incubator-metron#203
> > >> >> > METRON-362: Unify the Stellar Languages closes
> > >> >> > apache/incubator-metron#207
> > >> >> > METRON-339: Create YARN app to deploy endpoints closes
> > >> >> > apache/incubator-metron#205
> > >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> > >> >> > dlyle65535) closes apache/incubator-metron#206
> > >> >> > METRON-356 Modify Storm topology.classpath via configuration
> > >> >> (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#204
> > >> >> > METRON-242 remove Squid pattern closes
> apache/incubator-metron#202
> > >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535)
> closes
> > >> >> > apache/incubator-metron#199
> > >> >> > METRON-336 Update README.md to use brew instead of pip for
> ansible
> > >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> > >> >> apache/incubator-metron#198
> > >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> > >> >> > apache/incubator-metron#193
> > >> >> > METRON-284 SensorParserConfig object cannot be serialized with
> the
> > >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> > >> >> > apache/incubator-metron#184
> > >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and
> add
> > >> >> > metron-indexing (mmiklavc via dlyle65535) closes
> > >> >> apache/incubator-metron#201
> > >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> > >> >> > dlyle65535) closes apache/incubator-metron#196
> > >> >> > METRON-214: Build RPM Packages for Deployment
> (mmiklavc,justinleet
> > >> >> via
> > >> >> > dlyle65535 ) closes apache/incubator-metron#191
> > >> >> > METRON-304 Add PCAP backend rpm packaging
> > >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> > >> >> > METRON-305: Adding Solr Subpackage to RPM spec
> > >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> > >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> > >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> > >> >> > METRON-302 Add rpm spec file
> > >> >> > METRON-306: Create Docker container for RPM creation (dlyle65535
> > via
> > >> >> > cestella) closes apache/incubator-metron#190
> > >> >> > METRON-154: Decouple enrichment and indexing closes
> > >> >> > apache/incubator-metron#192
> > >> >> > METRON-294 Refactor parser topology builder (nickwallen via
> > cestella)
> > >> >> > closes apache/incubator-metron#185
> > >> >> > METRON-266 Remove duplicate entries of sniff_interface
> (nickwallen
> > >> >> via
> > >> >> > cestella) closes apache/incubator-metron#183
> > >> >> > METRON-225 Amazon-ec2 run script continues running on Maven
> build
> > >> >> > error (nickwallen via cestella) closes
> apache/incubator-metron#182
> > >> >> > METRON-279 Removed duplicative roles; metron-kafka and
> > metron-hbase
> > >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> > >> >> > METRON-281 Simplify deployment to alternative AWS region
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#180
> > >> >> > METRON-117 Deployment Report Created for All Deployments
> > (nickwallen
> > >> >> > via cestella) closes apache/incubator-metron#179
> > >> >> > METRON-262 Update codelab image scripts closes
> > >> >> > apache/incubator-metron#177
> > >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
> > closes
> > >> >> > apache/incubator-metron#187
> > >> >> >
> > >> >> >
> > >> >> > -------------------
> > >> >> > Thank you,
> > >> >> >
> > >> >> > James Sirota
> > >> >> > PPMC- Apache Metron (Incubating)
> > >> >> > jsirota AT apache DOT org
> > >> >> >
> > >>
> > >> -------------------
> > >> Thank you,
> > >>
> > >> James Sirota
> > >> PPMC- Apache Metron (Incubating)
> > >> jsirota AT apache DOT org
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
Re: [DISCUSS] Upcoming Metron Build
Posted by Michael Miklavcic <mi...@gmail.com>.
https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
committed
On Wed, Sep 28, 2016 at 5:41 PM, James Sirota <js...@apache.org> wrote:
> Sounds like we are still debating METRON-466. I want to make sure we get
> consensus on it before we wend up the build. Lets wait a day until we get
> resolution
>
> 28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> > No. METRON-466 is in review.
> >
> > On Wednesday, September 28, 2016, James Sirota <js...@apache.org>
> wrote:
> >
> >> Do we now have everything we wanted in there?
> >>
> >> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com <javascript:;>>:
> >> > I'd like to hold out for https://issues.apache.org/
> >> jira/browse/METRON-466.
> >> > I'm testing this now, so am a few hours out.
> >> >
> >> > -D...
> >> >
> >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> >> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> >> >
> >> >> Also need this Jira to bump the version.
> >> >>
> >> >> https://issues.apache.org/jira/browse/METRON-398
> >> >>
> >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <jsirota@apache.org
> >> <javascript:;>> wrote:
> >> >>
> >> >> > We are preparing the next release (will be put up for a vote
> within
> >> the
> >> >> > next few days) with the following list of Jiras. Do you feel there
> >> are
> >> >> any
> >> >> > other Jiras that should go into this release or are there any
> >> critical
> >> >> bugs
> >> >> > that anyone knows of that we should address before releasing?
> Please
> >> >> > comment on this thread. Otherwise, we will put up the release for
> a
> >> vote
> >> >> > shortly.
> >> >> >
> >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> >> >> > cestella) closes apache/incubator-metron#274
> >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> >> >> closes
> >> >> > apache/incubator-metron#271
> >> >> > METRON-453: Add a stellar shell function to open an external
> editor
> >> >> > and return the editor's contents closes
> apache/incubator-metron#272
> >> >> > METRON-452: Add rudimentary configuration management functions to
> >> >> > Stellar closes apache/incubator-metron#269
> >> >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE
> and
> >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> >> >> > METRON-427 Create Ambari Management Pack for Metron Installation
> >> >> > closes apache/incubator-metron#266
> >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> >> >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> >> >> > (nickwallen) closes apache/incubator-metron#264
> >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> >> >> > nickwallen) closes apache/incubator-metron#267
> >> >> > METRON-438: Back the Stellar REPL with a readline implementation
> >> >> > closes apache/incubator-metron#265
> >> >> > METRON-426: Stellar does not support scientific notation as a
> literal
> >> >> > closes apache/incubator-metron#257
> >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> >> >> > apache/incubator-metron#262
> >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> >> >> > METRON-433: Documentation update closes
> apache/incubator-metron#260
> >> >> > METRON-428: Allow a kafka offset to be passed to the
> ParserTopology
> >> >> > CLI closes apache/incubator-metron#258
> >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> >> >> > (nickwallen) closes apache/incubator-metron#259
> >> >> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> >> >> Host
> >> >> > to Start" (2xyo via dlyle65535) closes
> >> apache/incubator-metron#221
> >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> (mmiklavc
> >> >> > via cestella) closes apache/incubator-metron#256
> >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> closes
> >> >> > apache/incubator-metron#254
> >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> API
> >> >> > (nickwallen) closes apache/incubator-metron#249
> >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> (nickwallen)
> >> >> > closes apache/incubator-metron#252
> >> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> >> >> > apache/incubator-metron#255
> >> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> >> >> > apache/incubator-metron#251
> >> >> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> >> >> > apache/incubator-metron#253
> >> >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> >> >> > closes apache/incubator-metron#246
> >> >> > METRON-416: Provide the ability to store mergeable data structures
> >> >> for
> >> >> > summarizing data on-line closes apache/incubator-metron#250
> >> >> > METRON-397: Add a stellar function to interact with the HBase
> >> >> > enrichment table closes apache/incubator-metron#234
> >> >> > METRON-391 Create Stellar Function to Read Profile Data for Model
> >> >> > Scoring (nickwallen via cestella) closes
> apache/incubator-metron#242
> >> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> >> >> > apache/incubator-metron#248
> >> >> > METRON-407: We currently do not provide defaults if the Stix
> >> >> > Observable does not specify a condition closes
> >> >> apache/incubator-metron#244
> >> >> > METRON-406: Stellar variable resolution does not resolve variables
> >> >> > with ':' in them closes apache/incubator-metron#243
> >> >> > METRON-399 Stellar Date Functions Should Default to Current Time
> >> >> > (nickwallen) closes apache/incubator-metron#237
> >> >> > METRON-389 Create Java API to Read Profile Data During Model
> Scoring
> >> >> > (nickwallen) closes apache/incubator-metron#236
> >> >> > METRON-385 Create Ambari Service Definition for Indexing
> (justinleet
> >> >> > via cestella) closes apache/incubator-metron#222
> >> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> >> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> >> > apache/incubator-metron#241
> >> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> >> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> >> >> > METRON-381: Add support for multiple reducers in pcap_query.sh
> closes
> >> >> > apache/incubator-metron#217
> >> >> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> >> >> > (nickwallen) closes apache/incubator-metron#240
> >> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> >> >> > (nickwallen) closes apache/incubator-metron#230
> >> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> >> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> >> >> > METRON-396: Make Stellar function resolution happen via an
> annotation
> >> >> > and classpath search closes apache/incubator-metron#233
> >> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> >> > apache/incubator-metron#238
> >> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt
> (nickwallen
> >> >> > via cestella) closes apache/incubator-metron#239
> >> >> > METRON-394 Create Stellar Date Functions to Use with Profile
> 'Group
> >> >> > By' (nickwallen) closes apache/incubator-metron#231
> >> >> > METRON-390: Stellar functions should initialize upon use, rather
> than
> >> >> > all at once closes apache/incubator-metron#228
> >> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> >> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> >> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary
> Functions
> >> >> > (nickwallen) closes apache/incubator-metron#226
> >> >> > METRON-372 Enhance Statistical Operations Available for Use with
> the
> >> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> >> >> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> >> >> > closes apache/incubator-metron#227
> >> >> > METRON-341: Create stellar enrichment adapter closes
> >> >> > apache/incubator-metron#216
> >> >> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> >> >> > (nickwallen) closes apache/incubator-metron#213
> >> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> >> >> > (nickwallen) closes apache/incubator-metron#212
> >> >> > METRON-365: Load demo dashboard on Kibana Service install
> (dlyle65535
> >> >> > via cestella) closes apache/incubator-metron#211
> >> >> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> >> >> > closes apache/incubator-metron#224
> >> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> >> >> > apache/incubator-metron#208
> >> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> >> >> > apache/incubator-metron#210
> >> >> > METRON-357: Create Ambari Service Definition for Kibana
> (dlyle65535
> >> >> > via cestella) closes apache/incubator-metron#203
> >> >> > METRON-362: Unify the Stellar Languages closes
> >> >> > apache/incubator-metron#207
> >> >> > METRON-339: Create YARN app to deploy endpoints closes
> >> >> > apache/incubator-metron#205
> >> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> >> >> > dlyle65535) closes apache/incubator-metron#206
> >> >> > METRON-356 Modify Storm topology.classpath via configuration
> >> >> (mmiklavc
> >> >> > via cestella) closes apache/incubator-metron#204
> >> >> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
> >> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> >> >> > apache/incubator-metron#199
> >> >> > METRON-336 Update README.md to use brew instead of pip for ansible
> >> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> >> >> apache/incubator-metron#198
> >> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> >> >> > apache/incubator-metron#193
> >> >> > METRON-284 SensorParserConfig object cannot be serialized with the
> >> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> >> >> > apache/incubator-metron#184
> >> >> > METRON-338 Remove flux from metron-parsers and RPM builds and add
> >> >> > metron-indexing (mmiklavc via dlyle65535) closes
> >> >> apache/incubator-metron#201
> >> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> >> >> > dlyle65535) closes apache/incubator-metron#196
> >> >> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
> >> >> via
> >> >> > dlyle65535 ) closes apache/incubator-metron#191
> >> >> > METRON-304 Add PCAP backend rpm packaging
> >> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> >> >> > METRON-305: Adding Solr Subpackage to RPM spec
> >> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> >> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> >> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> >> >> > METRON-302 Add rpm spec file
> >> >> > METRON-306: Create Docker container for RPM creation (dlyle65535
> via
> >> >> > cestella) closes apache/incubator-metron#190
> >> >> > METRON-154: Decouple enrichment and indexing closes
> >> >> > apache/incubator-metron#192
> >> >> > METRON-294 Refactor parser topology builder (nickwallen via
> cestella)
> >> >> > closes apache/incubator-metron#185
> >> >> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
> >> >> via
> >> >> > cestella) closes apache/incubator-metron#183
> >> >> > METRON-225 Amazon-ec2 run script continues running on Maven build
> >> >> > error (nickwallen via cestella) closes apache/incubator-metron#182
> >> >> > METRON-279 Removed duplicative roles; metron-kafka and
> metron-hbase
> >> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> >> >> > METRON-281 Simplify deployment to alternative AWS region
> (nickwallen
> >> >> > via cestella) closes apache/incubator-metron#180
> >> >> > METRON-117 Deployment Report Created for All Deployments
> (nickwallen
> >> >> > via cestella) closes apache/incubator-metron#179
> >> >> > METRON-262 Update codelab image scripts closes
> >> >> > apache/incubator-metron#177
> >> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535)
> closes
> >> >> > apache/incubator-metron#187
> >> >> >
> >> >> >
> >> >> > -------------------
> >> >> > Thank you,
> >> >> >
> >> >> > James Sirota
> >> >> > PPMC- Apache Metron (Incubating)
> >> >> > jsirota AT apache DOT org
> >> >> >
> >>
> >> -------------------
> >> Thank you,
> >>
> >> James Sirota
> >> PPMC- Apache Metron (Incubating)
> >> jsirota AT apache DOT org
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
Re: [DISCUSS] Upcoming Metron Build
Posted by James Sirota <js...@apache.org>.
Sounds like we are still debating METRON-466. I want to make sure we get consensus on it before we wend up the build. Lets wait a day until we get resolution
28.09.2016, 12:34, "David Lyle" <dl...@gmail.com>:
> No. METRON-466 is in review.
>
> On Wednesday, September 28, 2016, James Sirota <js...@apache.org> wrote:
>
>> �Do we now have everything we wanted in there?
>>
>> �27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com <javascript:;>>:
>> �> I'd like to hold out for https://issues.apache.org/
>> �jira/browse/METRON-466.
>> �> I'm testing this now, so am a few hours out.
>> �>
>> �> -D...
>> �>
>> �> On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
>> �> michael.miklavcic@gmail.com <javascript:;>> wrote:
>> �>
>> �>> Also need this Jira to bump the version.
>> �>>
>> �>> https://issues.apache.org/jira/browse/METRON-398
>> �>>
>> �>> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <jsirota@apache.org
>> �<javascript:;>> wrote:
>> �>>
>> �>> > We are preparing the next release (will be put up for a vote within
>> �the
>> �>> > next few days) with the following list of Jiras. Do you feel there
>> �are
>> �>> any
>> �>> > other Jiras that should go into this release or are there any
>> �critical
>> �>> bugs
>> �>> > that anyone knows of that we should address before releasing? Please
>> �>> > comment on this thread. Otherwise, we will put up the release for a
>> �vote
>> �>> > shortly.
>> �>> >
>> �>> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
>> �>> > cestella) closes apache/incubator-metron#274
>> �>> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
>> �>> closes
>> �>> > apache/incubator-metron#271
>> �>> > METRON-453: Add a stellar shell function to open an external editor
>> �>> > and return the editor's contents closes apache/incubator-metron#272
>> �>> > METRON-452: Add rudimentary configuration management functions to
>> �>> > Stellar closes apache/incubator-metron#269
>> �>> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
>> �>> > LICENSE where appropriate closes apache/incubator-metron#229
>> �>> > METRON-427 Create Ambari Management Pack for Metron Installation
>> �>> > closes apache/incubator-metron#266
>> �>> > METRON-434: JSON Parser closes apache/incubator-metron#261
>> �>> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
>> �>> > (nickwallen) closes apache/incubator-metron#264
>> �>> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>> �>> > nickwallen) closes apache/incubator-metron#267
>> �>> > METRON-438: Back the Stellar REPL with a readline implementation
>> �>> > closes apache/incubator-metron#265
>> �>> > METRON-426: Stellar does not support scientific notation as a literal
>> �>> > closes apache/incubator-metron#257
>> �>> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
>> �>> > apache/incubator-metron#262
>> �>> > METRON-436: Updated architecture diagrams for Metron READMEs
>> �>> > (anandsubbu via cestella) closes apache/incubator-metron#263
>> �>> > METRON-433: Documentation update closes apache/incubator-metron#260
>> �>> > METRON-428: Allow a kafka offset to be passed to the ParserTopology
>> �>> > CLI closes apache/incubator-metron#258
>> �>> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>> �>> > (nickwallen) closes apache/incubator-metron#259
>> �>> > METRON-384 Deployment fails at task "Wait for Elasticsearch
>> �>> Host
>> �>> > to Start" (2xyo via dlyle65535) closes
>> �apache/incubator-metron#221
>> �>> > METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
>> �>> > via cestella) closes apache/incubator-metron#256
>> �>> > METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
>> �>> > apache/incubator-metron#254
>> �>> > METRON-413 Allow Start/End Time Range Search in Profiler Client API
>> �>> > (nickwallen) closes apache/incubator-metron#249
>> �>> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
>> �>> > closes apache/incubator-metron#252
>> �>> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
>> �>> > apache/incubator-metron#255
>> �>> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
>> �>> > apache/incubator-metron#251
>> �>> > METRON-415: Allow a Profile to Store Any Type as its Value closes
>> �>> > apache/incubator-metron#253
>> �>> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
>> �>> > closes apache/incubator-metron#246
>> �>> > METRON-416: Provide the ability to store mergeable data structures
>> �>> for
>> �>> > summarizing data on-line closes apache/incubator-metron#250
>> �>> > METRON-397: Add a stellar function to interact with the HBase
>> �>> > enrichment table closes apache/incubator-metron#234
>> �>> > METRON-391 Create Stellar Function to Read Profile Data for Model
>> �>> > Scoring (nickwallen via cestella) closes apache/incubator-metron#242
>> �>> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
>> �>> > apache/incubator-metron#248
>> �>> > METRON-407: We currently do not provide defaults if the Stix
>> �>> > Observable does not specify a condition closes
>> �>> apache/incubator-metron#244
>> �>> > METRON-406: Stellar variable resolution does not resolve variables
>> �>> > with ':' in them closes apache/incubator-metron#243
>> �>> > METRON-399 Stellar Date Functions Should Default to Current Time
>> �>> > (nickwallen) closes apache/incubator-metron#237
>> �>> > METRON-389 Create Java API to Read Profile Data During Model Scoring
>> �>> > (nickwallen) closes apache/incubator-metron#236
>> �>> > METRON-385 Create Ambari Service Definition for Indexing (justinleet
>> �>> > via cestella) closes apache/incubator-metron#222
>> �>> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
>> �>> > (mmiklavc via cestella) closes apache/incubator-metron#232
>> �>> > METRON-400 Deploy Probes to running Docker Container closes
>> �>> > apache/incubator-metron#241
>> �>> > METRON-408 Intermittent Failures of Profile Integration Tests
>> �>> > (nickwallen via cestella) closes apache/incubator-metron#245
>> �>> > METRON-381: Add support for multiple reducers in pcap_query.sh closes
>> �>> > apache/incubator-metron#217
>> �>> > METRON-404 Stellar Compiler Hides Function Initialization Errors
>> �>> > (nickwallen) closes apache/incubator-metron#240
>> �>> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
>> �>> > (nickwallen) closes apache/incubator-metron#230
>> �>> > METRON-383: Create Ambari Service Definition for Metron Parsers
>> �>> > (mmiklavc via cestella) closes apache/incubator-metron#218
>> �>> > METRON-396: Make Stellar function resolution happen via an annotation
>> �>> > and classpath search closes apache/incubator-metron#233
>> �>> > METRON-400 Deploy Probes to running Docker Container closes
>> �>> > apache/incubator-metron#238
>> �>> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
>> �>> > via cestella) closes apache/incubator-metron#239
>> �>> > METRON-394 Create Stellar Date Functions to Use with Profile 'Group
>> �>> > By' (nickwallen) closes apache/incubator-metron#231
>> �>> > METRON-390: Stellar functions should initialize upon use, rather than
>> �>> > all at once closes apache/incubator-metron#228
>> �>> > METRON-386 Create Ambari Service Definition for Elasticsearch
>> �>> > (justinleet via dlyle65535) closes apache/incubator-metron#223
>> �>> > METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
>> �>> > (nickwallen) closes apache/incubator-metron#226
>> �>> > METRON-372 Enhance Statistical Operations Available for Use with the
>> �>> > Profiler (nickwallen) closes apache/incubator-metron#225
>> �>> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
>> �>> > closes apache/incubator-metron#227
>> �>> > METRON-341: Create stellar enrichment adapter closes
>> �>> > apache/incubator-metron#216
>> �>> > METRON-368 Simplify Profile Configuration with Sensible Defaults
>> �>> > (nickwallen) closes apache/incubator-metron#213
>> �>> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
>> �>> > (nickwallen) closes apache/incubator-metron#212
>> �>> > METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
>> �>> > via cestella) closes apache/incubator-metron#211
>> �>> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
>> �>> > closes apache/incubator-metron#224
>> �>> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
>> �>> > apache/incubator-metron#208
>> �>> > METRON-366: Add MODEL_APPLY to Stellar closes
>> �>> > apache/incubator-metron#210
>> �>> > METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
>> �>> > via cestella) closes apache/incubator-metron#203
>> �>> > METRON-362: Unify the Stellar Languages closes
>> �>> > apache/incubator-metron#207
>> �>> > METRON-339: Create YARN app to deploy endpoints closes
>> �>> > apache/incubator-metron#205
>> �>> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
>> �>> > dlyle65535) closes apache/incubator-metron#206
>> �>> > METRON-356 Modify Storm topology.classpath via configuration
>> �>> (mmiklavc
>> �>> > via cestella) closes apache/incubator-metron#204
>> �>> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
>> �>> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
>> �>> > apache/incubator-metron#199
>> �>> > METRON-336 Update README.md to use brew instead of pip for ansible
>> �>> > 2.0.0.2 install (jfrazee via dlyle65535) closes
>> �>> apache/incubator-metron#198
>> �>> > METRON-314 Kibana Default Dashboard - Map Broken closes
>> �>> > apache/incubator-metron#193
>> �>> > METRON-284 SensorParserConfig object cannot be serialized with the
>> �>> > default Jackson ObjectMapper (cestella via dlyle65535) closes
>> �>> > apache/incubator-metron#184
>> �>> > METRON-338 Remove flux from metron-parsers and RPM builds and add
>> �>> > metron-indexing (mmiklavc via dlyle65535) closes
>> �>> apache/incubator-metron#201
>> �>> > METRON-334 Travis CI cache Maven dependencies (justinleet via
>> �>> > dlyle65535) closes apache/incubator-metron#196
>> �>> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
>> �>> via
>> �>> > dlyle65535 ) closes apache/incubator-metron#191
>> �>> > METRON-304 Add PCAP backend rpm packaging
>> �>> > METRON-300 Adding Enrichment Subpackage to RPM spec
>> �>> > METRON-305: Adding Solr Subpackage to RPM spec
>> �>> > METRON-303 Adding Data Management Subpackage to RPM spec
>> �>> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
>> �>> > METRON-299 Adding Parsers Subpackage to RPM spec
>> �>> > METRON-302 Add rpm spec file
>> �>> > METRON-306: Create Docker container for RPM creation (dlyle65535 via
>> �>> > cestella) closes apache/incubator-metron#190
>> �>> > METRON-154: Decouple enrichment and indexing closes
>> �>> > apache/incubator-metron#192
>> �>> > METRON-294 Refactor parser topology builder (nickwallen via cestella)
>> �>> > closes apache/incubator-metron#185
>> �>> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
>> �>> via
>> �>> > cestella) closes apache/incubator-metron#183
>> �>> > METRON-225 Amazon-ec2 run script continues running on Maven build
>> �>> > error (nickwallen via cestella) closes apache/incubator-metron#182
>> �>> > METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
>> �>> > (nickwallen via cestella) closes apache/incubator-metron#181
>> �>> > METRON-281 Simplify deployment to alternative AWS region (nickwallen
>> �>> > via cestella) closes apache/incubator-metron#180
>> �>> > METRON-117 Deployment Report Created for All Deployments (nickwallen
>> �>> > via cestella) closes apache/incubator-metron#179
>> �>> > METRON-262 Update codelab image scripts closes
>> �>> > apache/incubator-metron#177
>> �>> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
>> �>> > apache/incubator-metron#187
>> �>> >
>> �>> >
>> �>> > -------------------
>> �>> > Thank you,
>> �>> >
>> �>> > James Sirota
>> �>> > PPMC- Apache Metron (Incubating)
>> �>> > jsirota AT apache DOT org
>> �>> >
>>
>> �-------------------
>> �Thank you,
>>
>> �James Sirota
>> �PPMC- Apache Metron (Incubating)
>> �jsirota AT apache DOT org
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by David Lyle <dl...@gmail.com>.
No. METRON-466 is in review.
On Wednesday, September 28, 2016, James Sirota <js...@apache.org> wrote:
> Do we now have everything we wanted in there?
>
> 27.09.2016, 08:59, "David Lyle" <dlyle65535@gmail.com <javascript:;>>:
> > I'd like to hold out for https://issues.apache.org/
> jira/browse/METRON-466.
> > I'm testing this now, so am a few hours out.
> >
> > -D...
> >
> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > michael.miklavcic@gmail.com <javascript:;>> wrote:
> >
> >> Also need this Jira to bump the version.
> >>
> >> https://issues.apache.org/jira/browse/METRON-398
> >>
> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <jsirota@apache.org
> <javascript:;>> wrote:
> >>
> >> > We are preparing the next release (will be put up for a vote within
> the
> >> > next few days) with the following list of Jiras. Do you feel there
> are
> >> any
> >> > other Jiras that should go into this release or are there any
> critical
> >> bugs
> >> > that anyone knows of that we should address before releasing? Please
> >> > comment on this thread. Otherwise, we will put up the release for a
> vote
> >> > shortly.
> >> >
> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> >> > cestella) closes apache/incubator-metron#274
> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> >> closes
> >> > apache/incubator-metron#271
> >> > METRON-453: Add a stellar shell function to open an external editor
> >> > and return the editor's contents closes apache/incubator-metron#272
> >> > METRON-452: Add rudimentary configuration management functions to
> >> > Stellar closes apache/incubator-metron#269
> >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
> >> > LICENSE where appropriate closes apache/incubator-metron#229
> >> > METRON-427 Create Ambari Management Pack for Metron Installation
> >> > closes apache/incubator-metron#266
> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> >> > (nickwallen) closes apache/incubator-metron#264
> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> >> > nickwallen) closes apache/incubator-metron#267
> >> > METRON-438: Back the Stellar REPL with a readline implementation
> >> > closes apache/incubator-metron#265
> >> > METRON-426: Stellar does not support scientific notation as a literal
> >> > closes apache/incubator-metron#257
> >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> >> > apache/incubator-metron#262
> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> >> > METRON-433: Documentation update closes apache/incubator-metron#260
> >> > METRON-428: Allow a kafka offset to be passed to the ParserTopology
> >> > CLI closes apache/incubator-metron#258
> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> >> > (nickwallen) closes apache/incubator-metron#259
> >> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> >> Host
> >> > to Start" (2xyo via dlyle65535) closes
> apache/incubator-metron#221
> >> > METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
> >> > via cestella) closes apache/incubator-metron#256
> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
> >> > apache/incubator-metron#254
> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client API
> >> > (nickwallen) closes apache/incubator-metron#249
> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
> >> > closes apache/incubator-metron#252
> >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> >> > apache/incubator-metron#255
> >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> >> > apache/incubator-metron#251
> >> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> >> > apache/incubator-metron#253
> >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> >> > closes apache/incubator-metron#246
> >> > METRON-416: Provide the ability to store mergeable data structures
> >> for
> >> > summarizing data on-line closes apache/incubator-metron#250
> >> > METRON-397: Add a stellar function to interact with the HBase
> >> > enrichment table closes apache/incubator-metron#234
> >> > METRON-391 Create Stellar Function to Read Profile Data for Model
> >> > Scoring (nickwallen via cestella) closes apache/incubator-metron#242
> >> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> >> > apache/incubator-metron#248
> >> > METRON-407: We currently do not provide defaults if the Stix
> >> > Observable does not specify a condition closes
> >> apache/incubator-metron#244
> >> > METRON-406: Stellar variable resolution does not resolve variables
> >> > with ':' in them closes apache/incubator-metron#243
> >> > METRON-399 Stellar Date Functions Should Default to Current Time
> >> > (nickwallen) closes apache/incubator-metron#237
> >> > METRON-389 Create Java API to Read Profile Data During Model Scoring
> >> > (nickwallen) closes apache/incubator-metron#236
> >> > METRON-385 Create Ambari Service Definition for Indexing (justinleet
> >> > via cestella) closes apache/incubator-metron#222
> >> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
> >> > (mmiklavc via cestella) closes apache/incubator-metron#232
> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> > apache/incubator-metron#241
> >> > METRON-408 Intermittent Failures of Profile Integration Tests
> >> > (nickwallen via cestella) closes apache/incubator-metron#245
> >> > METRON-381: Add support for multiple reducers in pcap_query.sh closes
> >> > apache/incubator-metron#217
> >> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> >> > (nickwallen) closes apache/incubator-metron#240
> >> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> >> > (nickwallen) closes apache/incubator-metron#230
> >> > METRON-383: Create Ambari Service Definition for Metron Parsers
> >> > (mmiklavc via cestella) closes apache/incubator-metron#218
> >> > METRON-396: Make Stellar function resolution happen via an annotation
> >> > and classpath search closes apache/incubator-metron#233
> >> > METRON-400 Deploy Probes to running Docker Container closes
> >> > apache/incubator-metron#238
> >> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
> >> > via cestella) closes apache/incubator-metron#239
> >> > METRON-394 Create Stellar Date Functions to Use with Profile 'Group
> >> > By' (nickwallen) closes apache/incubator-metron#231
> >> > METRON-390: Stellar functions should initialize upon use, rather than
> >> > all at once closes apache/incubator-metron#228
> >> > METRON-386 Create Ambari Service Definition for Elasticsearch
> >> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> >> > METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
> >> > (nickwallen) closes apache/incubator-metron#226
> >> > METRON-372 Enhance Statistical Operations Available for Use with the
> >> > Profiler (nickwallen) closes apache/incubator-metron#225
> >> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> >> > closes apache/incubator-metron#227
> >> > METRON-341: Create stellar enrichment adapter closes
> >> > apache/incubator-metron#216
> >> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> >> > (nickwallen) closes apache/incubator-metron#213
> >> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> >> > (nickwallen) closes apache/incubator-metron#212
> >> > METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
> >> > via cestella) closes apache/incubator-metron#211
> >> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> >> > closes apache/incubator-metron#224
> >> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> >> > apache/incubator-metron#208
> >> > METRON-366: Add MODEL_APPLY to Stellar closes
> >> > apache/incubator-metron#210
> >> > METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
> >> > via cestella) closes apache/incubator-metron#203
> >> > METRON-362: Unify the Stellar Languages closes
> >> > apache/incubator-metron#207
> >> > METRON-339: Create YARN app to deploy endpoints closes
> >> > apache/incubator-metron#205
> >> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> >> > dlyle65535) closes apache/incubator-metron#206
> >> > METRON-356 Modify Storm topology.classpath via configuration
> >> (mmiklavc
> >> > via cestella) closes apache/incubator-metron#204
> >> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
> >> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> >> > apache/incubator-metron#199
> >> > METRON-336 Update README.md to use brew instead of pip for ansible
> >> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> >> apache/incubator-metron#198
> >> > METRON-314 Kibana Default Dashboard - Map Broken closes
> >> > apache/incubator-metron#193
> >> > METRON-284 SensorParserConfig object cannot be serialized with the
> >> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> >> > apache/incubator-metron#184
> >> > METRON-338 Remove flux from metron-parsers and RPM builds and add
> >> > metron-indexing (mmiklavc via dlyle65535) closes
> >> apache/incubator-metron#201
> >> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> >> > dlyle65535) closes apache/incubator-metron#196
> >> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
> >> via
> >> > dlyle65535 ) closes apache/incubator-metron#191
> >> > METRON-304 Add PCAP backend rpm packaging
> >> > METRON-300 Adding Enrichment Subpackage to RPM spec
> >> > METRON-305: Adding Solr Subpackage to RPM spec
> >> > METRON-303 Adding Data Management Subpackage to RPM spec
> >> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> >> > METRON-299 Adding Parsers Subpackage to RPM spec
> >> > METRON-302 Add rpm spec file
> >> > METRON-306: Create Docker container for RPM creation (dlyle65535 via
> >> > cestella) closes apache/incubator-metron#190
> >> > METRON-154: Decouple enrichment and indexing closes
> >> > apache/incubator-metron#192
> >> > METRON-294 Refactor parser topology builder (nickwallen via cestella)
> >> > closes apache/incubator-metron#185
> >> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
> >> via
> >> > cestella) closes apache/incubator-metron#183
> >> > METRON-225 Amazon-ec2 run script continues running on Maven build
> >> > error (nickwallen via cestella) closes apache/incubator-metron#182
> >> > METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
> >> > (nickwallen via cestella) closes apache/incubator-metron#181
> >> > METRON-281 Simplify deployment to alternative AWS region (nickwallen
> >> > via cestella) closes apache/incubator-metron#180
> >> > METRON-117 Deployment Report Created for All Deployments (nickwallen
> >> > via cestella) closes apache/incubator-metron#179
> >> > METRON-262 Update codelab image scripts closes
> >> > apache/incubator-metron#177
> >> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
> >> > apache/incubator-metron#187
> >> >
> >> >
> >> > -------------------
> >> > Thank you,
> >> >
> >> > James Sirota
> >> > PPMC- Apache Metron (Incubating)
> >> > jsirota AT apache DOT org
> >> >
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
Re: [DISCUSS] Upcoming Metron Build
Posted by James Sirota <js...@apache.org>.
Do we now have everything we wanted in there?
27.09.2016, 08:59, "David Lyle" <dl...@gmail.com>:
> I'd like to hold out for https://issues.apache.org/jira/browse/METRON-466.
> I'm testing this now, so am a few hours out.
>
> -D...
>
> On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> michael.miklavcic@gmail.com> wrote:
>
>> �Also need this Jira to bump the version.
>>
>> �https://issues.apache.org/jira/browse/METRON-398
>>
>> �On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <js...@apache.org> wrote:
>>
>> �> We are preparing the next release (will be put up for a vote within the
>> �> next few days) with the following list of Jiras. Do you feel there are
>> �any
>> �> other Jiras that should go into this release or are there any critical
>> �bugs
>> �> that anyone knows of that we should address before releasing? Please
>> �> comment on this thread. Otherwise, we will put up the release for a vote
>> �> shortly.
>> �>
>> �> METRON-457 Correct GrokParser logging spelling error (mmiklavc via
>> �> cestella) closes apache/incubator-metron#274
>> �> METRON-449 JSONMapParser should unfold maps to arbitrary depths
>> �closes
>> �> apache/incubator-metron#271
>> �> METRON-453: Add a stellar shell function to open an external editor
>> �> and return the editor's contents closes apache/incubator-metron#272
>> �> METRON-452: Add rudimentary configuration management functions to
>> �> Stellar closes apache/incubator-metron#269
>> �> METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
>> �> LICENSE where appropriate closes apache/incubator-metron#229
>> �> METRON-427 Create Ambari Management Pack for Metron Installation
>> �> closes apache/incubator-metron#266
>> �> METRON-434: JSON Parser closes apache/incubator-metron#261
>> �> METRON-437 Profile Definition's 'inputTopic' field is Extraneous
>> �> (nickwallen) closes apache/incubator-metron#264
>> �> METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>> �> nickwallen) closes apache/incubator-metron#267
>> �> METRON-438: Back the Stellar REPL with a readline implementation
>> �> closes apache/incubator-metron#265
>> �> METRON-426: Stellar does not support scientific notation as a literal
>> �> closes apache/incubator-metron#257
>> �> METRON-435: Create Stellar REPL (nickwallen via cestella) closes
>> �> apache/incubator-metron#262
>> �> METRON-436: Updated architecture diagrams for Metron READMEs
>> �> (anandsubbu via cestella) closes apache/incubator-metron#263
>> �> METRON-433: Documentation update closes apache/incubator-metron#260
>> �> METRON-428: Allow a kafka offset to be passed to the ParserTopology
>> �> CLI closes apache/incubator-metron#258
>> �> METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>> �> (nickwallen) closes apache/incubator-metron#259
>> �> METRON-384 Deployment fails at task "Wait for Elasticsearch
>> �Host
>> �> to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
>> �> METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
>> �> via cestella) closes apache/incubator-metron#256
>> �> METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
>> �> apache/incubator-metron#254
>> �> METRON-413 Allow Start/End Time Range Search in Profiler Client API
>> �> (nickwallen) closes apache/incubator-metron#249
>> �> METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
>> �> closes apache/incubator-metron#252
>> �> METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
>> �> apache/incubator-metron#255
>> �> METRON-418 Set TTL on HBase Puts (nickwallen) closes
>> �> apache/incubator-metron#251
>> �> METRON-415: Allow a Profile to Store Any Type as its Value closes
>> �> apache/incubator-metron#253
>> �> METRON-411 Support Greater Range of Profile Periods (nickwallen)
>> �> closes apache/incubator-metron#246
>> �> METRON-416: Provide the ability to store mergeable data structures
>> �for
>> �> summarizing data on-line closes apache/incubator-metron#250
>> �> METRON-397: Add a stellar function to interact with the HBase
>> �> enrichment table closes apache/incubator-metron#234
>> �> METRON-391 Create Stellar Function to Read Profile Data for Model
>> �> Scoring (nickwallen via cestella) closes apache/incubator-metron#242
>> �> METRON-414 Kibana Ansible Install Fails with SSL Error closes
>> �> apache/incubator-metron#248
>> �> METRON-407: We currently do not provide defaults if the Stix
>> �> Observable does not specify a condition closes
>> �apache/incubator-metron#244
>> �> METRON-406: Stellar variable resolution does not resolve variables
>> �> with ':' in them closes apache/incubator-metron#243
>> �> METRON-399 Stellar Date Functions Should Default to Current Time
>> �> (nickwallen) closes apache/incubator-metron#237
>> �> METRON-389 Create Java API to Read Profile Data During Model Scoring
>> �> (nickwallen) closes apache/incubator-metron#236
>> �> METRON-385 Create Ambari Service Definition for Indexing (justinleet
>> �> via cestella) closes apache/incubator-metron#222
>> �> METRON-395 Fix Metron Bro parser not parsing some timestamp values
>> �> (mmiklavc via cestella) closes apache/incubator-metron#232
>> �> METRON-400 Deploy Probes to running Docker Container closes
>> �> apache/incubator-metron#241
>> �> METRON-408 Intermittent Failures of Profile Integration Tests
>> �> (nickwallen via cestella) closes apache/incubator-metron#245
>> �> METRON-381: Add support for multiple reducers in pcap_query.sh closes
>> �> apache/incubator-metron#217
>> �> METRON-404 Stellar Compiler Hides Function Initialization Errors
>> �> (nickwallen) closes apache/incubator-metron#240
>> �> METRON-392 Allow User to Define Custom 'Group By' for a Profile
>> �> (nickwallen) closes apache/incubator-metron#230
>> �> METRON-383: Create Ambari Service Definition for Metron Parsers
>> �> (mmiklavc via cestella) closes apache/incubator-metron#218
>> �> METRON-396: Make Stellar function resolution happen via an annotation
>> �> and classpath search closes apache/incubator-metron#233
>> �> METRON-400 Deploy Probes to running Docker Container closes
>> �> apache/incubator-metron#238
>> �> METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
>> �> via cestella) closes apache/incubator-metron#239
>> �> METRON-394 Create Stellar Date Functions to Use with Profile 'Group
>> �> By' (nickwallen) closes apache/incubator-metron#231
>> �> METRON-390: Stellar functions should initialize upon use, rather than
>> �> all at once closes apache/incubator-metron#228
>> �> METRON-386 Create Ambari Service Definition for Elasticsearch
>> �> (justinleet via dlyle65535) closes apache/incubator-metron#223
>> �> METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
>> �> (nickwallen) closes apache/incubator-metron#226
>> �> METRON-372 Enhance Statistical Operations Available for Use with the
>> �> Profiler (nickwallen) closes apache/incubator-metron#225
>> �> METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
>> �> closes apache/incubator-metron#227
>> �> METRON-341: Create stellar enrichment adapter closes
>> �> apache/incubator-metron#216
>> �> METRON-368 Simplify Profile Configuration with Sensible Defaults
>> �> (nickwallen) closes apache/incubator-metron#213
>> �> METRON-367 Enhance Profiler to Support Multiple Numeric Types
>> �> (nickwallen) closes apache/incubator-metron#212
>> �> METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
>> �> via cestella) closes apache/incubator-metron#211
>> �> METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
>> �> closes apache/incubator-metron#224
>> �> METRON-309 Created a Normalcy Profiler (nickwallen) closes
>> �> apache/incubator-metron#208
>> �> METRON-366: Add MODEL_APPLY to Stellar closes
>> �> apache/incubator-metron#210
>> �> METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
>> �> via cestella) closes apache/incubator-metron#203
>> �> METRON-362: Unify the Stellar Languages closes
>> �> apache/incubator-metron#207
>> �> METRON-339: Create YARN app to deploy endpoints closes
>> �> apache/incubator-metron#205
>> �> METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
>> �> dlyle65535) closes apache/incubator-metron#206
>> �> METRON-356 Modify Storm topology.classpath via configuration
>> �(mmiklavc
>> �> via cestella) closes apache/incubator-metron#204
>> �> METRON-242 remove Squid pattern closes apache/incubator-metron#202
>> �> METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
>> �> apache/incubator-metron#199
>> �> METRON-336 Update README.md to use brew instead of pip for ansible
>> �> 2.0.0.2 install (jfrazee via dlyle65535) closes
>> �apache/incubator-metron#198
>> �> METRON-314 Kibana Default Dashboard - Map Broken closes
>> �> apache/incubator-metron#193
>> �> METRON-284 SensorParserConfig object cannot be serialized with the
>> �> default Jackson ObjectMapper (cestella via dlyle65535) closes
>> �> apache/incubator-metron#184
>> �> METRON-338 Remove flux from metron-parsers and RPM builds and add
>> �> metron-indexing (mmiklavc via dlyle65535) closes
>> �apache/incubator-metron#201
>> �> METRON-334 Travis CI cache Maven dependencies (justinleet via
>> �> dlyle65535) closes apache/incubator-metron#196
>> �> METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
>> �via
>> �> dlyle65535 ) closes apache/incubator-metron#191
>> �> METRON-304 Add PCAP backend rpm packaging
>> �> METRON-300 Adding Enrichment Subpackage to RPM spec
>> �> METRON-305: Adding Solr Subpackage to RPM spec
>> �> METRON-303 Adding Data Management Subpackage to RPM spec
>> �> METRON-301: Adding Elasticsearch Subpackage to RPM spec
>> �> METRON-299 Adding Parsers Subpackage to RPM spec
>> �> METRON-302 Add rpm spec file
>> �> METRON-306: Create Docker container for RPM creation (dlyle65535 via
>> �> cestella) closes apache/incubator-metron#190
>> �> METRON-154: Decouple enrichment and indexing closes
>> �> apache/incubator-metron#192
>> �> METRON-294 Refactor parser topology builder (nickwallen via cestella)
>> �> closes apache/incubator-metron#185
>> �> METRON-266 Remove duplicate entries of sniff_interface (nickwallen
>> �via
>> �> cestella) closes apache/incubator-metron#183
>> �> METRON-225 Amazon-ec2 run script continues running on Maven build
>> �> error (nickwallen via cestella) closes apache/incubator-metron#182
>> �> METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
>> �> (nickwallen via cestella) closes apache/incubator-metron#181
>> �> METRON-281 Simplify deployment to alternative AWS region (nickwallen
>> �> via cestella) closes apache/incubator-metron#180
>> �> METRON-117 Deployment Report Created for All Deployments (nickwallen
>> �> via cestella) closes apache/incubator-metron#179
>> �> METRON-262 Update codelab image scripts closes
>> �> apache/incubator-metron#177
>> �> METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
>> �> apache/incubator-metron#187
>> �>
>> �>
>> �> -------------------
>> �> Thank you,
>> �>
>> �> James Sirota
>> �> PPMC- Apache Metron (Incubating)
>> �> jsirota AT apache DOT org
>> �>
-------------------�
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Re: [DISCUSS] Upcoming Metron Build
Posted by David Lyle <dl...@gmail.com>.
I'd like to hold out for https://issues.apache.org/jira/browse/METRON-466.
I'm testing this now, so am a few hours out.
-D...
On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
michael.miklavcic@gmail.com> wrote:
> Also need this Jira to bump the version.
>
> https://issues.apache.org/jira/browse/METRON-398
>
> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <js...@apache.org> wrote:
>
> > We are preparing the next release (will be put up for a vote within the
> > next few days) with the following list of Jiras. Do you feel there are
> any
> > other Jiras that should go into this release or are there any critical
> bugs
> > that anyone knows of that we should address before releasing? Please
> > comment on this thread. Otherwise, we will put up the release for a vote
> > shortly.
> >
> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> > cestella) closes apache/incubator-metron#274
> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> closes
> > apache/incubator-metron#271
> > METRON-453: Add a stellar shell function to open an external editor
> > and return the editor's contents closes apache/incubator-metron#272
> > METRON-452: Add rudimentary configuration management functions to
> > Stellar closes apache/incubator-metron#269
> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
> > LICENSE where appropriate closes apache/incubator-metron#229
> > METRON-427 Create Ambari Management Pack for Metron Installation
> > closes apache/incubator-metron#266
> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> > (nickwallen) closes apache/incubator-metron#264
> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > nickwallen) closes apache/incubator-metron#267
> > METRON-438: Back the Stellar REPL with a readline implementation
> > closes apache/incubator-metron#265
> > METRON-426: Stellar does not support scientific notation as a literal
> > closes apache/incubator-metron#257
> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> > apache/incubator-metron#262
> > METRON-436: Updated architecture diagrams for Metron READMEs
> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > METRON-433: Documentation update closes apache/incubator-metron#260
> > METRON-428: Allow a kafka offset to be passed to the ParserTopology
> > CLI closes apache/incubator-metron#258
> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > (nickwallen) closes apache/incubator-metron#259
> > METRON-384 Deployment fails at task "Wait for Elasticsearch
> Host
> > to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
> > METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
> > via cestella) closes apache/incubator-metron#256
> > METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
> > apache/incubator-metron#254
> > METRON-413 Allow Start/End Time Range Search in Profiler Client API
> > (nickwallen) closes apache/incubator-metron#249
> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
> > closes apache/incubator-metron#252
> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> > apache/incubator-metron#255
> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > apache/incubator-metron#251
> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> > apache/incubator-metron#253
> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> > closes apache/incubator-metron#246
> > METRON-416: Provide the ability to store mergeable data structures
> for
> > summarizing data on-line closes apache/incubator-metron#250
> > METRON-397: Add a stellar function to interact with the HBase
> > enrichment table closes apache/incubator-metron#234
> > METRON-391 Create Stellar Function to Read Profile Data for Model
> > Scoring (nickwallen via cestella) closes apache/incubator-metron#242
> > METRON-414 Kibana Ansible Install Fails with SSL Error closes
> > apache/incubator-metron#248
> > METRON-407: We currently do not provide defaults if the Stix
> > Observable does not specify a condition closes
> apache/incubator-metron#244
> > METRON-406: Stellar variable resolution does not resolve variables
> > with ':' in them closes apache/incubator-metron#243
> > METRON-399 Stellar Date Functions Should Default to Current Time
> > (nickwallen) closes apache/incubator-metron#237
> > METRON-389 Create Java API to Read Profile Data During Model Scoring
> > (nickwallen) closes apache/incubator-metron#236
> > METRON-385 Create Ambari Service Definition for Indexing (justinleet
> > via cestella) closes apache/incubator-metron#222
> > METRON-395 Fix Metron Bro parser not parsing some timestamp values
> > (mmiklavc via cestella) closes apache/incubator-metron#232
> > METRON-400 Deploy Probes to running Docker Container closes
> > apache/incubator-metron#241
> > METRON-408 Intermittent Failures of Profile Integration Tests
> > (nickwallen via cestella) closes apache/incubator-metron#245
> > METRON-381: Add support for multiple reducers in pcap_query.sh closes
> > apache/incubator-metron#217
> > METRON-404 Stellar Compiler Hides Function Initialization Errors
> > (nickwallen) closes apache/incubator-metron#240
> > METRON-392 Allow User to Define Custom 'Group By' for a Profile
> > (nickwallen) closes apache/incubator-metron#230
> > METRON-383: Create Ambari Service Definition for Metron Parsers
> > (mmiklavc via cestella) closes apache/incubator-metron#218
> > METRON-396: Make Stellar function resolution happen via an annotation
> > and classpath search closes apache/incubator-metron#233
> > METRON-400 Deploy Probes to running Docker Container closes
> > apache/incubator-metron#238
> > METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
> > via cestella) closes apache/incubator-metron#239
> > METRON-394 Create Stellar Date Functions to Use with Profile 'Group
> > By' (nickwallen) closes apache/incubator-metron#231
> > METRON-390: Stellar functions should initialize upon use, rather than
> > all at once closes apache/incubator-metron#228
> > METRON-386 Create Ambari Service Definition for Elasticsearch
> > (justinleet via dlyle65535) closes apache/incubator-metron#223
> > METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
> > (nickwallen) closes apache/incubator-metron#226
> > METRON-372 Enhance Statistical Operations Available for Use with the
> > Profiler (nickwallen) closes apache/incubator-metron#225
> > METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> > closes apache/incubator-metron#227
> > METRON-341: Create stellar enrichment adapter closes
> > apache/incubator-metron#216
> > METRON-368 Simplify Profile Configuration with Sensible Defaults
> > (nickwallen) closes apache/incubator-metron#213
> > METRON-367 Enhance Profiler to Support Multiple Numeric Types
> > (nickwallen) closes apache/incubator-metron#212
> > METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
> > via cestella) closes apache/incubator-metron#211
> > METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> > closes apache/incubator-metron#224
> > METRON-309 Created a Normalcy Profiler (nickwallen) closes
> > apache/incubator-metron#208
> > METRON-366: Add MODEL_APPLY to Stellar closes
> > apache/incubator-metron#210
> > METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
> > via cestella) closes apache/incubator-metron#203
> > METRON-362: Unify the Stellar Languages closes
> > apache/incubator-metron#207
> > METRON-339: Create YARN app to deploy endpoints closes
> > apache/incubator-metron#205
> > METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> > dlyle65535) closes apache/incubator-metron#206
> > METRON-356 Modify Storm topology.classpath via configuration
> (mmiklavc
> > via cestella) closes apache/incubator-metron#204
> > METRON-242 remove Squid pattern closes apache/incubator-metron#202
> > METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> > apache/incubator-metron#199
> > METRON-336 Update README.md to use brew instead of pip for ansible
> > 2.0.0.2 install (jfrazee via dlyle65535) closes
> apache/incubator-metron#198
> > METRON-314 Kibana Default Dashboard - Map Broken closes
> > apache/incubator-metron#193
> > METRON-284 SensorParserConfig object cannot be serialized with the
> > default Jackson ObjectMapper (cestella via dlyle65535) closes
> > apache/incubator-metron#184
> > METRON-338 Remove flux from metron-parsers and RPM builds and add
> > metron-indexing (mmiklavc via dlyle65535) closes
> apache/incubator-metron#201
> > METRON-334 Travis CI cache Maven dependencies (justinleet via
> > dlyle65535) closes apache/incubator-metron#196
> > METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet
> via
> > dlyle65535 ) closes apache/incubator-metron#191
> > METRON-304 Add PCAP backend rpm packaging
> > METRON-300 Adding Enrichment Subpackage to RPM spec
> > METRON-305: Adding Solr Subpackage to RPM spec
> > METRON-303 Adding Data Management Subpackage to RPM spec
> > METRON-301: Adding Elasticsearch Subpackage to RPM spec
> > METRON-299 Adding Parsers Subpackage to RPM spec
> > METRON-302 Add rpm spec file
> > METRON-306: Create Docker container for RPM creation (dlyle65535 via
> > cestella) closes apache/incubator-metron#190
> > METRON-154: Decouple enrichment and indexing closes
> > apache/incubator-metron#192
> > METRON-294 Refactor parser topology builder (nickwallen via cestella)
> > closes apache/incubator-metron#185
> > METRON-266 Remove duplicate entries of sniff_interface (nickwallen
> via
> > cestella) closes apache/incubator-metron#183
> > METRON-225 Amazon-ec2 run script continues running on Maven build
> > error (nickwallen via cestella) closes apache/incubator-metron#182
> > METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
> > (nickwallen via cestella) closes apache/incubator-metron#181
> > METRON-281 Simplify deployment to alternative AWS region (nickwallen
> > via cestella) closes apache/incubator-metron#180
> > METRON-117 Deployment Report Created for All Deployments (nickwallen
> > via cestella) closes apache/incubator-metron#179
> > METRON-262 Update codelab image scripts closes
> > apache/incubator-metron#177
> > METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
> > apache/incubator-metron#187
> >
> >
> > -------------------
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>
Re: [DISCUSS] Upcoming Metron Build
Posted by Michael Miklavcic <mi...@gmail.com>.
Also need this Jira to bump the version.
https://issues.apache.org/jira/browse/METRON-398
On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <js...@apache.org> wrote:
> We are preparing the next release (will be put up for a vote within the
> next few days) with the following list of Jiras. Do you feel there are any
> other Jiras that should go into this release or are there any critical bugs
> that anyone knows of that we should address before releasing? Please
> comment on this thread. Otherwise, we will put up the release for a vote
> shortly.
>
> METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> cestella) closes apache/incubator-metron#274
> METRON-449 JSONMapParser should unfold maps to arbitrary depths closes
> apache/incubator-metron#271
> METRON-453: Add a stellar shell function to open an external editor
> and return the editor's contents closes apache/incubator-metron#272
> METRON-452: Add rudimentary configuration management functions to
> Stellar closes apache/incubator-metron#269
> METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and
> LICENSE where appropriate closes apache/incubator-metron#229
> METRON-427 Create Ambari Management Pack for Metron Installation
> closes apache/incubator-metron#266
> METRON-434: JSON Parser closes apache/incubator-metron#261
> METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> (nickwallen) closes apache/incubator-metron#264
> METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> nickwallen) closes apache/incubator-metron#267
> METRON-438: Back the Stellar REPL with a readline implementation
> closes apache/incubator-metron#265
> METRON-426: Stellar does not support scientific notation as a literal
> closes apache/incubator-metron#257
> METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> apache/incubator-metron#262
> METRON-436: Updated architecture diagrams for Metron READMEs
> (anandsubbu via cestella) closes apache/incubator-metron#263
> METRON-433: Documentation update closes apache/incubator-metron#260
> METRON-428: Allow a kafka offset to be passed to the ParserTopology
> CLI closes apache/incubator-metron#258
> METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> (nickwallen) closes apache/incubator-metron#259
> METRON-384 Deployment fails at task "Wait for Elasticsearch Host
> to Start" (2xyo via dlyle65535) closes apache/incubator-metron#221
> METRON-257 Enable pcap result pagination from the Pcap CLI (mmiklavc
> via cestella) closes apache/incubator-metron#256
> METRON-420 Add Expiration to a Profile Definition (nickwallen) closes
> apache/incubator-metron#254
> METRON-413 Allow Start/End Time Range Search in Profiler Client API
> (nickwallen) closes apache/incubator-metron#249
> METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL (nickwallen)
> closes apache/incubator-metron#252
> METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> apache/incubator-metron#255
> METRON-418 Set TTL on HBase Puts (nickwallen) closes
> apache/incubator-metron#251
> METRON-415: Allow a Profile to Store Any Type as its Value closes
> apache/incubator-metron#253
> METRON-411 Support Greater Range of Profile Periods (nickwallen)
> closes apache/incubator-metron#246
> METRON-416: Provide the ability to store mergeable data structures for
> summarizing data on-line closes apache/incubator-metron#250
> METRON-397: Add a stellar function to interact with the HBase
> enrichment table closes apache/incubator-metron#234
> METRON-391 Create Stellar Function to Read Profile Data for Model
> Scoring (nickwallen via cestella) closes apache/incubator-metron#242
> METRON-414 Kibana Ansible Install Fails with SSL Error closes
> apache/incubator-metron#248
> METRON-407: We currently do not provide defaults if the Stix
> Observable does not specify a condition closes apache/incubator-metron#244
> METRON-406: Stellar variable resolution does not resolve variables
> with ':' in them closes apache/incubator-metron#243
> METRON-399 Stellar Date Functions Should Default to Current Time
> (nickwallen) closes apache/incubator-metron#237
> METRON-389 Create Java API to Read Profile Data During Model Scoring
> (nickwallen) closes apache/incubator-metron#236
> METRON-385 Create Ambari Service Definition for Indexing (justinleet
> via cestella) closes apache/incubator-metron#222
> METRON-395 Fix Metron Bro parser not parsing some timestamp values
> (mmiklavc via cestella) closes apache/incubator-metron#232
> METRON-400 Deploy Probes to running Docker Container closes
> apache/incubator-metron#241
> METRON-408 Intermittent Failures of Profile Integration Tests
> (nickwallen via cestella) closes apache/incubator-metron#245
> METRON-381: Add support for multiple reducers in pcap_query.sh closes
> apache/incubator-metron#217
> METRON-404 Stellar Compiler Hides Function Initialization Errors
> (nickwallen) closes apache/incubator-metron#240
> METRON-392 Allow User to Define Custom 'Group By' for a Profile
> (nickwallen) closes apache/incubator-metron#230
> METRON-383: Create Ambari Service Definition for Metron Parsers
> (mmiklavc via cestella) closes apache/incubator-metron#218
> METRON-396: Make Stellar function resolution happen via an annotation
> and classpath search closes apache/incubator-metron#233
> METRON-400 Deploy Probes to running Docker Container closes
> apache/incubator-metron#238
> METRON-401 ParseException Thrown by ThreatIntelJoinBolt (nickwallen
> via cestella) closes apache/incubator-metron#239
> METRON-394 Create Stellar Date Functions to Use with Profile 'Group
> By' (nickwallen) closes apache/incubator-metron#231
> METRON-390: Stellar functions should initialize upon use, rather than
> all at once closes apache/incubator-metron#228
> METRON-386 Create Ambari Service Definition for Elasticsearch
> (justinleet via dlyle65535) closes apache/incubator-metron#223
> METRON-377 Enable Profiles that Use Non-Single Pass Summary Functions
> (nickwallen) closes apache/incubator-metron#226
> METRON-372 Enhance Statistical Operations Available for Use with the
> Profiler (nickwallen) closes apache/incubator-metron#225
> METRON-388: Stellar - Unable to Operate on Result of If-Then-Else
> closes apache/incubator-metron#227
> METRON-341: Create stellar enrichment adapter closes
> apache/incubator-metron#216
> METRON-368 Simplify Profile Configuration with Sensible Defaults
> (nickwallen) closes apache/incubator-metron#213
> METRON-367 Enhance Profiler to Support Multiple Numeric Types
> (nickwallen) closes apache/incubator-metron#212
> METRON-365: Load demo dashboard on Kibana Service install (dlyle65535
> via cestella) closes apache/incubator-metron#211
> METRON-387 Build Failure - Bad Merge with METRON-309 (nickwallen)
> closes apache/incubator-metron#224
> METRON-309 Created a Normalcy Profiler (nickwallen) closes
> apache/incubator-metron#208
> METRON-366: Add MODEL_APPLY to Stellar closes
> apache/incubator-metron#210
> METRON-357: Create Ambari Service Definition for Kibana (dlyle65535
> via cestella) closes apache/incubator-metron#203
> METRON-362: Unify the Stellar Languages closes
> apache/incubator-metron#207
> METRON-339: Create YARN app to deploy endpoints closes
> apache/incubator-metron#205
> METRON-352 Upgrade Metron HDP install to 2.4 Stack (jjmeyer0 via
> dlyle65535) closes apache/incubator-metron#206
> METRON-356 Modify Storm topology.classpath via configuration (mmiklavc
> via cestella) closes apache/incubator-metron#204
> METRON-242 remove Squid pattern closes apache/incubator-metron#202
> METRON-319 Automate RPM Builds (justinleet via dlyle65535) closes
> apache/incubator-metron#199
> METRON-336 Update README.md to use brew instead of pip for ansible
> 2.0.0.2 install (jfrazee via dlyle65535) closes apache/incubator-metron#198
> METRON-314 Kibana Default Dashboard - Map Broken closes
> apache/incubator-metron#193
> METRON-284 SensorParserConfig object cannot be serialized with the
> default Jackson ObjectMapper (cestella via dlyle65535) closes
> apache/incubator-metron#184
> METRON-338 Remove flux from metron-parsers and RPM builds and add
> metron-indexing (mmiklavc via dlyle65535) closes apache/incubator-metron#201
> METRON-334 Travis CI cache Maven dependencies (justinleet via
> dlyle65535) closes apache/incubator-metron#196
> METRON-214: Build RPM Packages for Deployment (mmiklavc,justinleet via
> dlyle65535 ) closes apache/incubator-metron#191
> METRON-304 Add PCAP backend rpm packaging
> METRON-300 Adding Enrichment Subpackage to RPM spec
> METRON-305: Adding Solr Subpackage to RPM spec
> METRON-303 Adding Data Management Subpackage to RPM spec
> METRON-301: Adding Elasticsearch Subpackage to RPM spec
> METRON-299 Adding Parsers Subpackage to RPM spec
> METRON-302 Add rpm spec file
> METRON-306: Create Docker container for RPM creation (dlyle65535 via
> cestella) closes apache/incubator-metron#190
> METRON-154: Decouple enrichment and indexing closes
> apache/incubator-metron#192
> METRON-294 Refactor parser topology builder (nickwallen via cestella)
> closes apache/incubator-metron#185
> METRON-266 Remove duplicate entries of sniff_interface (nickwallen via
> cestella) closes apache/incubator-metron#183
> METRON-225 Amazon-ec2 run script continues running on Maven build
> error (nickwallen via cestella) closes apache/incubator-metron#182
> METRON-279 Removed duplicative roles; metron-kafka and metron-hbase
> (nickwallen via cestella) closes apache/incubator-metron#181
> METRON-281 Simplify deployment to alternative AWS region (nickwallen
> via cestella) closes apache/incubator-metron#180
> METRON-117 Deployment Report Created for All Deployments (nickwallen
> via cestella) closes apache/incubator-metron#179
> METRON-262 Update codelab image scripts closes
> apache/incubator-metron#177
> METRON-321 Add items to .gitignore (mmiklavc via dlyle65535) closes
> apache/incubator-metron#187
>
>
> -------------------
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>