You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@metron.apache.org by "Casey Stella (JIRA)" <ji...@apache.org> on 2016/08/19 00:14:20 UTC

[jira] [Created] (METRON-381) Add support for multiple reducers in pcap_query.sh

Casey Stella created METRON-381:
-----------------------------------

             Summary: Add support for multiple reducers in pcap_query.sh
                 Key: METRON-381
                 URL: https://issues.apache.org/jira/browse/METRON-381
             Project: Metron
          Issue Type: New Feature
            Reporter: Casey Stella
            Assignee: Casey Stella


As a stopgap, the pcap_query.sh MapReduce job uses a single reducer to ensure that the packets captured come in the correct order.  This has issues on large queries because it forces all of the data to go through one reducer.  Instead, we should have a custom partitioner that will allow us to use multiple reducers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)