You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "David Auclair (JIRA)" <ji...@apache.org> on 2019/07/18 19:01:00 UTC

[jira] [Created] (METRON-2187) Profiler parallelism

David Auclair created METRON-2187:
-------------------------------------

             Summary: Profiler parallelism
                 Key: METRON-2187
                 URL: https://issues.apache.org/jira/browse/METRON-2187
             Project: Metron
          Issue Type: Bug
    Affects Versions: 0.7.1
            Reporter: David Auclair


No matter how many workers are configured for the profiler, each component ends up using 1 task (at most).

For example, from the flux definition of the enrichment topology:
spouts:
 - id: "kafkaSpout"
 className: "org.apache.metron.storm.kafka.flux.StormKafkaSpout"
 constructorArgs:
 - ref: "kafkaConfig"
 parallelism: ${kafka.spout.parallelism}

 

While the flux definition of the profiler topology:

spouts:
 - id: "kafkaSpout"
 className: "org.apache.metron.storm.kafka.flux.StormKafkaSpout"
 constructorArgs:
 - ref: "kafkaConfig"

^^^ Note the lack of parallelism



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)