Duplicated Alert Executors?

[Zhao Qingwen <qi...@gmail.com>]

Today I run a HdfsAuditLog topology in sandbox, and import one sample log
into Kafka When i check the topology log, and find

2016-04-11 11:07:52 o.a.e.p.e.PolicyProcessExecutor [INFO] Detected 1
alerts for policy testABC
2016-04-11 11:07:52 o.a.e.a.d.DefaultDeduplicator [INFO] Skipped 1 of 1
alerts because they are duplicated
2016-04-11 11:07:52 o.a.e.a.d.DefaultDeduplicator [INFO] Skipped 1 of 1
alerts because they are duplicated

*repeats 3 times!*

Question 1: I don't know why there are 4 alerts generated.
Question 2: I find the following code snippet, I want to know if we can
remove persistStreamProducer and entityDedupStreamProducer here, as they
can be replaced with emaiDedupStreamProducer and notificationStreamProducer.


val entityDedupStreamProducer = FlatMapProducer(entityDedupExecutor)
val persistStreamProducer = FlatMapProducer(persistExecutor)
val emailDedupStreamProducer = FlatMapProducer(emailDedupExecutor)
val notificationStreamProducer = FlatMapProducer(notificationExecutor)
toBeAddedEdges += StreamConnector(entityDedupStreamProducer,
persistStreamProducer)
toBeAddedEdges += StreamConnector(emailDedupStreamProducer,
notificationStreamProducer)

alertStreamProducers.foreach(sp => {
  toBeAddedEdges += StreamConnector(sp, entityDedupStreamProducer)
  toBeAddedEdges += StreamConnector(sp, emailDedupStreamProducer)
})


Best Regards,
Qingwen Zhao | 赵晴雯