You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Hamidreza Afzali (JIRA)" <ji...@apache.org> on 2016/12/01 13:08:58 UTC

[jira] [Updated] (KAFKA-4461) When using ProcessorTopologyTestDriver, the combination of map and .groupByKey does not produce any result

     [ https://issues.apache.org/jira/browse/KAFKA-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hamidreza Afzali updated KAFKA-4461:
------------------------------------
    Description: 
*Problem*

When using ProcessorTopologyTestDriver in the latest Kafka 0.10.1, the combination of map and .groupByKey does not produce any result. However, it works fine when using KStreamTestDriver.

The topology looks like this:

{code}
builder.stream(Serdes.String, Serdes.Integer, inputTopic)
 .map((k, v) => new KeyValue(fn(k), v))
 .groupByKey(Serdes.String, Serdes.Integer)
 .count(stateStore)
{code}

*Full examples*

Examples for ProcessorTopologyTestDriver and KStreamTestDriver:

https://gist.github.com/hrafzali/c2f50e7b957030dab13693eec1e49c13

*Additional info*

kafka-users mailing list:

http://mail-archives.apache.org/mod_mbox/kafka-users/201611.mbox/%3CCAHwHRrVq1APVkNhP3HVqxujxRJEP9FwHV2NRcvPPsHX7Wujzng%40mail.gmail.com%3E



  was:
*Problem*

When using ProcessorTopologyTestDriver in the latest Kafka 0.10.1, the combination of map and .groupByKey does not produce any result. However, it works fine when using KStreamTestDriver.

The topology looks like this:

{code}
builder.stream(Serdes.String, Serdes.Integer, inputTopic)
 .map((k, v) => new KeyValue(fn(k), v))
 .groupByKey(Serdes.String, Serdes.Integer)
 .count(stateStore)
{code}

*Full example*
https://gist.github.com/hrafzali/c2f50e7b957030dab13693eec1e49c13

*Additional info*

kafka-users mailing list:

http://mail-archives.apache.org/mod_mbox/kafka-users/201611.mbox/%3CCAHwHRrVq1APVkNhP3HVqxujxRJEP9FwHV2NRcvPPsHX7Wujzng%40mail.gmail.com%3E




> When using ProcessorTopologyTestDriver, the combination of map and .groupByKey does not produce any result
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-4461
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4461
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 0.10.1.0
>            Reporter: Hamidreza Afzali
>            Priority: Blocker
>
> *Problem*
> When using ProcessorTopologyTestDriver in the latest Kafka 0.10.1, the combination of map and .groupByKey does not produce any result. However, it works fine when using KStreamTestDriver.
> The topology looks like this:
> {code}
> builder.stream(Serdes.String, Serdes.Integer, inputTopic)
>  .map((k, v) => new KeyValue(fn(k), v))
>  .groupByKey(Serdes.String, Serdes.Integer)
>  .count(stateStore)
> {code}
> *Full examples*
> Examples for ProcessorTopologyTestDriver and KStreamTestDriver:
> https://gist.github.com/hrafzali/c2f50e7b957030dab13693eec1e49c13
> *Additional info*
> kafka-users mailing list:
> http://mail-archives.apache.org/mod_mbox/kafka-users/201611.mbox/%3CCAHwHRrVq1APVkNhP3HVqxujxRJEP9FwHV2NRcvPPsHX7Wujzng%40mail.gmail.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)