You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Rens Groothuijsen (Jira)" <ji...@apache.org> on 2020/08/30 20:36:00 UTC

[jira] [Commented] (KAFKA-10417) suppress() with cogroup() throws ClassCastException

    [ https://issues.apache.org/jira/browse/KAFKA-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187322#comment-17187322 ] 

Rens Groothuijsen commented on KAFKA-10417:
-------------------------------------------

A cogrouped stream creates a KTable with processor supplier type PassThrough, which implements ProcessorSupplier rather thanĀ  KTableProcessorSupplier. This then causes a problem [here|https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableImpl.java#L842].

> suppress() with cogroup() throws ClassCastException
> ---------------------------------------------------
>
>                 Key: KAFKA-10417
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10417
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 2.6.0
>            Reporter: Wardha Perinkada Kattu
>            Priority: Blocker
>              Labels: kafka-streams
>             Fix For: 2.7.0
>
>
> Streams operation - `cogroup()`, `aggregate()` followed by `suppress()` throws `ClassCastException`
> Works fine without the `suppress()`
> Code block tested -
> {code:java}
> val stream1 = requestStreams.merge(successStreams).merge(errorStreams)
>                 .groupByKey(Grouped.with(Serdes.String(), serdesConfig.notificationSerde()))
>         val streams2 = confirmationStreams
>                 .groupByKey(Grouped.with(Serdes.String(), serdesConfig.confirmationsSerde()))
>         val cogrouped = stream1.cogroup(notificationAggregator).cogroup(streams2, confirmationsAggregator)
>                 .windowedBy(TimeWindows.of(Duration.ofMinutes(notificationStreamsConfig.joinWindowMinutes.toLong())).grace(Duration.ofMinutes(notificationStreamsConfig.graceDurationMinutes.toLong())))
>                 .aggregate({ null }, Materialized.`as`<String, NotificationMetric, WindowStore<Bytes, ByteArray>>("time-windowed-aggregated-stream-store")
>                         .withValueSerde(serdesConfig.notificationMetricSerde()))
>                  .suppress(Suppressed.untilWindowCloses(unbounded()))
>                 .toStream()
> {code}
> Exception thrown is:
> {code:java}
> Caused by: java.lang.ClassCastException: class org.apache.kafka.streams.kstream.internals.PassThrough cannot be cast to class org.apache.kafka.streams.kstream.internals.KTableProcessorSupplier (org.apache.kafka.streams.kstream.internals.PassThrough and org.apache.kafka.streams.kstream.internals.KTableProcessorSupplier are in unnamed module of loader 'app')
> {code}
> [https://stackoverflow.com/questions/63459685/kgroupedstream-with-cogroup-aggregate-suppress]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)