You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Iaroslav Zeigerman (Jira)" <ji...@apache.org> on 2021/02/26 00:47:00 UTC
[jira] [Created] (FLINK-21507) Given a sequence of multiple custom
stream partitioning operations only last transformation in sequence is
applied while others are dropped
Iaroslav Zeigerman created FLINK-21507:
------------------------------------------
Summary: Given a sequence of multiple custom stream partitioning operations only last transformation in sequence is applied while others are dropped
Key: FLINK-21507
URL: https://issues.apache.org/jira/browse/FLINK-21507
Project: Flink
Issue Type: Bug
Components: API / DataStream, API / Scala
Affects Versions: 1.11.0
Reporter: Iaroslav Zeigerman
When I use multiple custom partitioning operations in a row like this:
{code:java}
stream
.partitionCustom(<custom_partitioner1>, _.key)
.process(...)
.partitionCustom(<custom_partitioner2>, _.key)
.process(...)
....{code}
I see that only last partitioning operation (custom_partitioner2) is reflected in the DAG while the 1st one is ignored entirely.
I've also confirmed that the 1st partitioning wasn't applied at runtime from application logs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)