You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Seth Wiesman (Jira)" <ji...@apache.org> on 2020/02/20 19:59:00 UTC
[jira] [Commented] (FLINK-16193) Improve error messaging when a key
is assigned to the wrong key group range
[ https://issues.apache.org/jira/browse/FLINK-16193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041272#comment-17041272 ]
Seth Wiesman commented on FLINK-16193:
--------------------------------------
[~aljoscha]
This is tricky because key group ranges are not validated in one place but all over the codebase, at low-level places around the state backends. I _think_ we could simply include a check at AbstractStreamOperator#setKeyContextElement and throw an exception there. This seems safe to me but I want to double check.
> Improve error messaging when a key is assigned to the wrong key group range
> ---------------------------------------------------------------------------
>
> Key: FLINK-16193
> URL: https://issues.apache.org/jira/browse/FLINK-16193
> Project: Flink
> Issue Type: Improvement
> Components: API / DataStream
> Affects Versions: 1.11.0
> Reporter: Seth Wiesman
> Priority: Major
>
> Occasionally, users may run into an exception that reads something like:
>
> java.lang.IllegalArgumentException: Key group 45 is not in KeyGroupRange{startKeyGroup=0, endKeyGroup=42}
>
> This may be caused by a number of issues including:
> 1) Unstable hash and equals methods on their key objects
> 2) Improper use of DataStreamUtils#reinterpretAsKeyedStream
>
> Key group ranges are a fairly low level detail that most users will be unfamiliar with when working with Flink. We should offer more comprehensive error messaging that outlines likely causes and solutions.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)