You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Ashish Walia (JIRA)" <ji...@apache.org> on 2016/09/30 19:52:20 UTC
[jira] [Created] (FLINK-4721) Getting exception when using a key of
type Option[String] in distinct operation
Ashish Walia created FLINK-4721:
-----------------------------------
Summary: Getting exception when using a key of type Option[String] in distinct operation
Key: FLINK-4721
URL: https://issues.apache.org/jira/browse/FLINK-4721
Project: Flink
Issue Type: Bug
Affects Versions: 1.1.2
Reporter: Ashish Walia
Priority: Minor
Selecting distinct records from the input dataset where one of the keys is Option[String] and it's value being None most of the times is leading to this exception :-
Exception in thread "main" java.lang.RuntimeException: Comparator org.apache.flink.api.scala.typeutils.OptionTypeComparator specifies an invalid length for the normalized key: -2147483648
at org.apache.flink.api.java.typeutils.runtime.PojoComparator.<init>(PojoComparator.java:95)
at org.apache.flink.api.java.typeutils.PojoTypeInfo$PojoTypeComparatorBuilder.createTypeComparator(PojoTypeInfo.java:400)
at org.apache.flink.api.common.typeutils.CompositeType.createComparator(CompositeType.java:167)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.createComparator(JavaApiPostPass.java:293)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.traverse(JavaApiPostPass.java:169)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.traverseChannel(JavaApiPostPass.java:267)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.traverse(JavaApiPostPass.java:173)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.traverseChannel(JavaApiPostPass.java:267)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.traverse(JavaApiPostPass.java:97)
at org.apache.flink.optimizer.postpass.JavaApiPostPass.postPass(JavaApiPostPass.java:81)
at org.apache.flink.optimizer.Optimizer.compile(Optimizer.java:521)
at org.apache.flink.optimizer.Optimizer.compile(Optimizer.java:398)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:185)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:91)
at org.apache.flink.api.scala.ExecutionEnvironment.execute(ExecutionEnvironment.scala:651)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)