You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Alexey Trenikhin (Jira)" <ji...@apache.org> on 2020/02/20 15:55:00 UTC
[jira] [Reopened] (FLINK-12410) KafkaTopicPartition cannot be used
as a POJO type because not all fields are valid POJO fields
[ https://issues.apache.org/jira/browse/FLINK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Trenikhin reopened FLINK-12410:
--------------------------------------
The original reporter did not serialize KafkaTopicPartiton, it is Flink Kafka connector - FlinkKafkaConsumerBase#initializeState:
{code:java}
this.unionOffsetStates = stateStore.getUnionListState(new ListStateDescriptor("topic-partition-offset-states", TypeInformation.of(new TypeHint<Tuple2<KafkaTopicPartition, Long>>() {
})));
{code}
> KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields
> ----------------------------------------------------------------------------------------------
>
> Key: FLINK-12410
> URL: https://issues.apache.org/jira/browse/FLINK-12410
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.8.0
> Reporter: Chethan UK
> Priority: Minor
>
> While Pushing data to Kafka Topic using Pojo, there is an error: "INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType"
> {code:java}
> // code placeholder
> 09:18:27,633 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition does not contain a setter for field topic
> 09:18:27,634 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,633 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition does not contain a setter for field topic
> 09:18:27,635 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,635 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition does not contain a setter for field topic
> 09:18:27,636 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,639 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition does not contain a setter for field topic
> 09:18:27,642 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,654 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer.
> 09:18:27,655 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer.
> 09:18:27,655 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer.
> 09:18:27,654 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer.
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)