[GitHub] [flink] XComp removed a comment on pull request #17152: [FLINK-24131][datastream/kafka] Reliably shutdown producer

[GitBox <gi...@apache.org>]

XComp removed a comment on pull request #17152:
URL: https://github.com/apache/flink/pull/17152#issuecomment-913540963


   A second run on the same cluster with more data caused the following Exceptions:
   ```
   org.apache.flink.kafka.shaded.org.apache.kafka.common.KafkaException: Cannot perform send because at least one previous transactional or idempotent request has failed with errors.
   	at org.apache.flink.kafka.shaded.org.apache.kafka.clients.producer.internals.TransactionManager.failIfNotReadyForSend(TransactionManager.java:356)
   	at org.apache.flink.kafka.shaded.org.apache.kafka.clients.producer.KafkaProducer.doSend(KafkaProducer.java:926)
   	at org.apache.flink.kafka.shaded.org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:865)
   	at org.apache.flink.connector.kafka.sink.KafkaWriter.write(KafkaWriter.java:184)
   	at org.apache.flink.streaming.runtime.operators.sink.SinkOperator.processElement(SinkOperator.java:166)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
   	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
   	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
   	at org.apache.flink.streaming.api.operators.StreamFilter.processElement(StreamFilter.java:39)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
   	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
   	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
   	at StreamExecCalc$6.processElement(Unknown Source)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57)
   	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
   	at org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask$AsyncDataOutputToOutput.emitRecord(SourceOperatorStreamTask.java:196)
   	at org.apache.flink.streaming.api.operators.source.SourceOutputWithWatermarks.collect(SourceOutputWithWatermarks.java:110)
   	at org.apache.flink.connector.kafka.source.reader.KafkaRecordEmitter.emitRecord(KafkaRecordEmitter.java:36)
   	at org.apache.flink.connector.kafka.source.reader.KafkaRecordEmitter.emitRecord(KafkaRecordEmitter.java:27)
   	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:141)
   	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:341)
   	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
   	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
   	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:490)
   	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203)
   	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:789)
   	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:741)
   	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
   	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
   	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766)
   	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575)
   	at java.lang.Thread.run(Thread.java:748)
   Caused by: org.apache.flink.kafka.shaded.org.apache.kafka.common.InvalidRecordException: This record has failed the validation on broker and hence be rejected.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org