You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Biao Liu (Jira)" <ji...@apache.org> on 2020/01/17 07:40:00 UTC

[jira] [Commented] (FLINK-15611) KafkaITCase.testOneToOneSources fails on Travis

    [ https://issues.apache.org/jira/browse/FLINK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017767#comment-17017767 ] 

Biao Liu commented on FLINK-15611:
----------------------------------

{quote}
...
Caused by: java.lang.Exception: Received a duplicate: 4924
	at org.apache.flink.streaming.connectors.kafka.testutils.ValidatingExactlyOnceSink.invoke(ValidatingExactlyOnceSink.java:57)
	at org.apache.flink.streaming.connectors.kafka.testutils.ValidatingExactlyOnceSink.invoke(ValidatingExactlyOnceSink.java:36)
	at org.apache.flink.streaming.api.functions.sink.SinkFunction.invoke(SinkFunction.java:52)
	at org.apache.flink.streaming.api.operators.StreamSink.processElement(StreamSink.java:56)
	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:170)
	at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.processElement(StreamTaskNetworkInput.java:151)
	at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.emitNext(StreamTaskNetworkInput.java:128)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:69)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:311)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:187)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:487)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:470)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:702)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:527)
	at java.lang.Thread.run(Thread.java:748)
{quote}

It looks like a serious issue. The exactly once semantics here seems to be broken.

> KafkaITCase.testOneToOneSources fails on Travis
> -----------------------------------------------
>
>                 Key: FLINK-15611
>                 URL: https://issues.apache.org/jira/browse/FLINK-15611
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Yangze Guo
>            Priority: Critical
>             Fix For: 1.10.0
>
>
> {{The test KafkaITCase.testOneToOneSources failed on Travis.}}
> {code:java}
> 03:15:02,019 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl  - Deleting topic scale-down-before-first-checkpoint
> 03:15:02,037 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase  - 
> --------------------------------------------------------------------------------
> Test testScaleDownBeforeFirstCheckpoint(org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase) successfully run.
> ================================================================================
> 03:15:02,038 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - -------------------------------------------------------------------------
> 03:15:02,038 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     -     Shut down KafkaTestBase 
> 03:15:02,038 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - -------------------------------------------------------------------------
> 03:15:25,728 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - -------------------------------------------------------------------------
> 03:15:25,728 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     -     KafkaTestBase finished
> 03:15:25,728 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - -------------------------------------------------------------------------
> 03:15:25.731 [INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 245.845 s - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase
> 03:15:26.099 [INFO] 
> 03:15:26.099 [INFO] Results:
> 03:15:26.099 [INFO] 
> 03:15:26.099 [ERROR] Failures: 
> 03:15:26.099 [ERROR]   KafkaITCase.testOneToOneSources:97->KafkaConsumerTestBase.runOneToOneExactlyOnceTest:862 Test failed: Job execution failed.
> {code}
> https://api.travis-ci.com/v3/job/276124537/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)