You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org> on 2017/07/28 15:23:00 UTC

[jira] [Closed] (FLINK-7287) test instability in Kafka010ITCase.testCommitOffsetsToKafka

     [ https://issues.apache.org/jira/browse/FLINK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tzu-Li (Gordon) Tai closed FLINK-7287.
--------------------------------------

> test instability in Kafka010ITCase.testCommitOffsetsToKafka
> -----------------------------------------------------------
>
>                 Key: FLINK-7287
>                 URL: https://issues.apache.org/jira/browse/FLINK-7287
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector, Tests
>    Affects Versions: 1.4.0
>            Reporter: Nico Kruber
>            Assignee: Nico Kruber
>              Labels: test-stability
>             Fix For: 1.4.0, 1.3.2
>
>
> sporadically, {{Kafka010ITCase.testCommitOffsetsToKafka}} seems to be failing, e.g. 
> {code}
> ================================================================================
> Test testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase) is running.
> --------------------------------------------------------------------------------
> 12:29:31,597 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - 
> ===================================
> == Writing sequence of 50 into testCommitOffsetsToKafkaTopic with p=3
> ===================================
> 12:29:31,597 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - Writing attempt #1
> 12:29:31,598 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl  - Creating topic testCommitOffsetsToKafkaTopic-1
> 12:29:31,598 INFO  org.I0Itec.zkclient.ZkEventThread                             - Starting ZkClient event thread.
> 12:29:31,599 INFO  org.I0Itec.zkclient.ZkClient                                  - Waiting for keeper state SyncConnected
> 12:29:31,601 INFO  org.I0Itec.zkclient.ZkClient                                  - zookeeper state changed (SyncConnected)
> 12:29:31,615 INFO  org.I0Itec.zkclient.ZkEventThread                             - Terminate ZkClient event thread.
> 12:29:31,719 INFO  org.I0Itec.zkclient.ZkEventThread                             - Starting ZkClient event thread.
> 12:29:31,722 INFO  org.I0Itec.zkclient.ZkClient                                  - Waiting for keeper state SyncConnected
> 12:29:31,728 INFO  org.I0Itec.zkclient.ZkClient                                  - zookeeper state changed (SyncConnected)
> 12:29:31,729 INFO  org.I0Itec.zkclient.ZkEventThread                             - Terminate ZkClient event thread.
> 12:29:31,832 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Starting FlinkKafkaProducer (3/3) to produce into default topic testCommitOffsetsToKafkaTopic-1
> 12:29:31,840 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Starting FlinkKafkaProducer (2/3) to produce into default topic testCommitOffsetsToKafkaTopic-1
> 12:29:31,842 WARN  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
> 12:29:31,844 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Starting FlinkKafkaProducer (1/3) to produce into default topic testCommitOffsetsToKafkaTopic-1
> 12:29:31,844 WARN  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
> 12:29:31,846 WARN  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
> 12:29:31,998 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - Finished writing sequence
> 12:29:31,998 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - Validating sequence
> 12:29:32,123 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
> 12:29:32,129 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
> 12:29:32,136 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
> 12:29:32,139 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}]
> 12:29:32,154 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 2 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}]
> 12:29:32,236 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 1 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}]
> 12:29:32,496 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
> 12:29:32,507 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
> 12:29:32,521 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
> 12:29:32,531 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 1 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}]
> 12:29:32,535 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 2 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}]
> 12:29:32,628 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}]
> 12:29:33,017 ERROR org.apache.flink.streaming.connectors.kafka.Kafka010ITCase    - 
> --------------------------------------------------------------------------------
> Test testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase) failed with:
> java.lang.RuntimeException: Job failed with an exception
> 	at org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runCommitOffsetsToKafka(KafkaConsumerTestBase.java:251)
> 	at org.apache.flink.streaming.connectors.kafka.Kafka010ITCase.testCommitOffsetsToKafka(Kafka010ITCase.java:162)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.flink.runtime.client.JobCancellationException: Job was cancelled.
> 	at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:921)
> 	at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873)
> 	at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873)
> 	at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
> 	at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
> 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40)
> 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
> 	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> 	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> 	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> 	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> {code}
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/258046274/log.txt?X-Amz-Expires=30&X-Amz-Date=20170727T155552Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJRYRXRSVGNKPKO5A/20170727/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=0b629a0c2b5daedc65c8aa8eb3293bc956f8fd61dc70066a051ed5878b004dbf



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)