You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/06/19 12:59:00 UTC

[jira] [Updated] (SPARK-7761) Flaky PySpark test: test_kafka_stream

     [ https://issues.apache.org/jira/browse/SPARK-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-7761:
-----------------------------
    Target Version/s: 1.5.0  (was: 1.4.0)

> Flaky PySpark test: test_kafka_stream
> -------------------------------------
>
>                 Key: SPARK-7761
>                 URL: https://issues.apache.org/jira/browse/SPARK-7761
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark, Streaming
>    Affects Versions: 1.4.0
>            Reporter: Xiangrui Meng
>            Assignee: Tathagata Das
>            Priority: Critical
>
> Saw this test failure in https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33137/console:
> {code}
> Testing with PyPy version:
> Python 2.7.9 (9c4588d731b7fe0b08669bd732c2b676cb0a8233, Apr 09 2015, 02:17:39)
> [PyPy 2.5.1 with GCC 4.4.7 20120313 (Red Hat 4.4.7-11)]
> Run core tests ...
> Running test: pyspark/rdd.py ... ok (32s)
> Running test: pyspark/context.py ... ok (18s)
> Running test: pyspark/conf.py ... ok (4s)
> Running test: pyspark/broadcast.py ... ok (5s)
> Running test: pyspark/accumulators.py ... ok (9s)
> Running test: pyspark/serializers.py ... ok (12s)
> Running test: pyspark/profiler.py ... ok (10s)
> Running test: pyspark/shuffle.py ... ok (1s)
> Running test: pyspark/tests.py ... ok (143s)
> Run sql tests ...
> Running test: pyspark/sql/_types.py ... ok (6s)
> Running test: pyspark/sql/context.py ... ok (20s)
> Running test: pyspark/sql/column.py ... ok (10s)
> Running test: pyspark/sql/dataframe.py ... ok (24s)
> Running test: pyspark/sql/group.py ... ok (12s)
> Running test: pyspark/sql/functions.py ... ok (13s)
> Running test: pyspark/sql/tests.py ... ok (91s)
> Run streaming tests ...
> Running test: pyspark/streaming/util.py ... ok (1s)
> Running test: pyspark/streaming/tests.py ... ..........................E.............
> ======================================================================
> ERROR: test_kafka_stream (__main__.KafkaStreamTests)
> Test the Python Kafka stream API.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File "pyspark/streaming/tests.py", line 585, in setUp
>     self._kafkaTestUtils.setup()
>   File "/home/jenkins/workspace/SparkPullRequestBuilder/python/lib/py4j-0.8.2.1-src.zip/py4j/java_gateway.py", line 538, in __call__
>     self.target_id, self.name)
>   File "/home/jenkins/workspace/SparkPullRequestBuilder/python/lib/py4j-0.8.2.1-src.zip/py4j/protocol.py", line 300, in get_return_value
>     format(target_id, '.', name), value)
> Py4JJavaError: An error occurred while calling o5816.setup.
> : org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 6000
> 	at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880)
> 	at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98)
> 	at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84)
> 	at org.apache.spark.streaming.kafka.KafkaTestUtils.setupEmbeddedZookeeper(KafkaTestUtils.scala:100)
> 	at org.apache.spark.streaming.kafka.KafkaTestUtils.setup(KafkaTestUtils.scala:123)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:231)
> 	at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:379)
> 	at py4j.Gateway.invoke(Gateway.java:259)
> 	at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
> 	at py4j.commands.CallCommand.execute(CallCommand.java:79)
> 	at py4j.GatewayConnection.run(GatewayConnection.java:207)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org