You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2015/04/10 08:15:14 UTC

[jira] [Resolved] (SPARK-6211) Test Python Kafka API using Python unit tests

     [ https://issues.apache.org/jira/browse/SPARK-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tathagata Das resolved SPARK-6211.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 1.4.0

> Test Python Kafka API using Python unit tests
> ---------------------------------------------
>
>                 Key: SPARK-6211
>                 URL: https://issues.apache.org/jira/browse/SPARK-6211
>             Project: Spark
>          Issue Type: Test
>          Components: Streaming, Tests
>            Reporter: Tathagata Das
>            Assignee: Saisai Shao
>            Priority: Critical
>             Fix For: 1.4.0
>
>
> This is tricky in python because the KafkaStreamSuiteBase (which has the functionality of creating embedded kafka clusters) is in the test package, which is not in the python path. To fix that, we have to ways. 
> 1. Add test jar to classpath in python test. Thats kind of trickier.
> 2. Bring that into the src package (maybe renamed as KafkaTestUtils), and then wrap that in python to use it from python. 
> If (2) does not add any extra test dependencies to the main Kafka pom, then 2 should be simpler to do.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org