You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Abraham Jacob <ab...@gmail.com> on 2014/10/08 00:36:04 UTC

Spark / Kafka connector - CDH5 distribution

Hi All,

Does anyone know if CDH5.1.2 packages the spark streaming kafka connector
under the spark externals project?



-- 
~

Re: Spark / Kafka connector - CDH5 distribution

Posted by Abraham Jacob <ab...@gmail.com>.

Never mind... my bad... made a typo.

looks good.

Thanks,

On Tue, Oct 7, 2014 at 3:57 PM, Abraham Jacob <ab...@gmail.com> wrote:

> Thanks Sean,
>
> Sorry in my earlier question I meant to type CDH5.1.3 not CDH5.1.2
>
> I presume it's included in spark-streaming_2.10-1.0.0-cdh5.1.3
>
> But for some reason eclipse complains that import
> org.apache.spark.streaming.kafka cannon be resolved, even though I have
> included the spark-streaming_2.10-1.0.0-cdh5.1.3.jar file in the project.
>
> Where can I find it in the CDH5.1.3 spark distribution?
>
>
>
>
> On Tue, Oct 7, 2014 at 3:40 PM, Sean Owen <so...@cloudera.com> wrote:
>
>> Yes, it is the entire Spark distribution.
>> On Oct 7, 2014 11:36 PM, "Abraham Jacob" <ab...@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> Does anyone know if CDH5.1.2 packages the spark streaming kafka
>>> connector under the spark externals project?
>>>
>>>
>>>
>>> --
>>> ~
>>>
>>
>
>
> --
> ~
>



-- 
~

Re: Spark / Kafka connector - CDH5 distribution

Posted by Abraham Jacob <ab...@gmail.com>.

Thanks Sean,

Sorry in my earlier question I meant to type CDH5.1.3 not CDH5.1.2

I presume it's included in spark-streaming_2.10-1.0.0-cdh5.1.3

But for some reason eclipse complains that import
org.apache.spark.streaming.kafka cannon be resolved, even though I have
included the spark-streaming_2.10-1.0.0-cdh5.1.3.jar file in the project.

Where can I find it in the CDH5.1.3 spark distribution?

On Tue, Oct 7, 2014 at 3:40 PM, Sean Owen <so...@cloudera.com> wrote:

> Yes, it is the entire Spark distribution.
> On Oct 7, 2014 11:36 PM, "Abraham Jacob" <ab...@gmail.com> wrote:
>
>> Hi All,
>>
>> Does anyone know if CDH5.1.2 packages the spark streaming kafka connector
>> under the spark externals project?
>>
>>
>>
>> --
>> ~
>>
>

-- 
~

Re: Spark / Kafka connector - CDH5 distribution

Posted by Sean Owen <so...@cloudera.com>.

Yes, it is the entire Spark distribution.
On Oct 7, 2014 11:36 PM, "Abraham Jacob" <ab...@gmail.com> wrote:

> Hi All,
>
> Does anyone know if CDH5.1.2 packages the spark streaming kafka connector
> under the spark externals project?
>
>
>
> --
> ~
>