You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Soheil Pourbafrani <so...@gmail.com> on 2018/11/03 17:41:56 UTC

Is there any Spark source in Java

Hi, I want to customize some part of Spark. I was wondering if there any
Spark source is written in Java language, or all the sources are in Scala
language?

Re: Is there any Spark source in Java

Posted by Soheil Pourbafrani <so...@gmail.com>.

Thanks,

I don't need sources for learning Spark.
I need some sources in Java language that I can implement new functions.
For example, Spark has HashTF and I want to customize that in such a way:

public static class newHashingTF implements Something<String>

On Sat, Nov 3, 2018 at 10:39 PM Chris Olivier <cj...@gmail.com> wrote:

> that’s a great link. thanks!
>
> On Sat, Nov 3, 2018 at 11:55 AM Jean Georges Perrin <jg...@jgp.net> wrote:
>
>> I would take this one very closely to my heart :)
>>
>> Look at:
>> https://github.com/jgperrin/net.jgp.labs.spark
>>
>> And if the examples are too weird, have a look at:
>> http://jgp.net/book published at Manning
>>
>> Feedback appreciated!
>>
>> jg
>>
>>
>> On Nov 3, 2018, at 12:30, Jeyhun Karimov <je...@gmail.com> wrote:
>>
>> Hi Soheil,
>>
>> From the spark github repo, you can find some classes implemented in Java:
>>
>> https://github.com/apache/spark/search?l=java
>>
>> Cheers,
>> Jeyhun
>>
>> On Sat, Nov 3, 2018 at 6:42 PM Soheil Pourbafrani <so...@gmail.com>
>> wrote:
>>
>>> Hi, I want to customize some part of Spark. I was wondering if there any
>>> Spark source is written in Java language, or all the sources are in Scala
>>> language?
>>>
>>

Re: Is there any Spark source in Java

Posted by Chris Olivier <cj...@gmail.com>.

that’s a great link. thanks!

On Sat, Nov 3, 2018 at 11:55 AM Jean Georges Perrin <jg...@jgp.net> wrote:

> I would take this one very closely to my heart :)
>
> Look at:
> https://github.com/jgperrin/net.jgp.labs.spark
>
> And if the examples are too weird, have a look at:
> http://jgp.net/book published at Manning
>
> Feedback appreciated!
>
> jg
>
>
> On Nov 3, 2018, at 12:30, Jeyhun Karimov <je...@gmail.com> wrote:
>
> Hi Soheil,
>
> From the spark github repo, you can find some classes implemented in Java:
>
> https://github.com/apache/spark/search?l=java
>
> Cheers,
> Jeyhun
>
> On Sat, Nov 3, 2018 at 6:42 PM Soheil Pourbafrani <so...@gmail.com>
> wrote:
>
>> Hi, I want to customize some part of Spark. I was wondering if there any
>> Spark source is written in Java language, or all the sources are in Scala
>> language?
>>
>

Re: Is there any Spark source in Java

Posted by Jean Georges Perrin <jg...@jgp.net>.

I would take this one very closely to my heart :) 

Look at:
https://github.com/jgperrin/net.jgp.labs.spark

And if the examples are too weird, have a look at:
http://jgp.net/book published at Manning 

Feedback appreciated!

jg


> On Nov 3, 2018, at 12:30, Jeyhun Karimov <je...@gmail.com> wrote:
> 
> Hi Soheil,
> 
> From the spark github repo, you can find some classes implemented in Java:
> 
> https://github.com/apache/spark/search?l=java
> 
> Cheers,
> Jeyhun
> 
>> On Sat, Nov 3, 2018 at 6:42 PM Soheil Pourbafrani <so...@gmail.com> wrote:
>> Hi, I want to customize some part of Spark. I was wondering if there any Spark source is written in Java language, or all the sources are in Scala language?

Re: Is there any Spark source in Java

Posted by Jeyhun Karimov <je...@gmail.com>.

Hi Soheil,

From the spark github repo, you can find some classes implemented in Java:

https://github.com/apache/spark/search?l=java

Cheers,
Jeyhun

On Sat, Nov 3, 2018 at 6:42 PM Soheil Pourbafrani <so...@gmail.com>
wrote:

> Hi, I want to customize some part of Spark. I was wondering if there any
> Spark source is written in Java language, or all the sources are in Scala
> language?
>

Re: Is there any Spark source in Java

Posted by Holden Karau <ho...@gmail.com>.

Parts of it are indeed written in Java. You probably want to reach out to
the developers list to talk about changing Spark.

On Sat, Nov 3, 2018, 11:42 AM Soheil Pourbafrani <soheil.ir08@gmail.com
wrote:

> Hi, I want to customize some part of Spark. I was wondering if there any
> Spark source is written in Java language, or all the sources are in Scala
> language?
>