Is it better to Use Java or Python on Scala for Spark for using big data sets

[nancy henry <na...@gmail.com>]

Hi All,

Is it better to Use Java or Python on Scala for Spark coding..

Mainly My work is with getting file data which is in csv format  and I have
to do some rule checking and rule aggrgeation

and put the final filtered data back to oracle so that real time apps can
use it..

Re: Is it better to Use Java or Python on Scala for Spark for using big data sets

[Gourav Sengupta <go...@gmail.com>]

SPARK is  written in SCALA and that is why its so efficient and super fast.

If you are looking for efficiency, speed, and easily maintainable code
(where you do not have to write thousands of lines of code instead of a few
lines) please use Scala functional programming. I have seen horrible JAVA
morons who use Scala for OOPs and claim its nothing new please avoid them.

Regards,
Gourav

On Mon, Feb 13, 2017 at 5:57 PM, Spark User <sp...@gmail.com> wrote:

> Spark has more support for scala, by that I mean more APIs are available
> for scala compared to python or Java. Also scala code will be more concise
> and easy to read. Java is very verbose.
>
> On Thu, Feb 9, 2017 at 10:21 PM, Irving Duran <ir...@gmail.com>
> wrote:
>
>> I would say Java, since it will be somewhat similar to Scala.  Now, this
>> assumes that you have some app already written in Scala. If you don't, then
>> pick the language that you feel most comfortable with.
>>
>> Thank you,
>>
>> Irving Duran
>>
>> On Feb 9, 2017, at 11:59 PM, nancy henry <na...@gmail.com>
>> wrote:
>>
>> Hi All,
>>
>> Is it better to Use Java or Python on Scala for Spark coding..
>>
>> Mainly My work is with getting file data which is in csv format  and I
>> have to do some rule checking and rule aggrgeation
>>
>> and put the final filtered data back to oracle so that real time apps can
>> use it..
>>
>
>

Re: Is it better to Use Java or Python on Scala for Spark for using big data sets

[Spark User <sp...@gmail.com>]

Spark has more support for scala, by that I mean more APIs are available
for scala compared to python or Java. Also scala code will be more concise
and easy to read. Java is very verbose.

On Thu, Feb 9, 2017 at 10:21 PM, Irving Duran <ir...@gmail.com>
wrote:

> I would say Java, since it will be somewhat similar to Scala.  Now, this
> assumes that you have some app already written in Scala. If you don't, then
> pick the language that you feel most comfortable with.
>
> Thank you,
>
> Irving Duran
>
> On Feb 9, 2017, at 11:59 PM, nancy henry <na...@gmail.com> wrote:
>
> Hi All,
>
> Is it better to Use Java or Python on Scala for Spark coding..
>
> Mainly My work is with getting file data which is in csv format  and I
> have to do some rule checking and rule aggrgeation
>
> and put the final filtered data back to oracle so that real time apps can
> use it..
>

Re: Is it better to Use Java or Python on Scala for Spark for using big data sets

[Irving Duran <ir...@gmail.com>]

I would say Java, since it will be somewhat similar to Scala.  Now, this assumes that you have some app already written in Scala. If you don't, then pick the language that you feel most comfortable with.

Thank you,

Irving Duran

On Feb 9, 2017, at 11:59 PM, nancy henry <na...@gmail.com> wrote:

Hi All,

Is it better to Use Java or Python on Scala for Spark coding..

Mainly My work is with getting file data which is in csv format  and I have to do some rule checking and rule aggrgeation

and put the final filtered data back to oracle so that real time apps can use it..