Moving to Spark 3x from Spark2

[rajat kumar <ku...@gmail.com>]

Hello Members,

We want to move to Spark 3 from Spark2.4 .

Are there any changes we need to do at code level which can break the
existing code?

Will it work by simply changing the version of spark & scala ?

Regards
Rajat

Re: Moving to Spark 3x from Spark2

[Martin Andersson <ma...@kambi.com>]

You should check the release notes and upgrade instructions.
________________________________
From: rajat kumar <ku...@gmail.com>
Sent: Thursday, September 1, 2022 12:44
To: user @spark <us...@spark.apache.org>
Subject: Moving to Spark 3x from Spark2


EXTERNAL SENDER. Do not click links or open attachments unless you recognize the sender and know the content is safe. DO NOT provide your username or password.


Hello Members,

We want to move to Spark 3 from Spark2.4 .

Are there any changes we need to do at code level which can break the existing code?

Will it work by simply changing the version of spark & scala ?

Regards
Rajat

Re: Moving to Spark 3x from Spark2

[Khalid Mammadov <kh...@gmail.com>]

Hi Rajat

There were a lot of changes between those versions and the only possible
option to assess impact to do your testings unfortunately.

Most probably you will have to do some changes to your codebase.

Regards
Khalid


On Thu, 1 Sept 2022, 11:45 rajat kumar, <ku...@gmail.com> wrote:

> Hello Members,
>
> We want to move to Spark 3 from Spark2.4 .
>
> Are there any changes we need to do at code level which can break the
> existing code?
>
> Will it work by simply changing the version of spark & scala ?
>
> Regards
> Rajat
>