Spark version

[RD <rd...@gmail.com>]

Hi Iceberg devs,
   We are in process of upgrading our Spark version to support Iceberg. We
wanted to know if Iceberg, would in the near term move to Spark 2.4.3? If
that's the case, we will do the work once and migrate to Spark 2.4.3
instead of Spark 2.4.0.

-Best,

Re: Spark version

[Edgar Rodriguez <ed...@airbnb.com.INVALID>]

I've tested with 2.4.3 and current Iceberg master branch works, at least
last time I tested it.

Cheers,

On Thu, Aug 22, 2019 at 3:00 PM Ryan Blue <rb...@netflix.com.invalid> wrote:

> Iceberg should work with all of the 2.4.x releases. I don't think there
> have been any changes to the DSv2 API in patch releases.
>
> On Thu, Aug 22, 2019 at 2:51 PM RD <rd...@gmail.com> wrote:
>
>> Hi Iceberg devs,
>>    We are in process of upgrading our Spark version to support Iceberg.
>> We wanted to know if Iceberg, would in the near term move to Spark 2.4.3?
>> If that's the case, we will do the work once and migrate to Spark 2.4.3
>> instead of Spark 2.4.0.
>>
>> -Best,
>>
>>
>>
>
> --
> Ryan Blue
> Software Engineer
> Netflix
>


-- 
Edgar Rodriguez

Re: Spark version

[Ryan Blue <rb...@netflix.com.INVALID>]

Iceberg should work with all of the 2.4.x releases. I don't think there
have been any changes to the DSv2 API in patch releases.

On Thu, Aug 22, 2019 at 2:51 PM RD <rd...@gmail.com> wrote:

> Hi Iceberg devs,
>    We are in process of upgrading our Spark version to support Iceberg. We
> wanted to know if Iceberg, would in the near term move to Spark 2.4.3? If
> that's the case, we will do the work once and migrate to Spark 2.4.3
> instead of Spark 2.4.0.
>
> -Best,
>
>
>

-- 
Ryan Blue
Software Engineer
Netflix