You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by Vinoth Chandar <vi...@apache.org> on 2019/09/09 23:16:28 UTC
Dropping support for Spark 2.2 and lower
Hello all,
I am trying to gauge what spark version everyone is on. We would like to
move the spark version to 2.4 and simplify a whole bunch of stuff. Any
objections? As a best effort, we can try to make 2.3 work reliably. Any
objections?
Note that if you are using the RDD based hudi-client primarily, this should
not affect you per se.
Thanks
Vinoth
Re: Dropping support for Spark 2.2 and lower
Posted by vino yang <ya...@gmail.com>.
+1
Vinoth Chandar <vi...@apache.org> 于2019年9月10日周二 上午7:16写道：
> Hello all,
>
> I am trying to gauge what spark version everyone is on. We would like to
> move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> objections? As a best effort, we can try to make 2.3 work reliably. Any
> objections?
>
> Note that if you are using the RDD based hudi-client primarily, this should
> not affect you per se.
>
> Thanks
> Vinoth
>
Re: Dropping support for Spark 2.2 and lower
Posted by Bhavani Sudha Saktheeswaran <bh...@uber.com.INVALID>.
+1 will be very useful.
On Tue, Sep 10, 2019 at 10:30 AM Kim Hammar <ki...@logicalclocks.com> wrote:
> +1, we are on Spark 2.4
>
> On Tue, Sep 10, 2019 at 6:49 PM Shiyan Xu <xu...@gmail.com>
> wrote:
>
> > +1
> >
> > On Tue, Sep 10, 2019 at 7:16 AM Vinoth Chandar <vi...@apache.org>
> wrote:
> >
> > > Hello all,
> > >
> > > I am trying to gauge what spark version everyone is on. We would like
> to
> > > move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> > > objections? As a best effort, we can try to make 2.3 work reliably. Any
> > > objections?
> > >
> > > Note that if you are using the RDD based hudi-client primarily, this
> > should
> > > not affect you per se.
> > >
> > > Thanks
> > > Vinoth
> > >
> >
>
Re: Dropping support for Spark 2.2 and lower
Posted by Kim Hammar <ki...@logicalclocks.com>.
+1, we are on Spark 2.4
On Tue, Sep 10, 2019 at 6:49 PM Shiyan Xu <xu...@gmail.com>
wrote:
> +1
>
> On Tue, Sep 10, 2019 at 7:16 AM Vinoth Chandar <vi...@apache.org> wrote:
>
> > Hello all,
> >
> > I am trying to gauge what spark version everyone is on. We would like to
> > move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> > objections? As a best effort, we can try to make 2.3 work reliably. Any
> > objections?
> >
> > Note that if you are using the RDD based hudi-client primarily, this
> should
> > not affect you per se.
> >
> > Thanks
> > Vinoth
> >
>
Re: Dropping support for Spark 2.2 and lower
Posted by Shiyan Xu <xu...@gmail.com>.
+1
On Tue, Sep 10, 2019 at 7:16 AM Vinoth Chandar <vi...@apache.org> wrote:
> Hello all,
>
> I am trying to gauge what spark version everyone is on. We would like to
> move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> objections? As a best effort, we can try to make 2.3 work reliably. Any
> objections?
>
> Note that if you are using the RDD based hudi-client primarily, this should
> not affect you per se.
>
> Thanks
> Vinoth
>
Re: Dropping support for Spark 2.2 and lower
Posted by "vbalaji@apache.org" <vb...@apache.org>.
+1 Would be super useful.
Balaji.V
On Tuesday, September 10, 2019, 04:22:53 AM PDT, taher koitawala <ta...@gmail.com> wrote:
+1 we can drop that
On Tue, Sep 10, 2019 at 4:45 PM Kabeer Ahmed <ka...@linuxmail.org> wrote:
> +1.
>
> I am on spark 2.3 but would love to move to Spark 2.4.
> On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org> wrote:
> > Hello all,
> >
> > I am trying to gauge what spark version everyone is on. We would like to
> > move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> > objections? As a best effort, we can try to make 2.3 work reliably. Any
> > objections?
> >
> > Note that if you are using the RDD based hudi-client primarily, this
> should
> > not affect you per se.
> >
> > Thanks
> > Vinoth
> >
>
>
Re: Dropping support for Spark 2.2 and lower
Posted by Vinoth Chandar <vi...@apache.org>.
Oh wow.. This is like the most popular vote by a long shot. :)
Will move forward. Thanks all!
On Tue, Sep 10, 2019 at 3:16 PM leesf <le...@gmail.com> wrote:
> +1
>
> Y. Ethan Guo <gu...@uber.com.invalid> 于2019年9月11日周三 上午3:06写道：
>
> > +1 we’re on Spark 2.4.
> >
> > On Tue, Sep 10, 2019 at 11:22 AM Minh Pham <mi...@cloudkitchens.com>
> wrote:
> >
> > > +1 we are also on 2.3 and want to move to 2.4
> > >
> > > Sent from my iPhone
> > >
> > > > On Sep 10, 2019, at 4:22 AM, taher koitawala <ta...@gmail.com>
> > wrote:
> > > >
> > > > +1 we can drop that
> > > >
> > > >> On Tue, Sep 10, 2019 at 4:45 PM Kabeer Ahmed <ka...@linuxmail.org>
> > > wrote:
> > > >>
> > > >> +1.
> > > >>
> > > >> I am on spark 2.3 but would love to move to Spark 2.4.
> > > >>> On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org>
> > wrote:
> > > >>> Hello all,
> > > >>>
> > > >>> I am trying to gauge what spark version everyone is on. We would
> like
> > > to
> > > >>> move the spark version to 2.4 and simplify a whole bunch of stuff.
> > Any
> > > >>> objections? As a best effort, we can try to make 2.3 work reliably.
> > Any
> > > >>> objections?
> > > >>>
> > > >>> Note that if you are using the RDD based hudi-client primarily,
> this
> > > >> should
> > > >>> not affect you per se.
> > > >>>
> > > >>> Thanks
> > > >>> Vinoth
> > > >>>
> > > >>
> > > >>
> > >
> >
>
Re: Dropping support for Spark 2.2 and lower
Posted by leesf <le...@gmail.com>.
+1
Y. Ethan Guo <gu...@uber.com.invalid> 于2019年9月11日周三 上午3:06写道：
> +1 we’re on Spark 2.4.
>
> On Tue, Sep 10, 2019 at 11:22 AM Minh Pham <mi...@cloudkitchens.com> wrote:
>
> > +1 we are also on 2.3 and want to move to 2.4
> >
> > Sent from my iPhone
> >
> > > On Sep 10, 2019, at 4:22 AM, taher koitawala <ta...@gmail.com>
> wrote:
> > >
> > > +1 we can drop that
> > >
> > >> On Tue, Sep 10, 2019 at 4:45 PM Kabeer Ahmed <ka...@linuxmail.org>
> > wrote:
> > >>
> > >> +1.
> > >>
> > >> I am on spark 2.3 but would love to move to Spark 2.4.
> > >>> On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org>
> wrote:
> > >>> Hello all,
> > >>>
> > >>> I am trying to gauge what spark version everyone is on. We would like
> > to
> > >>> move the spark version to 2.4 and simplify a whole bunch of stuff.
> Any
> > >>> objections? As a best effort, we can try to make 2.3 work reliably.
> Any
> > >>> objections?
> > >>>
> > >>> Note that if you are using the RDD based hudi-client primarily, this
> > >> should
> > >>> not affect you per se.
> > >>>
> > >>> Thanks
> > >>> Vinoth
> > >>>
> > >>
> > >>
> >
>
Re: Dropping support for Spark 2.2 and lower
Posted by "Y. Ethan Guo" <gu...@uber.com.INVALID>.
+1 we’re on Spark 2.4.
On Tue, Sep 10, 2019 at 11:22 AM Minh Pham <mi...@cloudkitchens.com> wrote:
> +1 we are also on 2.3 and want to move to 2.4
>
> Sent from my iPhone
>
> > On Sep 10, 2019, at 4:22 AM, taher koitawala <ta...@gmail.com> wrote:
> >
> > +1 we can drop that
> >
> >> On Tue, Sep 10, 2019 at 4:45 PM Kabeer Ahmed <ka...@linuxmail.org>
> wrote:
> >>
> >> +1.
> >>
> >> I am on spark 2.3 but would love to move to Spark 2.4.
> >>> On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org> wrote:
> >>> Hello all,
> >>>
> >>> I am trying to gauge what spark version everyone is on. We would like
> to
> >>> move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> >>> objections? As a best effort, we can try to make 2.3 work reliably. Any
> >>> objections?
> >>>
> >>> Note that if you are using the RDD based hudi-client primarily, this
> >> should
> >>> not affect you per se.
> >>>
> >>> Thanks
> >>> Vinoth
> >>>
> >>
> >>
>
Re: Dropping support for Spark 2.2 and lower
Posted by Minh Pham <mi...@cloudkitchens.com>.
+1 we are also on 2.3 and want to move to 2.4
Sent from my iPhone
> On Sep 10, 2019, at 4:22 AM, taher koitawala <ta...@gmail.com> wrote:
>
> +1 we can drop that
>
>> On Tue, Sep 10, 2019 at 4:45 PM Kabeer Ahmed <ka...@linuxmail.org> wrote:
>>
>> +1.
>>
>> I am on spark 2.3 but would love to move to Spark 2.4.
>>> On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org> wrote:
>>> Hello all,
>>>
>>> I am trying to gauge what spark version everyone is on. We would like to
>>> move the spark version to 2.4 and simplify a whole bunch of stuff. Any
>>> objections? As a best effort, we can try to make 2.3 work reliably. Any
>>> objections?
>>>
>>> Note that if you are using the RDD based hudi-client primarily, this
>> should
>>> not affect you per se.
>>>
>>> Thanks
>>> Vinoth
>>>
>>
>>
Re: Dropping support for Spark 2.2 and lower
Posted by taher koitawala <ta...@gmail.com>.
+1 we can drop that
On Tue, Sep 10, 2019 at 4:45 PM Kabeer Ahmed <ka...@linuxmail.org> wrote:
> +1.
>
> I am on spark 2.3 but would love to move to Spark 2.4.
> On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org> wrote:
> > Hello all,
> >
> > I am trying to gauge what spark version everyone is on. We would like to
> > move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> > objections? As a best effort, we can try to make 2.3 work reliably. Any
> > objections?
> >
> > Note that if you are using the RDD based hudi-client primarily, this
> should
> > not affect you per se.
> >
> > Thanks
> > Vinoth
> >
>
>
Re: Dropping support for Spark 2.2 and lower
Posted by Kabeer Ahmed <ka...@linuxmail.org>.
+1.
I am on spark 2.3 but would love to move to Spark 2.4.
On Sep 10 2019, at 12:16 am, Vinoth Chandar <vi...@apache.org> wrote:
> Hello all,
>
> I am trying to gauge what spark version everyone is on. We would like to
> move the spark version to 2.4 and simplify a whole bunch of stuff. Any
> objections? As a best effort, we can try to make 2.3 work reliably. Any
> objections?
>
> Note that if you are using the RDD based hudi-client primarily, this should
> not affect you per se.
>
> Thanks
> Vinoth
>