You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Sean Owen <sr...@apache.org> on 2019/08/22 01:46:11 UTC
Unmarking most things as experimental, evolving for 3.0?
There are currently about 130 things marked as 'experimental' in
Spark, and some have been around since Spark 1.x. A few may be
legitimately still experimental (e.g. barrier mode), but, would it be
safe to say most of these annotations should be removed for 3.0?
What's the theory for evolving vs experimental -- would almost all of
these items from, say, 2.3 and before be considered stable now, de
facto? Meaning, if we wouldn't take a breaking change for them after
3.0, seems like they're stable.
I can open a PR that removes most of it and see if anything looks
wrong, if that's an easy way forward.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Unmarking most things as experimental, evolving for 3.0?
Posted by Sean Owen <sr...@apache.org>.
Proposal at https://github.com/apache/spark/pull/25558
On Thu, Aug 22, 2019 at 2:33 AM Marco Gaido <ma...@gmail.com> wrote:
>
> Thanks for bringing this out Sean.
> +1 from me as well!
>
> Thanks,
> Marco
>
> Il giorno gio 22 ago 2019 alle ore 08:21 Dongjoon Hyun <do...@gmail.com> ha scritto:
>>
>> +1 for unmarking old ones (made in `2.3.x` and before).
>> Thank you, Sean.
>>
>> Bests,
>> Dongjoon.
>>
>> On Wed, Aug 21, 2019 at 6:46 PM Sean Owen <sr...@apache.org> wrote:
>>>
>>> There are currently about 130 things marked as 'experimental' in
>>> Spark, and some have been around since Spark 1.x. A few may be
>>> legitimately still experimental (e.g. barrier mode), but, would it be
>>> safe to say most of these annotations should be removed for 3.0?
>>>
>>> What's the theory for evolving vs experimental -- would almost all of
>>> these items from, say, 2.3 and before be considered stable now, de
>>> facto? Meaning, if we wouldn't take a breaking change for them after
>>> 3.0, seems like they're stable.
>>>
>>> I can open a PR that removes most of it and see if anything looks
>>> wrong, if that's an easy way forward.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>>
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Unmarking most things as experimental, evolving for 3.0?
Posted by Marco Gaido <ma...@gmail.com>.
Thanks for bringing this out Sean.
+1 from me as well!
Thanks,
Marco
Il giorno gio 22 ago 2019 alle ore 08:21 Dongjoon Hyun <
dongjoon.hyun@gmail.com> ha scritto:
> +1 for unmarking old ones (made in `2.3.x` and before).
> Thank you, Sean.
>
> Bests,
> Dongjoon.
>
> On Wed, Aug 21, 2019 at 6:46 PM Sean Owen <sr...@apache.org> wrote:
>
>> There are currently about 130 things marked as 'experimental' in
>> Spark, and some have been around since Spark 1.x. A few may be
>> legitimately still experimental (e.g. barrier mode), but, would it be
>> safe to say most of these annotations should be removed for 3.0?
>>
>> What's the theory for evolving vs experimental -- would almost all of
>> these items from, say, 2.3 and before be considered stable now, de
>> facto? Meaning, if we wouldn't take a breaking change for them after
>> 3.0, seems like they're stable.
>>
>> I can open a PR that removes most of it and see if anything looks
>> wrong, if that's an easy way forward.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>
>>
Re: Unmarking most things as experimental, evolving for 3.0?
Posted by Dongjoon Hyun <do...@gmail.com>.
+1 for unmarking old ones (made in `2.3.x` and before).
Thank you, Sean.
Bests,
Dongjoon.
On Wed, Aug 21, 2019 at 6:46 PM Sean Owen <sr...@apache.org> wrote:
> There are currently about 130 things marked as 'experimental' in
> Spark, and some have been around since Spark 1.x. A few may be
> legitimately still experimental (e.g. barrier mode), but, would it be
> safe to say most of these annotations should be removed for 3.0?
>
> What's the theory for evolving vs experimental -- would almost all of
> these items from, say, 2.3 and before be considered stable now, de
> facto? Meaning, if we wouldn't take a breaking change for them after
> 3.0, seems like they're stable.
>
> I can open a PR that removes most of it and see if anything looks
> wrong, if that's an easy way forward.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>