You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Dongjoon Hyun <do...@apache.org> on 2016/11/27 20:49:29 UTC
Two major versions?
Hi, All.
Do we have a release plan of Apache Spark 1.6.4?
Up to my knowledge, Apache Spark community has been focusing on latest two versions.
There was no official release of Apache Spark *X.X.4* so far. It's also well-documented on Apache Spark home page (Versioning policy; http://spark.apache.org/versioning-policy.html)
> A minor release usually sees 1-2 maintenance releases in the 6 months following its first release.
So, personally, I don't expect Apache Spark 1.6.4. After Apache Spark 2.1 will be released very soon, 2.1 and 2.0 will be the two major versions which the most community effort is going to focus on.
However, *literally*, two major versions of Apache Spark will be Apache Spark 1.X (1.6.3) and Apache Spark 2.X. Since there is API compatibility issues between major versions, I guess 1.6.X will survive for a while like JDK7.
If possible, could we have a clear statement whether there is a plan for 1.6.4 on homepage?
Bests,
Dongjoon.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Two major versions?
Posted by Dongjoon Hyun <do...@apache.org>.
Thank you, Sean.
Now, I agree with you that it's too rare to do something for Apache Spark
major versions.
Bests,
Dongjoon
On Mon, Nov 28, 2016 at 04:17 Sean Owen <so...@cloudera.com> wrote:
> Yeah, there's no official position on this. BTW see the new home of what
> info is published on this topic:
> http://spark.apache.org/versioning-policy.html
>
> The answer is indeed that minor releases have a target cadence, but
> maintenance releases are as-needed, as defined by the release manager's
> judgment.
>
> From
> https://issues.apache.org/jira/browse/SPARK/?selectedTab=com.atlassian.jira.jira-projects-plugin:versions-panel you
> can see that maintenance releases for a minor release seem to continue for
> 3-6 months in general, with 1.6.x going on for a longer period as the last
> 1.x minor release.
>
> I wouldn't mind putting down some text to set a non-binding expectation
> around this, that minor releases might be 'supported' for 3-6 months? until
> 2 more minor releases have succeeded it? Because in practice that's very
> much how back-ports behave.
>
> We also don't say anything about major releases but I think that may also
> be too rare to put even informal statements around. Every couple years?
>
> On Sun, Nov 27, 2016 at 8:49 PM Dongjoon Hyun <do...@apache.org> wrote:
>
> Hi, All.
>
> Do we have a release plan of Apache Spark 1.6.4?
>
> Up to my knowledge, Apache Spark community has been focusing on latest two
> versions.
> There was no official release of Apache Spark *X.X.4* so far. It's also
> well-documented on Apache Spark home page (Versioning policy;
> http://spark.apache.org/versioning-policy.html)
>
> > A minor release usually sees 1-2 maintenance releases in the 6 months
> following its first release.
>
> So, personally, I don't expect Apache Spark 1.6.4. After Apache Spark 2.1
> will be released very soon, 2.1 and 2.0 will be the two major versions
> which the most community effort is going to focus on.
>
> However, *literally*, two major versions of Apache Spark will be Apache
> Spark 1.X (1.6.3) and Apache Spark 2.X. Since there is API compatibility
> issues between major versions, I guess 1.6.X will survive for a while like
> JDK7.
>
> If possible, could we have a clear statement whether there is a plan for
> 1.6.4 on homepage?
>
> Bests,
> Dongjoon.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
Re: Two major versions?
Posted by Sean Owen <so...@cloudera.com>.
Yeah, there's no official position on this. BTW see the new home of what
info is published on this topic:
http://spark.apache.org/versioning-policy.html
The answer is indeed that minor releases have a target cadence, but
maintenance releases are as-needed, as defined by the release manager's
judgment.
From
https://issues.apache.org/jira/browse/SPARK/?selectedTab=com.atlassian.jira.jira-projects-plugin:versions-panel
you
can see that maintenance releases for a minor release seem to continue for
3-6 months in general, with 1.6.x going on for a longer period as the last
1.x minor release.
I wouldn't mind putting down some text to set a non-binding expectation
around this, that minor releases might be 'supported' for 3-6 months? until
2 more minor releases have succeeded it? Because in practice that's very
much how back-ports behave.
We also don't say anything about major releases but I think that may also
be too rare to put even informal statements around. Every couple years?
On Sun, Nov 27, 2016 at 8:49 PM Dongjoon Hyun <do...@apache.org> wrote:
> Hi, All.
>
> Do we have a release plan of Apache Spark 1.6.4?
>
> Up to my knowledge, Apache Spark community has been focusing on latest two
> versions.
> There was no official release of Apache Spark *X.X.4* so far. It's also
> well-documented on Apache Spark home page (Versioning policy;
> http://spark.apache.org/versioning-policy.html)
>
> > A minor release usually sees 1-2 maintenance releases in the 6 months
> following its first release.
>
> So, personally, I don't expect Apache Spark 1.6.4. After Apache Spark 2.1
> will be released very soon, 2.1 and 2.0 will be the two major versions
> which the most community effort is going to focus on.
>
> However, *literally*, two major versions of Apache Spark will be Apache
> Spark 1.X (1.6.3) and Apache Spark 2.X. Since there is API compatibility
> issues between major versions, I guess 1.6.X will survive for a while like
> JDK7.
>
> If possible, could we have a clear statement whether there is a plan for
> 1.6.4 on homepage?
>
> Bests,
> Dongjoon.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
Re: Two major versions?
Posted by Dongjoon Hyun <do...@apache.org>.
Thank you, Reynold. Clear enough as a backporting and as a new release criteria.
Yes. Definitely. If there is no new commit on `branch-1.6`, there is no need to release.
However, Apache Spark 1.6.3 was a single release *accumulating* those kind of 52 patches.
Given that `branch-1.5` has over 100 patches and we don't expect `1.5.3`, `branch-1.6` looks to me extraordinary as the last emperor of Apache Spark 1.X.
Bests,
Dongjoon.
On 2016-11-27 12:50 (-0800), Reynold Xin <rx...@databricks.com> wrote:
> I think this highly depends on what issues are found, e.g. critical bugs
> that impact wide use cases, or security bugs.
>
>
> On Sun, Nov 27, 2016 at 12:49 PM, Dongjoon Hyun <do...@apache.org> wrote:
>
> > Hi, All.
> >
> > Do we have a release plan of Apache Spark 1.6.4?
> >
> > Up to my knowledge, Apache Spark community has been focusing on latest two
> > versions.
> > There was no official release of Apache Spark *X.X.4* so far. It's also
> > well-documented on Apache Spark home page (Versioning policy;
> > http://spark.apache.org/versioning-policy.html)
> >
> > > A minor release usually sees 1-2 maintenance releases in the 6 months
> > following its first release.
> >
> > So, personally, I don't expect Apache Spark 1.6.4. After Apache Spark 2.1
> > will be released very soon, 2.1 and 2.0 will be the two major versions
> > which the most community effort is going to focus on.
> >
> > However, *literally*, two major versions of Apache Spark will be Apache
> > Spark 1.X (1.6.3) and Apache Spark 2.X. Since there is API compatibility
> > issues between major versions, I guess 1.6.X will survive for a while like
> > JDK7.
> >
> > If possible, could we have a clear statement whether there is a plan for
> > 1.6.4 on homepage?
> >
> > Bests,
> > Dongjoon.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
> >
> >
>
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Two major versions?
Posted by Reynold Xin <rx...@databricks.com>.
I think this highly depends on what issues are found, e.g. critical bugs
that impact wide use cases, or security bugs.
On Sun, Nov 27, 2016 at 12:49 PM, Dongjoon Hyun <do...@apache.org> wrote:
> Hi, All.
>
> Do we have a release plan of Apache Spark 1.6.4?
>
> Up to my knowledge, Apache Spark community has been focusing on latest two
> versions.
> There was no official release of Apache Spark *X.X.4* so far. It's also
> well-documented on Apache Spark home page (Versioning policy;
> http://spark.apache.org/versioning-policy.html)
>
> > A minor release usually sees 1-2 maintenance releases in the 6 months
> following its first release.
>
> So, personally, I don't expect Apache Spark 1.6.4. After Apache Spark 2.1
> will be released very soon, 2.1 and 2.0 will be the two major versions
> which the most community effort is going to focus on.
>
> However, *literally*, two major versions of Apache Spark will be Apache
> Spark 1.X (1.6.3) and Apache Spark 2.X. Since there is API compatibility
> issues between major versions, I guess 1.6.X will survive for a while like
> JDK7.
>
> If possible, could we have a clear statement whether there is a plan for
> 1.6.4 on homepage?
>
> Bests,
> Dongjoon.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>