You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Koert Kuipers <ko...@tresata.com> on 2016/07/02 04:41:01 UTC

branch-2.0 is now 2.0.1-SNAPSHOT?

is that correct?
where do i get the latest 2.0.0-SNAPSHOT?
thanks,
koert

Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Reynold Xin <rx...@databricks.com>.
I just bumped master branch version to 2.1.0-SNAPSHOT
https://github.com/apache/spark/commit/ffcb6e055a28f36208ed058a42df09c154555332

We used to have a problem with binary compatibility check not having the
2.0.0 base version in Maven (because 2.0.0 hasn't been released yet) but I
figured out a way yesterday to work around it.

On Mon, Jul 11, 2016 at 2:19 AM, Sean Owen <so...@cloudera.com> wrote:

> You are right, this is messed up a bit now.
>
> branch-2.0 should really still be 2.0.0-SNAPSHOT, technically. I think
> that was accidentally updated in the RC release. It won't matter a
> whole lot except for people who consume snapshots, but, you can always
> roll your own. After 2.0.0 it should be 2.0.1-SNAPSHOT anyway.
>
> Master isn't done yet because of a hiccup in the API checking
> component, MiMa. It should really be on 2.1.0-SNAPSHOT. At the latest
> it will be so after 2.0.0 is released but it sorta looks like Reynold
> maybe has an answer as of a few hours ago?
>
> Sean
>
> On Mon, Jul 11, 2016 at 10:15 AM, Dmitry Zhukov
> <dz...@transferwise.com> wrote:
> > So, as I understand the correct git branch to maven version mapping
> should
> > be the following:
> >
> > branch-2.0 -> 2.0.0-SNAPSHOT
> > master -> 2.1.0-SNAPSHOT
> >
> > but the current is
> >
> > branch-2.0 -> 2.0.1-SNAPSHOT
> > master -> 2.0.0-SNAPTHOT
> >
> >
> > We are starting to play with Spark 2.0 in TransferWise and find the
> > versioning of the development branches very confusing. Any plans to fix
> it?
> >
> > Thanks!
> >
> > On Sat, Jul 2, 2016 at 11:07 PM, Koert Kuipers <ko...@tresata.com>
> wrote:
> >>
> >> that helps, now i know i simply need to look at master
> >>
> >> On Sat, Jul 2, 2016 at 1:37 PM, Sean Owen <so...@cloudera.com> wrote:
> >>>
> >>> So, on the one hand I think branch-2.0 should really still be on
> >>> 2.0.0-SNAPSHOT but is on 2.0.1-SNAPSHOT, and while master should
> >>> technically be on 2.1.0-SNAPSHOT but we can't quite because of MiMa
> >>> right now, I do see that both snapshots are being produced still:
> >>>
> >>>
> >>>
> https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-core_2.11/
> >>>
> >>> 2.0.0-SNAPSHOT is actually from master, kinda confusingly. Not sure if
> >>> that helps.
> >>>
> >>> On Sat, Jul 2, 2016 at 5:25 PM, Koert Kuipers <ko...@tresata.com>
> wrote:
> >>> > You do, snapshots for spark 2.0.0-SNAPSHOT are updated daily on the
> >>> > apache
> >>> > snapshot repo. I use them in our own unit tests to find regressions
> >>> > etc. in
> >>> > spark and report them back
> >>> >
> >>> > On Jul 2, 2016 3:35 AM, "Sean Owen" <so...@cloudera.com> wrote:
> >>> >>
> >>> >> Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
> >>> >> at this stage because 2.0.0 is not yet released. But I'm not sure we
> >>> >> publish snapshots anyway?
> >>> >>
> >>> >> On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com>
> >>> >> wrote:
> >>> >> > is that correct?
> >>> >> > where do i get the latest 2.0.0-SNAPSHOT?
> >>> >> > thanks,
> >>> >> > koert
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>

Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Marcelo Vanzin <va...@cloudera.com>.
On Mon, Jul 11, 2016 at 2:19 AM, Sean Owen <so...@cloudera.com> wrote:
> branch-2.0 should really still be 2.0.0-SNAPSHOT, technically. I think
> that was accidentally updated in the RC release.

Actually it's correct, even if at first sight it might appear wrong.

The tag that is being voted on (rc2) has the "2.0.0" release. So,
technically, anything after that tag is after 2.0.0, so that in case
the vote passes, there's no need to push a commit that "fixes" the
version number to be 2.0.1-SNAPSHOT.

If the event of an rc3, as part of preparing the rc, the version will
be reverted to "2.0.0" and a new commit added after the rc3 tag to
forward the version to 2.0.1-SNAPSHOT.

See commits:
4a55b2326c8cf50f772907a8b73fd5e7b3d1aa06
6e8fa86ebf30a9b850f4a66810d5d38d1f188b33

-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Sean Owen <so...@cloudera.com>.
You are right, this is messed up a bit now.

branch-2.0 should really still be 2.0.0-SNAPSHOT, technically. I think
that was accidentally updated in the RC release. It won't matter a
whole lot except for people who consume snapshots, but, you can always
roll your own. After 2.0.0 it should be 2.0.1-SNAPSHOT anyway.

Master isn't done yet because of a hiccup in the API checking
component, MiMa. It should really be on 2.1.0-SNAPSHOT. At the latest
it will be so after 2.0.0 is released but it sorta looks like Reynold
maybe has an answer as of a few hours ago?

Sean

On Mon, Jul 11, 2016 at 10:15 AM, Dmitry Zhukov
<dz...@transferwise.com> wrote:
> So, as I understand the correct git branch to maven version mapping should
> be the following:
>
> branch-2.0 -> 2.0.0-SNAPSHOT
> master -> 2.1.0-SNAPSHOT
>
> but the current is
>
> branch-2.0 -> 2.0.1-SNAPSHOT
> master -> 2.0.0-SNAPTHOT
>
>
> We are starting to play with Spark 2.0 in TransferWise and find the
> versioning of the development branches very confusing. Any plans to fix it?
>
> Thanks!
>
> On Sat, Jul 2, 2016 at 11:07 PM, Koert Kuipers <ko...@tresata.com> wrote:
>>
>> that helps, now i know i simply need to look at master
>>
>> On Sat, Jul 2, 2016 at 1:37 PM, Sean Owen <so...@cloudera.com> wrote:
>>>
>>> So, on the one hand I think branch-2.0 should really still be on
>>> 2.0.0-SNAPSHOT but is on 2.0.1-SNAPSHOT, and while master should
>>> technically be on 2.1.0-SNAPSHOT but we can't quite because of MiMa
>>> right now, I do see that both snapshots are being produced still:
>>>
>>>
>>> https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-core_2.11/
>>>
>>> 2.0.0-SNAPSHOT is actually from master, kinda confusingly. Not sure if
>>> that helps.
>>>
>>> On Sat, Jul 2, 2016 at 5:25 PM, Koert Kuipers <ko...@tresata.com> wrote:
>>> > You do, snapshots for spark 2.0.0-SNAPSHOT are updated daily on the
>>> > apache
>>> > snapshot repo. I use them in our own unit tests to find regressions
>>> > etc. in
>>> > spark and report them back
>>> >
>>> > On Jul 2, 2016 3:35 AM, "Sean Owen" <so...@cloudera.com> wrote:
>>> >>
>>> >> Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
>>> >> at this stage because 2.0.0 is not yet released. But I'm not sure we
>>> >> publish snapshots anyway?
>>> >>
>>> >> On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com>
>>> >> wrote:
>>> >> > is that correct?
>>> >> > where do i get the latest 2.0.0-SNAPSHOT?
>>> >> > thanks,
>>> >> > koert
>>
>>
>

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Dmitry Zhukov <dz...@transferwise.com>.
So, as I understand the correct git branch to maven version mapping should
be the following:

branch-2.0 -> 2.0.0-SNAPSHOT
master -> 2.1.0-SNAPSHOT

but the current is

branch-2.0 -> 2.0.1-SNAPSHOT
master -> 2.0.0-SNAPTHOT


We are starting to play with Spark 2.0 in TransferWise and find the
versioning of the development branches very confusing. Any plans to fix it?

Thanks!

On Sat, Jul 2, 2016 at 11:07 PM, Koert Kuipers <ko...@tresata.com> wrote:

> that helps, now i know i simply need to look at master
>
> On Sat, Jul 2, 2016 at 1:37 PM, Sean Owen <so...@cloudera.com> wrote:
>
>> So, on the one hand I think branch-2.0 should really still be on
>> 2.0.0-SNAPSHOT but is on 2.0.1-SNAPSHOT, and while master should
>> technically be on 2.1.0-SNAPSHOT but we can't quite because of MiMa
>> right now, I do see that both snapshots are being produced still:
>>
>>
>> https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-core_2.11/
>>
>> 2.0.0-SNAPSHOT is actually from master, kinda confusingly. Not sure if
>> that helps.
>>
>> On Sat, Jul 2, 2016 at 5:25 PM, Koert Kuipers <ko...@tresata.com> wrote:
>> > You do, snapshots for spark 2.0.0-SNAPSHOT are updated daily on the
>> apache
>> > snapshot repo. I use them in our own unit tests to find regressions
>> etc. in
>> > spark and report them back
>> >
>> > On Jul 2, 2016 3:35 AM, "Sean Owen" <so...@cloudera.com> wrote:
>> >>
>> >> Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
>> >> at this stage because 2.0.0 is not yet released. But I'm not sure we
>> >> publish snapshots anyway?
>> >>
>> >> On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com>
>> wrote:
>> >> > is that correct?
>> >> > where do i get the latest 2.0.0-SNAPSHOT?
>> >> > thanks,
>> >> > koert
>>
>
>

Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Koert Kuipers <ko...@tresata.com>.
that helps, now i know i simply need to look at master

On Sat, Jul 2, 2016 at 1:37 PM, Sean Owen <so...@cloudera.com> wrote:

> So, on the one hand I think branch-2.0 should really still be on
> 2.0.0-SNAPSHOT but is on 2.0.1-SNAPSHOT, and while master should
> technically be on 2.1.0-SNAPSHOT but we can't quite because of MiMa
> right now, I do see that both snapshots are being produced still:
>
>
> https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-core_2.11/
>
> 2.0.0-SNAPSHOT is actually from master, kinda confusingly. Not sure if
> that helps.
>
> On Sat, Jul 2, 2016 at 5:25 PM, Koert Kuipers <ko...@tresata.com> wrote:
> > You do, snapshots for spark 2.0.0-SNAPSHOT are updated daily on the
> apache
> > snapshot repo. I use them in our own unit tests to find regressions etc.
> in
> > spark and report them back
> >
> > On Jul 2, 2016 3:35 AM, "Sean Owen" <so...@cloudera.com> wrote:
> >>
> >> Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
> >> at this stage because 2.0.0 is not yet released. But I'm not sure we
> >> publish snapshots anyway?
> >>
> >> On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com>
> wrote:
> >> > is that correct?
> >> > where do i get the latest 2.0.0-SNAPSHOT?
> >> > thanks,
> >> > koert
>

Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Sean Owen <so...@cloudera.com>.
So, on the one hand I think branch-2.0 should really still be on
2.0.0-SNAPSHOT but is on 2.0.1-SNAPSHOT, and while master should
technically be on 2.1.0-SNAPSHOT but we can't quite because of MiMa
right now, I do see that both snapshots are being produced still:

https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-core_2.11/

2.0.0-SNAPSHOT is actually from master, kinda confusingly. Not sure if
that helps.

On Sat, Jul 2, 2016 at 5:25 PM, Koert Kuipers <ko...@tresata.com> wrote:
> You do, snapshots for spark 2.0.0-SNAPSHOT are updated daily on the apache
> snapshot repo. I use them in our own unit tests to find regressions etc. in
> spark and report them back
>
> On Jul 2, 2016 3:35 AM, "Sean Owen" <so...@cloudera.com> wrote:
>>
>> Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
>> at this stage because 2.0.0 is not yet released. But I'm not sure we
>> publish snapshots anyway?
>>
>> On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com> wrote:
>> > is that correct?
>> > where do i get the latest 2.0.0-SNAPSHOT?
>> > thanks,
>> > koert

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Koert Kuipers <ko...@tresata.com>.
You do, snapshots for spark 2.0.0-SNAPSHOT are updated daily on the apache
snapshot repo. I use them in our own unit tests to find regressions etc. in
spark and report them back
On Jul 2, 2016 3:35 AM, "Sean Owen" <so...@cloudera.com> wrote:

> Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
> at this stage because 2.0.0 is not yet released. But I'm not sure we
> publish snapshots anyway?
>
> On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com> wrote:
> > is that correct?
> > where do i get the latest 2.0.0-SNAPSHOT?
> > thanks,
> > koert
>

Re: branch-2.0 is now 2.0.1-SNAPSHOT?

Posted by Sean Owen <so...@cloudera.com>.
Yeah, interesting question about whether it should be 2.0.1-SNAPSHOT
at this stage because 2.0.0 is not yet released. But I'm not sure we
publish snapshots anyway?

On Sat, Jul 2, 2016 at 5:41 AM, Koert Kuipers <ko...@tresata.com> wrote:
> is that correct?
> where do i get the latest 2.0.0-SNAPSHOT?
> thanks,
> koert

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org