You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by Matthias Boehm <mb...@gmail.com> on 2021/10/08 10:55:41 UTC
Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
ok, tonight I'll kickoff the perftest suite and see how it goes. In the
next week or two we should then restrict ourselves to bug fixes, and
hold off major features that are in the critical path (i.e., enabled by
default).
Regards,
Matthias
On 9/13/2021 10:44 PM, Baunsgaard, Sebastian wrote:
> Hi all,
>
>
> +1 for the plan.
>
>
> With regards to the performance suite,
>
> I think it would be nice with a standard short 1 hour version as well.
>
>
> best regards
>
> Sebastian
>
> ________________________________
> From: Matthias Boehm <mb...@gmail.com>
> Sent: Monday, September 13, 2021 10:26:25 PM
> To: dev@systemds.apache.org
> Subject: [DISCUSS] SystemDS 2.2 Release / Upgrades
>
> Hi all,
>
> the original plan was to release SystemDS 2.1 as the last release for
> JDK 8 and Spark 2.x. However, our main branch accumulated quite a number
> of critical fixes and performance improvements. Accordingly, I'd like to
> propose releasing SystemDS 2.2 again for JDK 8 and Spark 2.4 in the next
> weeks and then immediately switch to JDK 11 and then release SystemDS
> 2.3. Any comments or opinions?
>
> I would volunteer as release manager (never done it before) so we spread
> the knowledge how to run the release process a bit. Of course, I would
> appreciate help from previous release managers and people who
> contributed to the automation of the release.
>
> Finally, we recently revived the performance test suite so we can run a
> battery of algorithm-level tests at different scales before the release.
> I would make a case for running this for local/GPU, Spark, and federated
> with scales that allow to complete it in ~1-2 weeks.
>
> Regards,
> Matthias
>
Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
Posted by "Baunsgaard, Sebastian" <ba...@tugraz.at.INVALID>.
Great!!
Then we can celebrate a new release candidate later today!
🎉🥳🎉
________________________________
From: arnab phani <ph...@gmail.com>
Sent: Monday, October 25, 2021 10:37:59 AM
To: dev@systemds.apache.org
Subject: Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
Hi All,
I will cut RC1 today afternoon (CET).
Please merge pending bug fixes if any.
Regards,
Arnab..
On Tue, Oct 12, 2021 at 3:00 PM arnab phani <ph...@gmail.com> wrote:
> Thanks, Matthias.
>
> I'd like to remind all, please send me your contributions like before for
> the release notes.
> (FYI, Matthias kindly agreed to let me be the release manager for this
> minor release).
>
> Regards,
> Arnab..
>
> On Sun, Oct 10, 2021 at 10:11 PM Matthias Boehm <mb...@gmail.com> wrote:
>
>> ok, all issues have been resolved and the fixes are in SystemDS' main.
>> The MSVM OOM was due a missing Xmn parameter, the naive bayes number
>> came from 878s down to 46s, the MSVM number from 655s down to 109s, and
>> we now added the missing glmPredict builtin function as well.
>>
>> I'll now start a full fresh run of the perftest suite.
>>
>> Regards,
>> Matthias
>>
>> On 10/10/2021 4:47 PM, Matthias Boehm wrote:
>> > just a quick update - yesterday, we ran the perftest from 8MB to 80GB
>> > for all algorithms (and configurations) in the groups binomial,
>> > multinomial, and regression. Overall it looks pretty good, except the
>> > following issues, which we will address in the next days:
>> >
>> > * MSVM 8GB ran OOM on both binomial and multinomial
>> > * builtin glmPredict is still missing
>> > * Performance issues for MSVM 80GB multinomial (85s w/o intercept but
>> > 655s w/ intercept) and NaiveBayes 80GB nomial (878s although
>> non-iterative)
>> >
>> > Regards,
>> > Matthias
>> >
>> > On 10/8/2021 12:55 PM, Matthias Boehm wrote:
>> >> ok, tonight I'll kickoff the perftest suite and see how it goes. In
>> >> the next week or two we should then restrict ourselves to bug fixes,
>> >> and hold off major features that are in the critical path (i.e.,
>> >> enabled by default).
>> >>
>> >> Regards,
>> >> Matthias
>> >>
>> >> On 9/13/2021 10:44 PM, Baunsgaard, Sebastian wrote:
>> >>> Hi all,
>> >>>
>> >>>
>> >>> +1 for the plan.
>> >>>
>> >>>
>> >>> With regards to the performance suite,
>> >>>
>> >>> I think it would be nice with a standard short 1 hour version as well.
>> >>>
>> >>>
>> >>> best regards
>> >>>
>> >>> Sebastian
>> >>>
>> >>> ________________________________
>> >>> From: Matthias Boehm <mb...@gmail.com>
>> >>> Sent: Monday, September 13, 2021 10:26:25 PM
>> >>> To: dev@systemds.apache.org
>> >>> Subject: [DISCUSS] SystemDS 2.2 Release / Upgrades
>> >>>
>> >>> Hi all,
>> >>>
>> >>> the original plan was to release SystemDS 2.1 as the last release for
>> >>> JDK 8 and Spark 2.x. However, our main branch accumulated quite a
>> number
>> >>> of critical fixes and performance improvements. Accordingly, I'd like
>> to
>> >>> propose releasing SystemDS 2.2 again for JDK 8 and Spark 2.4 in the
>> next
>> >>> weeks and then immediately switch to JDK 11 and then release SystemDS
>> >>> 2.3. Any comments or opinions?
>> >>>
>> >>> I would volunteer as release manager (never done it before) so we
>> spread
>> >>> the knowledge how to run the release process a bit. Of course, I would
>> >>> appreciate help from previous release managers and people who
>> >>> contributed to the automation of the release.
>> >>>
>> >>> Finally, we recently revived the performance test suite so we can run
>> a
>> >>> battery of algorithm-level tests at different scales before the
>> release.
>> >>> I would make a case for running this for local/GPU, Spark, and
>> federated
>> >>> with scales that allow to complete it in ~1-2 weeks.
>> >>>
>> >>> Regards,
>> >>> Matthias
>> >>>
>>
>
Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
Posted by arnab phani <ph...@gmail.com>.
Hi All,
I will cut RC1 today afternoon (CET).
Please merge pending bug fixes if any.
Regards,
Arnab..
On Tue, Oct 12, 2021 at 3:00 PM arnab phani <ph...@gmail.com> wrote:
> Thanks, Matthias.
>
> I'd like to remind all, please send me your contributions like before for
> the release notes.
> (FYI, Matthias kindly agreed to let me be the release manager for this
> minor release).
>
> Regards,
> Arnab..
>
> On Sun, Oct 10, 2021 at 10:11 PM Matthias Boehm <mb...@gmail.com> wrote:
>
>> ok, all issues have been resolved and the fixes are in SystemDS' main.
>> The MSVM OOM was due a missing Xmn parameter, the naive bayes number
>> came from 878s down to 46s, the MSVM number from 655s down to 109s, and
>> we now added the missing glmPredict builtin function as well.
>>
>> I'll now start a full fresh run of the perftest suite.
>>
>> Regards,
>> Matthias
>>
>> On 10/10/2021 4:47 PM, Matthias Boehm wrote:
>> > just a quick update - yesterday, we ran the perftest from 8MB to 80GB
>> > for all algorithms (and configurations) in the groups binomial,
>> > multinomial, and regression. Overall it looks pretty good, except the
>> > following issues, which we will address in the next days:
>> >
>> > * MSVM 8GB ran OOM on both binomial and multinomial
>> > * builtin glmPredict is still missing
>> > * Performance issues for MSVM 80GB multinomial (85s w/o intercept but
>> > 655s w/ intercept) and NaiveBayes 80GB nomial (878s although
>> non-iterative)
>> >
>> > Regards,
>> > Matthias
>> >
>> > On 10/8/2021 12:55 PM, Matthias Boehm wrote:
>> >> ok, tonight I'll kickoff the perftest suite and see how it goes. In
>> >> the next week or two we should then restrict ourselves to bug fixes,
>> >> and hold off major features that are in the critical path (i.e.,
>> >> enabled by default).
>> >>
>> >> Regards,
>> >> Matthias
>> >>
>> >> On 9/13/2021 10:44 PM, Baunsgaard, Sebastian wrote:
>> >>> Hi all,
>> >>>
>> >>>
>> >>> +1 for the plan.
>> >>>
>> >>>
>> >>> With regards to the performance suite,
>> >>>
>> >>> I think it would be nice with a standard short 1 hour version as well.
>> >>>
>> >>>
>> >>> best regards
>> >>>
>> >>> Sebastian
>> >>>
>> >>> ________________________________
>> >>> From: Matthias Boehm <mb...@gmail.com>
>> >>> Sent: Monday, September 13, 2021 10:26:25 PM
>> >>> To: dev@systemds.apache.org
>> >>> Subject: [DISCUSS] SystemDS 2.2 Release / Upgrades
>> >>>
>> >>> Hi all,
>> >>>
>> >>> the original plan was to release SystemDS 2.1 as the last release for
>> >>> JDK 8 and Spark 2.x. However, our main branch accumulated quite a
>> number
>> >>> of critical fixes and performance improvements. Accordingly, I'd like
>> to
>> >>> propose releasing SystemDS 2.2 again for JDK 8 and Spark 2.4 in the
>> next
>> >>> weeks and then immediately switch to JDK 11 and then release SystemDS
>> >>> 2.3. Any comments or opinions?
>> >>>
>> >>> I would volunteer as release manager (never done it before) so we
>> spread
>> >>> the knowledge how to run the release process a bit. Of course, I would
>> >>> appreciate help from previous release managers and people who
>> >>> contributed to the automation of the release.
>> >>>
>> >>> Finally, we recently revived the performance test suite so we can run
>> a
>> >>> battery of algorithm-level tests at different scales before the
>> release.
>> >>> I would make a case for running this for local/GPU, Spark, and
>> federated
>> >>> with scales that allow to complete it in ~1-2 weeks.
>> >>>
>> >>> Regards,
>> >>> Matthias
>> >>>
>>
>
Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
Posted by arnab phani <ph...@gmail.com>.
Thanks, Matthias.
I'd like to remind all, please send me your contributions like before for
the release notes.
(FYI, Matthias kindly agreed to let me be the release manager for this
minor release).
Regards,
Arnab..
On Sun, Oct 10, 2021 at 10:11 PM Matthias Boehm <mb...@gmail.com> wrote:
> ok, all issues have been resolved and the fixes are in SystemDS' main.
> The MSVM OOM was due a missing Xmn parameter, the naive bayes number
> came from 878s down to 46s, the MSVM number from 655s down to 109s, and
> we now added the missing glmPredict builtin function as well.
>
> I'll now start a full fresh run of the perftest suite.
>
> Regards,
> Matthias
>
> On 10/10/2021 4:47 PM, Matthias Boehm wrote:
> > just a quick update - yesterday, we ran the perftest from 8MB to 80GB
> > for all algorithms (and configurations) in the groups binomial,
> > multinomial, and regression. Overall it looks pretty good, except the
> > following issues, which we will address in the next days:
> >
> > * MSVM 8GB ran OOM on both binomial and multinomial
> > * builtin glmPredict is still missing
> > * Performance issues for MSVM 80GB multinomial (85s w/o intercept but
> > 655s w/ intercept) and NaiveBayes 80GB nomial (878s although
> non-iterative)
> >
> > Regards,
> > Matthias
> >
> > On 10/8/2021 12:55 PM, Matthias Boehm wrote:
> >> ok, tonight I'll kickoff the perftest suite and see how it goes. In
> >> the next week or two we should then restrict ourselves to bug fixes,
> >> and hold off major features that are in the critical path (i.e.,
> >> enabled by default).
> >>
> >> Regards,
> >> Matthias
> >>
> >> On 9/13/2021 10:44 PM, Baunsgaard, Sebastian wrote:
> >>> Hi all,
> >>>
> >>>
> >>> +1 for the plan.
> >>>
> >>>
> >>> With regards to the performance suite,
> >>>
> >>> I think it would be nice with a standard short 1 hour version as well.
> >>>
> >>>
> >>> best regards
> >>>
> >>> Sebastian
> >>>
> >>> ________________________________
> >>> From: Matthias Boehm <mb...@gmail.com>
> >>> Sent: Monday, September 13, 2021 10:26:25 PM
> >>> To: dev@systemds.apache.org
> >>> Subject: [DISCUSS] SystemDS 2.2 Release / Upgrades
> >>>
> >>> Hi all,
> >>>
> >>> the original plan was to release SystemDS 2.1 as the last release for
> >>> JDK 8 and Spark 2.x. However, our main branch accumulated quite a
> number
> >>> of critical fixes and performance improvements. Accordingly, I'd like
> to
> >>> propose releasing SystemDS 2.2 again for JDK 8 and Spark 2.4 in the
> next
> >>> weeks and then immediately switch to JDK 11 and then release SystemDS
> >>> 2.3. Any comments or opinions?
> >>>
> >>> I would volunteer as release manager (never done it before) so we
> spread
> >>> the knowledge how to run the release process a bit. Of course, I would
> >>> appreciate help from previous release managers and people who
> >>> contributed to the automation of the release.
> >>>
> >>> Finally, we recently revived the performance test suite so we can run a
> >>> battery of algorithm-level tests at different scales before the
> release.
> >>> I would make a case for running this for local/GPU, Spark, and
> federated
> >>> with scales that allow to complete it in ~1-2 weeks.
> >>>
> >>> Regards,
> >>> Matthias
> >>>
>
Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
Posted by Matthias Boehm <mb...@gmail.com>.
ok, all issues have been resolved and the fixes are in SystemDS' main.
The MSVM OOM was due a missing Xmn parameter, the naive bayes number
came from 878s down to 46s, the MSVM number from 655s down to 109s, and
we now added the missing glmPredict builtin function as well.
I'll now start a full fresh run of the perftest suite.
Regards,
Matthias
On 10/10/2021 4:47 PM, Matthias Boehm wrote:
> just a quick update - yesterday, we ran the perftest from 8MB to 80GB
> for all algorithms (and configurations) in the groups binomial,
> multinomial, and regression. Overall it looks pretty good, except the
> following issues, which we will address in the next days:
>
> * MSVM 8GB ran OOM on both binomial and multinomial
> * builtin glmPredict is still missing
> * Performance issues for MSVM 80GB multinomial (85s w/o intercept but
> 655s w/ intercept) and NaiveBayes 80GB nomial (878s although non-iterative)
>
> Regards,
> Matthias
>
> On 10/8/2021 12:55 PM, Matthias Boehm wrote:
>> ok, tonight I'll kickoff the perftest suite and see how it goes. In
>> the next week or two we should then restrict ourselves to bug fixes,
>> and hold off major features that are in the critical path (i.e.,
>> enabled by default).
>>
>> Regards,
>> Matthias
>>
>> On 9/13/2021 10:44 PM, Baunsgaard, Sebastian wrote:
>>> Hi all,
>>>
>>>
>>> +1 for the plan.
>>>
>>>
>>> With regards to the performance suite,
>>>
>>> I think it would be nice with a standard short 1 hour version as well.
>>>
>>>
>>> best regards
>>>
>>> Sebastian
>>>
>>> ________________________________
>>> From: Matthias Boehm <mb...@gmail.com>
>>> Sent: Monday, September 13, 2021 10:26:25 PM
>>> To: dev@systemds.apache.org
>>> Subject: [DISCUSS] SystemDS 2.2 Release / Upgrades
>>>
>>> Hi all,
>>>
>>> the original plan was to release SystemDS 2.1 as the last release for
>>> JDK 8 and Spark 2.x. However, our main branch accumulated quite a number
>>> of critical fixes and performance improvements. Accordingly, I'd like to
>>> propose releasing SystemDS 2.2 again for JDK 8 and Spark 2.4 in the next
>>> weeks and then immediately switch to JDK 11 and then release SystemDS
>>> 2.3. Any comments or opinions?
>>>
>>> I would volunteer as release manager (never done it before) so we spread
>>> the knowledge how to run the release process a bit. Of course, I would
>>> appreciate help from previous release managers and people who
>>> contributed to the automation of the release.
>>>
>>> Finally, we recently revived the performance test suite so we can run a
>>> battery of algorithm-level tests at different scales before the release.
>>> I would make a case for running this for local/GPU, Spark, and federated
>>> with scales that allow to complete it in ~1-2 weeks.
>>>
>>> Regards,
>>> Matthias
>>>
Re: [DISCUSS] SystemDS 2.2 Release / Upgrades
Posted by Matthias Boehm <mb...@gmail.com>.
just a quick update - yesterday, we ran the perftest from 8MB to 80GB
for all algorithms (and configurations) in the groups binomial,
multinomial, and regression. Overall it looks pretty good, except the
following issues, which we will address in the next days:
* MSVM 8GB ran OOM on both binomial and multinomial
* builtin glmPredict is still missing
* Performance issues for MSVM 80GB multinomial (85s w/o intercept but
655s w/ intercept) and NaiveBayes 80GB nomial (878s although non-iterative)
Regards,
Matthias
On 10/8/2021 12:55 PM, Matthias Boehm wrote:
> ok, tonight I'll kickoff the perftest suite and see how it goes. In the
> next week or two we should then restrict ourselves to bug fixes, and
> hold off major features that are in the critical path (i.e., enabled by
> default).
>
> Regards,
> Matthias
>
> On 9/13/2021 10:44 PM, Baunsgaard, Sebastian wrote:
>> Hi all,
>>
>>
>> +1 for the plan.
>>
>>
>> With regards to the performance suite,
>>
>> I think it would be nice with a standard short 1 hour version as well.
>>
>>
>> best regards
>>
>> Sebastian
>>
>> ________________________________
>> From: Matthias Boehm <mb...@gmail.com>
>> Sent: Monday, September 13, 2021 10:26:25 PM
>> To: dev@systemds.apache.org
>> Subject: [DISCUSS] SystemDS 2.2 Release / Upgrades
>>
>> Hi all,
>>
>> the original plan was to release SystemDS 2.1 as the last release for
>> JDK 8 and Spark 2.x. However, our main branch accumulated quite a number
>> of critical fixes and performance improvements. Accordingly, I'd like to
>> propose releasing SystemDS 2.2 again for JDK 8 and Spark 2.4 in the next
>> weeks and then immediately switch to JDK 11 and then release SystemDS
>> 2.3. Any comments or opinions?
>>
>> I would volunteer as release manager (never done it before) so we spread
>> the knowledge how to run the release process a bit. Of course, I would
>> appreciate help from previous release managers and people who
>> contributed to the automation of the release.
>>
>> Finally, we recently revived the performance test suite so we can run a
>> battery of algorithm-level tests at different scales before the release.
>> I would make a case for running this for local/GPU, Spark, and federated
>> with scales that allow to complete it in ~1-2 weeks.
>>
>> Regards,
>> Matthias
>>