You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Hossein <fa...@gmail.com> on 2018/05/30 21:03:03 UTC
[VOTE] SPIP ML Pipelines in R
Hi,
I started discussion thread
<http://apache-spark-developers-list.1001551.n3.nabble.com/ML-Pipelines-in-R-td24022.html#a24023>
for a new R package to expose MLlib pipelines in R
<https://issues.apache.org/jira/secure/attachment/12925281/SparkML_%20ML%20Pipelines%20in%20R-v3.pdf>
.
To summarize we will work on utilities to generate R wrappers for MLlib
pipeline API for a new R package. This will lower the burden for exposing
new API in future.
Following the SPIP process
<https://spark.apache.org/improvement-proposals.html>, I am proposing the
SPIP <https://issues.apache.org/jira/browse/SPARK-24359> for a vote.
+1: Let's go ahead and implement the SPIP.
+0: Don't really care.
-1: I do not think this is a good idea for the following reasons.
Thanks,
--Hossein
Re: [VOTE] SPIP ML Pipelines in R
Posted by Xiangrui Meng <me...@databricks.com>.
+1.
On Thu, May 31, 2018 at 2:28 PM Joseph Bradley <jo...@databricks.com>
wrote:
> Hossein might be slow to respond (OOO), but I just commented on the JIRA.
> I'd recommend we follow the same process as the SparkR package.
>
> +1 on this from me (and I'll be happy to help shepherd it, though Felix
> and Shivaram are the experts in this area). CRAN presents challenges, but
> this is a good step towards making R a first-class citizen for ML use cases
> of Spark.
>
> On Thu, May 31, 2018 at 9:10 AM, Shivaram Venkataraman <
> shivaram@eecs.berkeley.edu> wrote:
>
>> Hossein -- Can you clarify what the resolution on the repository /
>> release issue discussed on SPIP ?
>>
>> Shivaram
>>
>> On Thu, May 31, 2018 at 9:06 AM, Felix Cheung <fe...@hotmail.com>
>> wrote:
>> > +1
>> > With my concerns in the SPIP discussion.
>> >
>> > ________________________________
>> > From: Hossein <fa...@gmail.com>
>> > Sent: Wednesday, May 30, 2018 2:03:03 PM
>> > To: dev@spark.apache.org
>> > Subject: [VOTE] SPIP ML Pipelines in R
>> >
>> > Hi,
>> >
>> > I started discussion thread for a new R package to expose MLlib
>> pipelines in
>> > R.
>> >
>> > To summarize we will work on utilities to generate R wrappers for MLlib
>> > pipeline API for a new R package. This will lower the burden for
>> exposing
>> > new API in future.
>> >
>> > Following the SPIP process, I am proposing the SPIP for a vote.
>> >
>> > +1: Let's go ahead and implement the SPIP.
>> > +0: Don't really care.
>> > -1: I do not think this is a good idea for the following reasons.
>> >
>> > Thanks,
>> > --Hossein
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>
>>
>
>
> --
>
> Joseph Bradley
>
> Software Engineer - Machine Learning
>
> Databricks, Inc.
>
> [image: http://databricks.com] <http://databricks.com/>
>
--
Xiangrui Meng
Software Engineer
Databricks Inc. [image: http://databricks.com] <http://databricks.com/>
Re: [VOTE] SPIP ML Pipelines in R
Posted by Joseph Bradley <jo...@databricks.com>.
Hossein might be slow to respond (OOO), but I just commented on the JIRA.
I'd recommend we follow the same process as the SparkR package.
+1 on this from me (and I'll be happy to help shepherd it, though Felix and
Shivaram are the experts in this area). CRAN presents challenges, but this
is a good step towards making R a first-class citizen for ML use cases of
Spark.
On Thu, May 31, 2018 at 9:10 AM, Shivaram Venkataraman <
shivaram@eecs.berkeley.edu> wrote:
> Hossein -- Can you clarify what the resolution on the repository /
> release issue discussed on SPIP ?
>
> Shivaram
>
> On Thu, May 31, 2018 at 9:06 AM, Felix Cheung <fe...@hotmail.com>
> wrote:
> > +1
> > With my concerns in the SPIP discussion.
> >
> > ________________________________
> > From: Hossein <fa...@gmail.com>
> > Sent: Wednesday, May 30, 2018 2:03:03 PM
> > To: dev@spark.apache.org
> > Subject: [VOTE] SPIP ML Pipelines in R
> >
> > Hi,
> >
> > I started discussion thread for a new R package to expose MLlib
> pipelines in
> > R.
> >
> > To summarize we will work on utilities to generate R wrappers for MLlib
> > pipeline API for a new R package. This will lower the burden for exposing
> > new API in future.
> >
> > Following the SPIP process, I am proposing the SPIP for a vote.
> >
> > +1: Let's go ahead and implement the SPIP.
> > +0: Don't really care.
> > -1: I do not think this is a good idea for the following reasons.
> >
> > Thanks,
> > --Hossein
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
--
Joseph Bradley
Software Engineer - Machine Learning
Databricks, Inc.
[image: http://databricks.com] <http://databricks.com/>
Re: [VOTE] SPIP ML Pipelines in R
Posted by Hossein <fa...@gmail.com>.
The vote passed with following +1.
- Felix
- Joseph
- Xiangrui
- Reynold
Joseph has kindly volunteered to shepherd this.
Thanks,
--Hossein
On Thu, Jun 14, 2018 at 1:32 PM Reynold Xin <rx...@databricks.com> wrote:
> +1 on the proposal.
>
>
> On Fri, Jun 1, 2018 at 8:17 PM Hossein <fa...@gmail.com> wrote:
>
>> Hi Shivaram,
>>
>> We converged on a CRAN release process that seems identical to current
>> SparkR.
>>
>> --Hossein
>>
>> On Thu, May 31, 2018 at 9:10 AM, Shivaram Venkataraman <
>> shivaram@eecs.berkeley.edu> wrote:
>>
>>> Hossein -- Can you clarify what the resolution on the repository /
>>> release issue discussed on SPIP ?
>>>
>>> Shivaram
>>>
>>> On Thu, May 31, 2018 at 9:06 AM, Felix Cheung <fe...@hotmail.com>
>>> wrote:
>>> > +1
>>> > With my concerns in the SPIP discussion.
>>> >
>>> > ________________________________
>>> > From: Hossein <fa...@gmail.com>
>>> > Sent: Wednesday, May 30, 2018 2:03:03 PM
>>> > To: dev@spark.apache.org
>>> > Subject: [VOTE] SPIP ML Pipelines in R
>>> >
>>> > Hi,
>>> >
>>> > I started discussion thread for a new R package to expose MLlib
>>> pipelines in
>>> > R.
>>> >
>>> > To summarize we will work on utilities to generate R wrappers for MLlib
>>> > pipeline API for a new R package. This will lower the burden for
>>> exposing
>>> > new API in future.
>>> >
>>> > Following the SPIP process, I am proposing the SPIP for a vote.
>>> >
>>> > +1: Let's go ahead and implement the SPIP.
>>> > +0: Don't really care.
>>> > -1: I do not think this is a good idea for the following reasons.
>>> >
>>> > Thanks,
>>> > --Hossein
>>>
>>
>>
Re: [VOTE] SPIP ML Pipelines in R
Posted by Reynold Xin <rx...@databricks.com>.
+1 on the proposal.
On Fri, Jun 1, 2018 at 8:17 PM Hossein <fa...@gmail.com> wrote:
> Hi Shivaram,
>
> We converged on a CRAN release process that seems identical to current
> SparkR.
>
> --Hossein
>
> On Thu, May 31, 2018 at 9:10 AM, Shivaram Venkataraman <
> shivaram@eecs.berkeley.edu> wrote:
>
>> Hossein -- Can you clarify what the resolution on the repository /
>> release issue discussed on SPIP ?
>>
>> Shivaram
>>
>> On Thu, May 31, 2018 at 9:06 AM, Felix Cheung <fe...@hotmail.com>
>> wrote:
>> > +1
>> > With my concerns in the SPIP discussion.
>> >
>> > ________________________________
>> > From: Hossein <fa...@gmail.com>
>> > Sent: Wednesday, May 30, 2018 2:03:03 PM
>> > To: dev@spark.apache.org
>> > Subject: [VOTE] SPIP ML Pipelines in R
>> >
>> > Hi,
>> >
>> > I started discussion thread for a new R package to expose MLlib
>> pipelines in
>> > R.
>> >
>> > To summarize we will work on utilities to generate R wrappers for MLlib
>> > pipeline API for a new R package. This will lower the burden for
>> exposing
>> > new API in future.
>> >
>> > Following the SPIP process, I am proposing the SPIP for a vote.
>> >
>> > +1: Let's go ahead and implement the SPIP.
>> > +0: Don't really care.
>> > -1: I do not think this is a good idea for the following reasons.
>> >
>> > Thanks,
>> > --Hossein
>>
>
>
Re: [VOTE] SPIP ML Pipelines in R
Posted by Hossein <fa...@gmail.com>.
Hi Shivaram,
We converged on a CRAN release process that seems identical to current
SparkR.
--Hossein
On Thu, May 31, 2018 at 9:10 AM, Shivaram Venkataraman <
shivaram@eecs.berkeley.edu> wrote:
> Hossein -- Can you clarify what the resolution on the repository /
> release issue discussed on SPIP ?
>
> Shivaram
>
> On Thu, May 31, 2018 at 9:06 AM, Felix Cheung <fe...@hotmail.com>
> wrote:
> > +1
> > With my concerns in the SPIP discussion.
> >
> > ________________________________
> > From: Hossein <fa...@gmail.com>
> > Sent: Wednesday, May 30, 2018 2:03:03 PM
> > To: dev@spark.apache.org
> > Subject: [VOTE] SPIP ML Pipelines in R
> >
> > Hi,
> >
> > I started discussion thread for a new R package to expose MLlib
> pipelines in
> > R.
> >
> > To summarize we will work on utilities to generate R wrappers for MLlib
> > pipeline API for a new R package. This will lower the burden for exposing
> > new API in future.
> >
> > Following the SPIP process, I am proposing the SPIP for a vote.
> >
> > +1: Let's go ahead and implement the SPIP.
> > +0: Don't really care.
> > -1: I do not think this is a good idea for the following reasons.
> >
> > Thanks,
> > --Hossein
>
Re: [VOTE] SPIP ML Pipelines in R
Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Hossein -- Can you clarify what the resolution on the repository /
release issue discussed on SPIP ?
Shivaram
On Thu, May 31, 2018 at 9:06 AM, Felix Cheung <fe...@hotmail.com> wrote:
> +1
> With my concerns in the SPIP discussion.
>
> ________________________________
> From: Hossein <fa...@gmail.com>
> Sent: Wednesday, May 30, 2018 2:03:03 PM
> To: dev@spark.apache.org
> Subject: [VOTE] SPIP ML Pipelines in R
>
> Hi,
>
> I started discussion thread for a new R package to expose MLlib pipelines in
> R.
>
> To summarize we will work on utilities to generate R wrappers for MLlib
> pipeline API for a new R package. This will lower the burden for exposing
> new API in future.
>
> Following the SPIP process, I am proposing the SPIP for a vote.
>
> +1: Let's go ahead and implement the SPIP.
> +0: Don't really care.
> -1: I do not think this is a good idea for the following reasons.
>
> Thanks,
> --Hossein
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: [VOTE] SPIP ML Pipelines in R
Posted by Felix Cheung <fe...@hotmail.com>.
+1
With my concerns in the SPIP discussion.
________________________________
From: Hossein <fa...@gmail.com>
Sent: Wednesday, May 30, 2018 2:03:03 PM
To: dev@spark.apache.org
Subject: [VOTE] SPIP ML Pipelines in R
Hi,
I started discussion thread<http://apache-spark-developers-list.1001551.n3.nabble.com/ML-Pipelines-in-R-td24022.html#a24023> for a new R package to expose MLlib pipelines in R<https://issues.apache.org/jira/secure/attachment/12925281/SparkML_%20ML%20Pipelines%20in%20R-v3.pdf>.
To summarize we will work on utilities to generate R wrappers for MLlib pipeline API for a new R package. This will lower the burden for exposing new API in future.
Following the SPIP process<https://spark.apache.org/improvement-proposals.html>, I am proposing the SPIP<https://issues.apache.org/jira/browse/SPARK-24359> for a vote.
+1: Let's go ahead and implement the SPIP.
+0: Don't really care.
-1: I do not think this is a good idea for the following reasons.
Thanks,
--Hossein