You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Herman van Hovell <he...@databricks.com.INVALID> on 2022/06/13 18:02:08 UTC

[VOTE][SPIP] Spark Connect

Hi all,

I’d like to start a vote for SPIP: "Spark Connect"

The goal of the SPIP is to introduce a Dataframe based client/server API
for Spark

Please also refer to:

- Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect -
A client and server interface for Apache Spark.
<https://lists.apache.org/thread/3fd2n34hlyg872nr55rylbv5cg8m1556>
- Design doc: Spark Connect - A client and server interface for Apache
Spark.
<https://docs.google.com/document/d/1Mnl6jmGszixLW4KcJU5j9IgpG9-UabS0dcM6PM2XGDc/edit?usp=sharing>
- JIRA: SPARK-39375 <https://issues.apache.org/jira/browse/SPARK-39375>

Please vote on the SPIP for the next 72 hours:

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don’t think this is a good idea because …

Kind Regards,
Herman

Re: [VOTE][SPIP] Spark Connect

Posted by Holden Karau <ho...@pigscanfly.ca>.
+1

On Thu, Jun 16, 2022 at 7:17 AM Thomas Graves <tg...@gmail.com> wrote:

> +1 for the concept.
> Correct me if I'm wrong, but at a high level this is proposing adding
> a new user API (which is language agnostic) and the proposal is to
> start with something like the Logical Plan, with the addition of being
> able to remotely call this API.
>
> +0 on architecture/design as it's not clear from the doc how much
> impact this truly has. But that is a problem with SPIPs which I have
> voiced my concern about in the past.
> I can see how this could be flushed out and keep the overall impact
> minimal (vs blow up the world architecture change) since it's not just
> a drop in replacement for all existing APIs.  For instance,
> conceptually this is just a version of the Spark thriftserver which
> uses grpc and passes the new API and internally we add a new API
> runPlan(LogicalPlan).  You could potentially also not use the internal
> version of the catalyst Logical Plan API but have some conversion
> still to allow changes to catalyst internals, not sure if that is
> needed but a possibility.
> With any API addition it will have to be kept stable and require more
> testing and likely more dev work, so weighing that vs usefulness is
> the question for me.
>
> Tom
>
> On Mon, Jun 13, 2022 at 1:04 PM Herman van Hovell
> <he...@databricks.com.invalid> wrote:
> >
> > Hi all,
> >
> > I’d like to start a vote for SPIP: "Spark Connect"
> >
> > The goal of the SPIP is to introduce a Dataframe based client/server API
> for Spark
> >
> > Please also refer to:
> >
> > - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect
> - A client and server interface for Apache Spark.
> > - Design doc: Spark Connect - A client and server interface for Apache
> Spark.
> > - JIRA: SPARK-39375
> >
> > Please vote on the SPIP for the next 72 hours:
> >
> > [ ] +1: Accept the proposal as an official SPIP
> > [ ] +0
> > [ ] -1: I don’t think this is a good idea because …
> >
> > Kind Regards,
> > Herman
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
> --
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Re: [VOTE][SPIP] Spark Connect

Posted by Thomas Graves <tg...@gmail.com>.
+1 for the concept.
Correct me if I'm wrong, but at a high level this is proposing adding
a new user API (which is language agnostic) and the proposal is to
start with something like the Logical Plan, with the addition of being
able to remotely call this API.

+0 on architecture/design as it's not clear from the doc how much
impact this truly has. But that is a problem with SPIPs which I have
voiced my concern about in the past.
I can see how this could be flushed out and keep the overall impact
minimal (vs blow up the world architecture change) since it's not just
a drop in replacement for all existing APIs.  For instance,
conceptually this is just a version of the Spark thriftserver which
uses grpc and passes the new API and internally we add a new API
runPlan(LogicalPlan).  You could potentially also not use the internal
version of the catalyst Logical Plan API but have some conversion
still to allow changes to catalyst internals, not sure if that is
needed but a possibility.
With any API addition it will have to be kept stable and require more
testing and likely more dev work, so weighing that vs usefulness is
the question for me.

Tom

On Mon, Jun 13, 2022 at 1:04 PM Herman van Hovell
<he...@databricks.com.invalid> wrote:
>
> Hi all,
>
> I’d like to start a vote for SPIP: "Spark Connect"
>
> The goal of the SPIP is to introduce a Dataframe based client/server API for Spark
>
> Please also refer to:
>
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A client and server interface for Apache Spark.
> - Design doc: Spark Connect - A client and server interface for Apache Spark.
> - JIRA: SPARK-39375
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Herman

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: Re: [VOTE][SPIP] Spark Connect

Posted by Reynold Xin <rx...@databricks.com.INVALID>.
+1 super excited about this. I think it'd make Spark a lot more usable in application development and cloud setting:

(1) Makes it easier to embed in applications with thinner client dependencies.
(2) Easier to isolate user code vs system code in the driver.

(3) Opens up the potential to upgrade the server side for better performance and security updates without application changes.

One thing related to (2) I'd love to discuss, but at a separate thread, is whether it'd make sense to expand or work on a project to better specify system code vs user code boundary in the executors as well. Then we can really have complete system code vs user code isolation in execution.

On Wed, Jun 15, 2022 at 9:21 AM, Xiao Li < gatorsmile@gmail.com > wrote:

> 
> +1
> 
> 
> Xiao
> 
> beliefer < beliefer@ 163. com ( beliefer@163.com ) > 于2022年6月14日周二 03:35写道:
> 
> 
> 
>> +1
>> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
>> But the Spark Driver in Livy looks heavy.
>> 
>> 
>> The SPIP may resolve the issue.
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> At 2022-06-14 18:11:21, "Wenchen Fan" < cloud0fan@ gmail. com (
>> cloud0fan@gmail.com ) > wrote:
>> 
>> 
>>> +1
>>> 
>>> 
>>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng < ruifengz@ foxmail. com (
>>> ruifengz@foxmail.com ) > wrote:
>>> 
>>> 
>>>> +1
>>>> 
>>>> 
>>>> 
>>>> 
>>>> ------------------ 原始邮件 ------------------
>>>> *发件人:* "huaxin gao" < huaxin. gao11@ gmail. com ( huaxin.gao11@gmail.com )
>>>> >;
>>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>>> *收件人:* "L. C. Hsieh"< viirya@ gmail. com ( viirya@gmail.com ) >;
>>>> *抄送:* "Spark dev list"< dev@ spark. apache. org ( dev@spark.apache.org ) >;
>>>> 
>>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>> 
>>>> 
>>>> +1
>>>> 
>>>> 
>>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh < viirya@ gmail. com (
>>>> viirya@gmail.com ) > wrote:
>>>> 
>>>> 
>>>>> +1
>>>>> 
>>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun < sunchao@ apache. org (
>>>>> sunchao@apache.org ) > wrote:
>>>>> >
>>>>> > +1 (non-binding)
>>>>> >
>>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon < gurwls223@ gmail. com (
>>>>> gurwls223@gmail.com ) > wrote:
>>>>> >>
>>>>> >> +1
>>>>> >>
>>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang < wgyumg@ gmail. com (
>>>>> wgyumg@gmail.com ) > wrote:
>>>>> >>>
>>>>> >>> +1.
>>>>> >>>
>>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia < matei. zaharia@ gmail.
>>>>> com ( matei.zaharia@gmail.com ) > wrote:
>>>>> >>>>
>>>>> >>>> +1, very excited about this direction.
>>>>> >>>>
>>>>> >>>> Matei
>>>>> >>>>
>>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell < herman@ databricks.
>>>>> com. INVALID ( herman@databricks.com.INVALID ) > wrote:
>>>>> >>>>
>>>>> >>>> Let me kick off the voting...
>>>>> >>>>
>>>>> >>>> +1
>>>>> >>>>
>>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell < herman@ databricks.
>>>>> com ( herman@databricks.com ) > wrote:
>>>>> >>>>>
>>>>> >>>>> Hi all,
>>>>> >>>>>
>>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>> >>>>>
>>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based client/server
>>>>> API for Spark
>>>>> >>>>>
>>>>> >>>>> Please also refer to:
>>>>> >>>>>
>>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>>> Connect - A client and server interface for Apache Spark.
>>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>>> Apache Spark.
>>>>> >>>>> - JIRA: SPARK-39375
>>>>> >>>>>
>>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>>> >>>>>
>>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> >>>>> [ ] +0
>>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>>> >>>>>
>>>>> >>>>> Kind Regards,
>>>>> >>>>> Herman
>>>>> >>>>
>>>>> >>>>
>>>>> 
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe e-mail: dev-unsubscribe@ spark. apache. org (
>>>>> dev-unsubscribe@spark.apache.org )
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
> 
>

Re: Re: [VOTE][SPIP] Spark Connect

Posted by Yikun Jiang <yi...@gmail.com>.
+1 (non-binding)

A lighter client will definitely help other ecosystems integrate more
easily with Spark!

Regards,
Yikun


On Thu, Jun 16, 2022 at 12:54 AM Gengliang Wang <lt...@gmail.com> wrote:

> +1 (non-binding)
>
> On Wed, Jun 15, 2022 at 9:32 AM Dongjoon Hyun <do...@gmail.com>
> wrote:
>
>> +1
>>
>> On Wed, Jun 15, 2022 at 9:22 AM Xiao Li <ga...@gmail.com> wrote:
>>
>>> +1
>>>
>>> Xiao
>>>
>>> beliefer <be...@163.com> 于2022年6月14日周二 03:35写道:
>>>
>>>> +1
>>>> Yeah, I tried to use Apache Livy, so as we can runing interactive
>>>> query. But the Spark Driver in Livy looks heavy.
>>>>
>>>> The SPIP may resolve the issue.
>>>>
>>>>
>>>>
>>>> At 2022-06-14 18:11:21, "Wenchen Fan" <cl...@gmail.com> wrote:
>>>>
>>>> +1
>>>>
>>>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng <ru...@foxmail.com>
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>>
>>>>> ------------------ 原始邮件 ------------------
>>>>> *发件人:* "huaxin gao" <hu...@gmail.com>;
>>>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>>>> *收件人:* "L. C. Hsieh"<vi...@gmail.com>;
>>>>> *抄送:* "Spark dev list"<de...@spark.apache.org>;
>>>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>>>
>>>>> +1
>>>>>
>>>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>>>>>> >
>>>>>> > +1 (non-binding)
>>>>>> >
>>>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>> wrote:
>>>>>> >>
>>>>>> >> +1
>>>>>> >>
>>>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com>
>>>>>> wrote:
>>>>>> >>>
>>>>>> >>> +1.
>>>>>> >>>
>>>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>>>>> matei.zaharia@gmail.com> wrote:
>>>>>> >>>>
>>>>>> >>>> +1, very excited about this direction.
>>>>>> >>>>
>>>>>> >>>> Matei
>>>>>> >>>>
>>>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>>>> <he...@databricks.com.INVALID> wrote:
>>>>>> >>>>
>>>>>> >>>> Let me kick off the voting...
>>>>>> >>>>
>>>>>> >>>> +1
>>>>>> >>>>
>>>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>>>>> herman@databricks.com> wrote:
>>>>>> >>>>>
>>>>>> >>>>> Hi all,
>>>>>> >>>>>
>>>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>>> >>>>>
>>>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>>>>> client/server API for Spark
>>>>>> >>>>>
>>>>>> >>>>> Please also refer to:
>>>>>> >>>>>
>>>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP:
>>>>>> Spark Connect - A client and server interface for Apache Spark.
>>>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>>>> Apache Spark.
>>>>>> >>>>> - JIRA: SPARK-39375
>>>>>> >>>>>
>>>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>>>> >>>>>
>>>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>>> >>>>> [ ] +0
>>>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>> >>>>>
>>>>>> >>>>> Kind Regards,
>>>>>> >>>>> Herman
>>>>>> >>>>
>>>>>> >>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>>>>>
>>>>>>

Re: Re: [VOTE][SPIP] Spark Connect

Posted by Gengliang Wang <lt...@gmail.com>.
+1 (non-binding)

On Wed, Jun 15, 2022 at 9:32 AM Dongjoon Hyun <do...@gmail.com>
wrote:

> +1
>
> On Wed, Jun 15, 2022 at 9:22 AM Xiao Li <ga...@gmail.com> wrote:
>
>> +1
>>
>> Xiao
>>
>> beliefer <be...@163.com> 于2022年6月14日周二 03:35写道:
>>
>>> +1
>>> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
>>> But the Spark Driver in Livy looks heavy.
>>>
>>> The SPIP may resolve the issue.
>>>
>>>
>>>
>>> At 2022-06-14 18:11:21, "Wenchen Fan" <cl...@gmail.com> wrote:
>>>
>>> +1
>>>
>>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng <ru...@foxmail.com>
>>> wrote:
>>>
>>>> +1
>>>>
>>>>
>>>> ------------------ 原始邮件 ------------------
>>>> *发件人:* "huaxin gao" <hu...@gmail.com>;
>>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>>> *收件人:* "L. C. Hsieh"<vi...@gmail.com>;
>>>> *抄送:* "Spark dev list"<de...@spark.apache.org>;
>>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>>
>>>> +1
>>>>
>>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>>>>> >
>>>>> > +1 (non-binding)
>>>>> >
>>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com>
>>>>> wrote:
>>>>> >>
>>>>> >> +1
>>>>> >>
>>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>>>>> >>>
>>>>> >>> +1.
>>>>> >>>
>>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>>>> matei.zaharia@gmail.com> wrote:
>>>>> >>>>
>>>>> >>>> +1, very excited about this direction.
>>>>> >>>>
>>>>> >>>> Matei
>>>>> >>>>
>>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>>> <he...@databricks.com.INVALID> wrote:
>>>>> >>>>
>>>>> >>>> Let me kick off the voting...
>>>>> >>>>
>>>>> >>>> +1
>>>>> >>>>
>>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>>>> herman@databricks.com> wrote:
>>>>> >>>>>
>>>>> >>>>> Hi all,
>>>>> >>>>>
>>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>> >>>>>
>>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>>>> client/server API for Spark
>>>>> >>>>>
>>>>> >>>>> Please also refer to:
>>>>> >>>>>
>>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>>> Connect - A client and server interface for Apache Spark.
>>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>>> Apache Spark.
>>>>> >>>>> - JIRA: SPARK-39375
>>>>> >>>>>
>>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>>> >>>>>
>>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> >>>>> [ ] +0
>>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>>> >>>>>
>>>>> >>>>> Kind Regards,
>>>>> >>>>> Herman
>>>>> >>>>
>>>>> >>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>>>>
>>>>>

Re: Re: [VOTE][SPIP] Spark Connect

Posted by Dongjoon Hyun <do...@gmail.com>.
+1

On Wed, Jun 15, 2022 at 9:22 AM Xiao Li <ga...@gmail.com> wrote:

> +1
>
> Xiao
>
> beliefer <be...@163.com> 于2022年6月14日周二 03:35写道:
>
>> +1
>> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
>> But the Spark Driver in Livy looks heavy.
>>
>> The SPIP may resolve the issue.
>>
>>
>>
>> At 2022-06-14 18:11:21, "Wenchen Fan" <cl...@gmail.com> wrote:
>>
>> +1
>>
>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng <ru...@foxmail.com>
>> wrote:
>>
>>> +1
>>>
>>>
>>> ------------------ 原始邮件 ------------------
>>> *发件人:* "huaxin gao" <hu...@gmail.com>;
>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>> *收件人:* "L. C. Hsieh"<vi...@gmail.com>;
>>> *抄送:* "Spark dev list"<de...@spark.apache.org>;
>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>
>>> +1
>>>
>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:
>>>
>>>> +1
>>>>
>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>>>> >
>>>> > +1 (non-binding)
>>>> >
>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com>
>>>> wrote:
>>>> >>
>>>> >> +1
>>>> >>
>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>>>> >>>
>>>> >>> +1.
>>>> >>>
>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>>> matei.zaharia@gmail.com> wrote:
>>>> >>>>
>>>> >>>> +1, very excited about this direction.
>>>> >>>>
>>>> >>>> Matei
>>>> >>>>
>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>> <he...@databricks.com.INVALID> wrote:
>>>> >>>>
>>>> >>>> Let me kick off the voting...
>>>> >>>>
>>>> >>>> +1
>>>> >>>>
>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>>> herman@databricks.com> wrote:
>>>> >>>>>
>>>> >>>>> Hi all,
>>>> >>>>>
>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>> >>>>>
>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>>> client/server API for Spark
>>>> >>>>>
>>>> >>>>> Please also refer to:
>>>> >>>>>
>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>> Connect - A client and server interface for Apache Spark.
>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>> Apache Spark.
>>>> >>>>> - JIRA: SPARK-39375
>>>> >>>>>
>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>> >>>>>
>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>> >>>>> [ ] +0
>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>> >>>>>
>>>> >>>>> Kind Regards,
>>>> >>>>> Herman
>>>> >>>>
>>>> >>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>>>
>>>>

Re: Re: [VOTE][SPIP] Spark Connect

Posted by Xiao Li <ga...@gmail.com>.
+1

Xiao

beliefer <be...@163.com> 于2022年6月14日周二 03:35写道:

> +1
> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
> But the Spark Driver in Livy looks heavy.
>
> The SPIP may resolve the issue.
>
>
>
> At 2022-06-14 18:11:21, "Wenchen Fan" <cl...@gmail.com> wrote:
>
> +1
>
> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng <ru...@foxmail.com>
> wrote:
>
>> +1
>>
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "huaxin gao" <hu...@gmail.com>;
>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>> *收件人:* "L. C. Hsieh"<vi...@gmail.com>;
>> *抄送:* "Spark dev list"<de...@spark.apache.org>;
>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>
>> +1
>>
>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:
>>
>>> +1
>>>
>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>>> >
>>> > +1 (non-binding)
>>> >
>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com>
>>> wrote:
>>> >>
>>> >> +1
>>> >>
>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>>> >>>
>>> >>> +1.
>>> >>>
>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>> matei.zaharia@gmail.com> wrote:
>>> >>>>
>>> >>>> +1, very excited about this direction.
>>> >>>>
>>> >>>> Matei
>>> >>>>
>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>> <he...@databricks.com.INVALID> wrote:
>>> >>>>
>>> >>>> Let me kick off the voting...
>>> >>>>
>>> >>>> +1
>>> >>>>
>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>> herman@databricks.com> wrote:
>>> >>>>>
>>> >>>>> Hi all,
>>> >>>>>
>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>> >>>>>
>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>> client/server API for Spark
>>> >>>>>
>>> >>>>> Please also refer to:
>>> >>>>>
>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>> Connect - A client and server interface for Apache Spark.
>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>> Apache Spark.
>>> >>>>> - JIRA: SPARK-39375
>>> >>>>>
>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>> >>>>>
>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>> >>>>> [ ] +0
>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>> >>>>>
>>> >>>>> Kind Regards,
>>> >>>>> Herman
>>> >>>>
>>> >>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>>
>>>

Re:Re: [VOTE][SPIP] Spark Connect

Posted by beliefer <be...@163.com>.
+1
Yeah, I tried to use Apache Livy, so as we can runing interactive query. But the Spark Driver in Livy looks heavy.

The SPIP may resolve the issue.







At 2022-06-14 18:11:21, "Wenchen Fan" <cl...@gmail.com> wrote:

+1



On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng <ru...@foxmail.com> wrote:

+1





------------------ 原始邮件 ------------------
发件人: "huaxin gao" <hu...@gmail.com>;
发送时间: 2022年6月14日(星期二) 上午8:47
收件人: "L. C. Hsieh"<vi...@gmail.com>;
抄送: "Spark dev list"<de...@spark.apache.org>;
主题: Re: [VOTE][SPIP] Spark Connect


+1



On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:

+1

On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>
> +1 (non-binding)
>
> On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>
>> +1
>>
>> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>>>
>>> +1.
>>>
>>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <ma...@gmail.com> wrote:
>>>>
>>>> +1, very excited about this direction.
>>>>
>>>> Matei
>>>>
>>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <he...@databricks.com.INVALID> wrote:
>>>>
>>>> Let me kick off the voting...
>>>>
>>>> +1
>>>>
>>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <he...@databricks.com> wrote:
>>>>>
>>>>> Hi all,
>>>>>
>>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>>
>>>>> The goal of the SPIP is to introduce a Dataframe based client/server API for Spark
>>>>>
>>>>> Please also refer to:
>>>>>
>>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A client and server interface for Apache Spark.
>>>>> - Design doc: Spark Connect - A client and server interface for Apache Spark.
>>>>> - JIRA: SPARK-39375
>>>>>
>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>
>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> [ ] +0
>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>
>>>>> Kind Regards,
>>>>> Herman
>>>>
>>>>

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: [VOTE][SPIP] Spark Connect

Posted by Wenchen Fan <cl...@gmail.com>.
+1

On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng <ru...@foxmail.com> wrote:

> +1
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "huaxin gao" <hu...@gmail.com>;
> *发送时间:* 2022年6月14日(星期二) 上午8:47
> *收件人:* "L. C. Hsieh"<vi...@gmail.com>;
> *抄送:* "Spark dev list"<de...@spark.apache.org>;
> *主题:* Re: [VOTE][SPIP] Spark Connect
>
> +1
>
> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:
>
>> +1
>>
>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>> >
>> > +1 (non-binding)
>> >
>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com>
>> wrote:
>> >>
>> >> +1
>> >>
>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>> >>>
>> >>> +1.
>> >>>
>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>> matei.zaharia@gmail.com> wrote:
>> >>>>
>> >>>> +1, very excited about this direction.
>> >>>>
>> >>>> Matei
>> >>>>
>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>> <he...@databricks.com.INVALID> wrote:
>> >>>>
>> >>>> Let me kick off the voting...
>> >>>>
>> >>>> +1
>> >>>>
>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>> herman@databricks.com> wrote:
>> >>>>>
>> >>>>> Hi all,
>> >>>>>
>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>> >>>>>
>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>> client/server API for Spark
>> >>>>>
>> >>>>> Please also refer to:
>> >>>>>
>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>> Connect - A client and server interface for Apache Spark.
>> >>>>> - Design doc: Spark Connect - A client and server interface for
>> Apache Spark.
>> >>>>> - JIRA: SPARK-39375
>> >>>>>
>> >>>>> Please vote on the SPIP for the next 72 hours:
>> >>>>>
>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>> >>>>> [ ] +0
>> >>>>> [ ] -1: I don’t think this is a good idea because …
>> >>>>>
>> >>>>> Kind Regards,
>> >>>>> Herman
>> >>>>
>> >>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>
>>

回复: [VOTE][SPIP] Spark Connect

Posted by Ruifeng Zheng <ru...@foxmail.com>.
+1




------------------&nbsp;原始邮件&nbsp;------------------
发件人:                                                                                                                        "huaxin gao"                                                                                    <huaxin.gao11@gmail.com&gt;;
发送时间:&nbsp;2022年6月14日(星期二) 上午8:47
收件人:&nbsp;"L. C. Hsieh"<viirya@gmail.com&gt;;
抄送:&nbsp;"Spark dev list"<dev@spark.apache.org&gt;;
主题:&nbsp;Re: [VOTE][SPIP] Spark Connect



+1


On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <viirya@gmail.com&gt; wrote:

+1
 
 On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <sunchao@apache.org&gt; wrote:
 &gt;
 &gt; +1 (non-binding)
 &gt;
 &gt; On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gurwls223@gmail.com&gt; wrote:
 &gt;&gt;
 &gt;&gt; +1
 &gt;&gt;
 &gt;&gt; On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wgyumg@gmail.com&gt; wrote:
 &gt;&gt;&gt;
 &gt;&gt;&gt; +1.
 &gt;&gt;&gt;
 &gt;&gt;&gt; On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <matei.zaharia@gmail.com&gt; wrote:
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt; +1, very excited about this direction.
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt; Matei
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt; On Jun 13, 2022, at 11:07 AM, Herman van Hovell <herman@databricks.com.INVALID&gt; wrote:
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt; Let me kick off the voting...
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt; +1
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt; On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <herman@databricks.com&gt; wrote:
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; Hi all,
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; I’d like to start a vote for SPIP: "Spark Connect"
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; The goal of the SPIP is to introduce a Dataframe based client/server API for Spark
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; Please also refer to:
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A client and server interface for Apache Spark.
 &gt;&gt;&gt;&gt;&gt; - Design doc: Spark Connect - A client and server interface for Apache Spark.
 &gt;&gt;&gt;&gt;&gt; - JIRA: SPARK-39375
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; Please vote on the SPIP for the next 72 hours:
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; [ ] +1: Accept the proposal as an official SPIP
 &gt;&gt;&gt;&gt;&gt; [ ] +0
 &gt;&gt;&gt;&gt;&gt; [ ] -1: I don’t think this is a good idea because …
 &gt;&gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;&gt; Kind Regards,
 &gt;&gt;&gt;&gt;&gt; Herman
 &gt;&gt;&gt;&gt;
 &gt;&gt;&gt;&gt;
 
 ---------------------------------------------------------------------
 To unsubscribe e-mail: dev-unsubscribe@spark.apache.org

Re: [VOTE][SPIP] Spark Connect

Posted by huaxin gao <hu...@gmail.com>.
+1

On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh <vi...@gmail.com> wrote:

> +1
>
> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
> >
> > +1 (non-binding)
> >
> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com>
> wrote:
> >>
> >> +1
> >>
> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
> >>>
> >>> +1.
> >>>
> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <ma...@gmail.com>
> wrote:
> >>>>
> >>>> +1, very excited about this direction.
> >>>>
> >>>> Matei
> >>>>
> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
> <he...@databricks.com.INVALID> wrote:
> >>>>
> >>>> Let me kick off the voting...
> >>>>
> >>>> +1
> >>>>
> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
> herman@databricks.com> wrote:
> >>>>>
> >>>>> Hi all,
> >>>>>
> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
> >>>>>
> >>>>> The goal of the SPIP is to introduce a Dataframe based client/server
> API for Spark
> >>>>>
> >>>>> Please also refer to:
> >>>>>
> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
> Connect - A client and server interface for Apache Spark.
> >>>>> - Design doc: Spark Connect - A client and server interface for
> Apache Spark.
> >>>>> - JIRA: SPARK-39375
> >>>>>
> >>>>> Please vote on the SPIP for the next 72 hours:
> >>>>>
> >>>>> [ ] +1: Accept the proposal as an official SPIP
> >>>>> [ ] +0
> >>>>> [ ] -1: I don’t think this is a good idea because …
> >>>>>
> >>>>> Kind Regards,
> >>>>> Herman
> >>>>
> >>>>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>

Re: [VOTE][SPIP] Spark Connect

Posted by "L. C. Hsieh" <vi...@gmail.com>.
+1

On Mon, Jun 13, 2022 at 5:41 PM Chao Sun <su...@apache.org> wrote:
>
> +1 (non-binding)
>
> On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>
>> +1
>>
>> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>>>
>>> +1.
>>>
>>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <ma...@gmail.com> wrote:
>>>>
>>>> +1, very excited about this direction.
>>>>
>>>> Matei
>>>>
>>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <he...@databricks.com.INVALID> wrote:
>>>>
>>>> Let me kick off the voting...
>>>>
>>>> +1
>>>>
>>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <he...@databricks.com> wrote:
>>>>>
>>>>> Hi all,
>>>>>
>>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>>
>>>>> The goal of the SPIP is to introduce a Dataframe based client/server API for Spark
>>>>>
>>>>> Please also refer to:
>>>>>
>>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A client and server interface for Apache Spark.
>>>>> - Design doc: Spark Connect - A client and server interface for Apache Spark.
>>>>> - JIRA: SPARK-39375
>>>>>
>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>
>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> [ ] +0
>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>
>>>>> Kind Regards,
>>>>> Herman
>>>>
>>>>

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: [VOTE][SPIP] Spark Connect

Posted by Chao Sun <su...@apache.org>.
+1 (non-binding)

On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon <gu...@gmail.com> wrote:

> +1
>
> On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:
>
>> +1.
>>
>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <ma...@gmail.com>
>> wrote:
>>
>>> +1, very excited about this direction.
>>>
>>> Matei
>>>
>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <
>>> herman@databricks.com.INVALID> wrote:
>>>
>>> Let me kick off the voting...
>>>
>>> +1
>>>
>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <he...@databricks.com>
>>> wrote:
>>>
>>>> Hi all,
>>>>
>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>
>>>> The goal of the SPIP is to introduce a Dataframe based client/server
>>>> API for Spark
>>>>
>>>> Please also refer to:
>>>>
>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>> Connect - A client and server interface for Apache Spark.
>>>> <https://lists.apache.org/thread/3fd2n34hlyg872nr55rylbv5cg8m1556>
>>>> - Design doc: Spark Connect - A client and server interface for Apache
>>>> Spark.
>>>> <https://docs.google.com/document/d/1Mnl6jmGszixLW4KcJU5j9IgpG9-UabS0dcM6PM2XGDc/edit?usp=sharing>
>>>> - JIRA: SPARK-39375 <https://issues.apache.org/jira/browse/SPARK-39375>
>>>>
>>>> Please vote on the SPIP for the next 72 hours:
>>>>
>>>> [ ] +1: Accept the proposal as an official SPIP
>>>> [ ] +0
>>>> [ ] -1: I don’t think this is a good idea because …
>>>>
>>>> Kind Regards,
>>>> Herman
>>>>
>>>
>>>

Re: [VOTE][SPIP] Spark Connect

Posted by Hyukjin Kwon <gu...@gmail.com>.
+1

On Tue, 14 Jun 2022 at 08:50, Yuming Wang <wg...@gmail.com> wrote:

> +1.
>
> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <ma...@gmail.com>
> wrote:
>
>> +1, very excited about this direction.
>>
>> Matei
>>
>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <
>> herman@databricks.com.INVALID> wrote:
>>
>> Let me kick off the voting...
>>
>> +1
>>
>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <he...@databricks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>
>>> The goal of the SPIP is to introduce a Dataframe based client/server
>>> API for Spark
>>>
>>> Please also refer to:
>>>
>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>> Connect - A client and server interface for Apache Spark.
>>> <https://lists.apache.org/thread/3fd2n34hlyg872nr55rylbv5cg8m1556>
>>> - Design doc: Spark Connect - A client and server interface for Apache
>>> Spark.
>>> <https://docs.google.com/document/d/1Mnl6jmGszixLW4KcJU5j9IgpG9-UabS0dcM6PM2XGDc/edit?usp=sharing>
>>> - JIRA: SPARK-39375 <https://issues.apache.org/jira/browse/SPARK-39375>
>>>
>>> Please vote on the SPIP for the next 72 hours:
>>>
>>> [ ] +1: Accept the proposal as an official SPIP
>>> [ ] +0
>>> [ ] -1: I don’t think this is a good idea because …
>>>
>>> Kind Regards,
>>> Herman
>>>
>>
>>

Re: [VOTE][SPIP] Spark Connect

Posted by Yuming Wang <wg...@gmail.com>.
+1.

On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <ma...@gmail.com>
wrote:

> +1, very excited about this direction.
>
> Matei
>
> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <
> herman@databricks.com.INVALID> wrote:
>
> Let me kick off the voting...
>
> +1
>
> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <he...@databricks.com>
> wrote:
>
>> Hi all,
>>
>> I’d like to start a vote for SPIP: "Spark Connect"
>>
>> The goal of the SPIP is to introduce a Dataframe based client/server API
>> for Spark
>>
>> Please also refer to:
>>
>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect
>> - A client and server interface for Apache Spark.
>> <https://lists.apache.org/thread/3fd2n34hlyg872nr55rylbv5cg8m1556>
>> - Design doc: Spark Connect - A client and server interface for Apache
>> Spark.
>> <https://docs.google.com/document/d/1Mnl6jmGszixLW4KcJU5j9IgpG9-UabS0dcM6PM2XGDc/edit?usp=sharing>
>> - JIRA: SPARK-39375 <https://issues.apache.org/jira/browse/SPARK-39375>
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>> Kind Regards,
>> Herman
>>
>
>

Re: [VOTE][SPIP] Spark Connect

Posted by Matei Zaharia <ma...@gmail.com>.
+1, very excited about this direction.

Matei

> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <he...@databricks.com.INVALID> wrote:
> 
> Let me kick off the voting...
> 
> +1
> 
> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <herman@databricks.com <ma...@databricks.com>> wrote:
> Hi all,
> 
> I’d like to start a vote for SPIP: "Spark Connect"
> 
> The goal of the SPIP is to introduce a Dataframe based client/server API for Spark
> 
> Please also refer to:
> 
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A client and server interface for Apache Spark. <https://lists.apache.org/thread/3fd2n34hlyg872nr55rylbv5cg8m1556>
> - Design doc: Spark Connect - A client and server interface for Apache Spark. <https://docs.google.com/document/d/1Mnl6jmGszixLW4KcJU5j9IgpG9-UabS0dcM6PM2XGDc/edit?usp=sharing>
> - JIRA: SPARK-39375 <https://issues.apache.org/jira/browse/SPARK-39375>
> 
> Please vote on the SPIP for the next 72 hours:
> 
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
> 
> Kind Regards,
> Herman


Re: [VOTE][SPIP] Spark Connect

Posted by Herman van Hovell <he...@databricks.com.INVALID>.
Let me kick off the voting...

+1

On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <he...@databricks.com>
wrote:

> Hi all,
>
> I’d like to start a vote for SPIP: "Spark Connect"
>
> The goal of the SPIP is to introduce a Dataframe based client/server API
> for Spark
>
> Please also refer to:
>
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect
> - A client and server interface for Apache Spark.
> <https://lists.apache.org/thread/3fd2n34hlyg872nr55rylbv5cg8m1556>
> - Design doc: Spark Connect - A client and server interface for Apache
> Spark.
> <https://docs.google.com/document/d/1Mnl6jmGszixLW4KcJU5j9IgpG9-UabS0dcM6PM2XGDc/edit?usp=sharing>
> - JIRA: SPARK-39375 <https://issues.apache.org/jira/browse/SPARK-39375>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Herman
>