You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Renjie Liu <li...@gmail.com> on 2025/05/09 08:52:39 UTC

[DISCUSS] New Spark Connect Client repository for Rust language

Hi, All:

I'd like to propose to add a new Apache Spark repository for `Spark Connect
Client for Rust`.

https://github.com/apache/spark-connect-
<https://github.com/apache/spark-connect-swift>rust

There are already some efforts for building spark-connect client in rust:
https://github.com/sjrusso8/spark-connect-rs

We have contacted the author and he's positive in donating this to the
apache community, see this discussion issue:
https://github.com/sjrusso8/spark-connect-rs

If the community agrees with creating this new repo, we could build the
spark-connect-rs client based on existing work. (I don't mean to copy codes
to the new repo, but it will be based on the existing effort).

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Jules Damji <ju...@gmail.com>.
+1 yes, having in one place may be desirable but the release & build
process could be onerous. I would keep them separate in their respective
repos.

Cheers
Jules

Excuse the thumb typos


On Fri, 16 May 2025 at 6:53 AM, Fokko Driesprong <fo...@apache.org> wrote:

> Hi Niranjan,
>
> Thanks for jumping in here. I have some experience with monorepos in OSS,
> more precisely Avro, and I believe this complicates things. Combining
> everything complicates the build process, and I often find myself fixing
> things in the PHP client while we are trying to get a Java patch release
> out. My preference would be to keep this separate. For Avro, we recently
> moved Rust into a separate repository. FWIW, other projects, for example,
> Arrow, are also moving to separate repositories.
>
> Kind regards,
> Fokko
>
> Op vr 16 mei 2025 om 14:11 schreef Niranjan Jayakar
> <ni...@databricks.com.invalid>:
>
>> +1 on the Rust client.
>>
>> We have a Swift, Go and soon a Rust client - I'm wondering if we should
>> manage these in a single monorepo, rather than one per client, with just a
>> separate top-level folder per language.
>>
>> This would make it easy to manage all clients, add features across
>> clients, add more clients by language, release management, etc.
>>
>> Niranjan
>>
>> On Fri, May 16, 2025 at 11:38 AM Renjie Liu <li...@gmail.com>
>> wrote:
>>
>>> Thanks Denny and Jules for the response.
>>>
>>> It seems there is no objection about this proposal, would some
>>> committer/PMC member help to create the repo?
>>>
>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>> wrote:
>>>
>>>> +1 in this effort.
>>>> —
>>>> Sent from my iPhone
>>>> Pardon the dumb thumb typos :)
>>>>
>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>>>>
>>>> 
>>>> Hi, All:
>>>>
>>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>>> Connect Client for Rust`.
>>>>
>>>> https://github.com/apache/spark-connect-
>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>
>>>> There are already some efforts for building spark-connect client in
>>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>>
>>>> We have contacted the author and he's positive in donating this to the
>>>> apache community, see this discussion issue:
>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>
>>>> If the community agrees with creating this new repo, we could build the
>>>> spark-connect-rs client based on existing work. (I don't mean to copy codes
>>>> to the new repo, but it will be based on the existing effort).
>>>>
>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Fokko Driesprong <fo...@apache.org>.
Hi Niranjan,

Thanks for jumping in here. I have some experience with monorepos in OSS,
more precisely Avro, and I believe this complicates things. Combining
everything complicates the build process, and I often find myself fixing
things in the PHP client while we are trying to get a Java patch release
out. My preference would be to keep this separate. For Avro, we recently
moved Rust into a separate repository. FWIW, other projects, for example,
Arrow, are also moving to separate repositories.

Kind regards,
Fokko

Op vr 16 mei 2025 om 14:11 schreef Niranjan Jayakar
<ni...@databricks.com.invalid>:

> +1 on the Rust client.
>
> We have a Swift, Go and soon a Rust client - I'm wondering if we should
> manage these in a single monorepo, rather than one per client, with just a
> separate top-level folder per language.
>
> This would make it easy to manage all clients, add features across
> clients, add more clients by language, release management, etc.
>
> Niranjan
>
> On Fri, May 16, 2025 at 11:38 AM Renjie Liu <li...@gmail.com>
> wrote:
>
>> Thanks Denny and Jules for the response.
>>
>> It seems there is no objection about this proposal, would some
>> committer/PMC member help to create the repo?
>>
>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>> wrote:
>>
>>> +1 in this effort.
>>> —
>>> Sent from my iPhone
>>> Pardon the dumb thumb typos :)
>>>
>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>>>
>>> 
>>> Hi, All:
>>>
>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>> Connect Client for Rust`.
>>>
>>> https://github.com/apache/spark-connect-
>>> <https://github.com/apache/spark-connect-swift>rust
>>>
>>> There are already some efforts for building spark-connect client in
>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>
>>> We have contacted the author and he's positive in donating this to the
>>> apache community, see this discussion issue:
>>> https://github.com/sjrusso8/spark-connect-rs
>>>
>>> If the community agrees with creating this new repo, we could build the
>>> spark-connect-rs client based on existing work. (I don't mean to copy codes
>>> to the new repo, but it will be based on the existing effort).
>>>
>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Niranjan Jayakar <ni...@databricks.com.INVALID>.
+1 on the Rust client.

We have a Swift, Go and soon a Rust client - I'm wondering if we should
manage these in a single monorepo, rather than one per client, with just a
separate top-level folder per language.

This would make it easy to manage all clients, add features across clients,
add more clients by language, release management, etc.

Niranjan

On Fri, May 16, 2025 at 11:38 AM Renjie Liu <li...@gmail.com> wrote:

> Thanks Denny and Jules for the response.
>
> It seems there is no objection about this proposal, would some
> committer/PMC member help to create the repo?
>
> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com> wrote:
>
>> +1 in this effort.
>> —
>> Sent from my iPhone
>> Pardon the dumb thumb typos :)
>>
>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>>
>> 
>> Hi, All:
>>
>> I'd like to propose to add a new Apache Spark repository for `Spark
>> Connect Client for Rust`.
>>
>> https://github.com/apache/spark-connect-
>> <https://github.com/apache/spark-connect-swift>rust
>>
>> There are already some efforts for building spark-connect client in rust:
>> https://github.com/sjrusso8/spark-connect-rs
>>
>> We have contacted the author and he's positive in donating this to the
>> apache community, see this discussion issue:
>> https://github.com/sjrusso8/spark-connect-rs
>>
>> If the community agrees with creating this new repo, we could build the
>> spark-connect-rs client based on existing work. (I don't mean to copy codes
>> to the new repo, but it will be based on the existing effort).
>>
>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Yuanjian Li <xy...@gmail.com>.
Agreed. Let me start a voting thread for this and move the existing +1s to
the new thread.

Mridul Muralidharan <mr...@gmail.com> 于2025年5月19日周一 08:44写道:

>
> Please start an explicit vote thread - so that it is not confusing.
>
> This shows us as a DISCUSS thread currently.
>
> Regards,
> Mridul
>
> On Mon, May 19, 2025 at 6:44 AM Niranjan Jayakar
> <ni...@databricks.com.invalid> wrote:
>
>> Thank you Renji and Fokko for your responses. Let's move forward with a
>> separate repo then.
>>
>> +1.
>>
>> On Mon, May 19, 2025 at 1:12 PM Denny Lee <de...@gmail.com> wrote:
>>
>>> +1 (non-binding)
>>>
>>>
>>> On Mon, May 19, 2025 at 02:42 Renjie Liu <li...@gmail.com>
>>> wrote:
>>>
>>>> +1 (non-binding)
>>>>
>>>> Hi, Niranjan:
>>>>
>>>> We also had a discussion when starting different
>>>> language implementations(too old and I can't find the link to the original
>>>> thread), and eventually we decided to use separate repos. It turns out to
>>>> work quite well.  Among all the benefits, the most important one is that
>>>> this approach helped to lower contribution bar as it would be easier to set
>>>> up dev environment for one language.
>>>>
>>>> On Mon, May 19, 2025 at 1:50 PM Peter Toth <pe...@gmail.com>
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Sun, May 18, 2025, 23:27 huaxin gao <hu...@gmail.com> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> +1 (non-binding)
>>>>>>> —
>>>>>>> Sent from my iPhone
>>>>>>> Pardon the dumb thumb typos :)
>>>>>>>
>>>>>>> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>> 
>>>>>>>
>>>>>>> Happy to see the Rust client proposal and glad to help with the
>>>>>>> follow-up repo management work.
>>>>>>>
>>>>>>> Let’s use this thread for voting—posting my +1 here.
>>>>>>>
>>>>>>> Jules Damji <ju...@gmail.com> :
>>>>>>>
>>>>>>>> I’ll ask them.
>>>>>>>>
>>>>>>>> Cheers
>>>>>>>> Jules
>>>>>>>>
>>>>>>>> Excuse the thumb typos
>>>>>>>>
>>>>>>>>
>>>>>>>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Thanks Denny and Jules for the response.
>>>>>>>>>
>>>>>>>>> It seems there is no objection about this proposal, would some
>>>>>>>>> committer/PMC member help to create the repo?
>>>>>>>>>
>>>>>>>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> +1 in this effort.
>>>>>>>>>> —
>>>>>>>>>> Sent from my iPhone
>>>>>>>>>> Pardon the dumb thumb typos :)
>>>>>>>>>>
>>>>>>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> 
>>>>>>>>>> Hi, All:
>>>>>>>>>>
>>>>>>>>>> I'd like to propose to add a new Apache Spark repository for
>>>>>>>>>> `Spark Connect Client for Rust`.
>>>>>>>>>>
>>>>>>>>>> https://github.com/apache/spark-connect-
>>>>>>>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>>>>>>>
>>>>>>>>>> There are already some efforts for building spark-connect client
>>>>>>>>>> in rust: https://github.com/sjrusso8/spark-connect-rs
>>>>>>>>>>
>>>>>>>>>> We have contacted the author and he's positive in donating this
>>>>>>>>>> to the apache community, see this discussion issue:
>>>>>>>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>>>>>>>
>>>>>>>>>> If the community agrees with creating this new repo, we could
>>>>>>>>>> build the spark-connect-rs client based on existing work. (I don't mean to
>>>>>>>>>> copy codes to the new repo, but it will be based on the existing effort).
>>>>>>>>>>
>>>>>>>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Mridul Muralidharan <mr...@gmail.com>.
Please start an explicit vote thread - so that it is not confusing.

This shows us as a DISCUSS thread currently.

Regards,
Mridul

On Mon, May 19, 2025 at 6:44 AM Niranjan Jayakar
<ni...@databricks.com.invalid> wrote:

> Thank you Renji and Fokko for your responses. Let's move forward with a
> separate repo then.
>
> +1.
>
> On Mon, May 19, 2025 at 1:12 PM Denny Lee <de...@gmail.com> wrote:
>
>> +1 (non-binding)
>>
>>
>> On Mon, May 19, 2025 at 02:42 Renjie Liu <li...@gmail.com> wrote:
>>
>>> +1 (non-binding)
>>>
>>> Hi, Niranjan:
>>>
>>> We also had a discussion when starting different
>>> language implementations(too old and I can't find the link to the original
>>> thread), and eventually we decided to use separate repos. It turns out to
>>> work quite well.  Among all the benefits, the most important one is that
>>> this approach helped to lower contribution bar as it would be easier to set
>>> up dev environment for one language.
>>>
>>> On Mon, May 19, 2025 at 1:50 PM Peter Toth <pe...@gmail.com> wrote:
>>>
>>>> +1
>>>>
>>>> On Sun, May 18, 2025, 23:27 huaxin gao <hu...@gmail.com> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> +1 (non-binding)
>>>>>> —
>>>>>> Sent from my iPhone
>>>>>> Pardon the dumb thumb typos :)
>>>>>>
>>>>>> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>> 
>>>>>>
>>>>>> Happy to see the Rust client proposal and glad to help with the
>>>>>> follow-up repo management work.
>>>>>>
>>>>>> Let’s use this thread for voting—posting my +1 here.
>>>>>>
>>>>>> Jules Damji <ju...@gmail.com> :
>>>>>>
>>>>>>> I’ll ask them.
>>>>>>>
>>>>>>> Cheers
>>>>>>> Jules
>>>>>>>
>>>>>>> Excuse the thumb typos
>>>>>>>
>>>>>>>
>>>>>>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Thanks Denny and Jules for the response.
>>>>>>>>
>>>>>>>> It seems there is no objection about this proposal, would some
>>>>>>>> committer/PMC member help to create the repo?
>>>>>>>>
>>>>>>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1 in this effort.
>>>>>>>>> —
>>>>>>>>> Sent from my iPhone
>>>>>>>>> Pardon the dumb thumb typos :)
>>>>>>>>>
>>>>>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> 
>>>>>>>>> Hi, All:
>>>>>>>>>
>>>>>>>>> I'd like to propose to add a new Apache Spark repository for
>>>>>>>>> `Spark Connect Client for Rust`.
>>>>>>>>>
>>>>>>>>> https://github.com/apache/spark-connect-
>>>>>>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>>>>>>
>>>>>>>>> There are already some efforts for building spark-connect client
>>>>>>>>> in rust: https://github.com/sjrusso8/spark-connect-rs
>>>>>>>>>
>>>>>>>>> We have contacted the author and he's positive in donating this to
>>>>>>>>> the apache community, see this discussion issue:
>>>>>>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>>>>>>
>>>>>>>>> If the community agrees with creating this new repo, we could
>>>>>>>>> build the spark-connect-rs client based on existing work. (I don't mean to
>>>>>>>>> copy codes to the new repo, but it will be based on the existing effort).
>>>>>>>>>
>>>>>>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Niranjan Jayakar <ni...@databricks.com.INVALID>.
Thank you Renji and Fokko for your responses. Let's move forward with a
separate repo then.

+1.

On Mon, May 19, 2025 at 1:12 PM Denny Lee <de...@gmail.com> wrote:

> +1 (non-binding)
>
>
> On Mon, May 19, 2025 at 02:42 Renjie Liu <li...@gmail.com> wrote:
>
>> +1 (non-binding)
>>
>> Hi, Niranjan:
>>
>> We also had a discussion when starting different
>> language implementations(too old and I can't find the link to the original
>> thread), and eventually we decided to use separate repos. It turns out to
>> work quite well.  Among all the benefits, the most important one is that
>> this approach helped to lower contribution bar as it would be easier to set
>> up dev environment for one language.
>>
>> On Mon, May 19, 2025 at 1:50 PM Peter Toth <pe...@gmail.com> wrote:
>>
>>> +1
>>>
>>> On Sun, May 18, 2025, 23:27 huaxin gao <hu...@gmail.com> wrote:
>>>
>>>> +1
>>>>
>>>> On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com>
>>>> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>> —
>>>>> Sent from my iPhone
>>>>> Pardon the dumb thumb typos :)
>>>>>
>>>>> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> 
>>>>>
>>>>> Happy to see the Rust client proposal and glad to help with the
>>>>> follow-up repo management work.
>>>>>
>>>>> Let’s use this thread for voting—posting my +1 here.
>>>>>
>>>>> Jules Damji <ju...@gmail.com> :
>>>>>
>>>>>> I’ll ask them.
>>>>>>
>>>>>> Cheers
>>>>>> Jules
>>>>>>
>>>>>> Excuse the thumb typos
>>>>>>
>>>>>>
>>>>>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks Denny and Jules for the response.
>>>>>>>
>>>>>>> It seems there is no objection about this proposal, would some
>>>>>>> committer/PMC member help to create the repo?
>>>>>>>
>>>>>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1 in this effort.
>>>>>>>> —
>>>>>>>> Sent from my iPhone
>>>>>>>> Pardon the dumb thumb typos :)
>>>>>>>>
>>>>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>> 
>>>>>>>> Hi, All:
>>>>>>>>
>>>>>>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>>>>>>> Connect Client for Rust`.
>>>>>>>>
>>>>>>>> https://github.com/apache/spark-connect-
>>>>>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>>>>>
>>>>>>>> There are already some efforts for building spark-connect client in
>>>>>>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>>>>>>
>>>>>>>> We have contacted the author and he's positive in donating this to
>>>>>>>> the apache community, see this discussion issue:
>>>>>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>>>>>
>>>>>>>> If the community agrees with creating this new repo, we could build
>>>>>>>> the spark-connect-rs client based on existing work. (I don't mean to copy
>>>>>>>> codes to the new repo, but it will be based on the existing effort).
>>>>>>>>
>>>>>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Denny Lee <de...@gmail.com>.
+1 (non-binding)


On Mon, May 19, 2025 at 02:42 Renjie Liu <li...@gmail.com> wrote:

> +1 (non-binding)
>
> Hi, Niranjan:
>
> We also had a discussion when starting different
> language implementations(too old and I can't find the link to the original
> thread), and eventually we decided to use separate repos. It turns out to
> work quite well.  Among all the benefits, the most important one is that
> this approach helped to lower contribution bar as it would be easier to set
> up dev environment for one language.
>
> On Mon, May 19, 2025 at 1:50 PM Peter Toth <pe...@gmail.com> wrote:
>
>> +1
>>
>> On Sun, May 18, 2025, 23:27 huaxin gao <hu...@gmail.com> wrote:
>>
>>> +1
>>>
>>> On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com>
>>> wrote:
>>>
>>>> +1 (non-binding)
>>>> —
>>>> Sent from my iPhone
>>>> Pardon the dumb thumb typos :)
>>>>
>>>> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com>
>>>> wrote:
>>>>
>>>> 
>>>>
>>>> Happy to see the Rust client proposal and glad to help with the
>>>> follow-up repo management work.
>>>>
>>>> Let’s use this thread for voting—posting my +1 here.
>>>>
>>>> Jules Damji <ju...@gmail.com> :
>>>>
>>>>> I’ll ask them.
>>>>>
>>>>> Cheers
>>>>> Jules
>>>>>
>>>>> Excuse the thumb typos
>>>>>
>>>>>
>>>>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Thanks Denny and Jules for the response.
>>>>>>
>>>>>> It seems there is no objection about this proposal, would some
>>>>>> committer/PMC member help to create the repo?
>>>>>>
>>>>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> +1 in this effort.
>>>>>>> —
>>>>>>> Sent from my iPhone
>>>>>>> Pardon the dumb thumb typos :)
>>>>>>>
>>>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>> 
>>>>>>> Hi, All:
>>>>>>>
>>>>>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>>>>>> Connect Client for Rust`.
>>>>>>>
>>>>>>> https://github.com/apache/spark-connect-
>>>>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>>>>
>>>>>>> There are already some efforts for building spark-connect client in
>>>>>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>>>>>
>>>>>>> We have contacted the author and he's positive in donating this to
>>>>>>> the apache community, see this discussion issue:
>>>>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>>>>
>>>>>>> If the community agrees with creating this new repo, we could build
>>>>>>> the spark-connect-rs client based on existing work. (I don't mean to copy
>>>>>>> codes to the new repo, but it will be based on the existing effort).
>>>>>>>
>>>>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Renjie Liu <li...@gmail.com>.
+1 (non-binding)

Hi, Niranjan:

We also had a discussion when starting different
language implementations(too old and I can't find the link to the original
thread), and eventually we decided to use separate repos. It turns out to
work quite well.  Among all the benefits, the most important one is that
this approach helped to lower contribution bar as it would be easier to set
up dev environment for one language.

On Mon, May 19, 2025 at 1:50 PM Peter Toth <pe...@gmail.com> wrote:

> +1
>
> On Sun, May 18, 2025, 23:27 huaxin gao <hu...@gmail.com> wrote:
>
>> +1
>>
>> On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com>
>> wrote:
>>
>>> +1 (non-binding)
>>> —
>>> Sent from my iPhone
>>> Pardon the dumb thumb typos :)
>>>
>>> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com>
>>> wrote:
>>>
>>> 
>>>
>>> Happy to see the Rust client proposal and glad to help with the
>>> follow-up repo management work.
>>>
>>> Let’s use this thread for voting—posting my +1 here.
>>>
>>> Jules Damji <ju...@gmail.com> :
>>>
>>>> I’ll ask them.
>>>>
>>>> Cheers
>>>> Jules
>>>>
>>>> Excuse the thumb typos
>>>>
>>>>
>>>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>>>> wrote:
>>>>
>>>>> Thanks Denny and Jules for the response.
>>>>>
>>>>> It seems there is no objection about this proposal, would some
>>>>> committer/PMC member help to create the repo?
>>>>>
>>>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> +1 in this effort.
>>>>>> —
>>>>>> Sent from my iPhone
>>>>>> Pardon the dumb thumb typos :)
>>>>>>
>>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>> 
>>>>>> Hi, All:
>>>>>>
>>>>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>>>>> Connect Client for Rust`.
>>>>>>
>>>>>> https://github.com/apache/spark-connect-
>>>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>>>
>>>>>> There are already some efforts for building spark-connect client in
>>>>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>>>>
>>>>>> We have contacted the author and he's positive in donating this to
>>>>>> the apache community, see this discussion issue:
>>>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>>>
>>>>>> If the community agrees with creating this new repo, we could build
>>>>>> the spark-connect-rs client based on existing work. (I don't mean to copy
>>>>>> codes to the new repo, but it will be based on the existing effort).
>>>>>>
>>>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Peter Toth <pe...@gmail.com>.
+1

On Sun, May 18, 2025, 23:27 huaxin gao <hu...@gmail.com> wrote:

> +1
>
> On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com> wrote:
>
>> +1 (non-binding)
>> —
>> Sent from my iPhone
>> Pardon the dumb thumb typos :)
>>
>> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com> wrote:
>>
>> 
>>
>> Happy to see the Rust client proposal and glad to help with the follow-up
>> repo management work.
>>
>> Let’s use this thread for voting—posting my +1 here.
>>
>> Jules Damji <ju...@gmail.com> :
>>
>>> I’ll ask them.
>>>
>>> Cheers
>>> Jules
>>>
>>> Excuse the thumb typos
>>>
>>>
>>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>>> wrote:
>>>
>>>> Thanks Denny and Jules for the response.
>>>>
>>>> It seems there is no objection about this proposal, would some
>>>> committer/PMC member help to create the repo?
>>>>
>>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>>> wrote:
>>>>
>>>>> +1 in this effort.
>>>>> —
>>>>> Sent from my iPhone
>>>>> Pardon the dumb thumb typos :)
>>>>>
>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> 
>>>>> Hi, All:
>>>>>
>>>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>>>> Connect Client for Rust`.
>>>>>
>>>>> https://github.com/apache/spark-connect-
>>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>>
>>>>> There are already some efforts for building spark-connect client in
>>>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>>>
>>>>> We have contacted the author and he's positive in donating this to the
>>>>> apache community, see this discussion issue:
>>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>>
>>>>> If the community agrees with creating this new repo, we could build
>>>>> the spark-connect-rs client based on existing work. (I don't mean to copy
>>>>> codes to the new repo, but it will be based on the existing effort).
>>>>>
>>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by huaxin gao <hu...@gmail.com>.
+1

On Sun, May 18, 2025 at 1:48 PM Jules Damji <ju...@gmail.com> wrote:

> +1 (non-binding)
> —
> Sent from my iPhone
> Pardon the dumb thumb typos :)
>
> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com> wrote:
>
> 
>
> Happy to see the Rust client proposal and glad to help with the follow-up
> repo management work.
>
> Let’s use this thread for voting—posting my +1 here.
>
> Jules Damji <ju...@gmail.com> :
>
>> I’ll ask them.
>>
>> Cheers
>> Jules
>>
>> Excuse the thumb typos
>>
>>
>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
>> wrote:
>>
>>> Thanks Denny and Jules for the response.
>>>
>>> It seems there is no objection about this proposal, would some
>>> committer/PMC member help to create the repo?
>>>
>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>>> wrote:
>>>
>>>> +1 in this effort.
>>>> —
>>>> Sent from my iPhone
>>>> Pardon the dumb thumb typos :)
>>>>
>>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>>>>
>>>> 
>>>> Hi, All:
>>>>
>>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>>> Connect Client for Rust`.
>>>>
>>>> https://github.com/apache/spark-connect-
>>>> <https://github.com/apache/spark-connect-swift>rust
>>>>
>>>> There are already some efforts for building spark-connect client in
>>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>>
>>>> We have contacted the author and he's positive in donating this to the
>>>> apache community, see this discussion issue:
>>>> https://github.com/sjrusso8/spark-connect-rs
>>>>
>>>> If the community agrees with creating this new repo, we could build the
>>>> spark-connect-rs client based on existing work. (I don't mean to copy codes
>>>> to the new repo, but it will be based on the existing effort).
>>>>
>>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Jules Damji <ju...@gmail.com>.
+1 (non-binding)  

—

Sent from my iPhone

Pardon the dumb thumb typos :)

  

> On May 16, 2025, at 10:22 AM, Yuanjian Li <xy...@gmail.com> wrote:  
>  
>

> 
>
> Happy to see the Rust client proposal and glad to help with the follow-up
> repo management work.
>
> Let’s use this thread for voting—posting my +1 here.
>
>  
>
>
> Jules Damji <[jules.damji@gmail.com](mailto:jules.damji@gmail.com)> :  
>
>

>> I’ll ask them.

>>

>>  
>
>>

>> Cheers

>>

>> Jules  
>  
>
>>

>> Excuse the thumb typos

>>

>>  
>
>>

>>  
>
>>

>> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu
<[liurenjie2008@gmail.com](mailto:liurenjie2008@gmail.com)> wrote:  
>
>>

>>> Thanks Denny and Jules for the response.

>>>

>>>  
>
>>>

>>> It seems there is no objection about this proposal, would some
committer/PMC member help to create the repo?

>>>

>>>  
>
>>>

>>> On Wed, May 14, 2025 at 3:45 AM Jules Damji
<[jules.damji@gmail.com](mailto:jules.damji@gmail.com)> wrote:  
>
>>>

>>>> +1 in this effort.  
>
>>>>

>>>> —

>>>>

>>>> Sent from my iPhone

>>>>

>>>> Pardon the dumb thumb typos :)

>>>>

>>>>  
>
>>>>

>>>>> On May 9, 2025, at 1:53 AM, Renjie Liu
<[liurenjie2008@gmail.com](mailto:liurenjie2008@gmail.com)> wrote:  
>  
>
>>>>

>>>>> 

>>>>>

>>>>> Hi, All:

>>>>>

>>>>>  
>
>>>>>

>>>>> I'd like to propose to add a new Apache Spark repository for `Spark
Connect Client for Rust`.

>>>>>

>>>>>  
>
>>>>>

>>>>> [https://github.com/apache/spark-
connect-](https://github.com/apache/spark-connect-swift)rust

>>>>>

>>>>>  
>
>>>>>

>>>>> There are already some efforts for building spark-connect client in
rust: <https://github.com/sjrusso8/spark-connect-rs>

>>>>>

>>>>>  
>
>>>>>

>>>>> We have contacted the author and he's positive in donating this to the
apache community, see this discussion issue:
<https://github.com/sjrusso8/spark-connect-rs>

>>>>>

>>>>>  
>
>>>>>

>>>>> If the community agrees with creating this new repo, we could build the
spark-connect-rs client based on existing work. (I don't mean to copy codes to
the new repo, but it will be based on the existing effort).


Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Yuanjian Li <xy...@gmail.com>.
Happy to see the Rust client proposal and glad to help with the follow-up
repo management work.

Let’s use this thread for voting—posting my +1 here.

Jules Damji <ju...@gmail.com> :

> I’ll ask them.
>
> Cheers
> Jules
>
> Excuse the thumb typos
>
>
> On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com>
> wrote:
>
>> Thanks Denny and Jules for the response.
>>
>> It seems there is no objection about this proposal, would some
>> committer/PMC member help to create the repo?
>>
>> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com>
>> wrote:
>>
>>> +1 in this effort.
>>> —
>>> Sent from my iPhone
>>> Pardon the dumb thumb typos :)
>>>
>>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>>>
>>> 
>>> Hi, All:
>>>
>>> I'd like to propose to add a new Apache Spark repository for `Spark
>>> Connect Client for Rust`.
>>>
>>> https://github.com/apache/spark-connect-
>>> <https://github.com/apache/spark-connect-swift>rust
>>>
>>> There are already some efforts for building spark-connect client in
>>> rust: https://github.com/sjrusso8/spark-connect-rs
>>>
>>> We have contacted the author and he's positive in donating this to the
>>> apache community, see this discussion issue:
>>> https://github.com/sjrusso8/spark-connect-rs
>>>
>>> If the community agrees with creating this new repo, we could build the
>>> spark-connect-rs client based on existing work. (I don't mean to copy codes
>>> to the new repo, but it will be based on the existing effort).
>>>
>>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Jules Damji <ju...@gmail.com>.
I’ll ask them.

Cheers
Jules

Excuse the thumb typos


On Fri, 16 May 2025 at 2:38 AM, Renjie Liu <li...@gmail.com> wrote:

> Thanks Denny and Jules for the response.
>
> It seems there is no objection about this proposal, would some
> committer/PMC member help to create the repo?
>
> On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com> wrote:
>
>> +1 in this effort.
>> —
>> Sent from my iPhone
>> Pardon the dumb thumb typos :)
>>
>> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>>
>> 
>> Hi, All:
>>
>> I'd like to propose to add a new Apache Spark repository for `Spark
>> Connect Client for Rust`.
>>
>> https://github.com/apache/spark-connect-
>> <https://github.com/apache/spark-connect-swift>rust
>>
>> There are already some efforts for building spark-connect client in rust:
>> https://github.com/sjrusso8/spark-connect-rs
>>
>> We have contacted the author and he's positive in donating this to the
>> apache community, see this discussion issue:
>> https://github.com/sjrusso8/spark-connect-rs
>>
>> If the community agrees with creating this new repo, we could build the
>> spark-connect-rs client based on existing work. (I don't mean to copy codes
>> to the new repo, but it will be based on the existing effort).
>>
>>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Renjie Liu <li...@gmail.com>.
Thanks Denny and Jules for the response.

It seems there is no objection about this proposal, would some
committer/PMC member help to create the repo?

On Wed, May 14, 2025 at 3:45 AM Jules Damji <ju...@gmail.com> wrote:

> +1 in this effort.
> —
> Sent from my iPhone
> Pardon the dumb thumb typos :)
>
> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:
>
> 
> Hi, All:
>
> I'd like to propose to add a new Apache Spark repository for `Spark
> Connect Client for Rust`.
>
> https://github.com/apache/spark-connect-
> <https://github.com/apache/spark-connect-swift>rust
>
> There are already some efforts for building spark-connect client in rust:
> https://github.com/sjrusso8/spark-connect-rs
>
> We have contacted the author and he's positive in donating this to the
> apache community, see this discussion issue:
> https://github.com/sjrusso8/spark-connect-rs
>
> If the community agrees with creating this new repo, we could build the
> spark-connect-rs client based on existing work. (I don't mean to copy codes
> to the new repo, but it will be based on the existing effort).
>
>

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Jules Damji <ju...@gmail.com>.
+1 in this effort.  

—

Sent from my iPhone

Pardon the dumb thumb typos :)

  

> On May 9, 2025, at 1:53 AM, Renjie Liu <li...@gmail.com> wrote:  
>  
>

> 
>
> Hi, All:
>
>  
>
>
> I'd like to propose to add a new Apache Spark repository for `Spark Connect
> Client for Rust`.
>
>  
>
>
> [https://github.com/apache/spark-connect-](https://github.com/apache/spark-
> connect-swift)rust
>
>  
>
>
> There are already some efforts for building spark-connect client in rust:
> <https://github.com/sjrusso8/spark-connect-rs>
>
>  
>
>
> We have contacted the author and he's positive in donating this to the
> apache community, see this discussion issue:
> <https://github.com/sjrusso8/spark-connect-rs>
>
>  
>
>
> If the community agrees with creating this new repo, we could build the
> spark-connect-rs client based on existing work. (I don't mean to copy codes
> to the new repo, but it will be based on the existing effort).


Re: [DISCUSS] New Spark Connect Client repository for Rust language

Posted by Denny Lee <de...@gmail.com>.
Hey Renjie,

I think this is a great idea and it certainly helps "connect" with the Rust
community to collaborate with the Spark community.   I would love to help
with this particular effort as well, eh?!

Thanks for initiating this!
Denny


On Fri, May 9, 2025 at 1:53 AM Renjie Liu <li...@gmail.com> wrote:

> Hi, All:
>
> I'd like to propose to add a new Apache Spark repository for `Spark
> Connect Client for Rust`.
>
> https://github.com/apache/spark-connect-
> <https://github.com/apache/spark-connect-swift>rust
>
> There are already some efforts for building spark-connect client in rust:
> https://github.com/sjrusso8/spark-connect-rs
>
> We have contacted the author and he's positive in donating this to the
> apache community, see this discussion issue:
> https://github.com/sjrusso8/spark-connect-rs
>
> If the community agrees with creating this new repo, we could build the
> spark-connect-rs client based on existing work. (I don't mean to copy codes
> to the new repo, but it will be based on the existing effort).
>