You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Yuanjian Li <xy...@gmail.com> on 2023/09/06 06:11:16 UTC
[VOTE] Release Apache Spark 3.5.0 (RC4)
Please vote on releasing the following candidate(RC4) as Apache Spark
version 3.5.0.
The vote is open until 11:59pm Pacific time Sep 8th and passes if a
majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
[ ] +1 Release this package as Apache Spark 3.5.0
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see http://spark.apache.org/
The tag to be voted on is v3.5.0-rc4 (commit
c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
https://github.com/apache/spark/tree/v3.5.0-rc4
The release files, including signatures, digests, etc. can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
Signatures used for Spark RCs can be found in this file:
https://dist.apache.org/repos/dist/dev/spark/KEYS
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1448
The documentation corresponding to this release can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
The list of bug fixes going into 3.5.0 can be found at the following URL:
https://issues.apache.org/jira/projects/SPARK/versions/12352848
This release is using the release script of the tag v3.5.0-rc4.
FAQ
=========================
How can I help test this release?
=========================
If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.
If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with an out of date RC going forward).
===========================================
What should happen to JIRA tickets still targeting 3.5.0?
===========================================
The current list of open tickets targeted at 3.5.0 can be found at:
https://issues.apache.org/jira/projects/SPARK and search for "Target
Version/s" = 3.5.0
Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.
==================
But my bug isn't fixed?
==================
In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.
Thanks,
Yuanjian Li
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Kent Yao <ya...@apache.org>.
+1 (Non-binding)
Kent
Gengliang Wang <lt...@gmail.com> 于2023年9月7日周四 14:09写道:
>
> +1
>
> On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com> wrote:
>>
>> +1 (non-binding)
>>
>> Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
>>>
>>> +1
>>>
>>> Xiao
>>>
>>> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>>>>
>>>> Tested connect, and everything looks good.
>>>>
>>>> +1
>>>>
>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com> wrote:
>>>>>
>>>>> Please vote on releasing the following candidate(RC4) as Apache Spark version 3.5.0.
>>>>>
>>>>>
>>>>> The vote is open until 11:59pm Pacific time Sep 8th and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>>
>>>>>
>>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>>
>>>>> [ ] -1 Do not release this package because ...
>>>>>
>>>>>
>>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>>
>>>>>
>>>>> The tag to be voted on is v3.5.0-rc4 (commit c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>>
>>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>>
>>>>>
>>>>> The release files, including signatures, digests, etc. can be found at:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>>
>>>>>
>>>>> Signatures used for Spark RCs can be found in this file:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>>
>>>>>
>>>>> The staging repository for this release can be found at:
>>>>>
>>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>>
>>>>>
>>>>> The documentation corresponding to this release can be found at:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>>
>>>>>
>>>>> The list of bug fixes going into 3.5.0 can be found at the following URL:
>>>>>
>>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>>
>>>>>
>>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>>
>>>>>
>>>>>
>>>>> FAQ
>>>>>
>>>>>
>>>>> =========================
>>>>>
>>>>> How can I help test this release?
>>>>>
>>>>> =========================
>>>>>
>>>>> If you are a Spark user, you can help us test this release by taking
>>>>>
>>>>> an existing Spark workload and running on this release candidate, then
>>>>>
>>>>> reporting any regressions.
>>>>>
>>>>>
>>>>> If you're working in PySpark you can set up a virtual env and install
>>>>>
>>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>>
>>>>> you can add the staging repository to your projects resolvers and test
>>>>>
>>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>>
>>>>> you don't end up building with an out of date RC going forward).
>>>>>
>>>>>
>>>>> ===========================================
>>>>>
>>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>>
>>>>> ===========================================
>>>>>
>>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>>
>>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.5.0
>>>>>
>>>>>
>>>>> Committers should look at those and triage. Extremely important bug
>>>>>
>>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>>
>>>>> be worked on immediately. Everything else please retarget to an
>>>>>
>>>>> appropriate release.
>>>>>
>>>>>
>>>>> ==================
>>>>>
>>>>> But my bug isn't fixed?
>>>>>
>>>>> ==================
>>>>>
>>>>> In order to make timely releases, we will typically not hold the
>>>>>
>>>>> release unless the bug in question is a regression from the previous
>>>>>
>>>>> release. That being said, if there is something which is a regression
>>>>>
>>>>> that has not been correctly targeted please ping me or a committer to
>>>>>
>>>>> help target the issue.
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Yuanjian Li
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Yuanjian Li <xy...@gmail.com>.
@Dongjoon Hyun <do...@gmail.com> Thank you for reporting this and
for your prompt response.
The vote has failed. I'll cut RC5 tonight, PST time.
Dongjoon Hyun <do...@gmail.com> 于2023年9月8日周五 15:57写道:
> Sorry but I'm -1 because there exists a late-arrival correctness patch
> although it's not a regression.
>
> - https://issues.apache.org/jira/browse/SPARK-44805
> "Data lost after union using
> spark.sql.parquet.enableNestedColumnVectorizedReader=true"
>
> - https://github.com/apache/spark/pull/42850
> -
> https://github.com/apache/spark/commit/b2b2ba97d3003d25d159943ab8a4bf50e421fdab
> (branch-3.5)
>
> Dongjoon.
>
>
>>>>>
>>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>>>> version 3.5.0.
>>>>>
>>>>>
>>>>>
>>>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
>>>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>>
>>>>>
>>>>>
>>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>>
>>>>> [ ] -1 Do not release this package because ...
>>>>>
>>>>>
>>>>>
>>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>>
>>>>>
>>>>>
>>>>> The tag to be voted on is v3.5.0-rc4 (commit
>>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>>
>>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>>
>>>>>
>>>>>
>>>>> The release files, including signatures, digests, etc. can be found at:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>>
>>>>>
>>>>>
>>>>> Signatures used for Spark RCs can be found in this file:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>>
>>>>>
>>>>>
>>>>> The staging repository for this release can be found at:
>>>>>
>>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>>
>>>>>
>>>>>
>>>>> The documentation corresponding to this release can be found at:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>>
>>>>>
>>>>>
>>>>> The list of bug fixes going into 3.5.0 can be found at the following
>>>>> URL:
>>>>>
>>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>>
>>>>>
>>>>>
>>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>>
>>>>>
>>>>>
>>>>> FAQ
>>>>>
>>>>>
>>>>>
>>>>> =========================
>>>>>
>>>>> How can I help test this release?
>>>>>
>>>>> =========================
>>>>>
>>>>> If you are a Spark user, you can help us test this release by taking
>>>>>
>>>>> an existing Spark workload and running on this release candidate, then
>>>>>
>>>>> reporting any regressions.
>>>>>
>>>>>
>>>>>
>>>>> If you're working in PySpark you can set up a virtual env and install
>>>>>
>>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>>
>>>>> you can add the staging repository to your projects resolvers and test
>>>>>
>>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>>
>>>>> you don't end up building with an out of date RC going forward).
>>>>>
>>>>>
>>>>>
>>>>> ===========================================
>>>>>
>>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>>
>>>>> ===========================================
>>>>>
>>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>>
>>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>>>> Version/s" = 3.5.0
>>>>>
>>>>>
>>>>>
>>>>> Committers should look at those and triage. Extremely important bug
>>>>>
>>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>>
>>>>> be worked on immediately. Everything else please retarget to an
>>>>>
>>>>> appropriate release.
>>>>>
>>>>>
>>>>>
>>>>> ==================
>>>>>
>>>>> But my bug isn't fixed?
>>>>>
>>>>> ==================
>>>>>
>>>>> In order to make timely releases, we will typically not hold the
>>>>>
>>>>> release unless the bug in question is a regression from the previous
>>>>>
>>>>> release. That being said, if there is something which is a regression
>>>>>
>>>>> that has not been correctly targeted please ping me or a committer to
>>>>>
>>>>> help target the issue.
>>>>>
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Yuanjian Li
>>>>>
>>>>>
>>>
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Yuanjian Li <xy...@gmail.com>.
@ian.a.manning@gmail.com <ia...@gmail.com> Thank you for your
question. Because the voting period hasn't ended yet and this fix has just
been merged, we don't want to release version 3.5.0 with a known
correctness bug.
We've quickly cut RC5, and we welcome you to continue assisting with the
testing.
Ian Manning <ia...@gmail.com> 于2023年9月9日周六 02:27写道:
> This issue is not a regression and yet we fail the vote? Couldn't this
> issue have been fixed in 3.5.1?
>
> Sorry I am new, so maybe this is how it works?
>
> On Sat, 9 Sep 2023, 02:29 Dongjoon Hyun, <do...@gmail.com> wrote:
>
>> Sorry but I'm -1 because there exists a late-arrival correctness patch
>> although it's not a regression.
>>
>> - https://issues.apache.org/jira/browse/SPARK-44805
>> "Data lost after union using
>> spark.sql.parquet.enableNestedColumnVectorizedReader=true"
>>
>> - https://github.com/apache/spark/pull/42850
>> -
>> https://github.com/apache/spark/commit/b2b2ba97d3003d25d159943ab8a4bf50e421fdab
>> (branch-3.5)
>>
>> Dongjoon.
>>
>>
>>>>>>
>>>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>>>>> version 3.5.0.
>>>>>>
>>>>>>
>>>>>>
>>>>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if
>>>>>> a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>>>
>>>>>>
>>>>>>
>>>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>>>
>>>>>> [ ] -1 Do not release this package because ...
>>>>>>
>>>>>>
>>>>>>
>>>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>>>
>>>>>>
>>>>>>
>>>>>> The tag to be voted on is v3.5.0-rc4 (commit
>>>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>>>
>>>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>>>
>>>>>>
>>>>>>
>>>>>> The release files, including signatures, digests, etc. can be found
>>>>>> at:
>>>>>>
>>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>>>
>>>>>>
>>>>>>
>>>>>> Signatures used for Spark RCs can be found in this file:
>>>>>>
>>>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>>>
>>>>>>
>>>>>>
>>>>>> The staging repository for this release can be found at:
>>>>>>
>>>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>>>
>>>>>>
>>>>>>
>>>>>> The documentation corresponding to this release can be found at:
>>>>>>
>>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>>>
>>>>>>
>>>>>>
>>>>>> The list of bug fixes going into 3.5.0 can be found at the following
>>>>>> URL:
>>>>>>
>>>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>>>
>>>>>>
>>>>>>
>>>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>>>
>>>>>>
>>>>>>
>>>>>> FAQ
>>>>>>
>>>>>>
>>>>>>
>>>>>> =========================
>>>>>>
>>>>>> How can I help test this release?
>>>>>>
>>>>>> =========================
>>>>>>
>>>>>> If you are a Spark user, you can help us test this release by taking
>>>>>>
>>>>>> an existing Spark workload and running on this release candidate, then
>>>>>>
>>>>>> reporting any regressions.
>>>>>>
>>>>>>
>>>>>>
>>>>>> If you're working in PySpark you can set up a virtual env and install
>>>>>>
>>>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>>>
>>>>>> you can add the staging repository to your projects resolvers and test
>>>>>>
>>>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>>>
>>>>>> you don't end up building with an out of date RC going forward).
>>>>>>
>>>>>>
>>>>>>
>>>>>> ===========================================
>>>>>>
>>>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>>>
>>>>>> ===========================================
>>>>>>
>>>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>>>
>>>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>>>>> Version/s" = 3.5.0
>>>>>>
>>>>>>
>>>>>>
>>>>>> Committers should look at those and triage. Extremely important bug
>>>>>>
>>>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>>>
>>>>>> be worked on immediately. Everything else please retarget to an
>>>>>>
>>>>>> appropriate release.
>>>>>>
>>>>>>
>>>>>>
>>>>>> ==================
>>>>>>
>>>>>> But my bug isn't fixed?
>>>>>>
>>>>>> ==================
>>>>>>
>>>>>> In order to make timely releases, we will typically not hold the
>>>>>>
>>>>>> release unless the bug in question is a regression from the previous
>>>>>>
>>>>>> release. That being said, if there is something which is a regression
>>>>>>
>>>>>> that has not been correctly targeted please ping me or a committer to
>>>>>>
>>>>>> help target the issue.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Yuanjian Li
>>>>>>
>>>>>>
>>>>
>>>> --
>>>> Twitter: https://twitter.com/holdenkarau
>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>
>>>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Ian Manning <ia...@gmail.com>.
This issue is not a regression and yet we fail the vote? Couldn't this
issue have been fixed in 3.5.1?
Sorry I am new, so maybe this is how it works?
On Sat, 9 Sep 2023, 02:29 Dongjoon Hyun, <do...@gmail.com> wrote:
> Sorry but I'm -1 because there exists a late-arrival correctness patch
> although it's not a regression.
>
> - https://issues.apache.org/jira/browse/SPARK-44805
> "Data lost after union using
> spark.sql.parquet.enableNestedColumnVectorizedReader=true"
>
> - https://github.com/apache/spark/pull/42850
> -
> https://github.com/apache/spark/commit/b2b2ba97d3003d25d159943ab8a4bf50e421fdab
> (branch-3.5)
>
> Dongjoon.
>
>
>>>>>
>>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>>>> version 3.5.0.
>>>>>
>>>>>
>>>>>
>>>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
>>>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>>
>>>>>
>>>>>
>>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>>
>>>>> [ ] -1 Do not release this package because ...
>>>>>
>>>>>
>>>>>
>>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>>
>>>>>
>>>>>
>>>>> The tag to be voted on is v3.5.0-rc4 (commit
>>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>>
>>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>>
>>>>>
>>>>>
>>>>> The release files, including signatures, digests, etc. can be found at:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>>
>>>>>
>>>>>
>>>>> Signatures used for Spark RCs can be found in this file:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>>
>>>>>
>>>>>
>>>>> The staging repository for this release can be found at:
>>>>>
>>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>>
>>>>>
>>>>>
>>>>> The documentation corresponding to this release can be found at:
>>>>>
>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>>
>>>>>
>>>>>
>>>>> The list of bug fixes going into 3.5.0 can be found at the following
>>>>> URL:
>>>>>
>>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>>
>>>>>
>>>>>
>>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>>
>>>>>
>>>>>
>>>>> FAQ
>>>>>
>>>>>
>>>>>
>>>>> =========================
>>>>>
>>>>> How can I help test this release?
>>>>>
>>>>> =========================
>>>>>
>>>>> If you are a Spark user, you can help us test this release by taking
>>>>>
>>>>> an existing Spark workload and running on this release candidate, then
>>>>>
>>>>> reporting any regressions.
>>>>>
>>>>>
>>>>>
>>>>> If you're working in PySpark you can set up a virtual env and install
>>>>>
>>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>>
>>>>> you can add the staging repository to your projects resolvers and test
>>>>>
>>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>>
>>>>> you don't end up building with an out of date RC going forward).
>>>>>
>>>>>
>>>>>
>>>>> ===========================================
>>>>>
>>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>>
>>>>> ===========================================
>>>>>
>>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>>
>>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>>>> Version/s" = 3.5.0
>>>>>
>>>>>
>>>>>
>>>>> Committers should look at those and triage. Extremely important bug
>>>>>
>>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>>
>>>>> be worked on immediately. Everything else please retarget to an
>>>>>
>>>>> appropriate release.
>>>>>
>>>>>
>>>>>
>>>>> ==================
>>>>>
>>>>> But my bug isn't fixed?
>>>>>
>>>>> ==================
>>>>>
>>>>> In order to make timely releases, we will typically not hold the
>>>>>
>>>>> release unless the bug in question is a regression from the previous
>>>>>
>>>>> release. That being said, if there is something which is a regression
>>>>>
>>>>> that has not been correctly targeted please ping me or a committer to
>>>>>
>>>>> help target the issue.
>>>>>
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Yuanjian Li
>>>>>
>>>>>
>>>
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Dongjoon Hyun <do...@gmail.com>.
Sorry but I'm -1 because there exists a late-arrival correctness patch
although it's not a regression.
- https://issues.apache.org/jira/browse/SPARK-44805
"Data lost after union using
spark.sql.parquet.enableNestedColumnVectorizedReader=true"
- https://github.com/apache/spark/pull/42850
-
https://github.com/apache/spark/commit/b2b2ba97d3003d25d159943ab8a4bf50e421fdab
(branch-3.5)
Dongjoon.
>>>>
>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>>> wrote:
>>>>
>>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>>> version 3.5.0.
>>>>
>>>>
>>>>
>>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
>>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>
>>>>
>>>>
>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>
>>>> [ ] -1 Do not release this package because ...
>>>>
>>>>
>>>>
>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>
>>>>
>>>>
>>>> The tag to be voted on is v3.5.0-rc4 (commit
>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>
>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>
>>>>
>>>>
>>>> The release files, including signatures, digests, etc. can be found at:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>
>>>>
>>>>
>>>> Signatures used for Spark RCs can be found in this file:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>
>>>>
>>>>
>>>> The staging repository for this release can be found at:
>>>>
>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>
>>>>
>>>>
>>>> The documentation corresponding to this release can be found at:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>
>>>>
>>>>
>>>> The list of bug fixes going into 3.5.0 can be found at the following
>>>> URL:
>>>>
>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>
>>>>
>>>>
>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>
>>>>
>>>>
>>>> FAQ
>>>>
>>>>
>>>>
>>>> =========================
>>>>
>>>> How can I help test this release?
>>>>
>>>> =========================
>>>>
>>>> If you are a Spark user, you can help us test this release by taking
>>>>
>>>> an existing Spark workload and running on this release candidate, then
>>>>
>>>> reporting any regressions.
>>>>
>>>>
>>>>
>>>> If you're working in PySpark you can set up a virtual env and install
>>>>
>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>
>>>> you can add the staging repository to your projects resolvers and test
>>>>
>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>
>>>> you don't end up building with an out of date RC going forward).
>>>>
>>>>
>>>>
>>>> ===========================================
>>>>
>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>
>>>> ===========================================
>>>>
>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>
>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>>> Version/s" = 3.5.0
>>>>
>>>>
>>>>
>>>> Committers should look at those and triage. Extremely important bug
>>>>
>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>
>>>> be worked on immediately. Everything else please retarget to an
>>>>
>>>> appropriate release.
>>>>
>>>>
>>>>
>>>> ==================
>>>>
>>>> But my bug isn't fixed?
>>>>
>>>> ==================
>>>>
>>>> In order to make timely releases, we will typically not hold the
>>>>
>>>> release unless the bug in question is a regression from the previous
>>>>
>>>> release. That being said, if there is something which is a regression
>>>>
>>>> that has not been correctly targeted please ping me or a committer to
>>>>
>>>> help target the issue.
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Yuanjian Li
>>>>
>>>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Xinrong Meng <xi...@gmail.com>.
+1
Thank you for driving the release!
On Fri, Sep 8, 2023 at 10:12 AM Jungtaek Lim <ka...@gmail.com>
wrote:
> +1 (non-binding)
>
> Thanks for driving this release!
>
> On Fri, Sep 8, 2023 at 11:29 AM Holden Karau <ho...@pigscanfly.ca> wrote:
>
>> +1 pip installing seems to function :)
>>
>> On Thu, Sep 7, 2023 at 7:22 PM Yuming Wang <yu...@apache.org> wrote:
>>
>>> +1.
>>>
>>> On Thu, Sep 7, 2023 at 10:33 PM yangjie01 <ya...@baidu.com.invalid>
>>> wrote:
>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> *发件人**: *Gengliang Wang <lt...@gmail.com>
>>>> *日期**: *2023年9月7日 星期四 12:53
>>>> *收件人**: *Yuanjian Li <xy...@gmail.com>
>>>> *抄送**: *Xiao Li <ga...@gmail.com>, "herman@databricks.com.invalid"
>>>> <he...@databricks.com.invalid>, Spark dev list <de...@spark.apache.org>
>>>> *主题**: *Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
>>>>
>>>>
>>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com>
>>>> wrote:
>>>>
>>>> +1 (non-binding)
>>>>
>>>> Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
>>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> Xiao
>>>>
>>>>
>>>>
>>>> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>>>>
>>>> Tested connect, and everything looks good.
>>>>
>>>>
>>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>>> wrote:
>>>>
>>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>>> version 3.5.0.
>>>>
>>>>
>>>>
>>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
>>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>
>>>>
>>>>
>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>
>>>> [ ] -1 Do not release this package because ...
>>>>
>>>>
>>>>
>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>
>>>>
>>>>
>>>> The tag to be voted on is v3.5.0-rc4 (commit
>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>
>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>
>>>>
>>>>
>>>> The release files, including signatures, digests, etc. can be found at:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>
>>>>
>>>>
>>>> Signatures used for Spark RCs can be found in this file:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>
>>>>
>>>>
>>>> The staging repository for this release can be found at:
>>>>
>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>
>>>>
>>>>
>>>> The documentation corresponding to this release can be found at:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>
>>>>
>>>>
>>>> The list of bug fixes going into 3.5.0 can be found at the following
>>>> URL:
>>>>
>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>
>>>>
>>>>
>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>
>>>>
>>>>
>>>> FAQ
>>>>
>>>>
>>>>
>>>> =========================
>>>>
>>>> How can I help test this release?
>>>>
>>>> =========================
>>>>
>>>> If you are a Spark user, you can help us test this release by taking
>>>>
>>>> an existing Spark workload and running on this release candidate, then
>>>>
>>>> reporting any regressions.
>>>>
>>>>
>>>>
>>>> If you're working in PySpark you can set up a virtual env and install
>>>>
>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>
>>>> you can add the staging repository to your projects resolvers and test
>>>>
>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>
>>>> you don't end up building with an out of date RC going forward).
>>>>
>>>>
>>>>
>>>> ===========================================
>>>>
>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>
>>>> ===========================================
>>>>
>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>
>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>>> Version/s" = 3.5.0
>>>>
>>>>
>>>>
>>>> Committers should look at those and triage. Extremely important bug
>>>>
>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>
>>>> be worked on immediately. Everything else please retarget to an
>>>>
>>>> appropriate release.
>>>>
>>>>
>>>>
>>>> ==================
>>>>
>>>> But my bug isn't fixed?
>>>>
>>>> ==================
>>>>
>>>> In order to make timely releases, we will typically not hold the
>>>>
>>>> release unless the bug in question is a regression from the previous
>>>>
>>>> release. That being said, if there is something which is a regression
>>>>
>>>> that has not been correctly targeted please ping me or a committer to
>>>>
>>>> help target the issue.
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Yuanjian Li
>>>>
>>>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Jungtaek Lim <ka...@gmail.com>.
+1 (non-binding)
Thanks for driving this release!
On Fri, Sep 8, 2023 at 11:29 AM Holden Karau <ho...@pigscanfly.ca> wrote:
> +1 pip installing seems to function :)
>
> On Thu, Sep 7, 2023 at 7:22 PM Yuming Wang <yu...@apache.org> wrote:
>
>> +1.
>>
>> On Thu, Sep 7, 2023 at 10:33 PM yangjie01 <ya...@baidu.com.invalid>
>> wrote:
>>
>>> +1
>>>
>>>
>>>
>>> *发件人**: *Gengliang Wang <lt...@gmail.com>
>>> *日期**: *2023年9月7日 星期四 12:53
>>> *收件人**: *Yuanjian Li <xy...@gmail.com>
>>> *抄送**: *Xiao Li <ga...@gmail.com>, "herman@databricks.com.invalid"
>>> <he...@databricks.com.invalid>, Spark dev list <de...@spark.apache.org>
>>> *主题**: *Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
>>>
>>>
>>>
>>> +1
>>>
>>>
>>>
>>> On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com>
>>> wrote:
>>>
>>> +1 (non-binding)
>>>
>>> Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
>>>
>>> +1
>>>
>>>
>>>
>>> Xiao
>>>
>>>
>>>
>>> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>>>
>>> Tested connect, and everything looks good.
>>>
>>>
>>>
>>> +1
>>>
>>>
>>>
>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>> wrote:
>>>
>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>> version 3.5.0.
>>>
>>>
>>>
>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>
>>>
>>>
>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>
>>> [ ] -1 Do not release this package because ...
>>>
>>>
>>>
>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>
>>>
>>>
>>> The tag to be voted on is v3.5.0-rc4 (commit
>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>
>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>
>>>
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>>
>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>
>>>
>>>
>>> Signatures used for Spark RCs can be found in this file:
>>>
>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>
>>>
>>>
>>> The staging repository for this release can be found at:
>>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>
>>>
>>>
>>> The documentation corresponding to this release can be found at:
>>>
>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>
>>>
>>>
>>> The list of bug fixes going into 3.5.0 can be found at the following URL:
>>>
>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>
>>>
>>>
>>> This release is using the release script of the tag v3.5.0-rc4.
>>>
>>>
>>>
>>> FAQ
>>>
>>>
>>>
>>> =========================
>>>
>>> How can I help test this release?
>>>
>>> =========================
>>>
>>> If you are a Spark user, you can help us test this release by taking
>>>
>>> an existing Spark workload and running on this release candidate, then
>>>
>>> reporting any regressions.
>>>
>>>
>>>
>>> If you're working in PySpark you can set up a virtual env and install
>>>
>>> the current RC and see if anything important breaks, in the Java/Scala
>>>
>>> you can add the staging repository to your projects resolvers and test
>>>
>>> with the RC (make sure to clean up the artifact cache before/after so
>>>
>>> you don't end up building with an out of date RC going forward).
>>>
>>>
>>>
>>> ===========================================
>>>
>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>
>>> ===========================================
>>>
>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>
>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>> Version/s" = 3.5.0
>>>
>>>
>>>
>>> Committers should look at those and triage. Extremely important bug
>>>
>>> fixes, documentation, and API tweaks that impact compatibility should
>>>
>>> be worked on immediately. Everything else please retarget to an
>>>
>>> appropriate release.
>>>
>>>
>>>
>>> ==================
>>>
>>> But my bug isn't fixed?
>>>
>>> ==================
>>>
>>> In order to make timely releases, we will typically not hold the
>>>
>>> release unless the bug in question is a regression from the previous
>>>
>>> release. That being said, if there is something which is a regression
>>>
>>> that has not been correctly targeted please ping me or a committer to
>>>
>>> help target the issue.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Yuanjian Li
>>>
>>>
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Holden Karau <ho...@pigscanfly.ca>.
+1 pip installing seems to function :)
On Thu, Sep 7, 2023 at 7:22 PM Yuming Wang <yu...@apache.org> wrote:
> +1.
>
> On Thu, Sep 7, 2023 at 10:33 PM yangjie01 <ya...@baidu.com.invalid>
> wrote:
>
>> +1
>>
>>
>>
>> *发件人**: *Gengliang Wang <lt...@gmail.com>
>> *日期**: *2023年9月7日 星期四 12:53
>> *收件人**: *Yuanjian Li <xy...@gmail.com>
>> *抄送**: *Xiao Li <ga...@gmail.com>, "herman@databricks.com.invalid"
>> <he...@databricks.com.invalid>, Spark dev list <de...@spark.apache.org>
>> *主题**: *Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
>>
>>
>>
>> +1
>>
>>
>>
>> On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com>
>> wrote:
>>
>> +1 (non-binding)
>>
>> Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
>>
>> +1
>>
>>
>>
>> Xiao
>>
>>
>>
>> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>>
>> Tested connect, and everything looks good.
>>
>>
>>
>> +1
>>
>>
>>
>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>> wrote:
>>
>> Please vote on releasing the following candidate(RC4) as Apache Spark
>> version 3.5.0.
>>
>>
>>
>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>
>>
>>
>> [ ] +1 Release this package as Apache Spark 3.5.0
>>
>> [ ] -1 Do not release this package because ...
>>
>>
>>
>> To learn more about Apache Spark, please see http://spark.apache.org/
>>
>>
>>
>> The tag to be voted on is v3.5.0-rc4 (commit
>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>
>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>
>>
>>
>> The release files, including signatures, digests, etc. can be found at:
>>
>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>
>>
>>
>> Signatures used for Spark RCs can be found in this file:
>>
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>
>>
>>
>> The staging repository for this release can be found at:
>>
>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>
>>
>>
>> The documentation corresponding to this release can be found at:
>>
>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>
>>
>>
>> The list of bug fixes going into 3.5.0 can be found at the following URL:
>>
>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>
>>
>>
>> This release is using the release script of the tag v3.5.0-rc4.
>>
>>
>>
>> FAQ
>>
>>
>>
>> =========================
>>
>> How can I help test this release?
>>
>> =========================
>>
>> If you are a Spark user, you can help us test this release by taking
>>
>> an existing Spark workload and running on this release candidate, then
>>
>> reporting any regressions.
>>
>>
>>
>> If you're working in PySpark you can set up a virtual env and install
>>
>> the current RC and see if anything important breaks, in the Java/Scala
>>
>> you can add the staging repository to your projects resolvers and test
>>
>> with the RC (make sure to clean up the artifact cache before/after so
>>
>> you don't end up building with an out of date RC going forward).
>>
>>
>>
>> ===========================================
>>
>> What should happen to JIRA tickets still targeting 3.5.0?
>>
>> ===========================================
>>
>> The current list of open tickets targeted at 3.5.0 can be found at:
>>
>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 3.5.0
>>
>>
>>
>> Committers should look at those and triage. Extremely important bug
>>
>> fixes, documentation, and API tweaks that impact compatibility should
>>
>> be worked on immediately. Everything else please retarget to an
>>
>> appropriate release.
>>
>>
>>
>> ==================
>>
>> But my bug isn't fixed?
>>
>> ==================
>>
>> In order to make timely releases, we will typically not hold the
>>
>> release unless the bug in question is a regression from the previous
>>
>> release. That being said, if there is something which is a regression
>>
>> that has not been correctly targeted please ping me or a committer to
>>
>> help target the issue.
>>
>>
>>
>> Thanks,
>>
>> Yuanjian Li
>>
>>
--
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Yuming Wang <yu...@apache.org>.
+1.
On Thu, Sep 7, 2023 at 10:33 PM yangjie01 <ya...@baidu.com.invalid>
wrote:
> +1
>
>
>
> *发件人**: *Gengliang Wang <lt...@gmail.com>
> *日期**: *2023年9月7日 星期四 12:53
> *收件人**: *Yuanjian Li <xy...@gmail.com>
> *抄送**: *Xiao Li <ga...@gmail.com>, "herman@databricks.com.invalid"
> <he...@databricks.com.invalid>, Spark dev list <de...@spark.apache.org>
> *主题**: *Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
>
>
>
> +1
>
>
>
> On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com> wrote:
>
> +1 (non-binding)
>
> Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
>
> +1
>
>
>
> Xiao
>
>
>
> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>
> Tested connect, and everything looks good.
>
>
>
> +1
>
>
>
> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com> wrote:
>
> Please vote on releasing the following candidate(RC4) as Apache Spark
> version 3.5.0.
>
>
>
> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if a
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
>
>
> [ ] +1 Release this package as Apache Spark 3.5.0
>
> [ ] -1 Do not release this package because ...
>
>
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
>
>
> The tag to be voted on is v3.5.0-rc4 (commit
> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>
> https://github.com/apache/spark/tree/v3.5.0-rc4
>
>
>
> The release files, including signatures, digests, etc. can be found at:
>
> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>
>
>
> Signatures used for Spark RCs can be found in this file:
>
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
>
>
> The staging repository for this release can be found at:
>
> https://repository.apache.org/content/repositories/orgapachespark-1448
>
>
>
> The documentation corresponding to this release can be found at:
>
> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>
>
>
> The list of bug fixes going into 3.5.0 can be found at the following URL:
>
> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>
>
>
> This release is using the release script of the tag v3.5.0-rc4.
>
>
>
> FAQ
>
>
>
> =========================
>
> How can I help test this release?
>
> =========================
>
> If you are a Spark user, you can help us test this release by taking
>
> an existing Spark workload and running on this release candidate, then
>
> reporting any regressions.
>
>
>
> If you're working in PySpark you can set up a virtual env and install
>
> the current RC and see if anything important breaks, in the Java/Scala
>
> you can add the staging repository to your projects resolvers and test
>
> with the RC (make sure to clean up the artifact cache before/after so
>
> you don't end up building with an out of date RC going forward).
>
>
>
> ===========================================
>
> What should happen to JIRA tickets still targeting 3.5.0?
>
> ===========================================
>
> The current list of open tickets targeted at 3.5.0 can be found at:
>
> https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 3.5.0
>
>
>
> Committers should look at those and triage. Extremely important bug
>
> fixes, documentation, and API tweaks that impact compatibility should
>
> be worked on immediately. Everything else please retarget to an
>
> appropriate release.
>
>
>
> ==================
>
> But my bug isn't fixed?
>
> ==================
>
> In order to make timely releases, we will typically not hold the
>
> release unless the bug in question is a regression from the previous
>
> release. That being said, if there is something which is a regression
>
> that has not been correctly targeted please ping me or a committer to
>
> help target the issue.
>
>
>
> Thanks,
>
> Yuanjian Li
>
>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by yangjie01 <ya...@baidu.com.INVALID>.
+1
发件人: Gengliang Wang <lt...@gmail.com>
日期: 2023年9月7日 星期四 12:53
收件人: Yuanjian Li <xy...@gmail.com>
抄送: Xiao Li <ga...@gmail.com>, "herman@databricks.com.invalid" <he...@databricks.com.invalid>, Spark dev list <de...@spark.apache.org>
主题: Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
+1
On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com>> wrote:
+1 (non-binding)
Xiao Li <ga...@gmail.com>> 于2023年9月6日周三 15:27写道:
+1
Xiao
Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
Tested connect, and everything looks good.
+1
On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>> wrote:
Please vote on releasing the following candidate(RC4) as Apache Spark version 3.5.0.
The vote is open until 11:59pm Pacific time Sep 8th and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
[ ] +1 Release this package as Apache Spark 3.5.0
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see http://spark.apache.org/
The tag to be voted on is v3.5.0-rc4 (commit c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
https://github.com/apache/spark/tree/v3.5.0-rc4
The release files, including signatures, digests, etc. can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
Signatures used for Spark RCs can be found in this file:
https://dist.apache.org/repos/dist/dev/spark/KEYS
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1448
The documentation corresponding to this release can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
The list of bug fixes going into 3.5.0 can be found at the following URL:
https://issues.apache.org/jira/projects/SPARK/versions/12352848
This release is using the release script of the tag v3.5.0-rc4.
FAQ
=========================
How can I help test this release?
=========================
If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.
If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with an out of date RC going forward).
===========================================
What should happen to JIRA tickets still targeting 3.5.0?
===========================================
The current list of open tickets targeted at 3.5.0 can be found at:
https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.5.0
Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.
==================
But my bug isn't fixed?
==================
In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.
Thanks,
Yuanjian Li
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Gengliang Wang <lt...@gmail.com>.
+1
On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li <xy...@gmail.com> wrote:
> +1 (non-binding)
>
> Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
>
>> +1
>>
>> Xiao
>>
>> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>>
>>> Tested connect, and everything looks good.
>>>
>>> +1
>>>
>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>>> wrote:
>>>
>>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>>> version 3.5.0.
>>>>
>>>> The vote is open until 11:59pm Pacific time Sep 8th and passes if a
>>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>>
>>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>>
>>>> [ ] -1 Do not release this package because ...
>>>>
>>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>>
>>>> The tag to be voted on is v3.5.0-rc4 (commit
>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>>
>>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>>
>>>> The release files, including signatures, digests, etc. can be found at:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>>
>>>> Signatures used for Spark RCs can be found in this file:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>>
>>>> The staging repository for this release can be found at:
>>>>
>>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>>
>>>> The documentation corresponding to this release can be found at:
>>>>
>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>>
>>>> The list of bug fixes going into 3.5.0 can be found at the following
>>>> URL:
>>>>
>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>>
>>>> This release is using the release script of the tag v3.5.0-rc4.
>>>>
>>>>
>>>> FAQ
>>>>
>>>> =========================
>>>>
>>>> How can I help test this release?
>>>>
>>>> =========================
>>>>
>>>> If you are a Spark user, you can help us test this release by taking
>>>>
>>>> an existing Spark workload and running on this release candidate, then
>>>>
>>>> reporting any regressions.
>>>>
>>>> If you're working in PySpark you can set up a virtual env and install
>>>>
>>>> the current RC and see if anything important breaks, in the Java/Scala
>>>>
>>>> you can add the staging repository to your projects resolvers and test
>>>>
>>>> with the RC (make sure to clean up the artifact cache before/after so
>>>>
>>>> you don't end up building with an out of date RC going forward).
>>>>
>>>> ===========================================
>>>>
>>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>>
>>>> ===========================================
>>>>
>>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>>
>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>>> Version/s" = 3.5.0
>>>>
>>>> Committers should look at those and triage. Extremely important bug
>>>>
>>>> fixes, documentation, and API tweaks that impact compatibility should
>>>>
>>>> be worked on immediately. Everything else please retarget to an
>>>>
>>>> appropriate release.
>>>>
>>>> ==================
>>>>
>>>> But my bug isn't fixed?
>>>>
>>>> ==================
>>>>
>>>> In order to make timely releases, we will typically not hold the
>>>>
>>>> release unless the bug in question is a regression from the previous
>>>>
>>>> release. That being said, if there is something which is a regression
>>>>
>>>> that has not been correctly targeted please ping me or a committer to
>>>>
>>>> help target the issue.
>>>>
>>>> Thanks,
>>>>
>>>> Yuanjian Li
>>>>
>>>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Yuanjian Li <xy...@gmail.com>.
+1 (non-binding)
Xiao Li <ga...@gmail.com> 于2023年9月6日周三 15:27写道:
> +1
>
> Xiao
>
> Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
>
>> Tested connect, and everything looks good.
>>
>> +1
>>
>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com>
>> wrote:
>>
>>> Please vote on releasing the following candidate(RC4) as Apache Spark
>>> version 3.5.0.
>>>
>>> The vote is open until 11:59pm Pacific time Sep 8th and passes if a
>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>
>>> [ ] +1 Release this package as Apache Spark 3.5.0
>>>
>>> [ ] -1 Do not release this package because ...
>>>
>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>
>>> The tag to be voted on is v3.5.0-rc4 (commit
>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>>
>>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>>
>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>>
>>> Signatures used for Spark RCs can be found in this file:
>>>
>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>
>>> The staging repository for this release can be found at:
>>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>>
>>> The documentation corresponding to this release can be found at:
>>>
>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>>
>>> The list of bug fixes going into 3.5.0 can be found at the following URL:
>>>
>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>>
>>> This release is using the release script of the tag v3.5.0-rc4.
>>>
>>>
>>> FAQ
>>>
>>> =========================
>>>
>>> How can I help test this release?
>>>
>>> =========================
>>>
>>> If you are a Spark user, you can help us test this release by taking
>>>
>>> an existing Spark workload and running on this release candidate, then
>>>
>>> reporting any regressions.
>>>
>>> If you're working in PySpark you can set up a virtual env and install
>>>
>>> the current RC and see if anything important breaks, in the Java/Scala
>>>
>>> you can add the staging repository to your projects resolvers and test
>>>
>>> with the RC (make sure to clean up the artifact cache before/after so
>>>
>>> you don't end up building with an out of date RC going forward).
>>>
>>> ===========================================
>>>
>>> What should happen to JIRA tickets still targeting 3.5.0?
>>>
>>> ===========================================
>>>
>>> The current list of open tickets targeted at 3.5.0 can be found at:
>>>
>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>> Version/s" = 3.5.0
>>>
>>> Committers should look at those and triage. Extremely important bug
>>>
>>> fixes, documentation, and API tweaks that impact compatibility should
>>>
>>> be worked on immediately. Everything else please retarget to an
>>>
>>> appropriate release.
>>>
>>> ==================
>>>
>>> But my bug isn't fixed?
>>>
>>> ==================
>>>
>>> In order to make timely releases, we will typically not hold the
>>>
>>> release unless the bug in question is a regression from the previous
>>>
>>> release. That being said, if there is something which is a regression
>>>
>>> that has not been correctly targeted please ping me or a committer to
>>>
>>> help target the issue.
>>>
>>> Thanks,
>>>
>>> Yuanjian Li
>>>
>>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Xiao Li <ga...@gmail.com>.
+1
Xiao
Herman van Hovell <he...@databricks.com.invalid> 于2023年9月6日周三 22:08写道:
> Tested connect, and everything looks good.
>
> +1
>
> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com> wrote:
>
>> Please vote on releasing the following candidate(RC4) as Apache Spark
>> version 3.5.0.
>>
>> The vote is open until 11:59pm Pacific time Sep 8th and passes if a
>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>
>> [ ] +1 Release this package as Apache Spark 3.5.0
>>
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see http://spark.apache.org/
>>
>> The tag to be voted on is v3.5.0-rc4 (commit
>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>>
>> https://github.com/apache/spark/tree/v3.5.0-rc4
>>
>> The release files, including signatures, digests, etc. can be found at:
>>
>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>>
>> Signatures used for Spark RCs can be found in this file:
>>
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>
>> The staging repository for this release can be found at:
>>
>> https://repository.apache.org/content/repositories/orgapachespark-1448
>>
>> The documentation corresponding to this release can be found at:
>>
>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>>
>> The list of bug fixes going into 3.5.0 can be found at the following URL:
>>
>> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>>
>> This release is using the release script of the tag v3.5.0-rc4.
>>
>>
>> FAQ
>>
>> =========================
>>
>> How can I help test this release?
>>
>> =========================
>>
>> If you are a Spark user, you can help us test this release by taking
>>
>> an existing Spark workload and running on this release candidate, then
>>
>> reporting any regressions.
>>
>> If you're working in PySpark you can set up a virtual env and install
>>
>> the current RC and see if anything important breaks, in the Java/Scala
>>
>> you can add the staging repository to your projects resolvers and test
>>
>> with the RC (make sure to clean up the artifact cache before/after so
>>
>> you don't end up building with an out of date RC going forward).
>>
>> ===========================================
>>
>> What should happen to JIRA tickets still targeting 3.5.0?
>>
>> ===========================================
>>
>> The current list of open tickets targeted at 3.5.0 can be found at:
>>
>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 3.5.0
>>
>> Committers should look at those and triage. Extremely important bug
>>
>> fixes, documentation, and API tweaks that impact compatibility should
>>
>> be worked on immediately. Everything else please retarget to an
>>
>> appropriate release.
>>
>> ==================
>>
>> But my bug isn't fixed?
>>
>> ==================
>>
>> In order to make timely releases, we will typically not hold the
>>
>> release unless the bug in question is a regression from the previous
>>
>> release. That being said, if there is something which is a regression
>>
>> that has not been correctly targeted please ping me or a committer to
>>
>> help target the issue.
>>
>> Thanks,
>>
>> Yuanjian Li
>>
>
Re: [VOTE] Release Apache Spark 3.5.0 (RC4)
Posted by Herman van Hovell <he...@databricks.com.INVALID>.
Tested connect, and everything looks good.
+1
On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xy...@gmail.com> wrote:
> Please vote on releasing the following candidate(RC4) as Apache Spark
> version 3.5.0.
>
> The vote is open until 11:59pm Pacific time Sep 8th and passes if a
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.5.0
>
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
> The tag to be voted on is v3.5.0-rc4 (commit
> c2939589a29dd0d6a2d3d31a8d833877a37ee02a):
>
> https://github.com/apache/spark/tree/v3.5.0-rc4
>
> The release files, including signatures, digests, etc. can be found at:
>
> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/
>
> Signatures used for Spark RCs can be found in this file:
>
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
>
> https://repository.apache.org/content/repositories/orgapachespark-1448
>
> The documentation corresponding to this release can be found at:
>
> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/
>
> The list of bug fixes going into 3.5.0 can be found at the following URL:
>
> https://issues.apache.org/jira/projects/SPARK/versions/12352848
>
> This release is using the release script of the tag v3.5.0-rc4.
>
>
> FAQ
>
> =========================
>
> How can I help test this release?
>
> =========================
>
> If you are a Spark user, you can help us test this release by taking
>
> an existing Spark workload and running on this release candidate, then
>
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
>
> the current RC and see if anything important breaks, in the Java/Scala
>
> you can add the staging repository to your projects resolvers and test
>
> with the RC (make sure to clean up the artifact cache before/after so
>
> you don't end up building with an out of date RC going forward).
>
> ===========================================
>
> What should happen to JIRA tickets still targeting 3.5.0?
>
> ===========================================
>
> The current list of open tickets targeted at 3.5.0 can be found at:
>
> https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 3.5.0
>
> Committers should look at those and triage. Extremely important bug
>
> fixes, documentation, and API tweaks that impact compatibility should
>
> be worked on immediately. Everything else please retarget to an
>
> appropriate release.
>
> ==================
>
> But my bug isn't fixed?
>
> ==================
>
> In order to make timely releases, we will typically not hold the
>
> release unless the bug in question is a regression from the previous
>
> release. That being said, if there is something which is a regression
>
> that has not been correctly targeted please ping me or a committer to
>
> help target the issue.
>
> Thanks,
>
> Yuanjian Li
>