You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by GitBox <gi...@apache.org> on 2020/06/18 17:00:31 UTC
[GitHub] [spark-website] cloud-fan opened a new pull request #271: the date of the post should the date you create it
cloud-fan opened a new pull request #271:
URL: https://github.com/apache/spark-website/pull/271
After talking with @rxin offline, we think it's confusing to use the RC vote pass date as the date of the post. People may be wondering why they didn't see the post before, as the date is usually many days before.
This PR tries to make it the policy clear: The date of the post should be the date you create it. This is the most intuitive IMO.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] srowen commented on pull request #271: the date of the post should be the date you create it
Posted by GitBox <gi...@apache.org>.
srowen commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646202686
Meh, I'm sure we have roughly the same review practices here. I'd also generally separate concerns. In practice, it's also OK to have a 'misc minor edits' PR. I know we want to make sure it's fixed up ASAP now that 3.0 is rolling out the door, announced. So probably no big deal to just make this one omnibus last minute tweak change.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646197761
Please see the 2.3.4/2.4.5 and old practices.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] cloud-fan commented on pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646197363
It's not a Spark PR, and I don't think the Spark PR policies apply here... We just do what's the most convenient.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #271: the date of the post should be the date you create it
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646203798
If you think so, okay. @srowen .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun edited a comment on pull request #271: the date of the post should be the date you create it
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646194278
Hi, @cloud-fan , @rxin , @gatorsmile .
This PR should change news date only~
- 2.4.4 (https://github.com/apache/spark-website/pull/217/files#diff-2e7c596ac11621f7b55e3299dd80f1b3R25)
- 2.4.5 (https://github.com/apache/spark-website/pull/261#discussion_r376745966)
- 2.3.4 (https://github.com/apache/spark-website/pull/221/files#diff-2e7c596ac11621f7b55e3299dd80f1b3R26)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] srowen commented on pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
srowen commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646186207
I agree with that take. The VOTE passing is just an internal procedural step. The release date is when it's fully available to end users, which isn't the same thing.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] gatorsmile merged pull request #271: the date of the post should be the date you create it
Posted by GitBox <gi...@apache.org>.
gatorsmile merged pull request #271:
URL: https://github.com/apache/spark-website/pull/271
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] cloud-fan commented on a change in pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on a change in pull request #271:
URL: https://github.com/apache/spark-website/pull/271#discussion_r442373302
##########
File path: release-process.md
##########
@@ -259,7 +259,8 @@ Then, create the release notes. Go to the
<a href="https://issues.apache.org/jira/projects/SPARK?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page">release page in JIRA</a>,
pick the release version from the list, then click on "Release Notes". Copy this URL and then make a short URL on
<a href="https://s.apache.org/">s.apache.org</a>, sign in to your Apache account, and pick the ID as something like
-`spark-2.1.2`. Create a new release post under `releases/_posts` to include this short URL.
+`spark-2.1.2`. Create a new release post under `releases/_posts` to include this short URL. The date of the post should
+be the date you create it.
Review comment:
I put it here so future releases can just follow it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] cloud-fan commented on pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646175051
cc @dongjoon-hyun @rxin @srowen
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646194278
Hi, @cloud-fan , @rxin , @gatorsmile .
This PR should change news date only~
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] cloud-fan commented on a change in pull request #271: the date of the post should be the date you create it
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on a change in pull request #271:
URL: https://github.com/apache/spark-website/pull/271#discussion_r442391584
##########
File path: releases/_posts/2020-06-18-spark-release-3-0-0.md
##########
@@ -11,7 +11,7 @@ meta:
_wpas_done_all: '1'
---
-Apache Spark 3.0.0 is the first release of the 3.x line. Apache Spark 3.0 builds on many of the innovations from Spark 2.x, bringing new ideas as well as continuing long-term projects that have been in development. With the help of tremendous contributions from the open-source community, this release resolved more than 3400 tickets as the result of contributions from over 440 contributors.
+Apache Spark 3.0.0 is the first release of the 3.x line. The vote passed on the 10th of June, 2020. This release is based on git tag `v3.0.0` which includes all commits up to June 10. Apache Spark 3.0 builds on many of the innovations from Spark 2.x, bringing new ideas as well as continuing long-term projects that have been in development. With the help of tremendous contributions from the open-source community, this release resolved more than 3400 tickets as the result of contributions from over 440 contributors.
Review comment:
This change is necessary as we need to mention the vote pass date somewhere.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] gatorsmile commented on a change in pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
gatorsmile commented on a change in pull request #271:
URL: https://github.com/apache/spark-website/pull/271#discussion_r442380758
##########
File path: releases/_posts/2020-06-18-spark-release-3-0-0.md
##########
@@ -315,18 +315,18 @@ Please read the [migration guide](https://spark.apache.org/docs/3.0.0/sparkr-mig
### Known Issues
- - Streaming queries with `dropDuplicates` operator may not be able to restart with the checkpoint written by Spark 2.x. ([SPARK-31990](https://issues.apache.org/jira/browse/SPARK-31990))
- - In Web UI, the job list page may hang for more than 40 seconds. ([SPARK-31967](https://issues.apache.org/jira/browse/SPARK-31967))
+ - Streaming queries with `dropDuplicates` operator may not be able to restart with the checkpoint written by Spark 2.x. This is fixed in the next release 3.0.1. ([SPARK-31990](https://issues.apache.org/jira/browse/SPARK-31990))
+ - In Web UI, the job list page may hang for more than 40 seconds. This is fixed in the next release 3.0.1. ([SPARK-31967](https://issues.apache.org/jira/browse/SPARK-31967))
- Set `io.netty.tryReflectionSetAccessible` for Arrow on JDK9+ ([SPARK-29923](https://issues.apache.org/jira/browse/SPARK-29923))
- With AWS SDK upgrade to 1.11.655, we strongly encourage the users that use S3N file system (open-source NativeS3FileSystem that is based on jets3t library) on Hadoop 2.7.3 to upgrade to use AWS Signature V4 and set the bucket endpoint or migrate to S3A (“s3a://” prefix) - jets3t library uses AWS v2 by default and s3.amazonaws.com as an endpoint. Otherwise, the 403 Forbidden error may be thrown in the following cases:
- If a user accesses an S3 path that contains “+” characters and uses the legacy S3N file system, e.g. s3n://bucket/path/+file.
- If a user has configured AWS V2 signature to sign requests to S3 with S3N file system.
Note that if you use S3AFileSystem, e.g. (“s3a://bucket/path”) to access S3 in S3Select or SQS connectors, then everything will work as expected. ([SPARK-30968](https://issues.apache.org/jira/browse/SPARK-30968))
- - Parsing day of year using pattern letter 'D' returns the wrong result if the year field is missing. This can happen in SQL functions like `to_timestamp` which parses datetime string to datetime values using a pattern string. ([SPARK-31939](https://issues.apache.org/jira/browse/SPARK-31939))
- - Join/Window/Aggregate inside subqueries may lead to wrong results if the keys have values -0.0 and 0.0. ([SPARK-31958](https://issues.apache.org/jira/browse/SPARK-31958))
- - A window query may fail with ambiguous self-join error unexpectedly. ([SPARK-31956](https://issues.apache.org/jira/browse/SPARK-31956))
+ - Parsing day of year using pattern letter 'D' returns the wrong result if the year field is missing. This can happen in SQL functions like `to_timestamp` which parses datetime string to datetime values using a pattern string. This is fixed in the next release 3.0.1. ([SPARK-31939](https://issues.apache.org/jira/browse/SPARK-31939))
Review comment:
=> This will be fixed in the next release 3.0.1.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun edited a comment on pull request #271: the date of the post should the date you create it
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on pull request #271:
URL: https://github.com/apache/spark-website/pull/271#issuecomment-646194278
Hi, @cloud-fan , @rxin , @gatorsmile .
This PR should change news date only~
- 2.4.5 (https://github.com/apache/spark-website/pull/261#discussion_r376745966)
- 2.3.4 (https://github.com/apache/spark-website/pull/221/files#diff-2e7c596ac11621f7b55e3299dd80f1b3R26)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org