You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/02/29 14:27:04 UTC
[GitHub] [spark] srowen opened a new pull request #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
srowen opened a new pull request #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746
### What changes were proposed in this pull request?
Manage up the version of Xerces that Hadoop uses (and potentially user apps) to 2.12.0 to match https://issues.apache.org/jira/browse/HADOOP-16530
### Why are the changes needed?
Picks up bug and security fixes: https://www.xml.com/news/2018-05-apache-xerces-j-2120/
### Does this PR introduce any user-facing change?
Should be no behavior changes.
### How was this patch tested?
Existing tests.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592950964
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/23867/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] holdenk commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
holdenk commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593171842
I'm not super sure why we would backport this one transitive library, it seems possible that there are a good number of other similar libraries and it might make sense to upgrade our default hadoop. Hadoop 2.7 is no longer on https://hadoop.apache.org/releases.html
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592963100
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592950964
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/23867/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27746: [SPARK-30992][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592950877
**[Test build #119125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119125/testReport)** for PR 27746 at commit [`da9d79b`](https://github.com/apache/spark/commit/da9d79b8b0047e5053fe7d9381748c9770805bff).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593040325
**[Test build #119133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119133/testReport)** for PR 27746 at commit [`e1824ec`](https://github.com/apache/spark/commit/e1824ece26c297633a6547b4db5c007144285f2e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951680
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/23868/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593055697
**[Test build #119133 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119133/testReport)** for PR 27746 at commit [`e1824ec`](https://github.com/apache/spark/commit/e1824ece26c297633a6547b4db5c007144285f2e).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593055844
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119133/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951543
**[Test build #119126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119126/testReport)** for PR 27746 at commit [`e1824ec`](https://github.com/apache/spark/commit/e1824ece26c297633a6547b4db5c007144285f2e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593041316
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/23875/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592950877
**[Test build #119125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119125/testReport)** for PR 27746 at commit [`da9d79b`](https://github.com/apache/spark/commit/da9d79b8b0047e5053fe7d9381748c9770805bff).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592950962
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen closed pull request #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
srowen closed pull request #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
srowen commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594489575
Let's try this one: https://github.com/apache/spark/pull/27790
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594327760
@srowen . Unfortunately, the five Maven Jenkins jobs skip Python Packaging. Only SBT jobs have the Python Packaging test coverage. And, those SBT jobs still show 2.9.1 in `master` and `branch-3.0`. It seems that we need a test coverage recovery as a follow-up.
```
copying deps/jars/xercesImpl-2.9.1.jar -> pyspark-3.0.0.dev0/deps/jars
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
srowen commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594473037
Hm, OK I understand. Let me see if I can convince the SBT build to read it the same way. I think we may have to have an explicit runtime dependency on it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594327760
@srowen . Unfortunately, the five Maven Jenkins jobs skip Python Packaging test. Only SBT jobs have the Python Packaging test coverage. And, those SBT jobs still show 2.9.1 in `master` and `branch-3.0`. It seems that we need a test coverage recovery as a follow-up.
```
copying deps/jars/xercesImpl-2.9.1.jar -> pyspark-3.0.0.dev0/deps/jars
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593041314
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951037
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951677
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951677
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594648762
Thank you~
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593036116
retest this please
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593041316
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/23875/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951680
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/23868/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
srowen commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593176962
@kiszk hm, good point. I think the sbt build doesn't seem to pick this up for some reason? I see 2.9.1 in `sbt dependencyList`. I'll have to look into that a bit more, esp. if this means it somehow affects the Pyspark artifacts.
@dongjoon-hyun it's probably reasonable to move to supporting just one latest Hadoop 2.x version in the foreseeable future, yes. I think that's somewhat separate.
@holdenk yeah the motivation for this particular library is the security issue, and this narrow change could for example back port to 2.4.x, though at this point it's not clear if the possible security issue highlighted in the release notes can affect Spark or how much. It may start popping up as part of automatic scans.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592963101
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119126/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594327760
@srowen . Unfortunately, the five Maven Jenkins jobs skip Python Packaging test. Only SBT jobs have the Python Packaging test coverage. And, those SBT jobs still show 2.9.1 in `master` and `branch-3.0`. It seems that we need a test coverage recovery as a follow-up.
```
copying deps/jars/xercesImpl-2.9.1.jar -> pyspark-3.0.0.dev0/deps/jars
```
We need to choose one of the followings.
1. Fix SBT build
2. Add a test coverage on one of Maven Jenkins jobs
(1) is the correct way, but (2) is also okay.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593055843
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592963101
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119126/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951543
**[Test build #119126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119126/testReport)** for PR 27746 at commit [`e1824ec`](https://github.com/apache/spark/commit/e1824ece26c297633a6547b4db5c007144285f2e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951039
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119125/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951039
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119125/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593041314
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592963100
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593040325
**[Test build #119133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119133/testReport)** for PR 27746 at commit [`e1824ec`](https://github.com/apache/spark/commit/e1824ece26c297633a6547b4db5c007144285f2e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592962978
**[Test build #119126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119126/testReport)** for PR 27746 at commit [`e1824ec`](https://github.com/apache/spark/commit/e1824ece26c297633a6547b4db5c007144285f2e).
* This patch **fails Spark unit tests**.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593055844
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119133/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951037
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
srowen commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593189008
Hm, I am not sure why sbt resolves it differently; I tried adding an exclusion but it removed the dependency entirely on both builds.
The Maven build is what's used for releases and it seems to package the right jar in jars/. pyspark artifacts are built from this. So I think the change is 'right' w.r.t. releases, but that's still odd. I don't see why setup.py ends up finding something else there.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593055843
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27746:
[SPARK-30992][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592950962
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on issue #27746: [SPARK-30994][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
srowen commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594009028
Merged to master/3.0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27746: [SPARK-30992][CORE]
Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27746: [SPARK-30992][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-592951036
**[Test build #119125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119125/testReport)** for PR 27746 at commit [`da9d79b`](https://github.com/apache/spark/commit/da9d79b8b0047e5053fe7d9381748c9770805bff).
* This patch **fails build dependency tests**.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] kiszk commented on issue #27746: [SPARK-30994][CORE] Update
xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
kiszk commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-593061235
The change sound good to me.
While I am not familiar with building pyspark, I am curious why we are seeing this line
```
...
copying deps/jars/xercesImpl-2.9.1.jar -> pyspark-3.1.0.dev0/deps/jars
...
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on issue #27746:
[SPARK-30994][CORE] Update xerces to 2.12.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0
URL: https://github.com/apache/spark/pull/27746#issuecomment-594327760
@srowen . Unfortunately, the five Maven Jenkins jobs skip Python Packaging test. Only SBT jobs have the Python Packaging test coverage. And, those SBT jobs still show 2.9.1 in `master` and `branch-3.0`. It seems that we need a test coverage recovery as a follow-up.
```
copying deps/jars/xercesImpl-2.9.1.jar -> pyspark-3.0.0.dev0/deps/jars
```
We need to choose one of the following.
1. Fix SBT build
2. Add a test coverage on one of Maven Jenkins jobs
(1) is the correct way, but (2) is also okay.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org