You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/08/19 06:54:29 UTC

[GitHub] [spark] jiangxb1987 opened a new pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

jiangxb1987 opened a new pull request #29474:
URL: https://github.com/apache/spark/pull/29474


   # What changes were proposed in this pull request?
   
   The `count` in `PartitionWriterStream` should be a long value, instead of int. The issue is introduced by apache/spark@abef84a . When the overflow happens, the shuffle index file would record wrong index of a reduceId, thus lead to `FetchFailedException: Stream is corrupted` error.
   
   Besides the fix, I also added some debug logs, so in the future it's easier to debug similar issues.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No
   
   ### How was this patch tested?
   
   A Spark user reported this issue when migrating their workload to 3.0. One of the jobs fail deterministically on Spark 3.0 without the patch, and the job succeed after applied the fix.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676634131






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675896362


   **[Test build #127628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127628/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] mridulm commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
mridulm commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-679239999


   Nice catch @jiangxb1987 !


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675896811






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] jiangxb1987 commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
jiangxb1987 commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676633422


   retest this please


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675893141






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] HyukjinKwon commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676090518


   retest this please


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675893108


   **[Test build #127626 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127626/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).
    * This patch **fails due to an unknown error code, -9**.
    * This patch merges cleanly.
    * This patch adds no public classes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676051782


   Merged build finished. Test FAILed.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] jiangxb1987 commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
jiangxb1987 commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675889531


   cc @mccheah @cloud-fan @Ngone51 @zhengruifeng 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675890659


   **[Test build #127626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127626/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676300780


   **[Test build #127641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127641/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).
    * This patch **fails Spark unit tests**.
    * This patch merges cleanly.
    * This patch adds no public classes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] gatorsmile commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
gatorsmile commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-678965862


   cc @vanzin @squito @jerryshao who are the major reviewers of the original PR https://github.com/apache/spark/pull/25007
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675896362


   **[Test build #127628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127628/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675891005






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676051807


   Test FAILed.
   Refer to this link for build results (access rights to CI server needed): 
   https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127628/
   Test FAILed.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676634131






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676303028


   Merged build finished. Test FAILed.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] cloud-fan closed pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
cloud-fan closed pull request #29474:
URL: https://github.com/apache/spark/pull/29474


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675893147


   Test FAILed.
   Refer to this link for build results (access rights to CI server needed): 
   https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127626/
   Test FAILed.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676787356


   **[Test build #127660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127660/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).
    * This patch passes all tests.
    * This patch merges cleanly.
    * This patch adds no public classes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675896811






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676050306


   **[Test build #127628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127628/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).
    * This patch **fails Spark unit tests**.
    * This patch merges cleanly.
    * This patch adds no public classes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676788342






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676093933


   **[Test build #127641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127641/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] cloud-fan commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-677388213


   thanks, merging to master/3.0!


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676095825






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676095825






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676303054


   Test FAILed.
   Refer to this link for build results (access rights to CI server needed): 
   https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127641/
   Test FAILed.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676638265


   **[Test build #127660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127660/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675890659


   **[Test build #127626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127626/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676788342






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676093933


   **[Test build #127641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127641/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676051782






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676638265


   **[Test build #127660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127660/testReport)** for PR 29474 at commit [`dd38f6d`](https://github.com/apache/spark/commit/dd38f6d1bf348e419108f88eac1b8207c9c792f0).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] cloud-fan commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675895746


   retest this please


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675891005






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676303028






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-675893141


   Merged build finished. Test FAILed.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] HyukjinKwon commented on pull request #29474: [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length overflow

Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #29474:
URL: https://github.com/apache/spark/pull/29474#issuecomment-676028504


   cc @zhengruifeng FYI. This is a blocker


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org