You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2023/01/16 09:06:43 UTC

[GitHub] [spark] lfspace opened a new pull request, #39605: when spark job had ran in k8s is finished ,it register to shutdown ho…

lfspace opened a new pull request, #39605:
URL: https://github.com/apache/spark/pull/39605

   What changes were proposed in this pull request?
   In k8s the host-path config to spark-local-dir ,Spark job clearup the shuffle tmp dirs when it is finished.
   
   Why are the changes needed?
   The shuffle data will filled the disks of tmp dirs.
   
   Does this PR introduce any user-facing change?
   
   How was this patch tested?
   In yaml config:
   ```
   driver:
       volumeMounts:
         - name: "spark-local-dir-1"
           mountPath: "/shuff/data"
   executor:
       volumeMounts:
         - name: "spark-local-dir-1"
           mountPath: "/shuff/data"
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #39605: when spark job had ran in k8s is finished ,it register to shutdown ho…

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on PR #39605:
URL: https://github.com/apache/spark/pull/39605#issuecomment-1386075621

   Can one of the admins verify this patch?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] github-actions[bot] closed pull request #39605: when spark job had ran in k8s is finished ,it register to shutdown ho…

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #39605: when spark job had ran in k8s is finished ,it register to shutdown ho…
URL: https://github.com/apache/spark/pull/39605


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] github-actions[bot] commented on pull request #39605: when spark job had ran in k8s is finished ,it register to shutdown ho…

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #39605:
URL: https://github.com/apache/spark/pull/39605#issuecomment-1528287537

   We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
   If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] srowen commented on pull request #39605: when spark job had ran in k8s is finished ,it register to shutdown ho…

Posted by GitBox <gi...@apache.org>.
srowen commented on PR #39605:
URL: https://github.com/apache/spark/pull/39605#issuecomment-1387186864

   Please read https://spark.apache.org/contributing.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org