You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "alkis (via GitHub)" <gi...@apache.org> on 2023/03/17 08:10:27 UTC
[GitHub] [spark] alkis opened a new pull request, #40464: [SPARK-XXXXX] scheduler micro opts
alkis opened a new pull request, #40464:
URL: https://github.com/apache/spark/pull/40464
### What changes were proposed in this pull request?
Scheduler micro optimizations to speed up the scheduling loop.
### Why are the changes needed?
The scheduler is single threaded and the faster we can schedule the faster a query executes. Changes to the scheduler usually adversely affect scheduling throughput which makes it hard to prototype novel changes. Getting some headroom makes experimentation faster while not hurting production.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #40464: [MINOR] scheduler micro opts
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #40464:
URL: https://github.com/apache/spark/pull/40464#issuecomment-1475459557
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] cloud-fan commented on pull request #40464: [SPARK-XXXXX] scheduler micro opts
Posted by "cloud-fan (via GitHub)" <gi...@apache.org>.
cloud-fan commented on PR #40464:
URL: https://github.com/apache/spark/pull/40464#issuecomment-1474006026
This is very trivial so probably doesn't need a JIRA ticket. We can add [MINOR] in the title.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] alkis commented on pull request #40464: [MINOR] scheduler micro opts
Posted by "alkis (via GitHub)" <gi...@apache.org>.
alkis commented on PR #40464:
URL: https://github.com/apache/spark/pull/40464#issuecomment-1475437896
> This is very trivial so probably doesn't need a JIRA ticket. We can add [MINOR] in the title.
Thank you @cloud-fan. Done!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #40464: [MINOR] scheduler micro opts
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon closed pull request #40464: [MINOR] scheduler micro opts
URL: https://github.com/apache/spark/pull/40464
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org