You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/03/08 02:40:50 UTC
[GitHub] [spark] beliefer opened a new pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
beliefer opened a new pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848
### What changes were proposed in this pull request?
1.Add version information to the configuration of `Status`.
2.Update the docs of `Status`.
I sorted out some information show below.
Item name | Since version | JIRA ID | Commit ID | Note
-- | -- | -- | -- | --
spark.appStateStore.asyncTracking.enable | 2.3.0 | SPARK-20653 | 772e4648d95bda3353723337723543c741ea8476#diff-9ab674b7af7b2097f7d28cb6f5fd1e8c |
spark.ui.liveUpdate.period | 2.3.0 | SPARK-20644 | c7f38e5adb88d43ef60662c5d6ff4e7a95bff580#diff-9ab674b7af7b2097f7d28cb6f5fd1e8c |
spark.ui.liveUpdate.minFlushPeriod | 2.4.2 | SPARK-27394 | a8a2ba11ac10051423e58920062b50f328b06421#diff-9ab674b7af7b2097f7d28cb6f5fd1e8c |
spark.ui.retainedJobs | 1.2.0 | SPARK-2321 | 9530316887612dca060a128fca34dd5a6ab2a9a9#diff-1f32bcb61f51133bd0959a4177a066a5 |
spark.ui.retainedStages | 0.9.0 | None | 112c0a1776bbc866a1026a9579c6f72f293414c4#diff-1f32bcb61f51133bd0959a4177a066a5 | 0.9.0-incubating-SNAPSHOT
spark.ui.retainedTasks | 2.0.1 | SPARK-15083 | 55db26245d69bb02b7d7d5f25029b1a1cd571644#diff-6bdad48cfc34314e89599655442ff210 |
spark.ui.retainedDeadExecutors | 2.0.0 | SPARK-7729 | 9f4263392e492b5bc0acecec2712438ff9a257b7#diff-a0ba36f9b1f9829bf3c4689b05ab6cf2 |
spark.ui.dagGraph.retainedRootRDDs | 2.1.0 | SPARK-17171 | cc87280fcd065b01667ca7a59a1a32c7ab757355#diff-3f492c527ea26679d4307041b28455b8 |
spark.metrics.appStatusSource.enabled | 3.0.0 | SPARK-30060 | 60f20e5ea2000ab8f4a593b5e4217fd5637c5e22#diff-9f796ae06b0272c1f0a012652a5b68d0 |
### Why are the changes needed?
Supplemental configuration version information.
### Does this PR introduce any user-facing change?
No
### How was this patch tested?
Exists UT
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329527
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("1s")
val MAX_RETAINED_JOBS = ConfigBuilder("spark.ui.retainedJobs")
+ .version("1.2.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_STAGES = ConfigBuilder("spark.ui.retainedStages")
+ .version("0.9.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_TASKS_PER_STAGE = ConfigBuilder("spark.ui.retainedTasks")
+ .version("2.0.1")
.intConf
.createWithDefault(100000)
val MAX_RETAINED_DEAD_EXECUTORS = ConfigBuilder("spark.ui.retainedDeadExecutors")
+ .version("2.0.0")
.intConf
.createWithDefault(100)
val MAX_RETAINED_ROOT_NODES = ConfigBuilder("spark.ui.dagGraph.retainedRootRDDs")
+ .version("2.1.0")
.intConf
.createWithDefault(Int.MaxValue)
val METRICS_APP_STATUS_SOURCE_ENABLED =
ConfigBuilder("spark.metrics.appStatusSource.enabled")
.doc("Whether Dropwizard/Codahale metrics " +
"will be reported for the status of the running spark app.")
+ .version("3.0.0")
Review comment:
SPARK-30060, commit ID: 60f20e5ea2000ab8f4a593b5e4217fd5637c5e22#diff-9f796ae06b0272c1f0a012652a5b68d0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170542
Build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329435
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("1s")
val MAX_RETAINED_JOBS = ConfigBuilder("spark.ui.retainedJobs")
+ .version("1.2.0")
Review comment:
SPARK-2321, commit ID: 9530316887612dca060a128fca34dd5a6ab2a9a9#diff-1f32bcb61f51133bd0959a4177a066a5
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329429
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
Review comment:
SPARK-27394, commit ID: a8a2ba11ac10051423e58920062b50f328b06421#diff-9ab674b7af7b2097f7d28cb6f5fd1e8c
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329384
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
Review comment:
SPARK-20653, commit ID: 772e4648d95bda3353723337723543c741ea8476#diff-9ab674b7af7b2097f7d28cb6f5fd1e8c
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329480
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("1s")
val MAX_RETAINED_JOBS = ConfigBuilder("spark.ui.retainedJobs")
+ .version("1.2.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_STAGES = ConfigBuilder("spark.ui.retainedStages")
+ .version("0.9.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_TASKS_PER_STAGE = ConfigBuilder("spark.ui.retainedTasks")
+ .version("2.0.1")
Review comment:
SPARK-15083, commit ID: 55db26245d69bb02b7d7d5f25029b1a1cd571644#diff-6bdad48cfc34314e89599655442ff210
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
HyukjinKwon closed pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329417
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
Review comment:
SPARK-20644, commit ID: c7f38e5adb88d43ef60662c5d6ff4e7a95bff580#diff-9ab674b7af7b2097f7d28cb6f5fd1e8c
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
HyukjinKwon removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-610343878
Also merged to branch-3.0.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-597969241
Seems this is the last ticket identified at this moment. I am merging it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170971
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24263/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177941
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119532/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596168066
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596160167
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24257/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180681
**[Test build #119533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119533/testReport)** for PR 27848 at commit [`c6a36c9`](https://github.com/apache/spark/commit/c6a36c93a36b98ae2488a0207eea6425f7aec86e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596193864
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170544
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24262/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596167957
**[Test build #119527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119527/testReport)** for PR 27848 at commit [`4f8be84`](https://github.com/apache/spark/commit/4f8be8491a3cafc5e46e8db814297661629684ba).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170970
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596160164
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180809
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177840
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119531/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329509
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("1s")
val MAX_RETAINED_JOBS = ConfigBuilder("spark.ui.retainedJobs")
+ .version("1.2.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_STAGES = ConfigBuilder("spark.ui.retainedStages")
+ .version("0.9.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_TASKS_PER_STAGE = ConfigBuilder("spark.ui.retainedTasks")
+ .version("2.0.1")
.intConf
.createWithDefault(100000)
val MAX_RETAINED_DEAD_EXECUTORS = ConfigBuilder("spark.ui.retainedDeadExecutors")
+ .version("2.0.0")
Review comment:
SPARK-7729, commit ID: 9f4263392e492b5bc0acecec2712438ff9a257b7#diff-a0ba36f9b1f9829bf3c4689b05ab6cf2
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177839
Build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596193867
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119533/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170471
**[Test build #119531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119531/testReport)** for PR 27848 at commit [`993e6d2`](https://github.com/apache/spark/commit/993e6d246c18d0be08a72b66f7b88146bb2fdf3d).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-610343984
Merged to master and branch-3.0.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170896
**[Test build #119532 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119532/testReport)** for PR 27848 at commit [`c6a36c9`](https://github.com/apache/spark/commit/c6a36c93a36b98ae2488a0207eea6425f7aec86e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180681
**[Test build #119533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119533/testReport)** for PR 27848 at commit [`c6a36c9`](https://github.com/apache/spark/commit/c6a36c93a36b98ae2488a0207eea6425f7aec86e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170544
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24262/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596160099
**[Test build #119527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119527/testReport)** for PR 27848 at commit [`4f8be84`](https://github.com/apache/spark/commit/4f8be8491a3cafc5e46e8db814297661629684ba).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180811
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24264/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177840
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119531/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177939
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329517
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("1s")
val MAX_RETAINED_JOBS = ConfigBuilder("spark.ui.retainedJobs")
+ .version("1.2.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_STAGES = ConfigBuilder("spark.ui.retainedStages")
+ .version("0.9.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_TASKS_PER_STAGE = ConfigBuilder("spark.ui.retainedTasks")
+ .version("2.0.1")
.intConf
.createWithDefault(100000)
val MAX_RETAINED_DEAD_EXECUTORS = ConfigBuilder("spark.ui.retainedDeadExecutors")
+ .version("2.0.0")
.intConf
.createWithDefault(100)
val MAX_RETAINED_ROOT_NODES = ConfigBuilder("spark.ui.dagGraph.retainedRootRDDs")
+ .version("2.1.0")
Review comment:
SPARK-17171, commit ID: cc87280fcd065b01667ca7a59a1a32c7ab757355#diff-3f492c527ea26679d4307041b28455b8
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596160167
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24257/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180809
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170542
Build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170971
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24263/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177774
**[Test build #119531 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119531/testReport)** for PR 27848 at commit [`993e6d2`](https://github.com/apache/spark/commit/993e6d246c18d0be08a72b66f7b88146bb2fdf3d).
* This patch **fails Spark unit tests**.
* This patch **does not merge cleanly**.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596160164
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177839
Build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596168069
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119527/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596168066
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177879
**[Test build #119532 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119532/testReport)** for PR 27848 at commit [`c6a36c9`](https://github.com/apache/spark/commit/c6a36c93a36b98ae2488a0207eea6425f7aec86e).
* This patch **fails due to an unknown error code, -9**.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
* `final class FValueSelector @Since(\"3.1.0\") (override val uid: String)`
* `trait SelectionTestResult `
* `case class CreateArray(children: Seq[Expression], useStringTypeWhenEmpty: Boolean)`
* `case class CreateMap(children: Seq[Expression], useStringTypeWhenEmpty: Boolean)`
* `public final class SparkFilterApi `
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180305
retest this please
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177941
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119532/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596168069
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119527/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596193867
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119533/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596180811
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24264/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#discussion_r389329466
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Status.scala
##########
@@ -22,43 +22,52 @@ import java.util.concurrent.TimeUnit
private[spark] object Status {
val ASYNC_TRACKING_ENABLED = ConfigBuilder("spark.appStateStore.asyncTracking.enable")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val LIVE_ENTITY_UPDATE_PERIOD = ConfigBuilder("spark.ui.liveUpdate.period")
+ .version("2.3.0")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("100ms")
val LIVE_ENTITY_UPDATE_MIN_FLUSH_PERIOD = ConfigBuilder("spark.ui.liveUpdate.minFlushPeriod")
.doc("Minimum time elapsed before stale UI data is flushed. This avoids UI staleness when " +
"incoming task events are not fired frequently.")
+ .version("2.4.2")
.timeConf(TimeUnit.NANOSECONDS)
.createWithDefaultString("1s")
val MAX_RETAINED_JOBS = ConfigBuilder("spark.ui.retainedJobs")
+ .version("1.2.0")
.intConf
.createWithDefault(1000)
val MAX_RETAINED_STAGES = ConfigBuilder("spark.ui.retainedStages")
+ .version("0.9.0")
Review comment:
No JIRA ID, commit ID: 112c0a1776bbc866a1026a9579c6f72f293414c4#diff-1f32bcb61f51133bd0959a4177a066a5
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-610343878
Also merged to branch-3.0.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596177939
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170896
**[Test build #119532 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119532/testReport)** for PR 27848 at commit [`c6a36c9`](https://github.com/apache/spark/commit/c6a36c93a36b98ae2488a0207eea6425f7aec86e).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
beliefer commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596163657
> Let's merge this one with another PR later just to fix them in batch a bit more.
OK
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170471
**[Test build #119531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119531/testReport)** for PR 27848 at commit [`993e6d2`](https://github.com/apache/spark/commit/993e6d246c18d0be08a72b66f7b88146bb2fdf3d).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596193864
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596193643
**[Test build #119533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119533/testReport)** for PR 27848 at commit [`c6a36c9`](https://github.com/apache/spark/commit/c6a36c93a36b98ae2488a0207eea6425f7aec86e).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
* `final class FValueSelector @Since(\"3.1.0\") (override val uid: String)`
* `trait SelectionTestResult `
* `case class CreateArray(children: Seq[Expression], useStringTypeWhenEmpty: Boolean)`
* `case class CreateMap(children: Seq[Expression], useStringTypeWhenEmpty: Boolean)`
* `public final class SparkFilterApi `
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596170970
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC]
Add version information to the configuration of Status
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596160099
**[Test build #119527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119527/testReport)** for PR 27848 at commit [`4f8be84`](https://github.com/apache/spark/commit/4f8be8491a3cafc5e46e8db814297661629684ba).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27848:
[SPARK-30911][CORE][DOC] Add version information to the configuration of
Status
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #27848: [SPARK-30911][CORE][DOC] Add version information to the configuration of Status
URL: https://github.com/apache/spark/pull/27848#issuecomment-596162499
Let's merge this one with another PR later just to fix them in batch a bit more.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org