You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by guoxiaolongzte <gi...@git.apache.org> on 2017/05/16 03:08:28 UTC
[GitHub] spark pull request #17991: [SPARK-20757][DOC][CORE]Spark timeout several sma...
GitHub user guoxiaolongzte opened a pull request:
https://github.com/apache/spark/pull/17991
[SPARK-20757][DOC][CORE]Spark timeout several small optimization
## What changes were proposed in this pull request?
1. ‘spark.storage.blockManagerSlaveTimeoutMs’ has not been explained in the Spark official website document.
2. The way to get the default value of 'spark.network.timeout' about ‘spark.storage.blockManagerSlaveTimeoutMs’ is incorrect.
3. Spark.shuffle.io.connectionTimeout is an obsolete configuration item, it can delete in the Spark official website document.
4. The default value of spark.rpc.lookupTimeout should be ''spark.network.timeout'.
## How was this patch tested?
manual tests
Please review http://spark.apache.org/contributing.html before opening a pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/guoxiaolongzte/spark SPARK-20757
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17991.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17991
----
commit d383efba12c66addb17006dea107bb0421d50bc3
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-03-31T13:57:09Z
[SPARK-20177]Document about compression way has some little detail changes.
commit 3059013e9d2aec76def14eb314b6761bea0e7ca0
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-01T01:38:02Z
[SPARK-20177] event log add a space
commit 555cef88fe09134ac98fd0ad056121c7df2539aa
Author: guoxiaolongzte <gu...@zte.com.cn>
Date: 2017-04-02T00:16:08Z
'/applications/[app-id]/jobs' in rest api,status should be [running|succeeded|failed|unknown]
commit 46bb1ad3ddd9fb55b5607ac4f20213a90186cfe9
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-05T03:16:50Z
Merge branch 'master' of https://github.com/apache/spark into SPARK-20177
commit 0efb0dd9e404229cce638fe3fb0c966276784df7
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-05T03:47:53Z
[SPARK-20218]'/applications/[app-id]/stages' in REST API,add description.
commit 0e37fdeee28e31fc97436dabd001d3c85c5a7794
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-05T05:22:54Z
[SPARK-20218] '/applications/[app-id]/stages/[stage-id]' in REST API,remove redundant description.
commit 52641bb01e55b48bd9e8579fea217439d14c7dc7
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-07T06:24:58Z
Merge branch 'SPARK-20218'
commit d3977c9cab0722d279e3fae7aacbd4eb944c22f6
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-08T07:13:02Z
Merge branch 'master' of https://github.com/apache/spark
commit 137b90e5a85cde7e9b904b3e5ea0bb52518c4716
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-10T05:13:40Z
Merge branch 'master' of https://github.com/apache/spark
commit 0fe5865b8022aeacdb2d194699b990d8467f7a0a
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-10T10:25:22Z
Merge branch 'SPARK-20190' of https://github.com/guoxiaolongzte/spark
commit cf6f42ac84466960f2232c025b8faeb5d7378fe1
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-10T10:26:27Z
Merge branch 'master' of https://github.com/apache/spark
commit 685cd6b6e3799c7be65674b2670159ba725f0b8f
Author: 郭小龙 10207633 <gu...@zte.com.cn>
Date: 2017-04-14T01:12:41Z
Merge branch 'master' of https://github.com/apache/spark
commit c716a9231e9ab117d2b03ba67a1c8903d8d9da93
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-17T06:57:21Z
Merge branch 'master' of https://github.com/apache/spark
commit 679cec36a968fbf995b567ca5f6f8cbd8e32673f
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-19T07:20:08Z
Merge branch 'master' of https://github.com/apache/spark
commit 3c9387af84a8f39cf8c1ce19e15de99dfcaf0ca5
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-19T08:15:26Z
Merge branch 'master' of https://github.com/apache/spark
commit cb71f4462a0889cbb0843875b1e4cf14bcb0d020
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-20T05:52:06Z
Merge branch 'master' of https://github.com/apache/spark
commit ce92a7415a2026f5bf909820110a13750a0949e1
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-21T05:21:48Z
Merge branch 'master' of https://github.com/apache/spark
commit dd64342206041a8c3a282459e5f2b898dc558d89
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-21T08:44:25Z
Merge branch 'master' of https://github.com/apache/spark
commit bffd2bd00c6b0e20313756e133adca4c97707c67
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-28T01:36:29Z
Merge branch 'master' of https://github.com/apache/spark
commit 588d42a382345a071532ace1eab5457911f6aa46
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-04-28T05:02:36Z
Merge branch 'master' of https://github.com/apache/spark
commit 4bbeee1231275d1afa0775dbb61fcc5817f6e57c
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-02T02:30:52Z
Merge branch 'master' of https://github.com/apache/spark
commit 362e5ad12bfe013a7780d81b5067c2ff644efa05
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-03T06:47:54Z
Merge branch 'master' of https://github.com/apache/spark
commit 4ed5e00e784ab3c31e1ba69f06fd64520c9d32e4
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-11T06:48:27Z
增加代码
commit d871e01860de20502ecdda26187b2b47cd07aca0
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-11T06:50:50Z
Merge branch 'master' of https://github.com/apache/spark
commit a1f775963e8c9113c3c6ab404c17c6e4385138bd
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-11T10:52:08Z
Merge branch 'master' of https://github.com/apache/spark
commit dc56cdf12a2f7213dcd2a9901293e8f9f9ca81f9
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-12T02:20:38Z
Merge branch 'master' of https://github.com/apache/spark
commit c999cf75052ba4725b2d0af07cee9eee4fe10109
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-16T02:01:33Z
Merge branch 'master' of https://github.com/apache/spark
commit 685dd8cf59b5e2088d28f28be4d66afb72d11bca
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-16T02:46:32Z
Merge branch 'master' of https://github.com/apache/spark
commit 38234cf2cdb892710dbc019b43bfe3c19d3cc80f
Author: guoxiaolong <gu...@zte.com.cn>
Date: 2017-05-16T02:53:22Z
[SPARK-20757] Spark timeout several small optimization
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request #17991: [SPARK-20757][DOC][CORE]Spark timeout several sma...
Posted by guoxiaolongzte <gi...@git.apache.org>.
Github user guoxiaolongzte closed the pull request at:
https://github.com/apache/spark/pull/17991
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #17991: [SPARK-20757][DOC][CORE]Spark timeout several small opti...
Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17991
- Please squash your commits
- It's not clear to me that `spark.storage.blockManagerSlaveTimeoutMs` is supposed to be documented -- why do you think so?
- I don't see what the problem is with the default value. It's 120s as documented.
- Removing spark.rpc.askTimeout looks incorrect
There are problems with almost all of this, so I'd ask that you close this PR
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org