You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by pwendell <gi...@git.apache.org> on 2014/10/10 08:36:51 UTC
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
GitHub user pwendell opened a pull request:
https://github.com/apache/spark/pull/2752
[SPARK-2805] Upgrade Akka to 2.3.4
This is a second rev of the Akka upgrade (earlier merged, but reverted). I made a slight modification which is that I also upgrade Hive to deal with a compatibility issue related to the protocol buffers library.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/pwendell/spark akka-upgrade
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2752.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2752
----
commit 2a551d36bd36a9b79715b1581d7d52a9bb142e9a
Author: Anand Avati <av...@redhat.com>
Date: 2014-07-27T02:20:34Z
SPARK-1812: core - upgrade to akka 2.3.4
Signed-off-by: Anand Avati <av...@redhat.com>
commit 57a23158973872f17d577730b85cab808fc99142
Author: Anand Avati <av...@redhat.com>
Date: 2014-07-31T02:22:48Z
SPARK-1812: streaming - remove tests which depend on akka.actor.IO
Not available in 2.3.x
Signed-off-by: Anand Avati <av...@redhat.com>
commit 4c7ca3fd78091b460dc01da9e42f9142637da479
Author: Patrick Wendell <pw...@gmail.com>
Date: 2014-10-10T06:34:45Z
Upgrading to new hive->protobuf version
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by pwendell <gi...@git.apache.org>.
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/2752#issuecomment-58617755
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by pwendell <gi...@git.apache.org>.
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/2752#issuecomment-58622871
Okay let's see if this does better with the nightly maven builds.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by witgo <gi...@git.apache.org>.
Github user witgo commented on the pull request:
https://github.com/apache/spark/pull/2752#issuecomment-58655305
This will cause some bug.
It seems to be related to `akka.remote.retry-gate-closed-for` configuration
the log:
```
14/10/10 20:56:03 WARN ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkYarnAM@10dian118.domain.test:20412] has failed, address is now gated for [5000] ms. Reason is: [Disassociated].
14/10/10 20:56:03 INFO TaskSetManager: Starting task 60.0 in stage 5427.0 (TID 35496, 10dian71.domain.test, PROCESS_LOCAL, 8062 bytes)
14/10/10 20:56:03 INFO TaskSetManager: Finished task 39.0 in stage 5427.0 (TID 35480) in 539 ms on 10dian71.domain.test (63/72)
14/10/10 20:56:03 INFO TaskSetManager: Finished task 50.0 in stage 5427.0 (TID 35488) in 279 ms on 10dian72.domain.test (64/72)
14/10/10 20:56:03 ERROR YarnClientSchedulerBackend: Yarn application has already exited with state FINISHED!
14/10/10 20:56:03 INFO SparkUI: Stopped Spark web UI at http://10dian71.domain.test:4040
14/10/10 20:56:03 INFO DAGScheduler: Stopping DAGScheduler
14/10/10 20:56:03 INFO YarnClientSchedulerBackend: Shutting down all executors
14/10/10 20:56:03 INFO YarnClientSchedulerBackend: Asking each executor to shut down
14/10/10 20:56:03 INFO DAGScheduler: Job 218 failed: count at TopicModeling.scala:475, took 2.400066 s
14/10/10 20:56:03 INFO YarnClientSchedulerBackend: Stopped
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2752#issuecomment-58622520
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21578/Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/2752
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2752#issuecomment-58617902
[QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21578/consoleFull) for PR 2752 at commit [`4c7ca3f`](https://github.com/apache/spark/commit/4c7ca3fd78091b460dc01da9e42f9142637da479).
* This patch merges cleanly.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-2805] Upgrade Akka to 2.3.4
Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2752#issuecomment-58622515
[QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21578/consoleFull) for PR 2752 at commit [`4c7ca3f`](https://github.com/apache/spark/commit/4c7ca3fd78091b460dc01da9e42f9142637da479).
* This patch **passes all tests**.
* This patch merges cleanly.
* This patch adds no public classes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org