You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by tdas <gi...@git.apache.org> on 2015/04/29 09:54:30 UTC

[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

GitHub user tdas opened a pull request:

    https://github.com/apache/spark/pull/5773

    [SPARK-6752][Streaming][Reopened] Allow StreamingContext to be recreated from checkpoint and existing SparkContext

    Original PR #5428 got reverted due to issues between MutableBoolean and Hadoop 1.0.4 (see JIRA). This replaces MutableBoolean with AtomicBoolean. 
    
    @srowen @pwendell 

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tdas/spark SPARK-6752

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/5773.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #5773
    
----
commit 204814ea2be868257b32f686e1455254f5d60582
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-08T22:30:48Z

    Added StreamingContext.getOrCreate with existing SparkContext

commit 36a782356e9fc032a0d6a42251ae82e2af25aeaa
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-08T22:32:02Z

    Minor changes.

commit eabd092fd794e50c67c82a926b44b173a8dfc5e6
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-16T01:14:11Z

    Added Function0, Java API and unit tests for StreamingContext.getOrCreate

commit 524f519ae69d7e1e70a637f826e8f0d859690aaf
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-22T08:23:23Z

    Many changes based on PR comments.

commit 94db63c7603c159d2156bd5fe55acf1149a3b89b
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-22T10:34:23Z

    Fix long line.

commit 70ae85bb9779df1bdb73c72a1a31cfcb1ece9704
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-29T07:30:42Z

    Merge remote-tracking branch 'apache-github/master' into SPARK-6752

commit a0c0ead27f9fd3e6cc1a43c4854648513df2d1c4
Author: Tathagata Das <ta...@gmail.com>
Date:   2015-04-29T07:48:53Z

    Fix for hadoop 1.0.4

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97338627
  
    Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97338799
  
      [Test build #31262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31262/consoleFull) for   PR 5773 at commit [`a0c0ead`](https://github.com/apache/spark/commit/a0c0ead27f9fd3e6cc1a43c4854648513df2d1c4).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97369894
  
      [Test build #31262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31262/consoleFull) for   PR 5773 at commit [`a0c0ead`](https://github.com/apache/spark/commit/a0c0ead27f9fd3e6cc1a43c4854648513df2d1c4).
     * This patch **passes all tests**.
     * This patch merges cleanly.
     * This patch adds no public classes.
     * This patch does not change any dependencies.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by pwendell <gi...@git.apache.org>.
Github user pwendell commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97557255
  
    LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97369902
  
    Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97369903
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31262/
    Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97338614
  
     Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/5773


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-6752][Streaming][Reopened] Allow Stream...

Posted by tdas <gi...@git.apache.org>.
Github user tdas commented on the pull request:

    https://github.com/apache/spark/pull/5773#issuecomment-97567922
  
    Thanks! Merging this!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org