You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2014/01/15 22:54:54 UTC

[2/2] git commit: Merge pull request #443 from tdas/filestream-fix

Merge pull request #443 from tdas/filestream-fix

Made some classes private[stremaing] and deprecated a method in JavaStreamingContext.

Classes `RawTextHelper`, `RawTextSender` and `RateLimitedOutputStream` are not useful in the streaming API. There are not used by the core functionality and was there as a support classes for an obscure example. One of the classes is RawTextSender has a main function which can be executed using bin/spark-class even if it is made private[streaming]. In future, I will probably completely remove these classes. For the time being, I am just converting them to private[streaming].

Accessing underlying JavaSparkContext in JavaStreamingContext was through `JavaStreamingContext.sc` . This is deprecated and preferred method is `JavaStreamingContext.sparkContext` to keep it consistent with the `StreamingContext.sparkContext`.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/2a05403a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/2a05403a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/2a05403a

Branch: refs/heads/master
Commit: 2a05403a7ced4ecf6084c96f582ee3a24f3cc874
Parents: 5fecd25 9e63753
Author: Patrick Wendell <pw...@gmail.com>
Authored: Wed Jan 15 13:54:45 2014 -0800
Committer: Patrick Wendell <pw...@gmail.com>
Committed: Wed Jan 15 13:54:45 2014 -0800

----------------------------------------------------------------------
 .../apache/spark/streaming/api/java/JavaStreamingContext.scala | 6 +++++-
 .../apache/spark/streaming/util/RateLimitedOutputStream.scala  | 1 +
 .../scala/org/apache/spark/streaming/util/RawTextHelper.scala  | 1 +
 .../scala/org/apache/spark/streaming/util/RawTextSender.scala  | 1 +
 .../src/test/java/org/apache/spark/streaming/JavaAPISuite.java | 6 +++---
 5 files changed, 11 insertions(+), 4 deletions(-)
----------------------------------------------------------------------