You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tinkerpop.apache.org by ok...@apache.org on 2015/12/09 14:51:35 UTC
[14/14] incubator-tinkerpop git commit: updated CHANGELOG and upgrade
docs.
updated CHANGELOG and upgrade docs.
Project: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/commit/9b59fac6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/tree/9b59fac6
Diff: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/diff/9b59fac6
Branch: refs/heads/master
Commit: 9b59fac6c9a47dba5734901ece610d1e096f7fa4
Parents: 357bc44
Author: Marko A. Rodriguez <ok...@gmail.com>
Authored: Wed Dec 9 06:51:07 2015 -0700
Committer: Marko A. Rodriguez <ok...@gmail.com>
Committed: Wed Dec 9 06:51:07 2015 -0700
----------------------------------------------------------------------
CHANGELOG.asciidoc | 3 ++-
docs/src/upgrade/release-3.1.x-incubating.asciidoc | 15 +++++++++++++++
2 files changed, 17 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/9b59fac6/CHANGELOG.asciidoc
----------------------------------------------------------------------
diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc
index 2bf0df7..52dae62 100644
--- a/CHANGELOG.asciidoc
+++ b/CHANGELOG.asciidoc
@@ -27,8 +27,9 @@ TinkerPop 3.1.1 (NOT OFFICIALLY RELEASED YET)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
* Fixed a `NullPointerException` bug in `PeerPressureVertexProgram` that occurred when an adjacency traversal was not provided.
-* Fixed a long standing issue around having to use `reduceByKey()` on input data to Spark. It is no longer required.
+* Fixed a long standing "view merge" issue requiring `reduceByKey()` on input data to Spark. It is no longer required.
* Added `Spark` static object to allow "file system" control of persisted RDDs in Spark.
+* Added a Spark "job server" to ensure that persisted RDDs are not garbage collected by Spark.
* Improved logging control during builds with Maven.
* Fixed settings that weren't being passed to the the Gremlin Driver `Cluster` through configuration file.
* `Column` now implements `Function`. The modulator `by(valueDecr)` can be replaced by `by(values,decr)` and thus, projection and order are separated.
http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/9b59fac6/docs/src/upgrade/release-3.1.x-incubating.asciidoc
----------------------------------------------------------------------
diff --git a/docs/src/upgrade/release-3.1.x-incubating.asciidoc b/docs/src/upgrade/release-3.1.x-incubating.asciidoc
index 5cccb94..b89bfe0 100644
--- a/docs/src/upgrade/release-3.1.x-incubating.asciidoc
+++ b/docs/src/upgrade/release-3.1.x-incubating.asciidoc
@@ -74,6 +74,21 @@ calls the old deprecated method. In this way, existing `Authenticator` implemen
See: link:https://issues.apache.org/jira/browse/TINKERPOP3-995[TINKERPOP3-995]
+Spark Persistence Updates
+^^^^^^^^^^^^^^^^^^^^^^^^^
+
+Spark RDD persistence is now much safer with a "job server" system that ensures that persisted RDDs are not garbage
+collected by Spark. With this, the user is provider a `spark` object that enables them to manage persisted RDDs
+much like the `hdfs` object is used for managing files in HDFS.
+
+Finally, `InputRDD` instance no longer need a `reduceByKey()` postfix as view merges happen prior to writing the
+`graphRDD`. Note that a `reduceByKey()` postfix will not cause problems if continued, it is simply inefficient
+and no longer required.
+
+See: link:https://issues.apache.org/jira/browse/TINKERPOP-1023[TINKERPOP-1023],
+link:https://issues.apache.org/jira/browse/TINKERPOP-1027[TINKERPOP-1027]
+
+
Upgrading for Providers
~~~~~~~~~~~~~~~~~~~~~~~