You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tinkerpop.apache.org by dk...@apache.org on 2016/04/11 20:10:31 UTC
[04/16] incubator-tinkerpop git commit: added a note about
HADOOP_CONF_DIR and updated CHANGELOG from something yesterday. CTR.
added a note about HADOOP_CONF_DIR and updated CHANGELOG from something yesterday. CTR.
Project: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/commit/913598ce
Tree: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/tree/913598ce
Diff: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/diff/913598ce
Branch: refs/heads/TINKERPOP-1020
Commit: 913598cee240e8e8128d5bb9d0a412e04829a43a
Parents: b195b62
Author: Marko A. Rodriguez <ok...@gmail.com>
Authored: Thu Apr 7 08:14:38 2016 -0600
Committer: Marko A. Rodriguez <ok...@gmail.com>
Committed: Thu Apr 7 08:14:38 2016 -0600
----------------------------------------------------------------------
CHANGELOG.asciidoc | 1 +
.../reference/implementations-hadoop.asciidoc | 31 ++++++++++++++------
2 files changed, 23 insertions(+), 9 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/913598ce/CHANGELOG.asciidoc
----------------------------------------------------------------------
diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc
index f90e71f..58ac67a 100644
--- a/CHANGELOG.asciidoc
+++ b/CHANGELOG.asciidoc
@@ -26,6 +26,7 @@ image::https://raw.githubusercontent.com/apache/incubator-tinkerpop/master/docs/
TinkerPop 3.1.2 (NOT OFFICIALLY RELEASED YET)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+* Fixed two `NullPointerException`-potential situations in `ObjectWritable`.
* Provided Docker script that allows the execution of several build tasks within a Docker container.
* Added a per-request `scriptEvaluationTimeout` option to the Gremlin Server protocol.
* Changed `DriverRemoteAcceptor` to send scripts as multi-line.
http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/913598ce/docs/src/reference/implementations-hadoop.asciidoc
----------------------------------------------------------------------
diff --git a/docs/src/reference/implementations-hadoop.asciidoc b/docs/src/reference/implementations-hadoop.asciidoc
index 4a4d4d8..41b003d 100644
--- a/docs/src/reference/implementations-hadoop.asciidoc
+++ b/docs/src/reference/implementations-hadoop.asciidoc
@@ -42,15 +42,6 @@ familiarize their self with Giraph (link:http://giraph.apache.org/quick_start.ht
Installing Hadoop-Gremlin
~~~~~~~~~~~~~~~~~~~~~~~~~
-The `HADOOP_GREMLIN_LIBS` references locations that contains jars that should be uploaded to a respective
-distributed cache (link:http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html[YARN] or SparkServer).
-Note that the locations in `HADOOP_GREMLIN_LIBS` can be a colon-separated (`:`) and all jars from all locations will
-be loaded into the cluster. Typically, only the jars of the respective GraphComputer are required to be loaded (e.g.
-`GiraphGraphComputer` plugin lib directory).
-
-[source,shell]
-export HADOOP_GREMLIN_LIBS=/usr/local/gremlin-console/ext/giraph-gremlin/lib
-
If using <<gremlin-console,Gremlin Console>>, it is important to install the Hadoop-Gremlin plugin. Note that
Hadoop-Gremlin requires a Gremlin Console restart after installing.
@@ -80,6 +71,28 @@ gremlin> :plugin use tinkerpop.hadoop
gremlin>
----
+It is important that the `CLASSPATH` environmental variable references `HADOOP_CONF_DIR` and that the configuration
+files in `HADOOP_CONF_DIR` contain references to a live Hadoop cluster. It is easy to verify a proper configuration
+from within the Gremlin Console. If `hdfs` references the local file system, then there is a configuration issue.
+
+[source,text]
+----
+gremlin> hdfs
+==>storage[org.apache.hadoop.fs.LocalFileSystem@65bb9029] // BAD
+
+gremlin> hdfs
+==>storage[DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1229457199_1, ugi=user (auth:SIMPLE)]]] // GOOD
+----
+
+The `HADOOP_GREMLIN_LIBS` references locations that contains jars that should be uploaded to a respective
+distributed cache (link:http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html[YARN] or SparkServer).
+Note that the locations in `HADOOP_GREMLIN_LIBS` can be a colon-separated (`:`) and all jars from all locations will
+be loaded into the cluster. Typically, only the jars of the respective GraphComputer are required to be loaded (e.g.
+`GiraphGraphComputer` plugin lib directory).
+
+[source,shell]
+export HADOOP_GREMLIN_LIBS=/usr/local/gremlin-console/ext/giraph-gremlin/lib
+
Properties Files
~~~~~~~~~~~~~~~~