You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kudu.apache.org by ad...@apache.org on 2017/02/21 22:30:48 UTC
[1/2] kudu git commit: docs: fix Spark example to provide partitioning
Repository: kudu
Updated Branches:
refs/heads/master 1bf12cf92 -> 91a35784e
docs: fix Spark example to provide partitioning
Change-Id: I23f720d8502bbb01c544aa8f2b0978ba0f147c7d
Reviewed-on: http://gerrit.cloudera.org:8080/6085
Tested-by: Kudu Jenkins
Reviewed-by: Dan Burkert <da...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/a099e85e
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/a099e85e
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/a099e85e
Branch: refs/heads/master
Commit: a099e85e20f0b104d092b03168c2bdf5f892aeb8
Parents: 1bf12cf
Author: Todd Lipcon <to...@apache.org>
Authored: Mon Feb 20 13:37:38 2017 -0800
Committer: Todd Lipcon <to...@apache.org>
Committed: Tue Feb 21 22:21:48 2017 +0000
----------------------------------------------------------------------
docs/developing.adoc | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu/blob/a099e85e/docs/developing.adoc
----------------------------------------------------------------------
diff --git a/docs/developing.adoc b/docs/developing.adoc
index cfa8e6a..7cb8055 100644
--- a/docs/developing.adoc
+++ b/docs/developing.adoc
@@ -108,6 +108,8 @@ then import kudu-spark and create a dataframe:
[source,scala]
----
import org.apache.kudu.spark.kudu._
+import org.apache.kudu.client._
+import collection.JavaConverters._
// Read a table from Kudu
val df = sqlContext.read.options(Map("kudu.master" -> "kudu.master:7051","kudu.table" -> "kudu_table")).kudu
@@ -124,7 +126,11 @@ val kuduContext = new KuduContext("kudu.master:7051")
// Create a new Kudu table from a dataframe schema
// NB: No rows from the dataframe are inserted into the table
-kuduContext.createTable("test_table", df.schema, Seq("key"), new CreateTableOptions().setNumReplicas(1))
+kuduContext.createTable(
+ "test_table", df.schema, Seq("key"),
+ new CreateTableOptions()
+ .setNumReplicas(1)
+ .addHashPartitions(List("key").asJava, 3))
// Insert data
kuduContext.insertRows(df, "test_table")
[2/2] kudu git commit: thirdparty: upgrade to python 2.7.13
Posted by ad...@apache.org.
thirdparty: upgrade to python 2.7.13
On very rare occasion, the Python build fails with an error like this:
Parser/acceler.o: file not recognized: File truncated
collect2: error: ld returned 1 exit status
It's not reproducible, and it seems to only happen when make is run with a
strange -j and the machine placed under load. The failure seems like
this [1] Python issue, a fix for which was backported to 2.7.12. So let's
take the opportunity to upgrade to the latest Python 2.7 release.
I tested this by rebuilding the thirdparty tree on a CentOS 6.6 box.
1. https://bugs.python.org/issue22359
Change-Id: I309bc6a0ef7d919d3610ed322d76953dfb090426
Reviewed-on: http://gerrit.cloudera.org:8080/6093
Tested-by: Adar Dembo <ad...@cloudera.com>
Reviewed-by: Dan Burkert <da...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/91a35784
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/91a35784
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/91a35784
Branch: refs/heads/master
Commit: 91a35784efa1bf3a294ae3da483d89f7ffe1d70b
Parents: a099e85
Author: Adar Dembo <ad...@cloudera.com>
Authored: Tue Feb 21 01:15:01 2017 -0800
Committer: Adar Dembo <ad...@cloudera.com>
Committed: Tue Feb 21 22:30:28 2017 +0000
----------------------------------------------------------------------
thirdparty/vars.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu/blob/91a35784/thirdparty/vars.sh
----------------------------------------------------------------------
diff --git a/thirdparty/vars.sh b/thirdparty/vars.sh
index d653afd..6e833e0 100644
--- a/thirdparty/vars.sh
+++ b/thirdparty/vars.sh
@@ -146,7 +146,7 @@ LLVM_SOURCE=$TP_SOURCE_DIR/$LLVM_NAME
# Python 2.7 is required to build LLVM 3.6+. It is only built and installed if
# the system Python version is not 2.7.
-PYTHON_VERSION=2.7.10
+PYTHON_VERSION=2.7.13
PYTHON_NAME=python-$PYTHON_VERSION
PYTHON_SOURCE=$TP_SOURCE_DIR/$PYTHON_NAME