You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kudu.apache.org by jd...@apache.org on 2016/12/08 16:14:34 UTC
[2/6] kudu git commit: [docs] - Fix python development section
location
[docs] - Fix python development section location
The Python Client section on the development is wedged between
two of the Spark sub-sections, this patch fixes that issue.
Change-Id: Ia437a3c139f81540e9f6883347afd90cdc565a0a
Reviewed-on: http://gerrit.cloudera.org:8080/5414
Reviewed-by: Todd Lipcon <to...@apache.org>
Tested-by: Todd Lipcon <to...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/db4d0a65
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/db4d0a65
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/db4d0a65
Branch: refs/heads/master
Commit: db4d0a653caea6f9be47072555c70ba601d6004b
Parents: faa587c
Author: Jordan Birdsell <jt...@apache.org>
Authored: Wed Dec 7 22:58:05 2016 -0500
Committer: Todd Lipcon <to...@apache.org>
Committed: Thu Dec 8 04:09:55 2016 +0000
----------------------------------------------------------------------
docs/developing.adoc | 31 ++++++++++++++++---------------
1 file changed, 16 insertions(+), 15 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu/blob/db4d0a65/docs/developing.adoc
----------------------------------------------------------------------
diff --git a/docs/developing.adoc b/docs/developing.adoc
index 03c8cdc..4bfea40 100644
--- a/docs/developing.adoc
+++ b/docs/developing.adoc
@@ -155,7 +155,22 @@ kuduContext.tableExists("another_table")
kuduContext.deleteTable("unwanted_table")
----
-=== Kudu Python Client
+=== Spark Integration Known Issues and Limitations
+
+- The Kudu Spark integration is tested and developed against Spark 1.6 and Scala
+ 2.10.
+- Kudu tables with a name containing upper case or non-ascii characters must be
+ assigned an alternate name when registered as a temporary table.
+- Kudu tables with a column name containing upper case or non-ascii characters
+ may not be used with SparkSQL. Non-primary key columns may be renamed in Kudu
+ to work around this issue.
+- `NULL`, `NOT NULL`, `<>`, `OR`, `LIKE`, and `IN` predicates are not pushed to
+ Kudu, and instead will be evaluated by the Spark task.
+- Kudu does not support all types supported by Spark SQL, such as `Date`,
+ `Decimal` and complex types.
+
+
+== Kudu Python Client
The Kudu Python client provides a Python friendly interface to the C++ client API.
The sample below demonstrates the use of part of the Python client.
[source,python]
@@ -216,20 +231,6 @@ scanner.add_predicate(table['ts_val'] == datetime(2017, 1, 1))
result = scanner.open().read_all_tuples()
----
-=== Spark Integration Known Issues and Limitations
-
-- The Kudu Spark integration is tested and developed against Spark 1.6 and Scala
- 2.10.
-- Kudu tables with a name containing upper case or non-ascii characters must be
- assigned an alternate name when registered as a temporary table.
-- Kudu tables with a column name containing upper case or non-ascii characters
- may not be used with SparkSQL. Non-primary key columns may be renamed in Kudu
- to work around this issue.
-- `NULL`, `NOT NULL`, `<>`, `OR`, `LIKE`, and `IN` predicates are not pushed to
- Kudu, and instead will be evaluated by the Spark task.
-- Kudu does not support all types supported by Spark SQL, such as `Date`,
- `Decimal` and complex types.
-
== Integration with MapReduce, YARN, and Other Frameworks
Kudu was designed to integrate with MapReduce, YARN, Spark, and other frameworks in