You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by td...@apache.org on 2015/10/26 05:57:39 UTC

spark git commit: [SPARK-11127][STREAMING] upgrade AWS SDK and Kinesis Client Library (KCL)

Repository: spark
Updated Branches:
  refs/heads/master 85e654c5e -> 87f82a5fb


[SPARK-11127][STREAMING] upgrade AWS SDK and Kinesis Client Library (KCL)

AWS SDK 1.9.40 is the latest 1.9.x release. KCL 1.5.1 is the latest release that using AWS SDK 1.9.x. The main goal is to have Kinesis consumer be able to read messages generated from Kinesis Producer Library (KPL). The API should be compatible with old versions.

tdas brkyvz

Author: Xiangrui Meng <me...@databricks.com>

Closes #9153 from mengxr/SPARK-11127.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/87f82a5f
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/87f82a5f
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/87f82a5f

Branch: refs/heads/master
Commit: 87f82a5fb9c4350a97c761411069245f07aad46f
Parents: 85e654c
Author: Xiangrui Meng <me...@databricks.com>
Authored: Sun Oct 25 21:57:34 2015 -0700
Committer: Tathagata Das <ta...@gmail.com>
Committed: Sun Oct 25 21:57:34 2015 -0700

----------------------------------------------------------------------
 pom.xml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/87f82a5f/pom.xml
----------------------------------------------------------------------
diff --git a/pom.xml b/pom.xml
index 445e65c..3dfc434 100644
--- a/pom.xml
+++ b/pom.xml
@@ -152,8 +152,8 @@
     <avro.version>1.7.7</avro.version>
     <avro.mapred.classifier>hadoop2</avro.mapred.classifier>
     <jets3t.version>0.7.1</jets3t.version>
-    <aws.java.sdk.version>1.9.16</aws.java.sdk.version>
-    <aws.kinesis.client.version>1.3.0</aws.kinesis.client.version>
+    <aws.java.sdk.version>1.9.40</aws.java.sdk.version>
+    <aws.kinesis.client.version>1.4.0</aws.kinesis.client.version>
     <!--  org.apache.httpcomponents/httpclient-->
     <commons.httpclient.version>4.3.2</commons.httpclient.version>
     <!--  commons-httpclient/commons-httpclient-->


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org