[jira] [Updated] (SPARK-12269) Update aws-java-sdk version

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-12269:
------------------------------
    Priority: Minor  (was: Major)

Makes some sense, but the question is always: are there any incompatible changes? do dependencies change? for example I think the Jackson dependency change is actually in the right direction, to match Spark's, but this is what you'd need to research and establish if you're asking for a dependency update across minor versions.

> Update aws-java-sdk version
> ---------------------------
>
>                 Key: SPARK-12269
>                 URL: https://issues.apache.org/jira/browse/SPARK-12269
>             Project: Spark
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: Brian London
>            Priority: Minor
>
> The current Spark Streaming kinesis connector references a quite old version 1.9.40 of the AWS Java SDK (1.10.40 is current).  Numerous AWS features including Kinesis Firehose are unavailable in 1.9.  Those two versions of  the AWS SDK in turn require conflicting versions of Jackson (2.4.4 and 2.5.3 respectively) such that one cannot include the current AWS SDK in a project that also uses the Spark Streaming Kinesis ASL.
> Bumping the version of Jackson and the AWS library solves this problem and will allow Firehose integrations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org