You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2016/11/04 09:57:58 UTC

[jira] [Created] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

Robert Metzger created FLINK-5013:
-------------------------------------

             Summary: Flink Kinesis connector doesn't work on old EMR versions
                 Key: FLINK-5013
                 URL: https://issues.apache.org/jira/browse/FLINK-5013
             Project: Flink
          Issue Type: Bug
          Components: Kinesis Connector
            Reporter: Robert Metzger


A user reported on the mailing list that our Kinesis connector doesn't work with EMR 4.4.0: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kinesis-Connector-Dependency-Problems-td9790.html

The problem seems to be that Flink is loading older libraries from the "YARN container classpath", which on EMR contains the default Amazon libraries.

We should try to shade kinesis and its amazon dependencies into a different namespace.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)