You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2016/01/20 17:58:40 UTC
[jira] [Commented] (FLINK-3247) Kafka Connector unusable with
quickstarts - shading issue
[ https://issues.apache.org/jira/browse/FLINK-3247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108907#comment-15108907 ]
Robert Metzger commented on FLINK-3247:
---------------------------------------
I can not reproduce the issue.
Also, the {{*}} does not seem to work properly:
{code}
[INFO] --- maven-shade-plugin:2.4.1:shade (default) @ debug-1.0-2.11 ---
[INFO] Including org.apache.flink:flink-scala:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including org.apache.flink:flink-core:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including org.apache.flink:flink-annotations:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including org.apache.flink:flink-shaded-hadoop2:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including xmlenc:xmlenc:jar:0.52 in the shaded jar.
[INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.4 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Including commons-net:commons-net:jar:3.1 in the shaded jar.
[INFO] Including javax.servlet:servlet-api:jar:2.5 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-core:jar:1.9 in the shaded jar.
[INFO] Including commons-el:commons-el:jar:1.0 in the shaded jar.
[INFO] Excluding commons-logging:commons-logging:jar:1.1.3 from the shaded jar.
[INFO] Including net.java.dev.jets3t:jets3t:jar:0.9.0 in the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.2.6 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.2.5 from the shaded jar.
[INFO] Including com.jamesmurty.utils:java-xmlbuilder:jar:0.4 in the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Including commons-configuration:commons-configuration:jar:1.6 in the shaded jar.
[INFO] Including commons-digester:commons-digester:jar:1.8 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils:jar:1.7.0 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils-core:jar:1.8.0 in the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.0.5 from the shaded jar.
[INFO] Including com.jcraft:jsch:jar:0.1.42 in the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Including commons-daemon:commons-daemon:jar:1.0.13 in the shaded jar.
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar.
[INFO] Including javax.xml.stream:stax-api:jar:1.0-2 in the shaded jar.
[INFO] Including javax.activation:activation:jar:1.1 in the shaded jar.
[INFO] Including com.google.inject:guice:jar:3.0 in the shaded jar.
[INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar.
[INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.2 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.24.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:2.1 from the shaded jar.
[INFO] Including org.apache.flink:flink-java:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.2 from the shaded jar.
[INFO] Excluding de.javakaffee:kryo-serializers:jar:0.27 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.5 from the shaded jar.
[INFO] Including org.joda:joda-convert:jar:1.7 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.5 in the shaded jar.
[INFO] Including org.apache.flink:flink-optimizer:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Including org.scalamacros:quasiquotes_2.10:jar:2.0.1 in the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.7 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.7 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Including org.apache.flink:flink-streaming-scala:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including org.apache.flink:flink-streaming-java:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Excluding org.apache.commons:commons-math:jar:2.2 from the shaded jar.
[INFO] Excluding org.apache.sling:org.apache.sling.commons.json:jar:2.0.6 from the shaded jar.
[INFO] Including org.apache.flink:flink-clients:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including org.apache.flink:flink-runtime:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.27.Final from the shaded jar.
[INFO] Including org.javassist:javassist:jar:3.18.2-GA in the shaded jar.
[INFO] Excluding com.typesafe.akka:akka-actor_2.10:jar:2.3.7 from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding com.typesafe.akka:akka-remote_2.10:jar:2.3.7 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Including com.google.protobuf:protobuf-java:jar:2.5.0 in the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding com.typesafe.akka:akka-slf4j_2.10:jar:2.3.7 from the shaded jar.
[INFO] Including org.clapper:grizzled-slf4j_2.10:jar:1.0.2 in the shaded jar.
[INFO] Excluding com.github.scopt:scopt_2.10:jar:3.2.0 from the shaded jar.
[INFO] Including io.dropwizard.metrics:metrics-core:jar:3.1.0 in the shaded jar.
[INFO] Including io.dropwizard.metrics:metrics-jvm:jar:3.1.0 in the shaded jar.
[INFO] Including io.dropwizard.metrics:metrics-json:jar:3.1.0 in the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.4.2 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.4.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.4.2 from the shaded jar.
[INFO] Including org.apache.zookeeper:zookeeper:jar:3.4.6 in the shaded jar.
[INFO] Including jline:jline:jar:0.9.94 in the shaded jar.
[INFO] Excluding junit:junit:jar:3.8.1 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.2 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Including org.apache.flink:flink-connector-kafka-0.8:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including org.apache.flink:flink-connector-kafka-base:jar:1.0-SNAPSHOT in the shaded jar.
[INFO] Including com.101tec:zkclient:jar:0.7 in the shaded jar.
[INFO] Including org.apache.kafka:kafka_2.10:jar:0.8.2.0 in the shaded jar.
[INFO] Including org.apache.kafka:kafka-clients:jar:0.8.2.0 in the shaded jar.
[INFO] Including net.jpountz.lz4:lz4:jar:1.2.0 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-core:jar:2.2.0 in the shaded jar.
[INFO] Including org.apache.flink:flink-shaded-curator-recipes:jar:1.0-SNAPSHOT in the shaded jar.
{code}
> Kafka Connector unusable with quickstarts - shading issue
> ---------------------------------------------------------
>
> Key: FLINK-3247
> URL: https://issues.apache.org/jira/browse/FLINK-3247
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector
> Affects Versions: 1.0.0
> Reporter: Stephan Ewen
> Assignee: Robert Metzger
> Priority: Blocker
> Fix For: 1.0.0
>
>
> The Kafka Connector now requires Curator, which is referenced as {{flink-shaded-curator}}. The quickstarts make sure it is not packaged into the jar file via exclusions.
> The curator classes are however only in relocated form in the flink-dist.jar - relocated manually in the {{flink-runtime}} project. The connector can thus not use find the Curator classes and fails.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)