You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by shikhar <sh...@schmizz.net> on 2016/03/02 18:24:44 UTC

Re: Flink packaging makes life hard for SBT fat jar's

Hi Till,

I just tried creating an assembly with RC4:

```
  "org.apache.flink" %% "flink-clients" % flinkVersion % "provided",
  "org.apache.flink" %% "flink-streaming-scala" % flinkVersion % "provided",
  "org.apache.flink" %% "flink-connector-kafka-0.8" % flinkVersion,
```

It actually succeeds in creating the assembly now, which is great. However,
I see that it is pulling in the Scala 2.10 version of the Kafka JAR's.
Perhaps the correct Scala version is not specified in the published POM's
for transitive dependencies?

https://repository.apache.org/content/repositories/orgapacheflink-1066/org/apache/flink/flink-connector-kafka-0.8_2.11/1.0.0/flink-connector-kafka-0.8_2.11-1.0.0.pom
refers to ${scala.binary.version} -- not sure how that is resolved



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-packaging-makes-life-hard-for-SBT-fat-jar-s-tp4897p5249.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Flink packaging makes life hard for SBT fat jar's

Posted by Till Rohrmann <ti...@gmail.com>.

Great to hear Shikhar :-)

Cheers, Till
On Mar 4, 2016 3:51 AM, "shikhar" <sh...@schmizz.net> wrote:

> Thanks Till. I can confirm that things are looking good with RC5.
> sbt-assembly works well with the flink-kafka connector dependency not
> marked
> as "provided".
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-packaging-makes-life-hard-for-SBT-fat-jar-s-tp4897p5292.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Re: Flink packaging makes life hard for SBT fat jar's

Posted by shikhar <sh...@schmizz.net>.

Thanks Till. I can confirm that things are looking good with RC5.
sbt-assembly works well with the flink-kafka connector dependency not marked
as "provided".



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-packaging-makes-life-hard-for-SBT-fat-jar-s-tp4897p5292.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Flink packaging makes life hard for SBT fat jar's

Posted by Till Rohrmann <ti...@gmail.com>.

Hi Shikhar,

that is a problem we just found out today. The problem is that the
scala.binary.version was not properly replaced in the parent pom so that it
resolves to 2.10 [1]. Max already opened a PR to fix this problem. With the
next release candidate, this should be fixed.

[1] https://issues.apache.org/jira/browse/FLINK-3565

Cheers,
Till


On Wed, Mar 2, 2016 at 6:24 PM, shikhar <sh...@schmizz.net> wrote:

> Hi Till,
>
> I just tried creating an assembly with RC4:
>
> ```
>   "org.apache.flink" %% "flink-clients" % flinkVersion % "provided",
>   "org.apache.flink" %% "flink-streaming-scala" % flinkVersion %
> "provided",
>   "org.apache.flink" %% "flink-connector-kafka-0.8" % flinkVersion,
> ```
>
> It actually succeeds in creating the assembly now, which is great. However,
> I see that it is pulling in the Scala 2.10 version of the Kafka JAR's.
> Perhaps the correct Scala version is not specified in the published POM's
> for transitive dependencies?
>
>
> https://repository.apache.org/content/repositories/orgapacheflink-1066/org/apache/flink/flink-connector-kafka-0.8_2.11/1.0.0/flink-connector-kafka-0.8_2.11-1.0.0.pom
> refers to ${scala.binary.version} -- not sure how that is resolved
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-packaging-makes-life-hard-for-SBT-fat-jar-s-tp4897p5249.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>