You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by amir bahmanyari <am...@yahoo.com> on 2016/05/10 01:08:18 UTC
Overlapping classes warnings when creating the fat jar for Flink
Cluster
Hi Colleagues,After compilation, when I do: mvn clean packageI get a list of overlapping classes warnings like these as an example (and many more):
WARNING] flink-clients_2.10-1.0.0.jar, flink-runtime_2.10-1.0.0.jar, flink-java-1.0.0.jar, flink-optimizer_2.10-1.0.0.jar, flink-core-1.0.0.jar, flink-streaming-java_2.10-1.0.0.jar define 1690 overlapping classes:[WARNING] - org.apache.flink.shaded.com.google.common.collect.Synchronized$SynchronizedSortedSetMultimap[WARNING] - org.apache.flink.shaded.com.google.common.util.concurrent.FutureCallback[WARNING] - org.apache.flink.shaded.com.google.common.util.concurrent.Monitor$Guard
flink-runtime_2.10-1.0.0.jar, flink-java-1.0.0.jar define 166 overlapping classes:[WARNING] - org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$LocalVarRule[WARNING] - org.apache.flink.shaded.org.objectweb.asm.tree.InvokeDynamicInsnNode[WARNING] - org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$ExceptionRule[WARNING] - org.apache.flink.shaded.org.objectweb.asm.Attribute
java-sdk-all-0.1.0-incubating-SNAPSHOT.jar, google-cloud-dataflow-java-runner-0.1.0-incubating-SNAPSHOT.jar define 1717 overlapping classes:[WARNING] - org.apache.beam.sdk.repackaged.com.google.common.collect.TreeRangeSet$ComplementRangesByLowerBound$2[WARNING] - org.apache.beam.sdk.repackaged.com.google.common.collect.WellBehavedMap$EntrySet$1$1[WARNING] - org.apache.beam.sdk.repackaged.com.google.common.util.concurrent.CycleDetectingLockFactory$Policies$1[WARNING] - org.apache.beam.sdk.repackaged.com.google.common.collect.Maps$6
Any idea pls?Thanks so much fr your time.
Re: Overlapping classes warnings when creating the fat jar for Flink Cluster
Posted by Maximilian Michels <mx...@apache.org>.
You can try replacing "https://" with "http://".
On Tue, May 10, 2016 at 5:25 PM, amir bahmanyari <am...@yahoo.com> wrote:
> Thanks so much Maximilian..
> I will follow this and enrich it with my own code & see how far it goes.
> I tried the curl in the quick start tab, I get certificate error, it seems:
>
> $ curl https://flink.apache.org/q/quickstart.sh | bash
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
> 0curl: (77) error setting certificate verify locations:
> CAfile: /usr/share/ssl/certs/ca-bundle.crt
> CApath: none
>
> Cheers+thanks again.
>
>
> ________________________________
> From: Maximilian Michels <mx...@apache.org>
> To: user@beam.incubator.apache.org; amir bahmanyari <am...@yahoo.com>
> Sent: Tuesday, May 10, 2016 7:15 AM
> Subject: Re: Overlapping classes warnings when creating the fat jar for
> Flink Cluster
>
> Hi Amir,
>
> Overlapping classes are not necessarily a problem; only if they are
> not identical. Your output looks safe because all overlapping classes
> seem to have the same jar version.
>
> You are probably better off with the Quickstart POM which handles the
> dependencies in a nicer way:
> https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html
>
> Cheers,
> Max
>
> On Tue, May 10, 2016 at 3:08 AM, amir bahmanyari <am...@yahoo.com>
> wrote:
>> Hi Colleagues,
>> After compilation, when I do: mvn clean package
>> I get a list of overlapping classes warnings like these as an example (and
>> many more):
>>
>> WARNING] flink-clients_2.10-1.0.0.jar, flink-runtime_2.10-1.0.0.jar,
>> flink-java-1.0.0.jar, flink-optimizer_2.10-1.0.0.jar,
>> flink-core-1.0.0.jar,
>> flink-streaming-java_2.10-1.0.0.jar define 1690 overlapping classes:
>> [WARNING] -
>>
>> org.apache.flink.shaded.com.google.common.collect.Synchronized$SynchronizedSortedSetMultimap
>> [WARNING] -
>> org.apache.flink.shaded.com.google.common.util.concurrent.FutureCallback
>> [WARNING] -
>> org.apache.flink.shaded.com.google.common.util.concurrent.Monitor$Guard
>>
>>
>> flink-runtime_2.10-1.0.0.jar, flink-java-1.0.0.jar define 166 overlapping
>> classes:
>> [WARNING] -
>>
>> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$LocalVarRule
>> [WARNING] -
>> org.apache.flink.shaded.org.objectweb.asm.tree.InvokeDynamicInsnNode
>> [WARNING] -
>>
>> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$ExceptionRule
>> [WARNING] - org.apache.flink.shaded.org.objectweb.asm.Attribute
>>
>>
>> java-sdk-all-0.1.0-incubating-SNAPSHOT.jar,
>> google-cloud-dataflow-java-runner-0.1.0-incubating-SNAPSHOT.jar define
>> 1717
>> overlapping classes:
>> [WARNING] -
>>
>> org.apache.beam.sdk.repackaged.com.google.common.collect.TreeRangeSet$ComplementRangesByLowerBound$2
>> [WARNING] -
>>
>> org.apache.beam.sdk.repackaged.com.google.common.collect.WellBehavedMap$EntrySet$1$1
>> [WARNING] -
>>
>> org.apache.beam.sdk.repackaged.com.google.common.util.concurrent.CycleDetectingLockFactory$Policies$1
>> [WARNING] -
>> org.apache.beam.sdk.repackaged.com.google.common.collect.Maps$6
>>
>> Any idea pls?
>> Thanks so much fr your time.
>
>
Re: Overlapping classes warnings when creating the fat jar for
Flink Cluster
Posted by amir bahmanyari <am...@yahoo.com>.
Thanks so much Maximilian..I will follow this and enrich it with my own code & see how far it goes.I tried the curl in the quick start tab, I get certificate error, it seems:
$ curl https://flink.apache.org/q/quickstart.sh | bash % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (77) error setting certificate verify locations: CAfile: /usr/share/ssl/certs/ca-bundle.crt CApath: none
Cheers+thanks again.
From: Maximilian Michels <mx...@apache.org>
To: user@beam.incubator.apache.org; amir bahmanyari <am...@yahoo.com>
Sent: Tuesday, May 10, 2016 7:15 AM
Subject: Re: Overlapping classes warnings when creating the fat jar for Flink Cluster
Hi Amir,
Overlapping classes are not necessarily a problem; only if they are
not identical. Your output looks safe because all overlapping classes
seem to have the same jar version.
You are probably better off with the Quickstart POM which handles the
dependencies in a nicer way:
https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html
Cheers,
Max
On Tue, May 10, 2016 at 3:08 AM, amir bahmanyari <am...@yahoo.com> wrote:
> Hi Colleagues,
> After compilation, when I do: mvn clean package
> I get a list of overlapping classes warnings like these as an example (and
> many more):
>
> WARNING] flink-clients_2.10-1.0.0.jar, flink-runtime_2.10-1.0.0.jar,
> flink-java-1.0.0.jar, flink-optimizer_2.10-1.0.0.jar, flink-core-1.0.0.jar,
> flink-streaming-java_2.10-1.0.0.jar define 1690 overlapping classes:
> [WARNING] -
> org.apache.flink.shaded.com.google.common.collect.Synchronized$SynchronizedSortedSetMultimap
> [WARNING] -
> org.apache.flink.shaded.com.google.common.util.concurrent.FutureCallback
> [WARNING] -
> org.apache.flink.shaded.com.google.common.util.concurrent.Monitor$Guard
>
>
> flink-runtime_2.10-1.0.0.jar, flink-java-1.0.0.jar define 166 overlapping
> classes:
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$LocalVarRule
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.tree.InvokeDynamicInsnNode
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$ExceptionRule
> [WARNING] - org.apache.flink.shaded.org.objectweb.asm.Attribute
>
>
> java-sdk-all-0.1.0-incubating-SNAPSHOT.jar,
> google-cloud-dataflow-java-runner-0.1.0-incubating-SNAPSHOT.jar define 1717
> overlapping classes:
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.TreeRangeSet$ComplementRangesByLowerBound$2
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.WellBehavedMap$EntrySet$1$1
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.util.concurrent.CycleDetectingLockFactory$Policies$1
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.Maps$6
>
> Any idea pls?
> Thanks so much fr your time.
Re: Overlapping classes warnings when creating the fat jar for Flink Cluster
Posted by Maximilian Michels <mx...@apache.org>.
Hi Amir,
Overlapping classes are not necessarily a problem; only if they are
not identical. Your output looks safe because all overlapping classes
seem to have the same jar version.
You are probably better off with the Quickstart POM which handles the
dependencies in a nicer way:
https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html
Cheers,
Max
On Tue, May 10, 2016 at 3:08 AM, amir bahmanyari <am...@yahoo.com> wrote:
> Hi Colleagues,
> After compilation, when I do: mvn clean package
> I get a list of overlapping classes warnings like these as an example (and
> many more):
>
> WARNING] flink-clients_2.10-1.0.0.jar, flink-runtime_2.10-1.0.0.jar,
> flink-java-1.0.0.jar, flink-optimizer_2.10-1.0.0.jar, flink-core-1.0.0.jar,
> flink-streaming-java_2.10-1.0.0.jar define 1690 overlapping classes:
> [WARNING] -
> org.apache.flink.shaded.com.google.common.collect.Synchronized$SynchronizedSortedSetMultimap
> [WARNING] -
> org.apache.flink.shaded.com.google.common.util.concurrent.FutureCallback
> [WARNING] -
> org.apache.flink.shaded.com.google.common.util.concurrent.Monitor$Guard
>
>
> flink-runtime_2.10-1.0.0.jar, flink-java-1.0.0.jar define 166 overlapping
> classes:
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$LocalVarRule
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.tree.InvokeDynamicInsnNode
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$ExceptionRule
> [WARNING] - org.apache.flink.shaded.org.objectweb.asm.Attribute
>
>
> java-sdk-all-0.1.0-incubating-SNAPSHOT.jar,
> google-cloud-dataflow-java-runner-0.1.0-incubating-SNAPSHOT.jar define 1717
> overlapping classes:
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.TreeRangeSet$ComplementRangesByLowerBound$2
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.WellBehavedMap$EntrySet$1$1
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.util.concurrent.CycleDetectingLockFactory$Policies$1
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.Maps$6
>
> Any idea pls?
> Thanks so much fr your time.