You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Farouk <fa...@gmail.com> on 2019/05/07 15:33:52 UTC
Migration from flink 1.7.2 to 1.8.0
Hi
We are migrating our app to Flink 1.8.0.
We built a docker image like this as Hadoop is not anymore bundled :
FROM myrepo:50000/flink:1.8.0-scala_2.11-alpine
ADD --chown=flink:flink
https://my-artifactory-repo/artifactory/my-repo/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar
/opt/flink/lib
When running Flink, we are facing the stack trace below :
java.lang.NullPointerException
at
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:284)
at
org.apache.flink.streaming.runtime.tasks.OperatorChain.createChainedOperator(OperatorChain.java:360)
at
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:296)
at
org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:133)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:267)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)
Any idea on what's happening ?
I think it's a problem with classloading.
With Flink 1.7.2, every thing works fine
Thanks
Farouk
Re: Migration from flink 1.7.2 to 1.8.0
Posted by Farouk <fa...@gmail.com>.
Hi Till
Thanks. I'll check it out.
Farouk
<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Garanti
sans virus. www.avg.com
<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
Le mer. 8 mai 2019 à 16:59, Till Rohrmann <tr...@apache.org> a écrit :
> Hi Farouk,
>
> from the stack trace alone I cannot say much. Would it be possible to
> share a minimal example which reproduces the problem?
>
> My suspicion is that OperatorChain.java:294 produces a null value.
> Differently, said that somehow there is no StreamConfig registered for the
> given outputId. What you could check is whether you have compiled the Flink
> job with Flink 1.8.0 and not 1.7.2? Maybe something changed wrt the output
> enumeration.
>
> Cheers,
> Till
>
> On Tue, May 7, 2019 at 5:34 PM Farouk <fa...@gmail.com> wrote:
>
>> Hi
>>
>> We are migrating our app to Flink 1.8.0.
>>
>> We built a docker image like this as Hadoop is not anymore bundled :
>>
>> FROM myrepo:50000/flink:1.8.0-scala_2.11-alpine
>>
>> ADD --chown=flink:flink
>> https://my-artifactory-repo/artifactory/my-repo/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar
>> /opt/flink/lib
>>
>> When running Flink, we are facing the stack trace below :
>>
>> java.lang.NullPointerException
>> at
>> org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:284)
>> at
>> org.apache.flink.streaming.runtime.tasks.OperatorChain.createChainedOperator(OperatorChain.java:360)
>> at
>> org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:296)
>> at
>> org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:133)
>> at
>> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:267)
>> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
>> at java.lang.Thread.run(Thread.java:748)
>>
>> Any idea on what's happening ?
>>
>> I think it's a problem with classloading.
>>
>> With Flink 1.7.2, every thing works fine
>>
>> Thanks
>> Farouk
>>
>
Re: Migration from flink 1.7.2 to 1.8.0
Posted by Till Rohrmann <tr...@apache.org>.
Hi Farouk,
from the stack trace alone I cannot say much. Would it be possible to share
a minimal example which reproduces the problem?
My suspicion is that OperatorChain.java:294 produces a null value.
Differently, said that somehow there is no StreamConfig registered for the
given outputId. What you could check is whether you have compiled the Flink
job with Flink 1.8.0 and not 1.7.2? Maybe something changed wrt the output
enumeration.
Cheers,
Till
On Tue, May 7, 2019 at 5:34 PM Farouk <fa...@gmail.com> wrote:
> Hi
>
> We are migrating our app to Flink 1.8.0.
>
> We built a docker image like this as Hadoop is not anymore bundled :
>
> FROM myrepo:50000/flink:1.8.0-scala_2.11-alpine
>
> ADD --chown=flink:flink
> https://my-artifactory-repo/artifactory/my-repo/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar
> /opt/flink/lib
>
> When running Flink, we are facing the stack trace below :
>
> java.lang.NullPointerException
> at
> org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:284)
> at
> org.apache.flink.streaming.runtime.tasks.OperatorChain.createChainedOperator(OperatorChain.java:360)
> at
> org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:296)
> at
> org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:133)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:267)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
> at java.lang.Thread.run(Thread.java:748)
>
> Any idea on what's happening ?
>
> I think it's a problem with classloading.
>
> With Flink 1.7.2, every thing works fine
>
> Thanks
> Farouk
>