You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Mathias Peters <ma...@gmx.org> on 2018/01/16 18:21:41 UTC

Problem while debugging a python job

Hi all,

I'm trying to debug a python script with a flink job in using Intellij.
I'm using the current snapshot (1.5 cloned today). In former versions, I
could simply run org.apache.flink.python.api.PythonPlanBinder from
within the IDE. Atm, I'm getting NoClassDefFoundError s from classes of
the core module (e.g. FSDataOutputStream). I imported the fresh project
as desribed on your website and I ran mvn clean package several times.

Is this a known issue or am I missing something?

Thanks in advance and cheers

Mathias

Re: Problem while debugging a python job

Posted by Mathias Peters <ma...@gmx.org>.

Thanks. That did it.

best

Mathias


On 17.01.2018 13:11, Chesnay Schepler wrote:
> All dependencies of flink-python are set to /provided/ so that they
> aren't included in the flink-python jar (which would duplicate all
> classes already contained in flink-dist).
>
> You can either temporarily modify the dependencies and remove the
> /provided /scope, or create a simple test class that calls
> PythonPlanBinder.
>
> On 16.01.2018 19:21, Mathias Peters wrote:
>> Hi all,
>>
>> I'm trying to debug a python script with a flink job in using Intellij.
>> I'm using the current snapshot (1.5 cloned today). In former versions, I
>> could simply run org.apache.flink.python.api.PythonPlanBinder from
>> within the IDE. Atm, I'm getting NoClassDefFoundError s from classes of
>> the core module (e.g. FSDataOutputStream). I imported the fresh project
>> as desribed on your website and I ran mvn clean package several times.
>>
>> Is this a known issue or am I missing something?
>>
>> Thanks in advance and cheers
>>
>> Mathias
>>
>>
>

Re: Problem while debugging a python job

Posted by Chesnay Schepler <ch...@apache.org>.

All dependencies of flink-python are set to /provided/ so that they 
aren't included in the flink-python jar (which would duplicate all 
classes already contained in flink-dist).

You can either temporarily modify the dependencies and remove the 
/provided /scope, or create a simple test class that calls PythonPlanBinder.

On 16.01.2018 19:21, Mathias Peters wrote:
> Hi all,
>
> I'm trying to debug a python script with a flink job in using Intellij.
> I'm using the current snapshot (1.5 cloned today). In former versions, I
> could simply run org.apache.flink.python.api.PythonPlanBinder from
> within the IDE. Atm, I'm getting NoClassDefFoundError s from classes of
> the core module (e.g. FSDataOutputStream). I imported the fresh project
> as desribed on your website and I ran mvn clean package several times.
>
> Is this a known issue or am I missing something?
>
> Thanks in advance and cheers
>
> Mathias
>
>