You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Joe Malt <jm...@yelp.com> on 2018/09/14 17:51:44 UTC
LocalEnvironment and Python streaming
Hi,
Is there any way to execute a job using the LocalEnvironment when using the
Python streaming API? This would make it much easier to debug jobs.
At the moment I'm not aware of any way of running them except firing up a
local cluster and submitting the job with pyflink-stream.sh.
Thanks,
Joe Malt
Engineering Intern, Stream Processing
Yelp
Re: LocalEnvironment and Python streaming
Posted by Chesnay Schepler <ch...@apache.org>.
No, this isn't really possible. You need a java process to kick off the
processing.
The only thing i can come up with is to open the flink-streaming-python
module in the IDE and manually call the PythonStreamBinder class with
the same arguments that you pass in the CLI as a test.
On 17.09.2018 04:35, vino yang wrote:
> Hi Joe,
>
> Maybe Chesnay is better suited to answer this question, Ping him for you.
>
> Thanks, vino.
>
> Joe Malt <jmalt@yelp.com <ma...@yelp.com>> 于2018年9月15日周六
> 上午1:51写道:
>
> Hi,
>
> Is there any way to execute a job using the LocalEnvironment when
> using the Python streaming API? This would make it much easier to
> debug jobs.
>
> At the moment I'm not aware of any way of running them except
> firing up a local cluster and submitting the job with
> pyflink-stream.sh.
>
> Thanks,
>
> Joe Malt
> Engineering Intern, Stream Processing
> Yelp
>
Re: LocalEnvironment and Python streaming
Posted by vino yang <ya...@gmail.com>.
Hi Joe,
Maybe Chesnay is better suited to answer this question, Ping him for you.
Thanks, vino.
Joe Malt <jm...@yelp.com> 于2018年9月15日周六 上午1:51写道:
> Hi,
>
> Is there any way to execute a job using the LocalEnvironment when using
> the Python streaming API? This would make it much easier to debug jobs.
>
> At the moment I'm not aware of any way of running them except firing up a
> local cluster and submitting the job with pyflink-stream.sh.
>
> Thanks,
>
> Joe Malt
> Engineering Intern, Stream Processing
> Yelp
>