You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by "Sumit Chawla (sumichaw)" <su...@cisco.com> on 2016/07/13 19:42:13 UTC

Ability to partition logs per pipeline

Hi All

Does beam provide any ability to streamline logs being generated from a  pipeline.  How can we keep the logs from two pipelines separate so that its easy to debug the pipeline execution (something dynamic to automatically partition the logs per pipeline) ? Or would it be something attributable to runner’s (Flink?) code?


Thanks
Sumit

Re: Ability to partition logs per pipeline

Posted by Lukasz Cwik <lc...@google.com>.

Logs generated from a pipeline are currently a per runner concept and any
features/limitations are dependent on the choice of the runner. So this
would be something attributable to Flink's code.

On Wed, Jul 13, 2016 at 3:42 PM, Sumit Chawla (sumichaw) <sumichaw@cisco.com
> wrote:

> Hi All
>
> Does beam provide any ability to streamline logs being generated from a
>  pipeline.  How can we keep the logs from two pipelines separate so that
> its easy to debug the pipeline execution (something dynamic to
> automatically partition the logs per pipeline) ? Or would it be something
> attributable to runner’s (Flink?) code?
>
>
> Thanks
> Sumit
>