You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Thomas Kappler <tk...@googlemail.com> on 2011/05/17 11:13:14 UTC

Visualizing the data flow of a Pig script

Hi all,

are there any tools that visualize the data flow in a Pig script, such
as the joins, unions etc.? Maybe somewhat like this:

A   B
  \ /
  C

I imagine that would be very helpful during development of more
complex scripts. It might be done with Graphviz or similar tools. I
couldn't find anything on ther web.

Cheers,
Thomas

Re: Visualizing the data flow of a Pig script

Posted by Thomas Kappler <tk...@googlemail.com>.
Thanks Harsh, it sounds pretty good. The latest comments on PIG-366
suggest it doesn't work with Pig 0.8+. I couldn't find a repository
for the project, the one on google code is outdated.

Do you know whether one can get it to work with Pig 0.8 or 0.9-branch?

Thanks,
Thomas

On Tue, May 17, 2011 at 13:20, Harsh J <ha...@cloudera.com> wrote:
> Hey Thomas,
>
> Perhaps you're looking for PigPen, the graphical eclipse plugin for Pig?
>
> Ticket: https://issues.apache.org/jira/browse/PIG-366
> Wiki: http://wiki.apache.org/pig/PigPen
>
> On Tue, May 17, 2011 at 2:43 PM, Thomas Kappler <tk...@googlemail.com> wrote:
>> Hi all,
>>
>> are there any tools that visualize the data flow in a Pig script, such
>> as the joins, unions etc.? Maybe somewhat like this:
>>
>> A   B
>>  \ /
>>  C
>>
>> I imagine that would be very helpful during development of more
>> complex scripts. It might be done with Graphviz or similar tools. I
>> couldn't find anything on ther web.
>>
>> Cheers,
>> Thomas
>>
>
>
>
> --
> Harsh J
>

Re: Visualizing the data flow of a Pig script

Posted by Harsh J <ha...@cloudera.com>.
Hey Thomas,

Perhaps you're looking for PigPen, the graphical eclipse plugin for Pig?

Ticket: https://issues.apache.org/jira/browse/PIG-366
Wiki: http://wiki.apache.org/pig/PigPen

On Tue, May 17, 2011 at 2:43 PM, Thomas Kappler <tk...@googlemail.com> wrote:
> Hi all,
>
> are there any tools that visualize the data flow in a Pig script, such
> as the joins, unions etc.? Maybe somewhat like this:
>
> A   B
>  \ /
>  C
>
> I imagine that would be very helpful during development of more
> complex scripts. It might be done with Graphviz or similar tools. I
> couldn't find anything on ther web.
>
> Cheers,
> Thomas
>



-- 
Harsh J