Pig Illustrate more verbose, remove Ellipsis

["Dan DeCapria, CivicScience" <da...@civicscience.com>]

Is there an easy way to non-truncate ILLUSTRATE and make each statement
more verbose for large nested complex Objects (aka, force removal of the
ellipsis from ILLUSTRATE and show all data)?

Many Thanks.

-Dan

Re: Pig Illustrate more verbose, remove Ellipsis

["Dan DeCapria, CivicScience" <da...@civicscience.com>]

Hi Johnny,

Yes, with ILLUSTRATE I am expecting a small sample of the data to be
returned for each LHS statement in my Pig script. ILLUSTRATE renders out
the data in fields, regardless of the quantity of fields, but concatenates
them into ellipsis for larger, more complex nested data structures.  I can
trace back up the output and manually substitute in what the data should
look like, but I was hoping for a easier flag or bootstrap for ILLUSTRATE
to print out the full complex data Object to the terminal.

USE CASE:
Illustrate of some sample data; ILLUSTRATE print output of lines A, and B,
and desired response B (verbose):

A:                aaaa, bbbb, cccc, dddd, eeee, ffff, gggg, 1.0, 2.0, 3.0
B:                {(aaaa, *...,* {(bbbb,* ...,* 3.0)})}
B (verbose):  {(aaaa, cccc, dddd, {(bbbb, eeee, ffff, gggg, 1.0, 2.0,
3.0)})}


Thanks.

-Dan


On Tue, Apr 9, 2013 at 1:42 PM, Johnny Zhang <xi...@cloudera.com> wrote:

> Hi, Dan:
> I guess this doesn't help you :) I don't think you can do that since
> ILLUSTRATE is based on sample data of your whole data set. To make the
> print out make sense, ILLUSTRATE also fake some data (not from the sample
> data) sometimes.
>
> Johnny
>
>
>
> On Tue, Apr 9, 2013 at 8:14 AM, Dan DeCapria, CivicScience <
> dan.decapria@civicscience.com> wrote:
>
> > Is there an easy way to non-truncate ILLUSTRATE and make each statement
> > more verbose for large nested complex Objects (aka, force removal of the
> > ellipsis from ILLUSTRATE and show all data)?
> >
> > Many Thanks.
> >
> > -Dan
> >
>



-- 
Dan DeCapria
CivicScience, Inc.
Senior Informatics / DM / ML / BI Specialist

Re: Pig Illustrate more verbose, remove Ellipsis

[Johnny Zhang <xi...@cloudera.com>]

Hi, Dan:
I guess this doesn't help you :) I don't think you can do that since
ILLUSTRATE is based on sample data of your whole data set. To make the
print out make sense, ILLUSTRATE also fake some data (not from the sample
data) sometimes.

Johnny



On Tue, Apr 9, 2013 at 8:14 AM, Dan DeCapria, CivicScience <
dan.decapria@civicscience.com> wrote:

> Is there an easy way to non-truncate ILLUSTRATE and make each statement
> more verbose for large nested complex Objects (aka, force removal of the
> ellipsis from ILLUSTRATE and show all data)?
>
> Many Thanks.
>
> -Dan
>