You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Steve Terrell <st...@oculus360.us> on 2016/01/06 20:33:00 UTC

Re: How to apply a simple Eval function in a dynamic load

You could write a streaming function that takes a variable number of inputs.

On Wed, Jan 6, 2016 at 1:11 PM, Sunilmanohar Kancharlapalli -X (sunkanch -
ZENSAR TECHNOLOGIES INC at Cisco) <su...@cisco.com> wrote:

> Hi All,
>
>
>
> I am trying to automate the loading process using Pig from a CSV file
> using piggybank’s CSVExcelStorage.
>
>
>
> When I am about to store, I want a UDF that needs to be applied to each
> and every column of that excel.
>
>
>
> Right now, I am using
>
>
>
> B = load ‘path/to/input/file’ using
> org.apache.pig.piggybank.storage.CSVExcelStorage( , , , , );
>
> C = foreach B generate function($0), function($1), function($2) ,
> function($3), function($4), function($5);
>
>
>
> But for automation, I am sending the path to input file as an argument and
> the number of columns might change every time.
>
>
>
> Please let me know if there is something which is helpful in this
> situation.
>
>
>
>
>
> Thanks
>
> Sunil
>
>
>
> [image: http://www.cisco.com/web/europe/images/email/signature/logo05.jpg]
>
> *Sunilmanohar Kancharlapalli*
> Engineer - IT
> sunkanch@cisco.com
> Phone:
>
> *Cisco Systems Limited*
>
>
>
>
> US
> Cisco.com <http://www.cisco.com>
>
>
>
> [image: Think before you print.]Think before you print.
>
> This email may contain confidential and privileged material for the sole
> use of the intended recipient. Any review, use, distribution or disclosure
> by others is strictly prohibited. If you are not the intended recipient (or
> authorized to receive for the recipient), please contact the sender by
> reply email and delete all copies of this message.
>
> For corporate legal information go to:
> http://www.cisco.com/web/about/doing_business/legal/cri/index.html
>
>
>
>
>