You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@pig.apache.org by Sandesh Devaraju <sc...@gmail.com> on 2010/10/27 18:20:59 UTC

Reporting progress in a storage UDF

Hi All,

Is there a need/mechanism to report progress in a storage UDF?

Thanks in advance.

- Sandesh

Re: Reporting progress in a storage UDF

Posted by Alan Gates <ga...@yahoo-inc.com>.

Progress is reported by Pig operators, so in general other operators  
in your pipeline should be reporting progress so that the store  
function does not need to.  The store function is not passed a  
reference to the progress reporter, so it would not be able to report  
progress anyway.  The progress reporter is passed to eval funcs  
because some users write eval funcs that do complex processing and may  
take enough time that they need to report progress.

Alan.

On Oct 27, 2010, at 9:20 AM, Sandesh Devaraju wrote:

> Hi All,
>
> Is there a need/mechanism to report progress in a storage UDF?
>
> Thanks in advance.
>
> - Sandesh