You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Julien Le Dem <ju...@ledem.net> on 2011/01/10 00:15:26 UTC
PigStats returned by BoundScript.runSingle() does not contain any
information in LOCAL mode
However, it works fine in mini cluster.
I'm not sure what causes it.
The consequence is that I can not check if a dataset is empty in the end
condition for the transitive closure in javascript.
Julien
Re: PigStats returned by BoundScript.runSingle() does not contain
any information in LOCAL mode
Posted by Richard Ding <rd...@yahoo-inc.com>.
The related jira is PIG-1286. We're waiting for a fix from hadoop team.
The methods getOutputLocations() and getOutputNames() don't use counters and they shouldn't return empty list.
On 1/10/11 2:52 PM, "Julien Le Dem" <ju...@ledem.net> wrote:
I was calling result("<alias>").getNumberRecords() from a script.
I've tried several of the methods but they all returned empty lists:
getOutputLocations()
getOutputNames()
If this is a known issue, is there a JIRA open ?
This should work independently of the mode.
Julien
On 1/10/11 2:41 PM, "Richard Ding" <rd...@yahoo-inc.com> wrote:
What method did you call to check if a dataset is empty? It's known that the counters don't work in local mode.
On 1/9/11 3:15 PM, "Julien Le Dem" <ju...@ledem.net> wrote:
However, it works fine in mini cluster.
I'm not sure what causes it.
The consequence is that I can not check if a dataset is empty in the end
condition for the transitive closure in javascript.
Julien
Re: PigStats returned by BoundScript.runSingle() does not contain any
information in LOCAL mode
Posted by Julien Le Dem <ju...@ledem.net>.
I was calling result("<alias>").getNumberRecords() from a script.
I¹ve tried several of the methods but they all returned empty lists:
getOutputLocations()
getOutputNames()
If this is a known issue, is there a JIRA open ?
This should work independently of the mode.
Julien
On 1/10/11 2:41 PM, "Richard Ding" <rd...@yahoo-inc.com> wrote:
> What method did you call to check if a dataset is empty? It¹s known that the
> counters don¹t work in local mode.
>
>
> On 1/9/11 3:15 PM, "Julien Le Dem" <ju...@ledem.net> wrote:
>
>> However, it works fine in mini cluster.
>> I'm not sure what causes it.
>> The consequence is that I can not check if a dataset is empty in the end
>> condition for the transitive closure in javascript.
>> Julien
>>
>>
>>
>
Re: PigStats returned by BoundScript.runSingle() does not contain
any information in LOCAL mode
Posted by Richard Ding <rd...@yahoo-inc.com>.
What method did you call to check if a dataset is empty? It's known that the counters don't work in local mode.
On 1/9/11 3:15 PM, "Julien Le Dem" <ju...@ledem.net> wrote:
However, it works fine in mini cluster.
I'm not sure what causes it.
The consequence is that I can not check if a dataset is empty in the end
condition for the transitive closure in javascript.
Julien