You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Gianmarco De Francisci Morales (JIRA)" <ji...@apache.org> on 2011/07/04 16:29:21 UTC
[jira] [Updated] (PIG-1926) Sample/Limit should take scalar
[ https://issues.apache.org/jira/browse/PIG-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gianmarco De Francisci Morales updated PIG-1926:
------------------------------------------------
Attachment: PIG-1926.12.patch
PIG-1926.12.patch addresses Thejas' comments:
* Rebased my work on current trunk.
* Renamed LimitVariableValidator to ScalarVariableValidator.
The new validator checks for out-of-context references to scalar variables both in Limit and Sample. To make it work for Sample, I modified LOFilter to keep track of whether the operator is the result of a Sample command (otherwise I would disallow projections in Filter).
* Added a test for the exception in TestSample
> Sample/Limit should take scalar
> -------------------------------
>
> Key: PIG-1926
> URL: https://issues.apache.org/jira/browse/PIG-1926
> Project: Pig
> Issue Type: Improvement
> Reporter: Daniel Dai
> Assignee: Gianmarco De Francisci Morales
> Labels: gsoc2011
> Attachments: PIG-1926.10.patch, PIG-1926.11.patch, PIG-1926.12.patch, PIG-1926.7.patch, PIG-1926.8.patch, PIG-1926.9.patch, PIG-1926.patch, PIG-1926.patch, PIG-1926.patch, PIG-1926.patch, PIG-1926.patch, PIG-1926.patch
>
>
> Currently, Limit, Sample only takes a constant. It would be better we can use a scalar in the place of constant. Eg:
> {code}
> a = load 'a.txt';
> b = group a all;
> c = foreach b generate COUNT(a) as sum;
> d = order a by $0;
> e = limit d c.sum/100;
> {code}
> This is a candidate project for Google summer of code 2011. More information about the program can be found at http://wiki.apache.org/pig/GSoc2011
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira