You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2008/11/20 18:48:46 UTC
[jira] Created: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
limit does not work if applied to outer most block and it is not a query
------------------------------------------------------------------------
Key: HIVE-75
URL: https://issues.apache.org/jira/browse/HIVE-75
Project: Hadoop Hive
Issue Type: Bug
Reporter: Namit Jain
Assignee: Namit Jain
limit does not work if applied to outer most block and it is not a query
For eg
insert into T1 select ... from T2 limit 10;
will be executed as a map-job only.
which means that the total number of rows in T1 is bounded by 10 * number of mappers.
We need another map-reduce job to fix this or the move task needs to be modified.
For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HIVE-75:
---------------------------------
Resolution: Fixed
Fix Version/s: 0.20.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks Namit!
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.20.0
>
> Attachments: patch1.txt, patch2.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-75:
---------------------------
Status: Open (was: Patch Available)
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt, patch2.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Raghotham Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649523#action_12649523 ]
Raghotham Murthy commented on HIVE-75:
--------------------------------------
+1
looks good
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt, patch2.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-75:
-------------------------------
Fix Version/s: 0.3.0
(was: 0.6.0)
Component/s: Query Processor
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: patch1.txt, patch2.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-75:
---------------------------
Attachment: patch1.txt
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-75:
---------------------------
Status: Open (was: Patch Available)
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-75:
---------------------------
Attachment: patch2.txt
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt, patch2.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-75:
---------------------------
Status: Patch Available (was: Open)
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-75) limit does not work if applied to outer
most block and it is not a query
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-75:
---------------------------
Status: Patch Available (was: Open)
> limit does not work if applied to outer most block and it is not a query
> ------------------------------------------------------------------------
>
> Key: HIVE-75
> URL: https://issues.apache.org/jira/browse/HIVE-75
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: patch1.txt, patch2.txt
>
>
> limit does not work if applied to outer most block and it is not a query
> For eg
> insert into T1 select ... from T2 limit 10;
> will be executed as a map-job only.
> which means that the total number of rows in T1 is bounded by 10 * number of mappers.
> We need another map-reduce job to fix this or the move task needs to be modified.
> For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.