You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2009/03/13 23:38:50 UTC
[jira] Created: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
[hive] lot of mappers due to a user error while specifying the partitioning column
----------------------------------------------------------------------------------
Key: HIVE-347
URL: https://issues.apache.org/jira/browse/HIVE-347
Project: Hadoop Hive
Issue Type: Bug
Components: Query Processor
Reporter: Namit Jain
Assignee: Namit Jain
A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
However, if the user forgets to add quotes while specifying the query:
select ... from T where ds = 2009-02-02
2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch, hive.347.4.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Status: Patch Available (was: Open)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Attachment: hive.347.3.patch
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Attachment: hive.347.1.patch
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Attachment: hive.347.4.patch
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch, hive.347.4.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Resolution: Fixed
Fix Version/s: 0.3.0
Status: Resolved (was: Patch Available)
committed.
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Status: Patch Available (was: Open)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12682528#action_12682528 ]
Namit Jain commented on HIVE-347:
---------------------------------
done
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Status: Open (was: Patch Available)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Status: Patch Available (was: Open)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Status: Patch Available (was: Reopened)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch, hive.347.4.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Hadoop Flags: [Reviewed]
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain reopened HIVE-347:
-----------------------------
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Raghotham Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12682524#action_12682524 ]
Raghotham Murthy commented on HIVE-347:
---------------------------------------
+1 looks good.
Can you change the comment to remove mention of 'date string' since that's not always the case?
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12683570#action_12683570 ]
Namit Jain commented on HIVE-347:
---------------------------------
There was a problem with the above patch. TRUE and unknown is unknown, therefore the patch was breaking for the following case:
select .. from T where partCol = value and col = 1;
col = 1 will be null even for 'value' partition, therefore 'value' partition will also be unknown.
The basic problem is that there is a implicit int to string conversion I dont think this can/should be fixed.
will upload a new patch undoing the patch
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Attachment: hive.347.2.patch
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch, hive.347.2.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681978#action_12681978 ]
Prasad Chakka commented on HIVE-347:
------------------------------------
The changes look good. I think the Error Message will confuse users since they see a partition predicate. I think error message should say something about incorrect type or quotes.
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-347:
----------------------------
Status: Open (was: Patch Available)
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.347.1.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-347) [hive] lot of mappers due to a user
error while specifying the partitioning column
Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12683604#action_12683604 ]
Ashish Thusoo commented on HIVE-347:
------------------------------------
+1
looks good to me.
> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>
> Key: HIVE-347
> URL: https://issues.apache.org/jira/browse/HIVE-347
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.3.0
>
> Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch, hive.347.4.patch
>
>
> A common scenario when the table is partitioned on 'ds' column which is of type 'string' of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.