You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Eric Hwang (JIRA)" <ji...@apache.org> on 2009/08/07 06:49:14 UTC
[jira] Created: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
MetaStoreUtils get_fields() does not return partition column
------------------------------------------------------------
Key: HIVE-736
URL: https://issues.apache.org/jira/browse/HIVE-736
Project: Hadoop Hive
Issue Type: Bug
Reporter: Eric Hwang
MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Raghotham Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghotham Murthy updated HIVE-736:
----------------------------------
Assignee: Eric Hwang
The changes look good. Will commit it if tests pass.
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
> Assignee: Eric Hwang
> Attachments: HIVE-736.1.patch
>
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Eric Hwang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740414#action_12740414 ]
Eric Hwang commented on HIVE-736:
---------------------------------
Actually I just talked to Zheng offline and I guess the get_fields function should NOT return the partition column under its proper usage. I can work around this by calling get_tables and then join the partitionkey field descriptors with the result of get_fields. I'll do this for now, however, this seems rather roundabout and I think there should still be a function which just returns all field descriptors altogether.
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Eric Hwang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Hwang updated HIVE-736:
----------------------------
Attachment: HIVE-736.1.patch
Patch Added:
Implements get_schema() in HiveMetaStore.java
Added get_schema() test cases to TestHiveMetaStore
Also added test cases for get_fields() in TestHiveMetaStore (related function)
All tests pass.
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
> Attachments: HIVE-736.1.patch
>
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Eric Hwang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740407#action_12740407 ]
Eric Hwang commented on HIVE-736:
---------------------------------
That would work, but I was hoping to solve both this and JIRA-671 in one fell swoop. Don't we just need to determine whether the table has a partition, and then append the partition key onto the field schemas returned by the deserializer?
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Raghotham Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740404#action_12740404 ]
Raghotham Murthy commented on HIVE-736:
---------------------------------------
As a work around, can you execute "describe <tablename>" to get the schema?
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Raghotham Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740425#action_12740425 ]
Raghotham Murthy commented on HIVE-736:
---------------------------------------
bq. I think there should still be a function which just returns all field descriptors altogether.
That makes sense. Instead of writing a work around, why not just add a function to the metastore thrift api that returns all columns (including partition columns)?
{code}
list<FieldSchema> get_schema(1:string db_name, 2:string tbl_name)
throws (1: MetaException o1, 2: UnknownTableException o2, 3: UnknownDBException o3),
{code}
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Eric Hwang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740765#action_12740765 ]
Eric Hwang commented on HIVE-736:
---------------------------------
Sounds like a good idea. I'll do that instead. Does anyone know if thrift permits the overloading of function names? The Hive server already has a function called get_schema with different arguments.
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Eric Hwang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Hwang updated HIVE-736:
----------------------------
Status: Patch Available (was: Open)
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
> Attachments: HIVE-736.1.patch
>
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-736) MetaStoreUtils get_fields() does not
return partition column
Posted by "Raghotham Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghotham Murthy updated HIVE-736:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.4.0
Release Note:
Provide a function in Metastore to return the schema of a table.
(Eric Hwang via rmurthy)
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed. Thanks Eric!
> MetaStoreUtils get_fields() does not return partition column
> ------------------------------------------------------------
>
> Key: HIVE-736
> URL: https://issues.apache.org/jira/browse/HIVE-736
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Eric Hwang
> Assignee: Eric Hwang
> Fix For: 0.4.0
>
> Attachments: HIVE-736.1.patch
>
>
> MetaStoreUtil's get_fields(), which is offered through the Hive Server interface, does not include the partition field in its returned list of fields. This may be related to JIRA-671. At the moment, there is no way for a Hive client to discover a partition column in a table, creating a big issue for anyone who wishes to query a partitioned table.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.