You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Arpit Gupta (JIRA)" <ji...@apache.org> on 2012/12/20 07:35:12 UTC

[jira] [Commented] (HIVE-3255) Add DBTokenStore to store Delegation Tokens in DB

    [ https://issues.apache.org/jira/browse/HIVE-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536820#comment-13536820 ] 

Arpit Gupta commented on HIVE-3255:
-----------------------------------

I tested this patch out on a cluster running Hive. 


Ran a pig script that used hcat loader to read data from a partitioned table, processed it and then stored the partitioned results in another table.

Hive metastore service was restarted as the data was being read and processed but before the data was stored in the table. The tests passed on the cluster when the following config was present on the server

{code}
<property>
  <name>hive.cluster.delegation.token.store.class</name>
  <value>org.apache.hadoop.hive.thrift.DBTokenStore</value>
</property>
{code}


When i ran the same test on a metastore which did not have this enabled the test failed as expected.

                
> Add DBTokenStore to store Delegation Tokens in DB
> -------------------------------------------------
>
>                 Key: HIVE-3255
>                 URL: https://issues.apache.org/jira/browse/HIVE-3255
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore, Security
>    Affects Versions: 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: hive-3255_2.patch, hive-3255_3.patch, hive-3255_4.patch, hive-3255.patch
>
>
> Before HIVE-1696 metastore was completely stateless and all the data is in backend db. HIVE-1696 added delegation tokens for metastore which metastore needs to keep in memory. HIVE-2467 added support for storing delegation tokens in ZooKeeper via an interface {{DelegationTokenStore}}. This jira is about using DB backend for storing tokens which metastore uses for storing data. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira