You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2013/11/09 01:04:17 UTC

[jira] [Commented] (HIVE-5627) Document 'usehcatalog' parameter on WebHCat calls

    [ https://issues.apache.org/jira/browse/HIVE-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817874#comment-13817874 ] 

Lefty Leverenz commented on HIVE-5627:
--------------------------------------

In a recent download, ../hive/hcatalog/templeton/Server.java has javadoc comments for this parameter for mapreduce/jar and pig, but not for hive (and it isn't in the hive code either).

Also, there are several errors and omissions in the javadocs and code.  The user parameter name is "usehcatalog" which corresponds to the internal "usesHcatalog":

* mapreduce/jar javadoc says "usesHcatalog" for the user parameter (incorrect)
** its javadoc omits several params 
** also has "enablelog" in the code -- not in javadoc 
* pig javadoc says "usehcatalog" (correct)
** javadoc omits several params 
** also has "enablelog" in the code -- not in javadoc  
** but Map<String, Object> omits "usehcatalog"
* hive javadoc doesn't have the parameter (nor is it in the code) 
** but it has javadoc for "enablelog" 
** javadoc has all params but calls 'files' "srcFile" and 'arg' "hiveArgs" 
** omits "arg" from Map<String, Object> 


> Document 'usehcatalog' parameter on WebHCat calls
> -------------------------------------------------
>
>                 Key: HIVE-5627
>                 URL: https://issues.apache.org/jira/browse/HIVE-5627
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Documentation, WebHCat
>    Affects Versions: 0.12.0
>            Reporter: Eugene Koifman
>            Assignee: Lefty Leverenz
>             Fix For: 0.13.0
>
>
> The following REST calls in WebHCat:
> 1. mapreduce/jar
> 2. pig
> now support an additional parameter 'usehcatalog'.  This is a mechanism for the caller to tell WebHCat that the submitted job uses HCat, and thus needs to access the metastore, which requires additional steps for WebHCat to perform in a secure cluster.  
> The JavaDoc on corresponding methods in  org.apache.hive.hcatalog.templeton.Server describe this parameter.  
> Additionally, if templeton.hive.archive, templeton.hive.home and templeton.hcat.home are defined in webhcat-site.xml (documented in webhcat-default.xml) then WebHCat will ship the Hive tar to the target node where the job actually runs.  This means that Hive doesn't need to be installed on every node in the Hadoop cluster.  (This part was added in HIVE-5547).  This is independent of security, but improves manageability.
> This should be added to the sections in https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference that correspond to these methods.



--
This message was sent by Atlassian JIRA
(v6.1#6144)