[jira] Commented: (HIVE-52) User-definable handlers for MAP and REDUCE transforms

["Edward Capriolo (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652072#action_12652072 ] 

Edward Capriolo commented on HIVE-52:
-------------------------------------

Has anyone thought of a handler to give this back to a JobClient or some type of in-process java handleing?

> User-definable handlers for MAP and REDUCE transforms
> -----------------------------------------------------
>
>                 Key: HIVE-52
>                 URL: https://issues.apache.org/jira/browse/HIVE-52
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Venky Iyer
>
> Mappers can be specified (as before) like:
> .... MAP USING 'uri' .....
> uris are in a format to be decided upon; possibilities are
> protocol://resource/param=value,param2=value2
> or
> protocol: resource_string
> For example, shell commands are like 
> sh://uniq or 
> sh: sort | uniq
> When no protocol is specified, we assume the default to be sh://.
> Another example is pyfunc://foo.bar/baz=2 , which points to the bar(baz=2) function from the foo module. 
> We can add handlers for these protocols like
> add handler sh shell (default)
> add handler pyfunc "python pyhive.py"
> and replace these handlers using appropriate syntax.
> Map and Reduce handlers can be distinct. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.