You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Julien Le Dem (JIRA)" <ji...@apache.org> on 2011/01/13 19:21:45 UTC

[jira] Created: (PIG-1804) Alow Jython function to implement Algebraic and/or Accumulator interfaces

Alow Jython function to implement Algebraic and/or Accumulator interfaces
-------------------------------------------------------------------------

                 Key: PIG-1804
                 URL: https://issues.apache.org/jira/browse/PIG-1804
             Project: Pig
          Issue Type: New Feature
          Components: impl
    Affects Versions: 0.9.0
            Reporter: Julien Le Dem


Currently Python UDFs can only be simple functions. For performance improvements in advanced use cases it should be possible to extend Algebraic and/or Accumulator interfaces

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] [Commented] (PIG-1804) Alow Jython function to implement Algebraic and/or Accumulator interfaces

Posted by "Mathias Herberts (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149628#comment-13149628 ] 

Mathias Herberts commented on PIG-1804:
---------------------------------------

Actually I take that back, this is what the Documentation seemed to imply. When looking at the source code for FuncSpec, it appears that what get{Initial,Intermed,Final} return is really a funcspec which can contain parameters, so my previous comment is null and void.
                
> Alow Jython function to implement Algebraic and/or Accumulator interfaces
> -------------------------------------------------------------------------
>
>                 Key: PIG-1804
>                 URL: https://issues.apache.org/jira/browse/PIG-1804
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.9.0
>            Reporter: Julien Le Dem
>
> Currently Python UDFs can only be simple functions. For performance improvements in advanced use cases it should be possible to extend Algebraic and/or Accumulator interfaces

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-1804) Alow Jython function to implement Algebraic and/or Accumulator interfaces

Posted by "Mathias Herberts (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149624#comment-13149624 ] 

Mathias Herberts commented on PIG-1804:
---------------------------------------

The Algebraic interface has three methods which return class names to be fed to FuncSpec.

This approach pretty much forbids dynamically created Algebraic UDFs using pure (with no compilation phase) scripting languages (not only Jython, but Groovy, JavaScript are also concerned).

What would the impact be if Algebraic was refactored so get{Initial,Intermed,Final} return class instances instead of class names?
                
> Alow Jython function to implement Algebraic and/or Accumulator interfaces
> -------------------------------------------------------------------------
>
>                 Key: PIG-1804
>                 URL: https://issues.apache.org/jira/browse/PIG-1804
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.9.0
>            Reporter: Julien Le Dem
>
> Currently Python UDFs can only be simple functions. For performance improvements in advanced use cases it should be possible to extend Algebraic and/or Accumulator interfaces

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-1804) Alow Jython function to implement Algebraic and/or Accumulator interfaces

Posted by "Jonathan Coveney (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149765#comment-13149765 ] 

Jonathan Coveney commented on PIG-1804:
---------------------------------------

Indeed, Mathias, it is possible to allow the scripting languages to have Algebraic and Accumulator. This was done in JRuby here https://issues.apache.org/jira/browse/PIG-2317
                
> Alow Jython function to implement Algebraic and/or Accumulator interfaces
> -------------------------------------------------------------------------
>
>                 Key: PIG-1804
>                 URL: https://issues.apache.org/jira/browse/PIG-1804
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.9.0
>            Reporter: Julien Le Dem
>
> Currently Python UDFs can only be simple functions. For performance improvements in advanced use cases it should be possible to extend Algebraic and/or Accumulator interfaces

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira