You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2008/05/22 22:29:55 UTC

[jira] Created: (PIG-246) UDF repository

UDF repository
--------------

                 Key: PIG-246
                 URL: https://issues.apache.org/jira/browse/PIG-246
             Project: Pig
          Issue Type: New Feature
            Reporter: Olga Natkovich
            Assignee: Olga Natkovich


Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12603641#action_12603641 ] 

Olga Natkovich commented on PIG-246:
------------------------------------

I went back and forth on that and used UDF on top so that users know what's there and then piggybank in the actuall org.apache.pig hierarchy. But I am ok to change that if others think it is best to call top level dir piggybank.

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch, PIG-246_v2.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Pi Song (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602617#action_12602617 ] 

Pi Song commented on PIG-246:
-----------------------------

pom.xml is a maven build file. Kishore, are you proposing to move from ant to maven? I don't see its advantage at this stage because we don't have many inter-dependent components right now. (That doesn't mean it's not gonna be useful later)

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich updated PIG-246:
-------------------------------

    Attachment: PIG-246_v2.patch

Updated patch

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch, PIG-246_v2.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Patrick Hunt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602481#action_12602481 ] 

Patrick Hunt commented on PIG-246:
----------------------------------

Just to verify - UPPER.java contains class "evaluation.string.UPPER", correct?

Any reason to use TestX.java rather than XTest.java? Is that something maven prefers one way or the other?

What will the name of the generated jar file be? udfs.jar? pigudfs.jar? other...?

How about adding another jira "add pig udf to CI/Hudson" that depends on this item? Ditto for updating the Pig docs/wiki providing details on this contrib package.


> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602465#action_12602465 ] 

Olga Natkovich commented on PIG-246:
------------------------------------

I am fine with this structure.

what is the content of pom.xml?

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602693#action_12602693 ] 

Olga Natkovich commented on PIG-246:
------------------------------------

Pi,

We don't have plans to move to maven. I think the idea is to have structure that would work for maven if we decide to move their later or if some of the users want to use it.

Since the changes are pretty minor and don't take anything away from using ant, I saw no reason not to follow the structure.

What do you think?

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich resolved PIG-246.
--------------------------------

    Resolution: Fixed

the repository has been added. documentation is next.

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch, PIG-246_v2.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Patrick Hunt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12603640#action_12603640 ] 

Patrick Hunt commented on PIG-246:
----------------------------------

Shouldn't  the dir structure be contrib/piggybank/... rather than contrib/udfs/... ?


> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch, PIG-246_v2.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Pi Song (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12600511#action_12600511 ] 

Pi Song commented on PIG-246:
-----------------------------

Just to say "no objection"

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "kishore gopalakrishna (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602462#action_12602462 ] 

kishore gopalakrishna commented on PIG-246:
-------------------------------------------

It will be nice if the structure follows maven directory structure. The difference is between the aboves structure and maven structure is very minor and can be accomplished easily

A contrib
A contrib/udfs
A contrib/udfs/java
A contrib/udfs/java/src/main/java
A contrib/udfs/java/src/main/java/evaluation
A contrib/udfs/java/src/main/java/evaluation/string
A contrib/udfs/java/src/main/java/evaluation/string/UPPER.java
A contrib/udfs/java/src/main/java/evaluation/math
A contrib/udfs/java/src/main/java/evaluation/util
A contrib/udfs/java/src/main/java/evaluation/stats
A contrib/udfs/java/src/main/java/comparison
A contrib/udfs/java/src/main/java/filtering
A contrib/udfs/java/src/main/java/storage
A contrib/udfs/java/src/main/java/grouping
A contrib/udfs/java/src/test/java
A contrib/udfs/java/src/test/java/evaluation
A contrib/udfs/java/src/test/java/evaluation/TestEvalString.java
A contrib/udfs/java/src/test/java/filtering
A contrib/udfs/java/src/test/java/storage
A contrib/udfs/java/src/test/java/grouping
A contrib/udfs/java/src/test/java/comparison
A contrib/udfs/java/lib
A contrib/udfs/java/build.xml
A contrib/udfs/java/pom.xml

pom.xml is for maven
Please feel free to comment

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602864#action_12602864 ] 

Olga Natkovich commented on PIG-246:
------------------------------------

Here is new structure. Please, review:

A         contrib
A         contrib/udfs
A         contrib/udfs/java
A         contrib/udfs/java/src
A         contrib/udfs/java/src/main
A         contrib/udfs/java/src/main/java
A         contrib/udfs/java/src/main/java/org
A         contrib/udfs/java/src/main/java/org/apache
A         contrib/udfs/java/src/main/java/org/apache/pig
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/evaluation
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/evaluation/string
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/evaluation/math
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/evaluation/util
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/evaluation/stats
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/comparison
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/filtering
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/storage
A         contrib/udfs/java/src/main/java/org/apache/pig/piggybank/grouping
A         contrib/udfs/java/src/test
A         contrib/udfs/java/src/test/java
A         contrib/udfs/java/src/test/java/org
A         contrib/udfs/java/src/test/java/org/apache
A         contrib/udfs/java/src/test/java/org/apache/pig
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test/evaluation
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test/evaluation/TestEvalString.java
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test/filtering
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test/comparison
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test/grouping
A         contrib/udfs/java/src/test/java/org/apache/pig/piggybank/test/storage
A         contrib/udfs/java/lib
A         contrib/udfs/java/build.xml

> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-246) UDF repository

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich updated PIG-246:
-------------------------------

    Attachment: PIG-246_v1.patch

Here is the proposed structure for the repository. Please, critique:

A         contrib
A         contrib/udfs
A         contrib/udfs/java
A         contrib/udfs/java/src
A         contrib/udfs/java/src/evaluation
A         contrib/udfs/java/src/evaluation/string
A         contrib/udfs/java/src/evaluation/string/UPPER.java
A         contrib/udfs/java/src/evaluation/math
A         contrib/udfs/java/src/evaluation/util
A         contrib/udfs/java/src/evaluation/stats
A         contrib/udfs/java/src/comparison
A         contrib/udfs/java/src/filtering
A         contrib/udfs/java/src/storage
A         contrib/udfs/java/src/grouping
A         contrib/udfs/java/test
A         contrib/udfs/java/test/evaluation
A         contrib/udfs/java/test/evaluation/TestEvalString.java
A         contrib/udfs/java/test/filtering
A         contrib/udfs/java/test/storage
A         contrib/udfs/java/test/grouping
A         contrib/udfs/java/test/comparison
A         contrib/udfs/java/lib
A         contrib/udfs/java/build.xml


> UDF repository
> --------------
>
>                 Key: PIG-246
>                 URL: https://issues.apache.org/jira/browse/PIG-246
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Olga Natkovich
>         Attachments: PIG-246_v1.patch
>
>
> Creating a way to add UDFs to pig

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.