You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/01/07 03:01:39 UTC
[jira] [Commented] (TAJO-1686) Allow Tajo to use Hive UDF

    [ https://issues.apache.org/jira/browse/TAJO-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086663#comment-15086663 ] 

ASF GitHub Bot commented on TAJO-1686:
--------------------------------------

GitHub user eminency opened a pull request:

    https://github.com/apache/tajo/pull/929

    TAJO-1686: Allow Tajo to use Hive UDF

    This patch consists of parts below.
    
    #### Core Logic 
    1. **TajoMaster.java / HiveFunctionLoader.java** : in charge of finding Hive UDFs and registering them.
    2. **HiveFunctionInvoke.java** : to call Hive UDF
    
    #### Utility
    1. **WritableTypeConverter.java** : utility class, to convert from Writable type to Datum and vice versa.
    2. **FunctionDescBuilder.java** : helper/builder to build FunctionDesc more conveniently.
    
    and others.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/eminency/tajo hive_udf

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/tajo/pull/929.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #929
    
----
commit 8e2cafb21f6d149dc3bec7a3c7a845d54e678672
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-23T08:21:31Z

    base

commit 070f3610442199edaa55e7f76c5343c549a66a01
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-27T07:41:41Z

    Method name refactoring

commit 7efc29eefe6d78837cc6a817d1f1c68d0f550fce
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-27T07:55:08Z

    Remove a simple method

commit 3a803f19a7758b18d5a592a4f44d95c071cf6f14
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T03:21:41Z

    get UDF classes

commit 0fdfa0903f5d4922bf5d1c484013ec079770dede
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T03:22:07Z

    refactor for Java 8

commit 1cd0d5a04b88d6fc2b7bf11f7c85089a7eef375b
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T03:23:03Z

    test for local

commit 98f65a6001b4619e12ee34bc95a13c367b5ad1a9
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T07:11:12Z

    name and deterministic

commit 6a69fdd2eab72380535e5b959e26ced1b55b811a
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T07:11:28Z

    variable name refactoring

commit a0fe3b21114ab67f710585485891ac787782e964
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T07:29:55Z

    remove useless enum

commit 6dcd24b537a0b245a079ef8db1c411a0a7563b19
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T07:31:32Z

    Revert "remove useless enum"
    
    This reverts commit a8739670ffb688b3d2c2ea5b8e8422d21059cf92.

commit 055a6db84feeb185c279b1b41e61190ede0ca155
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-10-29T07:32:30Z

    Remove useless enum

commit 64899ae7bdb6b2dad951c3d98d9282ecc83bd4cc
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-09T02:58:20Z

    Weird variable name changed

commit 935cd2891d6810d466c12838cf0498f94eb47bb0
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-09T05:32:48Z

    analyzeUDF test

commit 6bc4e1eba76f242ee26c0dff2143dff819accb1b
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-09T05:33:08Z

    test code missed

commit e2c0d719fa5c707fa08775b756aff45eb7cd19c6
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-09T06:03:31Z

    License added

commit e675e15067fbf1effdafb3bfa0fc76da895f6a36
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-09T06:12:19Z

    deterministic added and test modified

commit 6df6409852fd324c9d83b02fbd0d077f3ee08d27
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-09T08:40:09Z

    deterministic test

commit 110c5882eba1780e323412c4339b11154ad62ea8
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-10T07:59:37Z

    More test and FunctionDescBuilder added

commit 2142e3a0dca128c64c81dc22c8fe437ac60f4167
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-11T09:28:12Z

    test refactoring

commit 5fd2c9187ac137fd34f0e03d8bf59d8db9cc2ef9
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-11T09:30:04Z

    setup sequence refined

commit b4a7015d485e253195c29657373519aad12880fd
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-12T08:57:40Z

    Method names are changed

commit 96a8c72a5f59079a8f782b861f970bf77e588e97
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-12T08:59:33Z

    Test problem fixed

commit 96b9294495d27cb098147765db7841816273aa27
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-16T03:28:52Z

    AmbiguousFunctionException in loading function

commit 2b43dc1dd8fff8c6aee0d4badcaae4d10abfc345
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-16T05:36:56Z

    Basic finding test

commit fd69123f7e0972f584c82f8bb5ccb9e783151972
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-16T06:08:03Z

    process synonyms

commit b31a9180e19018b40db9599cc3f1f7c1512c143b
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-16T06:28:24Z

    process description and example

commit 3c9a00c81a695530158e77d8f6938827df2c4d75
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-11-16T06:31:53Z

    Non @Description UDF test added

commit 58172a6376622e7aef9dae2333f811b150214c1e
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-12-01T02:59:28Z

    Change PythonUDF PB to UDF one

commit ee2790b82a59eccc6456c555e1474df0f5147401
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-12-01T02:59:49Z

    runFunction test added

commit 6fb0ee44422540b5a1456745d4f56a7f6eb71b3e
Author: Jongyoung Park <em...@gmail.com>
Date:   2015-12-01T06:16:04Z

    Constructor modified

----


> Allow Tajo to use Hive UDF
> --------------------------
>
>                 Key: TAJO-1686
>                 URL: https://issues.apache.org/jira/browse/TAJO-1686
>             Project: Tajo
>          Issue Type: New Feature
>          Components: Function/UDF
>            Reporter: Jaehwa Jung
>            Assignee: Jongyoung Park
>
> Hive has been widely used in this area. Many users have maintained lots of big tables through Hive metastore using HiveQL and UDFs. Currently, Tajo provides own UDF and Hive users can implement their UDFs in Tajo. But if we can wrap Hive UDF in Tajo, it seems that they would be able to use Tajo easily for their analysis infrastructure.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)