You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Abdelrahman Shettia (JIRA)" <ji...@apache.org> on 2015/04/16 16:17:58 UTC

[jira] [Commented] (HIVE-10121) Implement a hive --service udflint command to check UDF jars for common shading mistakes

    [ https://issues.apache.org/jira/browse/HIVE-10121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498076#comment-14498076 ] 

Abdelrahman Shettia commented on HIVE-10121:
--------------------------------------------

Hi Gopal, 

I am attaching the following use cases output files: 

bad_udfs.out
bad_udfs_verbose.out
good_udfs.out
good_udfs_verbose.out

Usage: 

Normal mode: 
$ hive --service UDFLint -file /tmp/hive_udf-1.0.0.jar 
Verbose mode: 
hive --service UDFLint -jar yi/hive-json-serde-0.3.jar -v 
Without any options:
[root@sandbox test]#  hive --service UDFLint 
usage: udflint
 -h,--help                        print help message
    --hiveconf <property=value>   Use value for given property
    --jar <arg>                   Comma separated list of jars to validate
 -v,--verbose                     Verbose mode (Run the tool in debug
                                  mode)

Please let me know if you have questions. 

Thanks
-Rahman

> Implement a hive --service udflint command to check UDF jars for common shading mistakes
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-10121
>                 URL: https://issues.apache.org/jira/browse/HIVE-10121
>             Project: Hive
>          Issue Type: New Feature
>          Components: UDF
>            Reporter: Gopal V
>            Assignee: Abdelrahman Shettia
>             Fix For: 1.2.0
>
>         Attachments: HIVE-10121.1.patch, bad_udfs.out, bad_udfs_verbose.out, good_udfs.out, good_udfs_verbose.out
>
>
> Several SerDe and UDF jars tend to shade in various parts of the dependencies including hadoop-common or guava without relocation.
> Implement a simple udflint tool which automates some part of the class path and shaded resources audit process required when upgrading a hive install from an old version to a new one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)