[jira] [Commented] (LENS-831) Create a single jar for shipping with hive queries

["Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LENS-831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026519#comment-15026519 ] 

Amareshwari Sriramadasu commented on LENS-831:
----------------------------------------------

Just noticed that the patch is including hive-metastore jar as well, but runtime of hive-metastore can be of different version and if compile time jar is included it might conflict with deployed version. It should be removed from ship-jars. Created - LENS-881

> Create a single jar for shipping with hive queries
> --------------------------------------------------
>
>                 Key: LENS-831
>                 URL: https://issues.apache.org/jira/browse/LENS-831
>             Project: Apache Lens
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 2.4
>            Reporter: Srikanth Sundarrajan
>            Assignee: Srikanth Sundarrajan
>              Labels: packaging
>             Fix For: 2.4
>
>         Attachments: LENS-831-V1.patch, LENS-831.patch
>
>
> Currently a number of jars have to be shipped along with each query apart from user extension jars for udf, serde etc. This has two side effects:
> 1. Number of ClassLoader on the hive server increases (potentially causing PermGen OOM issues)
> 2. Number of jar localization events in the node manager when executing a task.
> The proposal is to bundle these and create a single shaded jar and make it available in the binary distribution.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)