You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Sharad Agarwal (JIRA)" <ji...@apache.org> on 2015/03/27 07:18:52 UTC
[jira] [Comment Edited] (LENS-436) Fix dependencies in ML
distribution
[ https://issues.apache.org/jira/browse/LENS-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383393#comment-14383393 ]
Sharad Agarwal edited comment on LENS-436 at 3/27/15 6:18 AM:
--------------------------------------------------------------
With this patch ML service come up fine in Docker.
On running the example:
$LENS_CLIENT/bin/lens-run-class.sh org.apache.lens.ml.MLRunner $LENS_ML/data/naive_bayes --conf $LENS_CLIENT_CONF
looks like the remote fn registration is failing. In hive.log
2015-03-27 05:37:15,242 ERROR exec.Task (SessionState.java:printError(572)) - FAILED: Class org.apache.lens.ml.HiveMLUDF not found
2015-03-27 05:37:15,245 INFO exec.FunctionTask (FunctionTask.java:createTemporaryFunction(198)) - create function: java.lang.ClassNotFoundException: org.apache.lens.ml.HiveMLUDF
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(FunctionTask.java:313)
was (Author: sharadag):
ML service come up fine in Docker.
On running the example:
$LENS_CLIENT/bin/lens-run-class.sh org.apache.lens.ml.MLRunner $LENS_ML/data/naive_bayes --conf $LENS_CLIENT_CONF
looks like the remote fn registration is failing. In hive.log
2015-03-27 05:37:15,242 ERROR exec.Task (SessionState.java:printError(572)) - FAILED: Class org.apache.lens.ml.HiveMLUDF not found
2015-03-27 05:37:15,245 INFO exec.FunctionTask (FunctionTask.java:createTemporaryFunction(198)) - create function: java.lang.ClassNotFoundException: org.apache.lens.ml.HiveMLUDF
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(FunctionTask.java:313)
> Fix dependencies in ML distribution
> -----------------------------------
>
> Key: LENS-436
> URL: https://issues.apache.org/jira/browse/LENS-436
> Project: Apache Lens
> Issue Type: Bug
> Components: ml
> Reporter: Sharad Agarwal
> Attachments: Lens-436-1.patch
>
>
> currently all the transitive dependencies are being pulled into the ml dist package leading to conflict in versions while deploying the MLService in Lens server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)