[jira] [Commented] (HIVEMALL-260) Remove dependencies to Scala library in xgboost classifier

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVEMALL-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959039#comment-16959039 ] 

ASF GitHub Bot commented on HIVEMALL-260:
-----------------------------------------

myui commented on pull request #205: https://issues.apache.org/jira/browse/HIVEMALL-260
URL: https://github.com/apache/incubator-hivemall/pull/205
 
 
   ## What changes were proposed in this pull request?
   
   Remove dependencies to Scala library in xgboost classifier
   
   ## What type of PR is it?
   
   Bug Fix, Hot Fix
   
   ## What is the Jira issue?
   
   https://issues.apache.org/jira/browse/HIVEMALL-260
   
   ## How was this patch tested?
   
   manual tests on EMR
   
   ## How to use this feature?
   
   to appear
   
   ## Checklist
   
   - [x] Did you apply source code formatter, i.e., `./bin/format_code.sh`, for your commit?
   - [ ] Did you run system tests on Hive (or Spark)?
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Remove dependencies to Scala library in xgboost classifier
> ----------------------------------------------------------
>
>                 Key: HIVEMALL-260
>                 URL: https://issues.apache.org/jira/browse/HIVEMALL-260
>             Project: Hivemall
>          Issue Type: Bug
>    Affects Versions: 0.5.2
>            Reporter: Makoto Yui
>            Assignee: Makoto Yui
>            Priority: Blocker
>             Fix For: 0.6.0
>
>
> Since LabeledPoint is implemented in Scala, java library of xgboost requires Scala library.
> [https://github.com/dmlc/xgboost/blob/master/jvm-packages/xgboost4j/src/main/scala/ml/dmlc/xgboost4j/LabeledPoint.scala]
> So, replace ml/dmlc/xgboost4j/LabeledPoint.scala with ml/dmlc/xgboost4j/LabeledPoint.java in 
> https://github.com/myui/build-xgboost-jvm
> {code:java}
> java.lang.RuntimeException: java.lang.NoClassDefFoundError: scala/Product$class
>  at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:257)
>  at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
>  at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
>  at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:414)
>  at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:301)
>  at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
>  at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NoClassDefFoundError: scala/Product$class
>  at ml.dmlc.xgboost4j.LabeledPoint.<init>(LabeledPoint.scala:35)
>  at ml.dmlc.xgboost4j.LabeledPoint.<init>(LabeledPoint.scala:41)
>  at hivemall.xgboost.XGBoostUtils.parseFeatures(XGBoostUtils.java:54)
>  at hivemall.xgboost.XGBoostUDTF.process(XGBoostUDTF.java:294)
>  at org.apache.hadoop.hive.ql.exec.UDTFOperator.process(UDTFOperator.java:116)
>  at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:897)
>  at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:95)
>  at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:236)
>  ... 11 more
> Caused by: java.lang.ClassNotFoundException: scala.Product$class
>  at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>  at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>  at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
>  at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>  ... 19 more{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)