You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hivemall.apache.org by "Makoto Yui (Jira)" <ji...@apache.org> on 2019/09/27 03:56:00 UTC

[jira] [Commented] (HIVEMALL-268) train_ffm(features,label) causes NPE while train_ffm(features,label,'') works fine

    [ https://issues.apache.org/jira/browse/HIVEMALL-268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939100#comment-16939100 ] 

Makoto Yui commented on HIVEMALL-268:
-------------------------------------

initScheme is not initialized when no hyperparameter is passed.

{code:java}
org.apache.hadoop.hive.ql.metadata.HiveException: Exception caused in the 2-th call of train()
    at hivemall.fm.FactorizationMachineUDTF.train(FactorizationMachineUDTF.java:404)
    at hivemall.fm.FactorizationMachineUDTF.runTrainingIteration(FactorizationMachineUDTF.java:617)
    at hivemall.fm.FactorizationMachineUDTF.close(FactorizationMachineUDTF.java:477)
    at org.apache.hadoop.hive.ql.exec.UDTFOperator.closeOp(UDTFOperator.java:143)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:577)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:588)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:588)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:588)
    at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:227)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
    at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:380)
    at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:301)
    at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
    at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
    at hivemall.fm.FactorizationMachineUDTF.trainTheta(FactorizationMachineUDTF.java:424)
    at hivemall.fm.FactorizationMachineUDTF.train(FactorizationMachineUDTF.java:401)
    ... 20 more
{code}


> train_ffm(features,label) causes NPE while train_ffm(features,label,'') works fine
> ----------------------------------------------------------------------------------
>
>                 Key: HIVEMALL-268
>                 URL: https://issues.apache.org/jira/browse/HIVEMALL-268
>             Project: Hivemall
>          Issue Type: Bug
>    Affects Versions: 0.5.2
>            Reporter: Makoto Yui
>            Assignee: Makoto Yui
>            Priority: Critical
>             Fix For: 0.6.0
>
>
> train_ffm(features,label) causes NPE while train_ffm(features,label,'') works fine.
> {code:java}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Exception caused in the 1-th call of train()
> 	at hivemall.fm.FactorizationMachineUDTF.train(FactorizationMachineUDTF.java:404)
> 	at hivemall.fm.FactorizationMachineUDTF.process(FactorizationMachineUDTF.java:314)
> 	at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator.java:107)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
> 	at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
> 	at org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
> 	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:262)
> 	... 11 more
> Caused by: java.lang.NullPointerException
> 	at hivemall.fm.FactorizationMachineModel.initV(FactorizationMachineModel.java:391)
> 	at hivemall.fm.FFMStringFeatureMapModel.getV(FFMStringFeatureMapModel.java:152)
> 	at hivemall.fm.FieldAwareFactorizationMachineModel.predict(FieldAwareFactorizationMachineModel.java:98)
> 	at hivemall.fm.FieldAwareFactorizationMachineUDTF.trainTheta(FieldAwareFactorizationMachineUDTF.java:195)
> 	at hivemall.fm.FactorizationMachineUDTF.train(FactorizationMachineUDTF.java:401)
> 	... 18 more 
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)