You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Alexey Goncharuk (JIRA)" <ji...@apache.org> on 2019/02/28 09:41:00 UTC
[jira] [Comment Edited] (IGNITE-11401) [ML] Labmdas doesn't work in
binary builds
[ https://issues.apache.org/jira/browse/IGNITE-11401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780313#comment-16780313 ]
Alexey Goncharuk edited comment on IGNITE-11401 at 2/28/19 9:40 AM:
--------------------------------------------------------------------
{code}
[2019-02-28 11:48:26,437][ERROR][sys-#46][GridTaskWorker] Failed to obtain remote job result policy for result from ComputeTask.result(..) method (will fail the whole task): GridJobResultImpl [job=C2 [c=o.a.i.ml.compute.IgniteCallableWrapper@63f34b70], sib=GridJobSiblingImpl [sesId=dbf0a433961-68c23d76-98bb-403c-bd19-f1aede32f245, jobId=fbf0a433961-68c23d76-98bb-403c-bd19-f1aede32f245, nodeId=28bab0e6-b041-42f4-8669-7e297fd2dce2, isJobDone=false], jobCtx=GridJobContextImpl [jobId=fbf0a433961-68c23d76-98bb-403c-bd19-f1aede32f245, timeoutObj=null, attrs=HashMap {}], node=TcpDiscoveryNode [id=28bab0e6-b041-42f4-8669-7e297fd2dce2, addrs=ArrayList [0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.17.0.1, 172.25.4.139, 172.25.4.25], sockAddrs=HashSet [/172.25.4.25:47500, /172.17.0.1:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /172.25.4.139:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1551343692014, loc=false, ver=2.8.0#20190228-sha1:e5538a10, isClient=false], ex=class o.a.i.IgniteException: Failed to deserialize object [typeName=o.a.i.i.processors.closure.GridClosureProcessor$C2], hasRes=true, isCancelled=false, isOccupied=true]
class org.apache.ignite.IgniteException: Remote job threw user exception (override or implement ComputeTask.result(..) method if you would like to have automatic failover for this exception): Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:102)
at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1062)
at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1055)
at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6877)
at org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:1055)
at org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:862)
at org.apache.ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:1125)
at org.apache.ignite.internal.processors.task.GridTaskProcessor$JobMessageListener.onMessage(GridTaskProcessor.java:1358)
at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1561)
at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1189)
at org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:127)
at org.apache.ignite.internal.managers.communication.GridIoManager$8.run(GridIoManager.java:1086)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: class org.apache.ignite.IgniteException: Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.internal.processors.job.GridJobWorker.initialize(GridJobWorker.java:460)
at org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1119)
at org.apache.ignite.internal.processors.job.GridJobProcessor$JobExecutionListener.onMessage(GridJobProcessor.java:1923)
... 7 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:10018)
at org.apache.ignite.internal.processors.job.GridJobWorker.initialize(GridJobWorker.java:441)
... 9 more
Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:913)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1763)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
at org.apache.ignite.internal.binary.GridBinaryMarshaller.deserialize(GridBinaryMarshaller.java:307)
at org.apache.ignite.internal.binary.BinaryMarshaller.unmarshal0(BinaryMarshaller.java:101)
at org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(AbstractNodeNameAwareMarshaller.java:81)
at org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:10012)
... 10 more
Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to deserialize object [typeName=org.apache.ignite.ml.compute.IgniteCallableWrapper]
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:913)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1763)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
at org.apache.ignite.internal.binary.BinaryUtils.doReadObject(BinaryUtils.java:1799)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.readObject(BinaryReaderExImpl.java:1330)
at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.readBinary(GridClosureProcessor.java:1872)
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:864)
... 16 more
Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to read field [name=internalCallable]
at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:192)
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:874)
... 22 more
Caused by: class org.apache.ignite.binary.BinaryInvalidTypeException: org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils$$Lambda$122/116734858
at org.apache.ignite.internal.binary.BinaryContext.descriptorForTypeId(BinaryContext.java:709)
at org.apache.ignite.internal.binary.BinaryContext.descriptorForTypeId(BinaryContext.java:706)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1756)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.readField(BinaryReaderExImpl.java:1983)
at org.apache.ignite.internal.binary.BinaryFieldAccessor$DefaultFinalClassAccessor.read0(BinaryFieldAccessor.java:703)
at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:188)
... 23 more
Caused by: java.lang.ClassNotFoundException: org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils$$Lambda$122/116734858
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.ignite.internal.util.IgniteUtils.forName(IgniteUtils.java:8643)
at org.apache.ignite.internal.MarshallerContextImpl.getClass(MarshallerContextImpl.java:374)
at org.apache.ignite.internal.binary.BinaryContext.descriptorForTypeId(BinaryContext.java:700)
... 29 more
{code}
was (Author: aplatonov):
[2019-02-28 11:48:26,437][ERROR][sys-#46][GridTaskWorker] Failed to obtain remote job result policy for result from ComputeTask.result(..) method (will fail the whole task): GridJobResultImpl [job=C2 [c=o.a.i.ml.compute.IgniteCallableWrapper@63f34b70], sib=GridJobSiblingImpl [sesId=dbf0a433961-68c23d76-98bb-403c-bd19-f1aede32f245, jobId=fbf0a433961-68c23d76-98bb-403c-bd19-f1aede32f245, nodeId=28bab0e6-b041-42f4-8669-7e297fd2dce2, isJobDone=false], jobCtx=GridJobContextImpl [jobId=fbf0a433961-68c23d76-98bb-403c-bd19-f1aede32f245, timeoutObj=null, attrs=HashMap {}], node=TcpDiscoveryNode [id=28bab0e6-b041-42f4-8669-7e297fd2dce2, addrs=ArrayList [0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.17.0.1, 172.25.4.139, 172.25.4.25], sockAddrs=HashSet [/172.25.4.25:47500, /172.17.0.1:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /172.25.4.139:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1551343692014, loc=false, ver=2.8.0#20190228-sha1:e5538a10, isClient=false], ex=class o.a.i.IgniteException: Failed to deserialize object [typeName=o.a.i.i.processors.closure.GridClosureProcessor$C2], hasRes=true, isCancelled=false, isOccupied=true]
class org.apache.ignite.IgniteException: Remote job threw user exception (override or implement ComputeTask.result(..) method if you would like to have automatic failover for this exception): Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:102)
at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1062)
at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1055)
at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6877)
at org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:1055)
at org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:862)
at org.apache.ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:1125)
at org.apache.ignite.internal.processors.task.GridTaskProcessor$JobMessageListener.onMessage(GridTaskProcessor.java:1358)
at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1561)
at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1189)
at org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:127)
at org.apache.ignite.internal.managers.communication.GridIoManager$8.run(GridIoManager.java:1086)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: class org.apache.ignite.IgniteException: Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.internal.processors.job.GridJobWorker.initialize(GridJobWorker.java:460)
at org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1119)
at org.apache.ignite.internal.processors.job.GridJobProcessor$JobExecutionListener.onMessage(GridJobProcessor.java:1923)
... 7 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:10018)
at org.apache.ignite.internal.processors.job.GridJobWorker.initialize(GridJobWorker.java:441)
... 9 more
Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to deserialize object [typeName=org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2]
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:913)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1763)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
at org.apache.ignite.internal.binary.GridBinaryMarshaller.deserialize(GridBinaryMarshaller.java:307)
at org.apache.ignite.internal.binary.BinaryMarshaller.unmarshal0(BinaryMarshaller.java:101)
at org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(AbstractNodeNameAwareMarshaller.java:81)
at org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:10012)
... 10 more
Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to deserialize object [typeName=org.apache.ignite.ml.compute.IgniteCallableWrapper]
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:913)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1763)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
at org.apache.ignite.internal.binary.BinaryUtils.doReadObject(BinaryUtils.java:1799)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.readObject(BinaryReaderExImpl.java:1330)
at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.readBinary(GridClosureProcessor.java:1872)
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:864)
... 16 more
Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to read field [name=internalCallable]
at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:192)
at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:874)
... 22 more
Caused by: class org.apache.ignite.binary.BinaryInvalidTypeException: org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils$$Lambda$122/116734858
at org.apache.ignite.internal.binary.BinaryContext.descriptorForTypeId(BinaryContext.java:709)
at org.apache.ignite.internal.binary.BinaryContext.descriptorForTypeId(BinaryContext.java:706)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1756)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
at org.apache.ignite.internal.binary.BinaryReaderExImpl.readField(BinaryReaderExImpl.java:1983)
at org.apache.ignite.internal.binary.BinaryFieldAccessor$DefaultFinalClassAccessor.read0(BinaryFieldAccessor.java:703)
at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:188)
... 23 more
Caused by: java.lang.ClassNotFoundException: org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils$$Lambda$122/116734858
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.ignite.internal.util.IgniteUtils.forName(IgniteUtils.java:8643)
at org.apache.ignite.internal.MarshallerContextImpl.getClass(MarshallerContextImpl.java:374)
at org.apache.ignite.internal.binary.BinaryContext.descriptorForTypeId(BinaryContext.java:700)
... 29 more
> [ML] Labmdas doesn't work in binary builds
> ------------------------------------------
>
> Key: IGNITE-11401
> URL: https://issues.apache.org/jira/browse/IGNITE-11401
> Project: Ignite
> Issue Type: Bug
> Components: ml
> Reporter: Alexey Platonov
> Assignee: Alexey Platonov
> Priority: Major
> Fix For: 2.8
>
>
> Current lambdas for feature extraction doesn't work in binary builds and fail with such errors:
> Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to deserialize object [typeName=org.apache.ignite.ml.regressions.linear.FeatureExtractorWrapper]
> at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:913)
> at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1763)
> at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
> at org.apache.ignite.internal.binary.BinaryReaderExImpl.readField(BinaryReaderExImpl.java:1983)
> at org.apache.ignite.internal.binary.BinaryFieldAccessor$DefaultFinalClassAccessor.read0(BinaryFieldAccessor.java:703)
> at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:188)
> ... 40 more
> Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to read field [name=featureExtractor]
> at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:192)
> at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:874)
> ... 45 more
> Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to deserialize object [typeName=java.lang.invoke.SerializedLambda]
> at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:913)
> at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize0(BinaryReaderExImpl.java:1763)
> at org.apache.ignite.internal.binary.BinaryReaderExImpl.deserialize(BinaryReaderExImpl.java:1715)
> at org.apache.ignite.internal.binary.BinaryReaderExImpl.readField(BinaryReaderExImpl.java:1983)
> at org.apache.ignite.internal.binary.BinaryFieldAccessor$DefaultFinalClassAccessor.read0(BinaryFieldAccessor.java:703)
> at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:188)
> ... 46 more
> Caused by: class org.apache.ignite.binary.BinaryObjectException: Failed to read field [name=capturedArgs]
> at org.apache.ignite.internal.binary.BinaryFieldAccessor.read(BinaryFieldAccessor.java:192)
> at org.apache.ignite.internal.binary.BinaryClassDescriptor.read(BinaryClassDescriptor.java:874)
> ... 51 more
> Caused by: class org.apache.ignite.binary.BinaryInvalidTypeException: org.apache.ignite.examples.ml.regression.linear.StaticFun
>
> ....
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)