[jira] Commented: (HAMA-129) Improving speed of matrix multiplication

["Edward J. Yoon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12655065#action_12655065 ] 

Edward J. Yoon commented on HAMA-129:
-------------------------------------

Hmm.. This patch causes 'UnknownScannerException'
----
08/12/10 10:14:43 INFO mapred.JobClient:  map 50% reduce 16%
08/12/10 10:16:29 INFO mapred.JobClient: Task Id : attempt_200812100956_0005_m_000000_0, Status : FAILED
org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: -598694650616426837
        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
        at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
        at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856)
        at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155)
        at org.apache.hama.mapred.BlockInputFormatBase$TableRecordReader.next(BlockInputFormatBase.java:177)
        at org.apache.hama.mapred.BlockInputFormatBase$TableRecordReader.next(BlockInputFormatBase.java:58)
        at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
        at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)


> Improving speed of matrix multiplication
> ----------------------------------------
>
>                 Key: HAMA-129
>                 URL: https://issues.apache.org/jira/browse/HAMA-129
>             Project: Hama
>          Issue Type: Improvement
>          Components: implementation
>    Affects Versions: 0.1.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.1.0
>
>         Attachments: HAMA-129.patch
>
>
> We use a blockinputformat (row based partitioning). but it causes "java.lang.OutOfMemoryError: Java heap space" when size is big.
> I'll write the formulas and partition them as PIEstimator.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.