You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@mahout.apache.org by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org> on 2014/06/04 23:59:01 UTC

[jira] [Created] (MAHOUT-1572) blockify() to detect (naively) the data sparsity in the loaded data

Dmitriy Lyubimov created MAHOUT-1572:
----------------------------------------

             Summary: blockify() to detect (naively) the data sparsity in the loaded data 
                 Key: MAHOUT-1572
                 URL: https://issues.apache.org/jira/browse/MAHOUT-1572
             Project: Mahout
          Issue Type: Bug
            Reporter: Dmitriy Lyubimov
             Fix For: 1.0


per [~ssc]:
.bq a dense matrix is converted into a SparseRowMatrix with dense row vectors by blockify(), after serialization this becomes a dense matrix in sparse format (triggering OOMs)! 

i guess we can look at first row vector and go on to either DenseMatrix or SparseRowMatrix




--
This message was sent by Atlassian JIRA
(v6.2#6252)