You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2008/10/13 06:26:46 UTC

[jira] Created: (HAMA-79) MappedMatrix Input/output formatter

MappedMatrix Input/output formatter
-----------------------------------

                 Key: HAMA-79
                 URL: https://issues.apache.org/jira/browse/HAMA-79
             Project: Hama
          Issue Type: New Feature
          Components: mapred 
            Reporter: Edward J. Yoon
             Fix For: 0.1.0


MappedMatrixInput/Output formmatter is implementation of an row by column matrix as a one-dimensional map.

A 2D matrix can be mapped onto a 1D map, like so: 

 [a b c]
 [d e f] 

<<row0,column0>, a>
<<row0,column1>, b>
...


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HAMA-79) MappedMatrix Input/output formatter

Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HAMA-79?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward J. Yoon resolved HAMA-79.
--------------------------------

    Resolution: Won't Fix
      Assignee: Edward J. Yoon

There is a lot of writable (e.g., TwoDArrayWritable, MapWritable, Int/Double/FloatWritable,...,etc) and InputFormatter. So I think we don't need to provide this.

> MappedMatrix Input/output formatter
> -----------------------------------
>
>                 Key: HAMA-79
>                 URL: https://issues.apache.org/jira/browse/HAMA-79
>             Project: Hama
>          Issue Type: New Feature
>          Components: mapred 
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.1.0
>
>
> MappedMatrixInput/Output formmatter is implementation of an row by column matrix as a one-dimensional map.
> A 2D matrix can be mapped onto a 1D map, like so: 
>  [a b c]
>  [d e f] 
> <<row0,column0>, a>
> <<row0,column1>, b>
> ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HAMA-79) MappedMatrix Input/output formatter

Posted by "Samuel Guo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HAMA-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638962#action_12638962 ] 

Samuel Guo commented on HAMA-79:
--------------------------------

why we map a 2D matrix onto a 1D map? Is there any advantage of this kind of format? I am confusing about it.

> MappedMatrix Input/output formatter
> -----------------------------------
>
>                 Key: HAMA-79
>                 URL: https://issues.apache.org/jira/browse/HAMA-79
>             Project: Hama
>          Issue Type: New Feature
>          Components: mapred 
>            Reporter: Edward J. Yoon
>             Fix For: 0.1.0
>
>
> MappedMatrixInput/Output formmatter is implementation of an row by column matrix as a one-dimensional map.
> A 2D matrix can be mapped onto a 1D map, like so: 
>  [a b c]
>  [d e f] 
> <<row0,column0>, a>
> <<row0,column1>, b>
> ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HAMA-79) MappedMatrix Input/output formatter

Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HAMA-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638974#action_12638974 ] 

Edward J. Yoon commented on HAMA-79:
------------------------------------

Hmm, I guess it can be used such as intermediate file format.  

If we store the 2d matrix to file as a high-level structure (e.g. r-tree or Map<row, Map<column, entry>>) on HDFS, it'll same with hbase structure and heavy. This is a low-level file format for some operation that doesn't need to communicate between map tasks.


> MappedMatrix Input/output formatter
> -----------------------------------
>
>                 Key: HAMA-79
>                 URL: https://issues.apache.org/jira/browse/HAMA-79
>             Project: Hama
>          Issue Type: New Feature
>          Components: mapred 
>            Reporter: Edward J. Yoon
>             Fix For: 0.1.0
>
>
> MappedMatrixInput/Output formmatter is implementation of an row by column matrix as a one-dimensional map.
> A 2D matrix can be mapped onto a 1D map, like so: 
>  [a b c]
>  [d e f] 
> <<row0,column0>, a>
> <<row0,column1>, b>
> ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.