You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2011/03/10 05:25:59 UTC
[jira] Created: (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Design a new data structure for tag and message data of BSPMessage
------------------------------------------------------------------
Key: HAMA-362
URL: https://issues.apache.org/jira/browse/HAMA-362
Project: Hama
Issue Type: New Feature
Components: bsp
Affects Versions: 0.3.0
Reporter: Edward J. Yoon
Fix For: 0.3.0
The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
By supporting generic hash and array datatypes, it should be able to represent any standard hierarchical data structure.
And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015268#comment-13015268 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
Patch looks good. +1
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon reassigned HAMA-362:
-----------------------------------
Assignee: Thomas Jungblut
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: In Progress (was: Patch Available)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13013588#comment-13013588 ]
Thomas Jungblut commented on HAMA-362:
--------------------------------------
This issue sometimes annoys me. This is very similar to writing byte arrays in HBase, this annoys me too.
Do you have a concrete idea for that?
I've seen that the BSPMessage already defines the Writable interface, my idea would be to implement a "Messagable" interface.
You leave the concrete implementation to the user, but he must provide his own serialization and deserialization.
{code:title=Messagable.java|borderStyle=solid}
public interface Messagable {
// this will be a ByteArrayInputStream,
// or even a real stream if the data is coming from
// the network (don't know what to change behind the messages).
void read(InputStream in);
// ByteArrayOutputStream
void write(OutputStream out);
}
{code}
So you are keeping the underlying byte arrays to keep the data itself, but it is just a more convenient way to pass the arguments to the message.
The interfaces will be passed in both arguments of a constructor for tag and data. Similar to Hadoop's context.write(Writable key, Writable value)
Adding the constructor:
{code:title=BSPMessage.java|borderStyle=solid}
public BSPMessage(Messagable tag, Messagable data) {
// put the data into the byte arrays
}
{code}
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015708#comment-13015708 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
Thomas, did you attach your new patch?
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: 362.patch
okay fixed this with implementing writable too
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Patch Available (was: Open)
resubmitting to hudson
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Open (was: Patch Available)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: 362.patch
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: 362.patch
Okay, added the default constructor and cleaned the findbugs messages. At least the vanished in Eclipse.
Ran the Unit tests and everything seems fine now. Thank you for your patience :)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-362:
--------------------------------
Description:
The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
And, It should be compressible, writable, and flexible.
was:
The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
By supporting generic hash and array datatypes, it will be able to represent any data structure and make easy-to-program.
And, It should be compressible, writable, and flexible.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: (was: 362.patch)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Patch Available (was: Open)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: (was: 362.patch)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015763#comment-13015763 ]
Thomas Jungblut commented on HAMA-362:
--------------------------------------
It actually was, maybe I should've renamed it. I'll try again.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: 362.patch
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: (was: 362.patch)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015294#comment-13015294 ]
Thomas Jungblut commented on HAMA-362:
--------------------------------------
Yea I missed the default constructor, forgot that writables using reflection :)
Will fix that soon.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-362:
--------------------------------
Status: Open (was: Patch Available)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Commented] (HAMA-362) Design a new data structure for tag and message data of BSPMessage
Posted by "Edward J. Yoon" <ed...@udanax.org>.
Please review this patch if you possible.
Sent from my iPad
On Apr 5, 2011, at 2:48 PM, "Thomas Jungblut (JIRA)" <ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015770#comment-13015770 ]
>
> Thomas Jungblut commented on HAMA-362:
> --------------------------------------
>
> Okay thx for your help :)
>
>> Design a new data structure for tag and message data of BSPMessage
>> ------------------------------------------------------------------
>>
>> Key: HAMA-362
>> URL: https://issues.apache.org/jira/browse/HAMA-362
>> Project: Hama
>> Issue Type: New Feature
>> Components: bsp
>> Affects Versions: 0.3.0
>> Reporter: Edward J. Yoon
>> Assignee: Thomas Jungblut
>> Fix For: 0.3.0
>>
>> Attachments: hama-362.patch
>>
>>
>> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
>> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
>> And, It should be compressible, writable, and flexible.
>
> --
> This message is automatically generated by JIRA.
> For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015770#comment-13015770 ]
Thomas Jungblut commented on HAMA-362:
--------------------------------------
Okay thx for your help :)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: hama-362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015183#comment-13015183 ]
Thomas Jungblut commented on HAMA-362:
--------------------------------------
Okay this was obvious:
{noformat}
java.io.IOException: Call to localhost/127.0.0.1:30005 failed on local exception: java.io.IOException: *Can't write: org.apache.hama.bsp.ByteMessage@716cb7 as class org.apache.hama.bsp.BSPMessage*
at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
at org.apache.hadoop.ipc.Client.call(Client.java:743)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy0.put(Unknown Source)
at org.apache.hama.bsp.BSPPeer.sync(BSPPeer.java:196)
at org.apache.hama.bsp.TestBSPPeer$BSPPeerThread.runTest(TestBSPPeer.java:132)
at net.sourceforge.groboutils.junit.v1.TestRunnable.run(TestRunnable.java:154)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Can't write: org.apache.hama.bsp.ByteMessage@716cb7 as class org.apache.hama.bsp.BSPMessage
at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:162)
at org.apache.hadoop.ipc.RPC$Invocation.write(RPC.java:112)
at org.apache.hadoop.ipc.Client$Connection.sendParam(Client.java:475)
at org.apache.hadoop.ipc.Client.call(Client.java:721)
... 6 more
{noformat}
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015123#comment-13015123 ]
Thomas Jungblut commented on HAMA-362:
--------------------------------------
+1
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014436#comment-13014436 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
I'm still trying to figure it out. Let's thinking more with me.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015275#comment-13015275 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
You need to fix this problem:
{code}
at org.apache.hama.bsp.BSPPeer.sync(BSPPeer.java:196)
at org.apache.hama.bsp.TestBSPPeer$BSPPeerThread.runTest(TestBSPPeer.java:132)
{code}
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: (was: 362.patch)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Patch Available (was: Open)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: hama-362.patch
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: hama-362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015271#comment-13015271 ]
Hudson commented on HAMA-362:
-----------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12475320/362.patch
against trunk revision 1085856.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs -1. The patch appears to introduce 4 new Findbugs warnings.
core tests -1. The patch failed core unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/318/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hama-Patch/318/findbugsResult/
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/318/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hama-Patch/318/console
This message is automatically generated.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015767#comment-13015767 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
Please upload new file with new name (e.g., 362_v02.patch) instead of overwrite.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: hama-362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-362:
--------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I tested on my cluster, patch looks good.
I've just committed this. Thanks Thomas!
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: hama-362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (HAMA-362) Design a new data
structure for tag and message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015156#comment-13015156 ]
Thomas Jungblut edited comment on HAMA-362 at 4/3/11 3:12 PM:
--------------------------------------------------------------
Played a little, hope you'll like this ;)
I made the getData and getTag methods in BSPMessage abstract and extended with DoubleMessage (directly used in PiEstimator) and ByteMessage (quite the same like the old Message). Added an empty Messagable Interface for that.
Please don't tell me that the communication uses the writable interface for the serialization? In this case, I guess I have messed it up. :(
was (Author: thomas.jungblut):
Played a little, hope you'll like this ;)
I made the getData and getTag methods in BSPMessage abstract and extended with DoubleMessage (directly used in PiEstimator) and ByteMessage (quite the same like the old Message). Added an empty Messagable Interface for that.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015277#comment-13015277 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
Check also https://builds.apache.org/hudson/job/Hama-Patch/ws/trunk/build/reports/findbugs/newPatchFindbugsWarnings.html
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-362:
--------------------------------
Description:
The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
By supporting generic hash and array datatypes, it will be able to represent any data structure and make easy-to-program.
And, It should be compressible, writable, and flexible.
was:
The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
By supporting generic hash and array datatypes, it should be able to represent any standard hierarchical data structure.
And, It should be compressible, writable, and flexible.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic hash and array datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Open (was: Patch Available)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015115#comment-13015115 ]
Edward J. Yoon commented on HAMA-362:
-------------------------------------
I think, it would be nice if we can change the BSPMessage to abstract class, so that user can use their own Message class. For example,
{code}
DoubleMessage msg = new DoubleMessage(4.0 * (double) in / (double) iterations);
bspPeer.send(masterTask, msg);
bspPeer.sync();
{code}
Then, we can also implement like this:
{code}
class AdjacentListMessage extends MessageAbstract implements Messagable {
}
{code}
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015157#comment-13015157 ]
Hudson commented on HAMA-362:
-----------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12475313/362.patch
against trunk revision 1085856.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs -1. The patch appears to introduce 4 new Findbugs warnings.
core tests -1. The patch failed core unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/317/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hama-Patch/317/findbugsResult/
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/317/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hama-Patch/317/console
This message is automatically generated.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Patch Available (was: Open)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: hama-362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Status: Patch Available (was: In Progress)
submitting to jenkins/hudson whatever this guy is called now
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: 362.patch
Played a little, hope you'll like this ;)
I made the getData and getTag methods in BSPMessage abstract and extended with DoubleMessage (directly used in PiEstimator) and ByteMessage (quite the same like the old Message). Added an empty Messagable Interface for that.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Fix For: 0.3.0
>
> Attachments: 362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-362) Design a new data structure for tag and
message data of BSPMessage
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-362:
---------------------------------
Attachment: (was: 362.patch)
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-362) Design a new data structure for tag
and message data of BSPMessage
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015768#comment-13015768 ]
Hudson commented on HAMA-362:
-----------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12475460/hama-362.patch
against trunk revision 1088851.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/319/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hama-Patch/319/findbugsResult/
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/319/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hama-Patch/319/console
This message is automatically generated.
> Design a new data structure for tag and message data of BSPMessage
> ------------------------------------------------------------------
>
> Key: HAMA-362
> URL: https://issues.apache.org/jira/browse/HAMA-362
> Project: Hama
> Issue Type: New Feature
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Thomas Jungblut
> Fix For: 0.3.0
>
> Attachments: hama-362.patch
>
>
> The tag and message type are byte[]. However, I guess, the message of BSPMessage (almost) will be a {adjacent, vector, .., etc} *list*.
> By supporting generic datatypes, it will be able to represent any data structure and make easy-to-program.
> And, It should be compressible, writable, and flexible.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira