You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hama.apache.org by Apache Wiki <wi...@apache.org> on 2012/10/23 13:11:18 UTC

[Hama Wiki] Update of "RunningOverInfiniBand" by edwardyoon

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hama Wiki" for change notification.

The "RunningOverInfiniBand" page has been changed by edwardyoon:
http://wiki.apache.org/hama/RunningOverInfiniBand

Comment:
Add SDP enabiling guide 

New page:
== Running Hama Over InfiniBand ==

=== Create an SDP configuration file ===

Each BSP peer (task) will have its own port number for communicating with others. For example, if you set {{{set bsp.peer.port}}} to 61000 and set {{{bsp.tasks.maximum}}} to 5, BSP peers will use the port range from 61000 to 61005.

To enable SDP support for BSP peers, create a configuration file like the following sample:

{{{
[edward@192.168.10.1 ~]# cat {$HAMA_HOME}/conf/sdp.conf
# Use SDP when binding to
bind 192.168.10.1 61000-61010

# Use SDP when connecting to
connect 192.168.10.0/24 61000-61010
}}}

NOTE: This configuration file must reside on every node.

=== Set the system property that specifies the location of the configuration file ===

And then, set the location of the configuration file by adding {{{-Dcom.sun.sdp.conf}}} to the {{{bsp.child.java.opts}}} property as following: 

{{{
  <property>
    <name>bsp.child.java.opts</name>
    <value>-Dcom.sun.sdp.conf={$HAMA_HOME}/sdp.conf -Xmx1024m</value>
    <description>Java opts for the groom server child processes.  
    The following symbol, if present, will be interpolated: @taskid@ is replaced 
    by current TaskID. Any other occurrences of '@' will go unchanged.
    For example, to enable verbose gc logging to a file named for the taskid in
    /tmp and to set the heap maximum to be a gigabyte, pass a 'value' of:
          -Xmx1024m -verbose:gc -Xloggc:/tmp/@taskid@.gc
    The configuration variable bsp.child.ulimit can be used to control the
    maximum virtual memory of the child processes. 
    </description>
  </property>
}}}


If everything is OK, you will see the following logs.

{{{
CONNECT to 192.168.10.2:61005 (socket converted to SDP protocol)
CONNECT to 192.168.10.5:61002 (socket converted to SDP protocol)
CONNECT to 192.168.10.4:61003 (socket converted to SDP protocol)
CONNECT to 192.168.10.1:61006 (socket converted to SDP protocol)
...
}}}

1. http://en.wikipedia.org/wiki/Sockets_Direct_Protocol