You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by "Xiaoyi Lu@cse.osu" <lu...@cse.ohio-state.edu> on 2014/08/19 23:04:35 UTC
Announcing the release of RDMA for Apache Hadoop-2.x 0.9.1
The RDMA for Apache Hadoop team is pleased to announce the release of
Hadoop-2.x 0.9.1 package (for Hadoop 2.x series) with the following
features.
* RDMA for Apache Hadoop-2.x 0.9.1 Features
- Based on Apache Hadoop 2.4.1
- High performance design with native InfiniBand and RoCE
support at the verbs level for the HDFS component
- Compliant with Apache Hadoop 2.4.1 APIs and applications
- Easily configurable for native InfiniBand, RoCE, and the
traditional sockets based support (Ethernet and InfiniBand
with IPoIB)
- On-demand connection setup
- HDFS over native InfiniBand and RoCE
- RDMA-based write
- RDMA-based replication
- Parallel replication support
- Optimizations for SSD
- Tested with
- Mellanox InfiniBand adapters (DDR, QDR and FDR)
- RoCE support with Mellanox adapters
- Various multi-core platforms
- Different file systems with disks and SSDs
For downloading RDMA for Apache Hadoop-2.x 0.9.1 package and the
associated user guide, please visit the following URL:
http://hibd.cse.ohio-state.edu
Sample performance numbers for benchmarks using RDMA for Apache
Hadoop-2.x 0.9.1 version can be viewed by visiting the `Performance'
tab of the above website.
All questions, feedbacks and bug reports are welcome. Please post it
to the rdma-hadoop-discuss mailing list (rdma-hadoop-discuss at
cse.ohio-state.edu).
Thanks,
The High-Performance Big Data (HiBD) Team