You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Mike Drob (JIRA)" <ji...@apache.org> on 2016/08/12 17:29:20 UTC

[jira] [Commented] (ACCUMULO-884) Insight into short circuit read for local files

    [ https://issues.apache.org/jira/browse/ACCUMULO-884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419161#comment-15419161 ] 

Mike Drob commented on ACCUMULO-884:
------------------------------------

Linking [~mridley]'s presentation here for future searchers.

Accumulo Summit page:
http://accumulosummit.com/program/talks/hdfs-short-circuit-local-read-performance-benchmarking-with-apache-accumulo-and-apache-hbase/

Slides Direct:
http://www.slideshare.net/AccumuloSummit/accumulo-summit-2015-hdfs-short-circuit-local-read-performance-benchmarking-with-apache-accumulo-and-apache-hbase

Video Direct:
https://www.youtube.com/watch?v=OjsRqLghwqc

> Insight into short circuit read for local files
> -----------------------------------------------
>
>                 Key: ACCUMULO-884
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-884
>             Project: Accumulo
>          Issue Type: Sub-task
>          Components: docs
>            Reporter: Billie Rinaldi
>
> This is a new feature in hadoop 1.0.x and some versions of 0.22 and 0.23.  It allows a client to read directly from disk instead of through a DataNode when the data is stored locally.  Enabling it involves setting two configuration parameters, the first in hdfs-site.xml and the second in accumulo-site.xml.  We should make sure this works with Accumulo and recommend it in the documentation.
> - dfs.block.local-path-access.user is the key in datanode configuration to specify the user allowed to do short circuit read.
> - dfs.client.read.shortcircuit is the key to enable short circuit read at the client side configuration.
> See HDFS-2246 and http://hbase.apache.org/book/perf.hdfs.configs.html for more information.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)