You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Sean Busbey (JIRA)" <ji...@apache.org> on 2019/01/04 15:50:00 UTC
[jira] [Commented] (HBASE-21672) Allow skipping HDFS block
distribution computation
[ https://issues.apache.org/jira/browse/HBASE-21672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734269#comment-16734269 ]
Sean Busbey commented on HBASE-21672:
-------------------------------------
this feels a bit hacky. Shouldn't this either be a no-op for filesystems that don't have locality, or something we can just ask the filesystem? (even if the current FileSystem API can't do that)
> Allow skipping HDFS block distribution computation
> --------------------------------------------------
>
> Key: HBASE-21672
> URL: https://issues.apache.org/jira/browse/HBASE-21672
> Project: HBase
> Issue Type: Improvement
> Reporter: Nihal Jain
> Assignee: Nihal Jain
> Priority: Major
> Labels: S3
>
> We should have a configuration to skip HDFS block distribution calculation in HBase. For example on file systems that do not surface locality such as S3, calculating block distribution would not be any useful.
> Currentlly, we do not have a way to skip hdfs block distribution computation. For this, we can provide a new configuration key, say {{hbase.block.distribution.skip.computation}} (which would be {{false}} by default).
> Users using filesystems such as s3 may choose to make this {{true}}, thus skipping block distribution computation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)