You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Noble Paul (JIRA)" <ji...@apache.org> on 2018/02/27 05:54:00 UTC
[jira] [Updated] (SOLR-11064) Collection APIs should provide disk
space hint to Policy when possible
[ https://issues.apache.org/jira/browse/SOLR-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Noble Paul updated SOLR-11064:
------------------------------
Description:
SOLR-11063 added disk space hint to Policy. The ADDREPLICA, MOVEREPLICA, SPLITSHARD and REPLACENODE APIs can provide this hint.
# ADDREPLICA can query the size of the leader's data direcoty for the same shard and pass it to policy
# MOVEREPLICA again knows the size of the replica being moved
# REPLACENODE can compute the sum of disk usage of all the replicas' data directories
We should probably include both index and tlog size in the hint to ensure that we have ample space on target nodes.
We should also take care of HDFS because for movereplica and replacenode, there are no disk space requirements because the original replica's HDFS data and ulog directories are used by the new replicas.
was:
SOLR-11063 added disk space hint to Policy. The ADDREPLICA, MOVEREPLICA, SPLITSHARD and REPLACENODE APIs can provide this hint.
# ADDREPLICA can query the size of the leader's data direcoty for the same shard and pass it to policy
# MOVEREPLICA again knows the size of the replica being moved
# SPLITSHARD knows the size of the split indexes before it calls addreplica to create replicas of the sub-shards
# REPLACENODE can compute the sum of disk usage of all the replicas' data directories
We should probably include both index and tlog size in the hint to ensure that we have ample space on target nodes.
We should also take care of HDFS because for movereplica and replacenode, there are no disk space requirements because the original replica's HDFS data and ulog directories are used by the new replicas.
> Collection APIs should provide disk space hint to Policy when possible
> ----------------------------------------------------------------------
>
> Key: SOLR-11064
> URL: https://issues.apache.org/jira/browse/SOLR-11064
> Project: Solr
> Issue Type: Sub-task
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling, SolrCloud
> Reporter: Shalin Shekhar Mangar
> Assignee: Noble Paul
> Priority: Major
> Fix For: master (8.0), 7.3
>
>
> SOLR-11063 added disk space hint to Policy. The ADDREPLICA, MOVEREPLICA, SPLITSHARD and REPLACENODE APIs can provide this hint.
> # ADDREPLICA can query the size of the leader's data direcoty for the same shard and pass it to policy
> # MOVEREPLICA again knows the size of the replica being moved
> # REPLACENODE can compute the sum of disk usage of all the replicas' data directories
> We should probably include both index and tlog size in the hint to ensure that we have ample space on target nodes.
> We should also take care of HDFS because for movereplica and replacenode, there are no disk space requirements because the original replica's HDFS data and ulog directories are used by the new replicas.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org