You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bookkeeper.apache.org by "Venkateswararao Jujjuri (JV) (JIRA)" <ji...@apache.org> on 2016/04/07 16:40:25 UTC
[jira] [Commented] (BOOKKEEPER-916) Placement policy to accomodate
different types of ledger storage
[ https://issues.apache.org/jira/browse/BOOKKEEPER-916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15230331#comment-15230331 ]
Venkateswararao Jujjuri (JV) commented on BOOKKEEPER-916:
---------------------------------------------------------
1. No; Storage tiers is going to be much broader and deeper discussion. I will open a new Zira for that.
2. Absolutely. Reliability should not be affected. Preferred to be on specified medium and maintaining enough replicas is absolute must.
3. We may have to divide ledger storage directories into storage classes, placement policy to give the order of priority and Writer and replication logic will follow that.
No design document yet. :( Will come up with one soon.
> Placement policy to accomodate different types of ledger storage
> ----------------------------------------------------------------
>
> Key: BOOKKEEPER-916
> URL: https://issues.apache.org/jira/browse/BOOKKEEPER-916
> Project: Bookkeeper
> Issue Type: New Feature
> Components: bookkeeper-client, bookkeeper-server
> Affects Versions: 4.3.2
> Reporter: Venkateswararao Jujjuri (JV)
> Assignee: Venkateswararao Jujjuri (JV)
>
> As we start to use bookkeeper as long term storage, it may not be right use of resources to keep all copies of entry (write ensemble) on efficient storage. This feature is to come up with an intelligent placement that distributes entry copies across different classes of storage.
> Simply put, say we have SSD based ledger storage and HDD based ledger storage on each system. Instead of putting all copies of entries either on SSD or on HDD, this placement policy maintains one copy on SSD and others on HDD.
> - Have at least one copy on SSD and others on HDD.
> - Writer need to be aware of this classification
> - Replication logic need to be aware of this logic.
> - While reading attempt to read from SSD first.
> - Reader also need to be aware of this logic.
> This will push bookkeeper towards the long term storage, also can be a stepping store towards introducing storage tiers in the future.
> This has dependency/relation to
> https://issues.apache.org/jira/browse/BOOKKEEPER-912.
> https://issues.apache.org/jira/browse/BOOKKEEPER-915
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)