You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2023/02/22 23:29:54 UTC
[GitHub] [pulsar] Apurva007 created a discussion: Bookkeeper Storage recommendations
GitHub user Apurva007 created a discussion: Bookkeeper Storage recommendations
Hello,
My team is currently exploring Apache Pulsar. We had a few questions on the storage configuration of the bookkeeper.
1. What is the recommended storage ratio of journal to the ledger disks? We have 6 ledger SSD SATA disks of 7.5 TB each available. We were wondering how much journal storage(NVMe) would be required?
2. Which file system is recommended for Pulsar? Kafka recommends utilizing xfs filesystem. Was wondering if its the same for pulsar as well?
Any help would be highly appreciated.
GitHub link: https://github.com/apache/pulsar/discussions/19606
----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org
[GitHub] [pulsar] hangc0276 added a comment to the discussion: Bookkeeper Storage recommendations
Posted by GitBox <gi...@apache.org>.
GitHub user hangc0276 added a comment to the discussion: Bookkeeper Storage recommendations
> What is the recommended storage ratio of journal to the ledger disks? We have 6 ledger SSD SATA disks of 7.5 TB each available. We were wondering how much journal storage(NVMe) would be required?
The journal disk doesn't have the storage size requirement, maybe 100GB is enough. You need to ensure the journal throughput can match with your 6 ledger SSD throughput.
> Which file system is recommended for Pulsar? Kafka recommends utilizing xfs filesystem. Was wondering if its the same for pulsar as well?
Both XFS and ext4 can be good options to use with Apache Bookkeeper. If performance is a top priority and you have large segments and high-throughput workloads, XFS may be the better choice. If reliability and stability are more important, then ext4 may be the better choice.
GitHub link: https://github.com/apache/pulsar/discussions/19606#discussioncomment-5737468
----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org
[GitHub] [pulsar] Apurva007 added a comment to the discussion: Bookkeeper Storage recommendations
Posted by GitBox <gi...@apache.org>.
GitHub user Apurva007 added a comment to the discussion: Bookkeeper Storage recommendations
@hangc0276 Great! thanks for helping with the answer! 😄
GitHub link: https://github.com/apache/pulsar/discussions/19606#discussioncomment-5738485
----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org