You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/11/23 13:24:27 UTC
[GitHub] [pulsar] hpvd opened a new issue #8671: doc: hardware recommodations (Cores, RAM, storage) for dev
hpvd opened a new issue #8671:
URL: https://github.com/apache/pulsar/issues/8671
**Is your enhancement request related to a problem? Please describe.**
Would be nice to have some hardware recommodations / name the reqirements also for dev setups (Cores, RAM, storage)
- standalone Pulsar locally https://pulsar.apache.org/docs/en/standalone/
- standalone Pulsar in Docker https://pulsar.apache.org/docs/en/standalone-docker/
- Pulsar with Helm on Kubernetes https://pulsar.apache.org/docs/en/kubernetes-helm/
for production there are already some startingpoints regarding AWS: 3x t2.small + 3x i3.4xlarge
https://pulsar.apache.org/docs/en/deploy-bare-metal/
**Describe the solution you'd like**
some numbers to get an idea: does it make sense/is it possible to start on a grownup dev notebook? How much storage do I have to free up...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #8671:
URL: https://github.com/apache/pulsar/issues/8671#issuecomment-734183536
in general it would be handy to put hardware recommendations for all setup types(not only for dev setups) in form of
- number of cores
- amount of RAM [GB]
- amount of storage [GB]
Of course it helps like already done at https://pulsar.apache.org/docs/en/deploy-bare-metal/
to name the according AWS instances.
But also the "translation" would help for comparison reasons a lot.
In this case:
- for zookeeper: 3x t2.small: 1v CPU 2GB RAM 19USD/month
- for PulsarBroker and Bookkeeper Bokkies: 3x i3Xlarge (io intensive 2017) 4 vCPU, 30GB RAM, 1TB NVME SSD 230USD/month
The sum for this:
15 core, 120 GB RAM, 3TB Storage
= 750USD/month
Price is only shown to complete the picture, of course it changes over time.
But also hardware requirements will change as more features got to implemented and if possible the "cost" of these could be documented if possible - may be in form of this feature cost about roughly 20% on xx.
(thinking of transaction https://github.com/apache/pulsar/issues/8633, https://github.com/apache/pulsar/issues/2664)
https://de.slideshare.net/streamnative/transaction-preview-of-apache-pulsar)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] sijia-w commented on issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
sijia-w commented on issue #8671:
URL: https://github.com/apache/pulsar/issues/8671#issuecomment-899329010
@codelipenghui Any recommendations for the numbers?
From Ran: "We usually give recommendations according to the user requirements in POC, then they run tests in this environment and see what should be changed."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #8671:
URL: https://github.com/apache/pulsar/issues/8671#issuecomment-734183536
in general it would be handy to put hardware recommendations for all setup types (not only for dev setups) in form of
- number of cores
- amount of RAM [GB]
- amount of storage [GB]
Of course it helps like already done at https://pulsar.apache.org/docs/en/deploy-bare-metal/
to name the according AWS instances.
But also the "translation" would help for comparison reasons a lot.
In this case:
- for zookeeper: 3x t2.small: 1v CPU 2GB RAM 19USD/month
- for PulsarBroker and Bookkeeper Bookies: 3x i3Xlarge (io intensive 2017) 4 vCPU, 30GB RAM, 1TB NVME SSD 230USD/month
The sum for this:
15 core, 120 GB RAM, 3TB Storage
= 750USD/month
Price is only shown to complete the picture, of course it changes over time.
But also hardware requirements will change as more features got to implemented and if possible the "cost" of these could be documented if possible - may be in form of this feature cost about roughly +20% of CPU time +10% of RAM on xx.
(thinking e.g. of transaction https://github.com/apache/pulsar/issues/8633, https://github.com/apache/pulsar/issues/2664)
https://de.slideshare.net/streamnative/transaction-preview-of-apache-pulsar)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd commented on issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
hpvd commented on issue #8671:
URL: https://github.com/apache/pulsar/issues/8671#issuecomment-734183536
in general it would be handy to put hardware recommendations for all setup types(not only for dev setups) in form of
- number of cores
- amount of RAM [GB]
- amount of storage [GB]
Of course it helps like already done at https://pulsar.apache.org/docs/en/deploy-bare-metal/
to name the according AWS instances.
But also the "translation" would help for comparison reasons a lot.
In this case:
- for zookeeper: 3x t2.small: 1v CPU 2GB RAM 19USD/month
- for PulsarBroker and Bookkeeper Bokkies: 3x i3Xlarge (io intensive 2017) 4 vCPU, 30GB RAM, 1TB NVME SSD 230USD/month
The sum for this:
15 core, 120 GB RAM, 3TB Storage
= 750USD/month
Price is only shown to complete the picture, of course it changes over time.
But also hardware requirements will change as more features got to implemented and if possible the "cost" of these could be documented if possible - may be in form of this feature cost about roughly 20% on xx.
(thinking of transactionhttps://github.com/apache/pulsar/issues/8633, https://github.com/apache/pulsar/issues/2664)
https://de.slideshare.net/streamnative/transaction-preview-of-apache-pulsar)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] Anonymitaet closed issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
Anonymitaet closed issue #8671:
URL: https://github.com/apache/pulsar/issues/8671
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] Jennifer88huang commented on issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
Jennifer88huang commented on issue #8671:
URL: https://github.com/apache/pulsar/issues/8671#issuecomment-895899484
@sijia-w could you like to investigate and try to fix the issue? Thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #8671: [Doc] hardware recommodations (Cores, RAM, storage) for dev
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #8671:
URL: https://github.com/apache/pulsar/issues/8671#issuecomment-734183536
in general it would be handy to put hardware recommendations for all setup types (not only for dev setups) in form of
- number of cores
- amount of RAM [GB]
- amount of storage [GB]
Of course it helps like already done at https://pulsar.apache.org/docs/en/deploy-bare-metal/
to name the according AWS instances.
But also the "translation" would help for comparison reasons a lot.
In this case:
- for zookeeper: 3x t2.small: 1v CPU 2GB RAM 19USD/month
- for PulsarBroker and Bookkeeper Bookies: 3x i3Xlarge (io intensive 2017) 4 vCPU, 30GB RAM, 1TB NVME SSD 230USD/month
The sum for this:
15 core, 120 GB RAM, 3TB Storage
= 750USD/month
Price is only shown to complete the picture, of course it changes over time.
But also hardware requirements will change as more features got to implemented and if possible the "cost" of these could be documented if possible - may be in form of this feature cost about roughly 20% on xx.
(thinking of transaction https://github.com/apache/pulsar/issues/8633, https://github.com/apache/pulsar/issues/2664)
https://de.slideshare.net/streamnative/transaction-preview-of-apache-pulsar)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org