You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by GitBox <gi...@apache.org> on 2022/10/05 20:58:33 UTC
[GitHub] [couchdb] ornotnull opened a new issue, #4196: The database with q = 1024
ornotnull opened a new issue, #4196:
URL: https://github.com/apache/couchdb/issues/4196
Trying to create a database with q = 1024 and n = 1.
Is this supported? Any limitation for q?
<0.7629.0> cd536cbb12 req_err(1645417114) unknown_error : badarith
[<<"math:pow/2">>,<<"fabric_util:get_db_timeout/4 L160">>,<<"fabric_util:get_db/2 L114">>,<<"fabric:get_security/2 L183">>,<<"chttpd_auth_request:db_authorization_check/1 L112">>,<<"chttpd_auth_request:authorize_request/1 L19">>,<<"chttpd:handle_req_after_auth/2 L325">>,<<"chttpd:process_request/1 L310">>]
the error is produced by line 160 of src/fabric/src/fabric_util.erl
math:pow(Factor, N + 1)
and do not see a way to avoid this
Factor is not less then 2 by 111 line
Factor = max(2, config:get_integer("fabric", "shard_timeout_factor", 2))
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva commented on issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
nickva commented on issue #4196:
URL: https://github.com/apache/couchdb/issues/4196#issuecomment-1269159277
A q factor is 1024 is probably not practical. The default is 2 and I even it the larger clusters I don't recall seeing anything larger than 256.
What are you trying to do?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva commented on issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
nickva commented on issue #4196:
URL: https://github.com/apache/couchdb/issues/4196#issuecomment-1270169524
@ornotnull thanks for reaching out and reporting the bug. Here is a PR that should fix it https://github.com/apache/couchdb/issues/4196
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] ornotnull commented on issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
ornotnull commented on issue #4196:
URL: https://github.com/apache/couchdb/issues/4196#issuecomment-1269417483
OK. Now just testing the database of size about 10Tb
and follow the recommendation to keep a shard within 10Gb
https://neighbourhood.ie/blog/2020/09/22/sharding-choosing-the-right-q-value/
So the test database is q = 1024 and n = 2 but now only able to go with q = 256, n = 2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva commented on issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
nickva commented on issue #4196:
URL: https://github.com/apache/couchdb/issues/4196#issuecomment-1270133136
@ornotnull you can still go as high as 1022 or so (the highest limit is 1023 and there is a +1 so max q would be about 1022). But even with a 10TB I would stick with a smaller sharding factor.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] big-r81 commented on issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
big-r81 commented on issue #4196:
URL: https://github.com/apache/couchdb/issues/4196#issuecomment-1269527417
Hi,
what @nickva says, but I can reproduce this, See for more error messages: https://gist.github.com/big-r81/d244a22c36820c165ed63a105d6a092b
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva closed issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
nickva closed issue #4196: The database with q = 1024
URL: https://github.com/apache/couchdb/issues/4196
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] ornotnull commented on issue #4196: The database with q = 1024
Posted by GitBox <gi...@apache.org>.
ornotnull commented on issue #4196:
URL: https://github.com/apache/couchdb/issues/4196#issuecomment-1271124784
@nickva, thank you a lot
able to compile the new 3.2.2-228b07e version and no issue any more
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org