required limits for DocumentStore

[Julian Reschke <ju...@gmx.de>]

Hi there,

it would be awesome if we could document what the expectations with 
respect to:

- key lengths

and

- document sizes

are. MongoDB seems to have a 1K (?) limit on keys, and a 16M limit on 
documents.

Does every DS implementation need to support the same?

Best regards, Julian

Re: required limits for DocumentStore

[Julian Reschke <ju...@gmx.de>]

On 2014-03-24 16:16, Thomas Mueller wrote:
> Hi,
>
> In theory, what we could do is let the DocumentStore decide the limits.
> This is what we do for the BlobStore for example. So we could add two
> methods: getMaxKeySize, getMaxDocumentSize.

What would the user of the DocumentStore do if the limits are too low?

I believe there are two questions here: a) document the minimum the 
store needs to support, b) allow a caller to take advantage of higher 
limits.

a) is essential. b) is a nice-to-have, with the added risk of things 
being harder to predict/test.

> For getMaxKeySize, we could say it's "the number of bytes of the UTF-8
> representation of the key".
>
> For getMaxDocumentSize, the problem is, the size depends on the storage
> format. I don't how we could solve that. Maybe some "worst case"
> formatting, for example the number of bytes of the toString representation
> of the document, converted to UTF-8?
>
> Regards,
> Thomas

Best regards, Julian

Re: required limits for DocumentStore

[Thomas Mueller <mu...@adobe.com>]

Hi,

In theory, what we could do is let the DocumentStore decide the limits.
This is what we do for the BlobStore for example. So we could add two
methods: getMaxKeySize, getMaxDocumentSize.

For getMaxKeySize, we could say it's "the number of bytes of the UTF-8
representation of the key".

For getMaxDocumentSize, the problem is, the size depends on the storage
format. I don't how we could solve that. Maybe some "worst case"
formatting, for example the number of bytes of the toString representation
of the document, converted to UTF-8?

Regards,
Thomas


On 24/03/14 14:32, "Julian Reschke" <ju...@gmx.de> wrote:

>Hi there,
>
>it would be awesome if we could document what the expectations with
>respect to:
>
>- key lengths
>
>and
>
>- document sizes
>
>are. MongoDB seems to have a 1K (?) limit on keys, and a 16M limit on
>documents.
>
>Does every DS implementation need to support the same?
>
>Best regards, Julian