questions, about Allocator and subscan

[Lisen Mu <im...@gmail.com>]

Hi,

since I missed the last 2 opportunities to ask in hangout, and likely to
miss more in the near future, I would like to post the questions here:

* I can see in recent submissions about scan/subscan and scan/endpoint
assignment. Is there any document to cover the design considerations of
this part?

* Is there any recommended way to monitor and diagnostic off-heap memory
usage?

Thanks,

Lisen

Re: questions, about Allocator and subscan

[Lisen Mu <im...@gmail.com>]

J,

Thanks for the reply. I don't have much thought on memory management yet
either. I'll see what I can do.




On Tue, Aug 27, 2013 at 11:35 AM, Jacques Nadeau <ja...@apache.org> wrote:

> Good questions...
>
>
> * I can see in recent submissions about scan/subscan and scan/endpoint
> assignment. Is there any document to cover the design considerations of
> this part?
>
> -- Not really, we need to put something together.  We'll try to get on that
> in the next week or two.
>
> * Is there any recommended way to monitor and diagnostic off-heap memory
> usage?
> -- There aren't a lot of tools yet.  We need to add the sub allocators per
> query which would then at least allow us to know allocation per segment.  I
> think we're pushing new territory in general with our memory management
> approach within Java so any ideas of how to manage better would be much
> appreciated.
>
> j
>
>
>
> On Mon, Aug 26, 2013 at 1:11 AM, Lisen Mu <im...@gmail.com> wrote:
>
> > Hi,
> >
> > since I missed the last 2 opportunities to ask in hangout, and likely to
> > miss more in the near future, I would like to post the questions here:
> >
> > * I can see in recent submissions about scan/subscan and scan/endpoint
> > assignment. Is there any document to cover the design considerations of
> > this part?
> >
> > * Is there any recommended way to monitor and diagnostic off-heap memory
> > usage?
> >
> > Thanks,
> >
> > Lisen
> >
>

Re: questions, about Allocator and subscan

[Jacques Nadeau <ja...@apache.org>]

Good questions...


* I can see in recent submissions about scan/subscan and scan/endpoint
assignment. Is there any document to cover the design considerations of
this part?

-- Not really, we need to put something together.  We'll try to get on that
in the next week or two.

* Is there any recommended way to monitor and diagnostic off-heap memory
usage?
-- There aren't a lot of tools yet.  We need to add the sub allocators per
query which would then at least allow us to know allocation per segment.  I
think we're pushing new territory in general with our memory management
approach within Java so any ideas of how to manage better would be much
appreciated.

j



On Mon, Aug 26, 2013 at 1:11 AM, Lisen Mu <im...@gmail.com> wrote:

> Hi,
>
> since I missed the last 2 opportunities to ask in hangout, and likely to
> miss more in the near future, I would like to post the questions here:
>
> * I can see in recent submissions about scan/subscan and scan/endpoint
> assignment. Is there any document to cover the design considerations of
> this part?
>
> * Is there any recommended way to monitor and diagnostic off-heap memory
> usage?
>
> Thanks,
>
> Lisen
>