You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@directmemory.apache.org by Tommaso Teofili <to...@gmail.com> on 2011/12/27 09:49:43 UTC
examples module and Solr DM based cache
Hi all,
yesterday I night I checked in the first few lines of the examples module,
a first very basic version of Solr cache using DM is there, feel free to
extend / improve it. Also it'd be nice if we have other examples to add to
the module.
Have happy holidays and a wonderful day.
Tommaso
Re: examples module and Solr DM based cache
Posted by "Raffaele P. Guidi" <ra...@gmail.com>.
And the team is on the right track! :)
Il giorno 29/dic/2011 17:53, "Benoit Perroud" <be...@noisette.ch> ha
scritto:
> It seems that off-heap caching is the next battle for performance
> tuning on a JVM. DirectMemory project is right on time !
>
>
> 2011/12/29 Tommaso Teofili <to...@gmail.com>:
> > thanks a lot, I will take a look :)
> > Tommaso
> >
> > 2011/12/29 Ashish <pa...@gmail.com>
> >
> >> https://issues.apache.org/jira/browse/LUCENE-3659
> >> https://issues.apache.org/jira/browse/LUCENE-2292
> >>
> >> Not sure if they are planning this, but if they are, then our
> >> implementation would fit for the use.
> >>
> >> Also found this thread related to HBase, seems like everyone needs this
> :)
> >>
> >>
> >>
> http://grokbase.com/t/hbase.apache.org/dev/2011/08/hbase-user-group-meeting-off-heap-caching-slides/23ip3aowyhw4twzd5vvwzvnedk7a
> >>
> >>
> >>
> >> On Thu, Dec 29, 2011 at 7:48 PM, Tommaso Teofili
> >> <to...@gmail.com> wrote:
> >> > Sure guys, just I'm on holidays right now so I couldn't be able to
> write
> >> it
> >> > till the second week of January.
> >> > I didn't know the Lucene community is working at an off-heap directory
> >> > storage but it could be definitely better to join them on that.
> >> > Ashish, could you please provide pointers (links, Jira issues, etc) ?
> >> > Cheers.
> >> > Tommaso
> >> >
> >> > 2011/12/29 Ashish <pa...@gmail.com>
> >> >
> >> >> On Wed, Dec 28, 2011 at 4:55 PM, Raffaele P. Guidi
> >> >> <ra...@gmail.com> wrote:
> >> >> > ....and, Tommaso, why don't you put together a blog entry about the
> >> SolR
> >> >> > integration? It probably would be quite interesting to both the
> >> >> SolR/lucene
> >> >> > community and ours. I would be quite pleased to help, If I can.
> >> >> >
> >> >> > Ciao,
> >> >> > R
> >> >>
> >> >> another interesting use case would be, using the DM Memory Manager
> for
> >> >> allocating off-heap memory for RAM Directory.
> >> >> Not very sure, but Lucene community is also working on providing an
> >> >> offheap directory storage in trunk. Probably could be a reuse here.
> >> >>
> >> >> cheers
> >> >> ashish
> >> >>
> >>
> >>
> >>
> >> --
> >> thanks
> >> ashish
> >>
> >> Blog: http://www.ashishpaliwal.com/blog
> >> My Photo Galleries: http://www.pbase.com/ashishpaliwal
> >>
>
>
>
> --
> sent from my Nokia 3210
>
Re: examples module and Solr DM based cache
Posted by Benoit Perroud <be...@noisette.ch>.
It seems that off-heap caching is the next battle for performance
tuning on a JVM. DirectMemory project is right on time !
2011/12/29 Tommaso Teofili <to...@gmail.com>:
> thanks a lot, I will take a look :)
> Tommaso
>
> 2011/12/29 Ashish <pa...@gmail.com>
>
>> https://issues.apache.org/jira/browse/LUCENE-3659
>> https://issues.apache.org/jira/browse/LUCENE-2292
>>
>> Not sure if they are planning this, but if they are, then our
>> implementation would fit for the use.
>>
>> Also found this thread related to HBase, seems like everyone needs this :)
>>
>>
>> http://grokbase.com/t/hbase.apache.org/dev/2011/08/hbase-user-group-meeting-off-heap-caching-slides/23ip3aowyhw4twzd5vvwzvnedk7a
>>
>>
>>
>> On Thu, Dec 29, 2011 at 7:48 PM, Tommaso Teofili
>> <to...@gmail.com> wrote:
>> > Sure guys, just I'm on holidays right now so I couldn't be able to write
>> it
>> > till the second week of January.
>> > I didn't know the Lucene community is working at an off-heap directory
>> > storage but it could be definitely better to join them on that.
>> > Ashish, could you please provide pointers (links, Jira issues, etc) ?
>> > Cheers.
>> > Tommaso
>> >
>> > 2011/12/29 Ashish <pa...@gmail.com>
>> >
>> >> On Wed, Dec 28, 2011 at 4:55 PM, Raffaele P. Guidi
>> >> <ra...@gmail.com> wrote:
>> >> > ....and, Tommaso, why don't you put together a blog entry about the
>> SolR
>> >> > integration? It probably would be quite interesting to both the
>> >> SolR/lucene
>> >> > community and ours. I would be quite pleased to help, If I can.
>> >> >
>> >> > Ciao,
>> >> > R
>> >>
>> >> another interesting use case would be, using the DM Memory Manager for
>> >> allocating off-heap memory for RAM Directory.
>> >> Not very sure, but Lucene community is also working on providing an
>> >> offheap directory storage in trunk. Probably could be a reuse here.
>> >>
>> >> cheers
>> >> ashish
>> >>
>>
>>
>>
>> --
>> thanks
>> ashish
>>
>> Blog: http://www.ashishpaliwal.com/blog
>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>>
--
sent from my Nokia 3210
Re: examples module and Solr DM based cache
Posted by Tommaso Teofili <to...@gmail.com>.
thanks a lot, I will take a look :)
Tommaso
2011/12/29 Ashish <pa...@gmail.com>
> https://issues.apache.org/jira/browse/LUCENE-3659
> https://issues.apache.org/jira/browse/LUCENE-2292
>
> Not sure if they are planning this, but if they are, then our
> implementation would fit for the use.
>
> Also found this thread related to HBase, seems like everyone needs this :)
>
>
> http://grokbase.com/t/hbase.apache.org/dev/2011/08/hbase-user-group-meeting-off-heap-caching-slides/23ip3aowyhw4twzd5vvwzvnedk7a
>
>
>
> On Thu, Dec 29, 2011 at 7:48 PM, Tommaso Teofili
> <to...@gmail.com> wrote:
> > Sure guys, just I'm on holidays right now so I couldn't be able to write
> it
> > till the second week of January.
> > I didn't know the Lucene community is working at an off-heap directory
> > storage but it could be definitely better to join them on that.
> > Ashish, could you please provide pointers (links, Jira issues, etc) ?
> > Cheers.
> > Tommaso
> >
> > 2011/12/29 Ashish <pa...@gmail.com>
> >
> >> On Wed, Dec 28, 2011 at 4:55 PM, Raffaele P. Guidi
> >> <ra...@gmail.com> wrote:
> >> > ....and, Tommaso, why don't you put together a blog entry about the
> SolR
> >> > integration? It probably would be quite interesting to both the
> >> SolR/lucene
> >> > community and ours. I would be quite pleased to help, If I can.
> >> >
> >> > Ciao,
> >> > R
> >>
> >> another interesting use case would be, using the DM Memory Manager for
> >> allocating off-heap memory for RAM Directory.
> >> Not very sure, but Lucene community is also working on providing an
> >> offheap directory storage in trunk. Probably could be a reuse here.
> >>
> >> cheers
> >> ashish
> >>
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>
Re: examples module and Solr DM based cache
Posted by Ashish <pa...@gmail.com>.
https://issues.apache.org/jira/browse/LUCENE-3659
https://issues.apache.org/jira/browse/LUCENE-2292
Not sure if they are planning this, but if they are, then our
implementation would fit for the use.
Also found this thread related to HBase, seems like everyone needs this :)
http://grokbase.com/t/hbase.apache.org/dev/2011/08/hbase-user-group-meeting-off-heap-caching-slides/23ip3aowyhw4twzd5vvwzvnedk7a
On Thu, Dec 29, 2011 at 7:48 PM, Tommaso Teofili
<to...@gmail.com> wrote:
> Sure guys, just I'm on holidays right now so I couldn't be able to write it
> till the second week of January.
> I didn't know the Lucene community is working at an off-heap directory
> storage but it could be definitely better to join them on that.
> Ashish, could you please provide pointers (links, Jira issues, etc) ?
> Cheers.
> Tommaso
>
> 2011/12/29 Ashish <pa...@gmail.com>
>
>> On Wed, Dec 28, 2011 at 4:55 PM, Raffaele P. Guidi
>> <ra...@gmail.com> wrote:
>> > ....and, Tommaso, why don't you put together a blog entry about the SolR
>> > integration? It probably would be quite interesting to both the
>> SolR/lucene
>> > community and ours. I would be quite pleased to help, If I can.
>> >
>> > Ciao,
>> > R
>>
>> another interesting use case would be, using the DM Memory Manager for
>> allocating off-heap memory for RAM Directory.
>> Not very sure, but Lucene community is also working on providing an
>> offheap directory storage in trunk. Probably could be a reuse here.
>>
>> cheers
>> ashish
>>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
Re: examples module and Solr DM based cache
Posted by Tommaso Teofili <to...@gmail.com>.
Sure guys, just I'm on holidays right now so I couldn't be able to write it
till the second week of January.
I didn't know the Lucene community is working at an off-heap directory
storage but it could be definitely better to join them on that.
Ashish, could you please provide pointers (links, Jira issues, etc) ?
Cheers.
Tommaso
2011/12/29 Ashish <pa...@gmail.com>
> On Wed, Dec 28, 2011 at 4:55 PM, Raffaele P. Guidi
> <ra...@gmail.com> wrote:
> > ....and, Tommaso, why don't you put together a blog entry about the SolR
> > integration? It probably would be quite interesting to both the
> SolR/lucene
> > community and ours. I would be quite pleased to help, If I can.
> >
> > Ciao,
> > R
>
> another interesting use case would be, using the DM Memory Manager for
> allocating off-heap memory for RAM Directory.
> Not very sure, but Lucene community is also working on providing an
> offheap directory storage in trunk. Probably could be a reuse here.
>
> cheers
> ashish
>
Re: examples module and Solr DM based cache
Posted by Ashish <pa...@gmail.com>.
On Wed, Dec 28, 2011 at 4:55 PM, Raffaele P. Guidi
<ra...@gmail.com> wrote:
> ....and, Tommaso, why don't you put together a blog entry about the SolR
> integration? It probably would be quite interesting to both the SolR/lucene
> community and ours. I would be quite pleased to help, If I can.
>
> Ciao,
> R
another interesting use case would be, using the DM Memory Manager for
allocating off-heap memory for RAM Directory.
Not very sure, but Lucene community is also working on providing an
offheap directory storage in trunk. Probably could be a reuse here.
cheers
ashish
Re: examples module and Solr DM based cache
Posted by "Raffaele P. Guidi" <ra...@gmail.com>.
....and, Tommaso, why don't you put together a blog entry about the SolR
integration? It probably would be quite interesting to both the SolR/lucene
community and ours. I would be quite pleased to help, If I can.
Ciao,
R
On Tue, Dec 27, 2011 at 10:02 AM, Raffaele P. Guidi <
raffaele.p.guidi@gmail.com> wrote:
> very good news, and the Sole example bis really a surprise. Thank you and
> happy happy holidays to you
>
> Ciao,
> R
>
> Il giorno 27/dic/2011 09:50, "Tommaso Teofili" <to...@gmail.com>
> ha scritto:
>
> >
> > Hi all,
> > yesterday I night I checked in the first few lines of the examples
> module,
> > a first very basic version of Solr cache using DM is there, feel free to
> > extend / improve it. Also it'd be nice if we have other examples to add
> to
> > the module.
> > Have happy holidays and a wonderful day.
> > Tommaso
>
>
Re: examples module and Solr DM based cache
Posted by "Raffaele P. Guidi" <ra...@gmail.com>.
very good news, and the Sole example bis really a surprise. Thank you and
happy happy holidays to you
Ciao,
R
Il giorno 27/dic/2011 09:50, "Tommaso Teofili" <to...@gmail.com>
ha scritto:
>
> Hi all,
> yesterday I night I checked in the first few lines of the examples module,
> a first very basic version of Solr cache using DM is there, feel free to
> extend / improve it. Also it'd be nice if we have other examples to add to
> the module.
> Have happy holidays and a wonderful day.
> Tommaso