You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@asterixdb.apache.org by Steven Jacobs <sj...@ucr.edu> on 2018/04/04 17:32:46 UTC

Great LSM Ingestion news!

Just wanted to share for anyone who wanted positive news today. Two of
Chen's recent changes:
https://asterix-gerrit.ics.uci.edu/#/c/2560/
https://asterix-gerrit.ics.uci.edu/#/c/2553/

will have a huge impact on write performance. I have a query that ends up
writing about 40,000 records, and the time was reduced from 5 seconds down
to less than a second just by incorporating these changes!

Thank you Chen! May the odds be ever in your favor!

Steven

Re: Great LSM Ingestion news!

Posted by Chen Luo <cl...@uci.edu>.
Thanks Steven! BTW, as your dataset gets larger, each insert might become
more and more expensive. This patch
https://asterix-gerrit.ics.uci.edu/#/c/2453/ can help once you encounter
that problem...

On Wed, Apr 4, 2018 at 11:27 AM, Mike Carey <dt...@gmail.com> wrote:

> Nice!!!
>
>
>
> On 4/4/18 10:32 AM, Steven Jacobs wrote:
>
>> Just wanted to share for anyone who wanted positive news today. Two of
>> Chen's recent changes:
>> https://asterix-gerrit.ics.uci.edu/#/c/2560/
>> https://asterix-gerrit.ics.uci.edu/#/c/2553/
>>
>> will have a huge impact on write performance. I have a query that ends up
>> writing about 40,000 records, and the time was reduced from 5 seconds down
>> to less than a second just by incorporating these changes!
>>
>> Thank you Chen! May the odds be ever in your favor!
>>
>> Steven
>>
>>
>

Re: Great LSM Ingestion news!

Posted by Mike Carey <dt...@gmail.com>.
Nice!!!


On 4/4/18 10:32 AM, Steven Jacobs wrote:
> Just wanted to share for anyone who wanted positive news today. Two of
> Chen's recent changes:
> https://asterix-gerrit.ics.uci.edu/#/c/2560/
> https://asterix-gerrit.ics.uci.edu/#/c/2553/
>
> will have a huge impact on write performance. I have a query that ends up
> writing about 40,000 records, and the time was reduced from 5 seconds down
> to less than a second just by incorporating these changes!
>
> Thank you Chen! May the odds be ever in your favor!
>
> Steven
>