You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucenenet.apache.org by Guido Tagliavini Ponce <t-...@microsoft.com> on 2015/01/30 03:20:26 UTC

People working on core's tests

Hi devs,

For the ones that don't remember, I'm part of a Microsoft's team working on Lucene.Net core's tests. We'd like to know if there is somebody else working on them and, if so, on which ones.

Having a reliable version of Lucene.Net is our core priority. So if anyone wants to contribute to the project, any help on fixing these bugs will be very appreciated!

Best regards,

Guido

Re: People working on core's tests

Posted by Itamar Syn-Hershko <it...@code972.com>.
Hi Guido - that sounds like a plan

I'll be working on tests and more porting sporadically during the next 2
weeks. I'll probably not step on anyone's toes, but just to be on the safe
side - please make sure you submit isolated PRs for fixes as soon as you
have them ready. I'll make sure to merge them asap.

Cheers,

--

Itamar Syn-Hershko
http://code972.com | @synhershko <https://twitter.com/synhershko>
Freelance Developer & Consultant
Lucene.NET committer and PMC member

On Fri, Jan 30, 2015 at 8:34 PM, Guido Tagliavini Ponce <
t-gupon@microsoft.com> wrote:

> It's good to hear we are on the same track, Laimonas! Hope you fix that
> one soon.
>
> A couple of days ago, I finished with a bug in Lucene.Net.Store, and there
> are a couple left there, so those are the ones I'm going to work on next.
> I'll also tell via this list every new group of tests I move on to.
>
> Any other one working on the tests?
>
> Guido
>
> -----Original Message-----
> From: Laimonas Simutis [mailto:laimis@gmail.com]
> Sent: Thursday, January 29, 2015 6:58 PM
> To: dev@lucenenet.apache.org
> Subject: Re: People working on core's tests
>
> Guido,
>
> I am one of the devs working on them. My focus has been on the tests that
> you can find in Lucene.Net.Codecs.Lucene4x namespaces. Each version of
> codec implementation had a lot of failures but it is down to ~20 failing
> tests across the board. The progress has been impeded a bit by
> LogByteSizeMergePolicy issue which you can read all about in the mailing
> list, as well as here: https://github.com/apache/lucenenet/pull/63. That
> is what I am looking at next: why does LogByteSizeMergePolicy results in
> never ending merges.
>
> Once I am finished with LogByteSizeMergePolicy fix (I hope I find the
> culprit!), not sure what I will tackle next. I usually do a couple of full
> test runs locally, gather logs to identify the next area that has a lot of
> failures and just go at it. I will make sure to announce on the list when I
> do and will keep an eye on for the activity of others.
>
>
> Laimonas
>
>
> On Thu, Jan 29, 2015 at 9:20 PM, Guido Tagliavini Ponce <
> t-gupon@microsoft.com> wrote:
>
> > Hi devs,
> >
> > For the ones that don't remember, I'm part of a Microsoft's team
> > working on Lucene.Net core's tests. We'd like to know if there is
> > somebody else working on them and, if so, on which ones.
> >
> > Having a reliable version of Lucene.Net is our core priority. So if
> > anyone wants to contribute to the project, any help on fixing these
> > bugs will be very appreciated!
> >
> > Best regards,
> >
> > Guido
> >
>

RE: People working on core's tests

Posted by Guido Tagliavini Ponce <t-...@microsoft.com>.
It's good to hear we are on the same track, Laimonas! Hope you fix that one soon.

A couple of days ago, I finished with a bug in Lucene.Net.Store, and there are a couple left there, so those are the ones I'm going to work on next. I'll also tell via this list every new group of tests I move on to.

Any other one working on the tests?

Guido

-----Original Message-----
From: Laimonas Simutis [mailto:laimis@gmail.com] 
Sent: Thursday, January 29, 2015 6:58 PM
To: dev@lucenenet.apache.org
Subject: Re: People working on core's tests

Guido,

I am one of the devs working on them. My focus has been on the tests that you can find in Lucene.Net.Codecs.Lucene4x namespaces. Each version of codec implementation had a lot of failures but it is down to ~20 failing tests across the board. The progress has been impeded a bit by LogByteSizeMergePolicy issue which you can read all about in the mailing list, as well as here: https://github.com/apache/lucenenet/pull/63. That is what I am looking at next: why does LogByteSizeMergePolicy results in never ending merges.

Once I am finished with LogByteSizeMergePolicy fix (I hope I find the culprit!), not sure what I will tackle next. I usually do a couple of full test runs locally, gather logs to identify the next area that has a lot of failures and just go at it. I will make sure to announce on the list when I do and will keep an eye on for the activity of others.


Laimonas


On Thu, Jan 29, 2015 at 9:20 PM, Guido Tagliavini Ponce < t-gupon@microsoft.com> wrote:

> Hi devs,
>
> For the ones that don't remember, I'm part of a Microsoft's team 
> working on Lucene.Net core's tests. We'd like to know if there is 
> somebody else working on them and, if so, on which ones.
>
> Having a reliable version of Lucene.Net is our core priority. So if 
> anyone wants to contribute to the project, any help on fixing these 
> bugs will be very appreciated!
>
> Best regards,
>
> Guido
>

Re: People working on core's tests

Posted by Laimonas Simutis <la...@gmail.com>.
Guido,

I am one of the devs working on them. My focus has been on the tests that
you can find in Lucene.Net.Codecs.Lucene4x namespaces. Each version of
codec implementation had a lot of failures but it is down to ~20 failing
tests across the board. The progress has been impeded a bit by
LogByteSizeMergePolicy issue which you can read all about in the mailing
list, as well as here: https://github.com/apache/lucenenet/pull/63. That is
what I am looking at next: why does LogByteSizeMergePolicy results in never
ending merges.

Once I am finished with LogByteSizeMergePolicy fix (I hope I find the
culprit!), not sure what I will tackle next. I usually do a couple of full
test runs locally, gather logs to identify the next area that has a lot of
failures and just go at it. I will make sure to announce on the list when I
do and will keep an eye on for the activity of others.


Laimonas


On Thu, Jan 29, 2015 at 9:20 PM, Guido Tagliavini Ponce <
t-gupon@microsoft.com> wrote:

> Hi devs,
>
> For the ones that don't remember, I'm part of a Microsoft's team working
> on Lucene.Net core's tests. We'd like to know if there is somebody else
> working on them and, if so, on which ones.
>
> Having a reliable version of Lucene.Net is our core priority. So if anyone
> wants to contribute to the project, any help on fixing these bugs will be
> very appreciated!
>
> Best regards,
>
> Guido
>

Re: People working on core's tests

Posted by Itamar Syn-Hershko <it...@code972.com>.
Hi Chris, thanks for the late intro email :)

We are happy to have you on board. Just so you know, I have been in contact
with MS Open Tech to try and get some help from them. If you want to try
and push that angle a bit more, you are more than welcome.

Lucene.NET core, if you ignore the codecs part (which maybe you could), is
almost ready for stability testing. If you focus on the non-codec tests,
that should get us there quickly. Then you may find some subprojects
contain more stuff that you need (like the Analysis part), and most
sub-project haven't been ported completely yet.

For what's it worth, I'm trying to find ways to allow myself to dedicate
more time on this project. Being a freelancer its a bit challenging to
dedicate full days and weeks on an OSS project. I posted about this here:
http://code972.com/blog/2015/01/79-lucene-nets-new-future-and-status-update
and will probably go and actively look for sponsors soon.

--

Itamar Syn-Hershko
http://code972.com | @synhershko <https://twitter.com/synhershko>
Freelance Developer & Consultant
Lucene.NET committer and PMC member

On Sat, Jan 31, 2015 at 3:16 AM, Chris Anderson (OSG) <ch...@microsoft.com>
wrote:

> Hello
>
> Guido already knows me (he is just down the hall from my office) but I
> wanted to take this time to introduce myself a bit and explain why we are
> reaching out to people.
>
> We have a fairly tight deadline to migrate our older outdated version of
> Lucene to this latest and greatest version. Our production servers host
> billions of documents and there are many teams that rely on this every day.
> Fortunately for us, more partners are onboarding and pushing more data into
> our index. Unfortunately things are slowing down and this makes our
> customers unhappy. Our hope is that the new version will have enough perf
> improvements for us to slow the relentless tide of data. Any help on
> tracking down these bugs would be greatly appreciated.
>
> For me, I have been working at Microsoft now for 20 years, 7 of them on
> Bing search. Most recently I worked with a very small team to grow the Bing
> index by nearly 10x. It was a very challenging and fun project and I hope
> to bring some of my learnings to contribute into Lucene.
>
> Thanks
> Chris
>
> -----Original Message-----
> From: Guido Tagliavini Ponce [mailto:t-gupon@microsoft.com]
> Sent: Thursday, January 29, 2015 6:20 PM
> To: dev@lucenenet.apache.org
> Subject: People working on core's tests
>
> Hi devs,
>
> For the ones that don't remember, I'm part of a Microsoft's team working
> on Lucene.Net core's tests. We'd like to know if there is somebody else
> working on them and, if so, on which ones.
>
> Having a reliable version of Lucene.Net is our core priority. So if anyone
> wants to contribute to the project, any help on fixing these bugs will be
> very appreciated!
>
> Best regards,
>
> Guido
>

RE: People working on core's tests

Posted by "Chris Anderson (OSG)" <ch...@microsoft.com>.
Hello

Guido already knows me (he is just down the hall from my office) but I wanted to take this time to introduce myself a bit and explain why we are reaching out to people.

We have a fairly tight deadline to migrate our older outdated version of Lucene to this latest and greatest version. Our production servers host billions of documents and there are many teams that rely on this every day. Fortunately for us, more partners are onboarding and pushing more data into our index. Unfortunately things are slowing down and this makes our customers unhappy. Our hope is that the new version will have enough perf improvements for us to slow the relentless tide of data. Any help on tracking down these bugs would be greatly appreciated.

For me, I have been working at Microsoft now for 20 years, 7 of them on Bing search. Most recently I worked with a very small team to grow the Bing index by nearly 10x. It was a very challenging and fun project and I hope to bring some of my learnings to contribute into Lucene.

Thanks
Chris

-----Original Message-----
From: Guido Tagliavini Ponce [mailto:t-gupon@microsoft.com] 
Sent: Thursday, January 29, 2015 6:20 PM
To: dev@lucenenet.apache.org
Subject: People working on core's tests

Hi devs,

For the ones that don't remember, I'm part of a Microsoft's team working on Lucene.Net core's tests. We'd like to know if there is somebody else working on them and, if so, on which ones.

Having a reliable version of Lucene.Net is our core priority. So if anyone wants to contribute to the project, any help on fixing these bugs will be very appreciated!

Best regards,

Guido