You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by Karl Wright <da...@gmail.com> on 2014/11/03 10:08:46 UTC

Should we have a 1.7.2 release to address CONNECTORS-1090 and CONNECTORS-1091?

Together, these two tickets make for a severe problem with scaling.  Not
only does it impact performance for people crawling large data sets, but it
also means that document scheduling is broken for jobs that are run a
second time, or are paused, or when the agents process is restarted.

Karl

Re: Should we have a 1.7.2 release to address CONNECTORS-1090 and CONNECTORS-1091?

Posted by Karl Wright <da...@gmail.com>.
CONNECTORS-1093 also would seem appropriate to include.

I've now run several load tests, including a revised filesystem load test
that does two crawls, one after the other.  Postgresql and MySQL perform
great on this task.  I saw some oddness with HSQLDB doing a similar task
(basically, it got itself into a state where its performance was truly
awful), but that might have been due to memory issues.  I'm trying again
with the official test now.

If all goes well, I will create an RC0 this evening.  Hopefully our loyal
base of committers will be willing to sign off on it. ;-)

Karl


On Mon, Nov 3, 2014 at 12:19 PM, Karl Wright <da...@gmail.com> wrote:

> I've updated the release-1.7-branch to include the tickets that I think
> MUST go into a release 1.7.2.  If you want to build it, please go ahead and
> check out
> https://svn.apache.org/repos/asf/manifoldcf/branches/release-1.7-branch .
>
> Thanks,
> Karl
>
>
> On Mon, Nov 3, 2014 at 9:42 AM, Aeham Abushwashi <
> aeham.abushwashi@exonar.com> wrote:
>
>> ​That would get my vote!
>>
>
>

Re: Should we have a 1.7.2 release to address CONNECTORS-1090 and CONNECTORS-1091?

Posted by Karl Wright <da...@gmail.com>.
I've updated the release-1.7-branch to include the tickets that I think
MUST go into a release 1.7.2.  If you want to build it, please go ahead and
check out
https://svn.apache.org/repos/asf/manifoldcf/branches/release-1.7-branch .

Thanks,
Karl


On Mon, Nov 3, 2014 at 9:42 AM, Aeham Abushwashi <
aeham.abushwashi@exonar.com> wrote:

> ​That would get my vote!
>

Re: Should we have a 1.7.2 release to address CONNECTORS-1090 and CONNECTORS-1091?

Posted by Aeham Abushwashi <ae...@exonar.com>.
​That would get my vote!