Commit taking very long

[Rohit Gupta <ro...@in-rev.com>]

Hi,

My commit seems to be taking too much time, if you notice from the Dataimport 
status given below to commit 1000 docs its taking longer than 24 minutes

</lst>
<str name="status">busy</str>
<str name="importResponse">A command is still running...</str>
−
<lst name="statusMessages">
<str name="Time Elapsed">0:24:43.156</str>
<str name="Total Requests made to DataSource">1001</str>
<str name="Total Rows Fetched">1658</str>
<str name="Total Documents Skipped">0</str>
<str name="Full Dump Started">2011-06-07 09:15:17</str>
−
<str name="">
Indexing completed. Added/Updated: 1000 documents. Deleted 0 documents.
</str>
</lst>

What can be causing this, I have tried looking for a reason or a way to improve 
this, but am just not able to find. At this rate my documents would never get 
indexed, given that I have more than 100,000 records coming into the database 
every hour.

Regards,
Rohit

Re: Commit taking very long

[Erick Erickson <er...@gmail.com>]

Are you optimizing? That is unnecessary when committing, and is often the
culprit.


Best
Erick

On Tue, Jun 7, 2011 at 5:42 AM, Rohit Gupta <ro...@in-rev.com> wrote:
> Hi,
>
> My commit seems to be taking too much time, if you notice from the Dataimport
> status given below to commit 1000 docs its taking longer than 24 minutes
>
> </lst>
> <str name="status">busy</str>
> <str name="importResponse">A command is still running...</str>
> -
> <lst name="statusMessages">
> <str name="Time Elapsed">0:24:43.156</str>
> <str name="Total Requests made to DataSource">1001</str>
> <str name="Total Rows Fetched">1658</str>
> <str name="Total Documents Skipped">0</str>
> <str name="Full Dump Started">2011-06-07 09:15:17</str>
> -
> <str name="">
> Indexing completed. Added/Updated: 1000 documents. Deleted 0 documents.
> </str>
> </lst>
>
> What can be causing this, I have tried looking for a reason or a way to improve
> this, but am just not able to find. At this rate my documents would never get
> indexed, given that I have more than 100,000 records coming into the database
> every hour.
>
> Regards,
> Rohit