You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "David Webb (Created) (JIRA)" <ji...@apache.org> on 2011/12/10 19:29:39 UTC

[jira] [Created] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

DIH with threads and TikaEntityProcessor JDBC ISsue
---------------------------------------------------

                 Key: SOLR-2961
                 URL: https://issues.apache.org/jira/browse/SOLR-2961
             Project: Solr
          Issue Type: Bug
          Components: contrib - DataImportHandler
    Affects Versions: 3.5, 3.4
         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
            Reporter: David Webb


I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  


SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
SEVERE: Ignoring Error when closing connection
java.sql.SQLRecoverableException: IO Error: Socket closed
	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
	at java.lang.ref.Finalizer.access$100(Unknown Source)
	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
Caused by: java.net.SocketException: Socket closed
	at java.net.SocketOutputStream.socketWrite(Unknown Source)
	at java.net.SocketOutputStream.write(Unknown Source)
	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
	... 8 more
Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
SEVERE: Exception in entity : null
org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
	... 14 more
Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
SEVERE: Exception in entity : null
org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
	... 14 more
Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
SEVERE: Exception in entity : null



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by Mikhail Khludnev <mk...@griddynamics.com>.
hi,

Pls find jars and patches attached. Pls check and let me know whether it
works for you?
It should fix core multithreading issue (but a really in quick manner). And
ClassCastException as well.

Regards

On Sun, Dec 11, 2011 at 1:30 AM, David T. Webb <da...@brightmove.com>wrote:

>  Mikhail,
>
> I am not building from source, so I am not setup to apply the patch.  Is
> there any way you can provide the patched JAR file for me to use?  That
> would be a real time saver for me.  Thanks for the info.
>
> I had seen your Jira when I was searching for the solution, but it looked
> like it had been commited to the 3.4  branch already.  Thanks for the
> clarification.  Do you need me to +1 any particular jira to help our cause?
>
>
>  Sincerely,
> David Webb, President
> BrightMove, Inc. (www.brightmove.com)
> 320 High Tide Drive
> Suite 101B
> St Augustine Beach, FL 32080
> (904) 861-2396 x6050
>
>
> ------------------------------
> *From:* Mikhail Khludnev [mailto:mkhludnev@griddynamics.com]
> *Sent:* Sat 12/10/2011 2:59 PM
> *To:* dev@lucene.apache.org; David T. Webb; solr-user@lucene.apache.org
> *Subject:* Re: [jira] [Commented] (SOLR-2961) DIH with threads and
> TikaEntityProcessor JDBC ISsue
>
>
>
> On Sat, Dec 10, 2011 at 11:58 PM, Mikhail Khludnev <
> mkhludnev@griddynamics.com> wrote:
>
>> Hello David,
>>
>> I know about DIH thread problems. Some time ago I did quick fix patch for
>> 3.4, which passes tests. If you have some time pls try it.
>>
>> http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201110.mbox/%3CCANGii8cOrWXsSvP9EYcRFX_mQBoVdatzRW%2BF0Cq2c%3D6sx8czZw%40mail.gmail.com%3E
>> I'm working on fixing it in trunk.
>>
>> But I've never seen that ClassCastException, it can be an another one bug.
>>
>> Regards
>>
>>
>> On Sat, Dec 10, 2011 at 10:35 PM, David Webb (Commented) (JIRA) <
>> jira@apache.org> wrote:
>>
>>>
>>>    [
>>> https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166926#comment-13166926]
>>>
>>> David Webb commented on SOLR-2961:
>>> ----------------------------------
>>>
>>> Weird note, when threads="2", processing continues even though the
>>> stacktraces are output to the logs.  When threads="6", when the error
>>> occues, the DIH process immediately stops and performs a rollback.
>>>
>>> This is preventing me from using DIH to load and maintain my production
>>> index.  Any help is greatly appreciated since I am now at the 11th hour. :)
>>>
>>> Solr and all components have been stellar up to this point. Great
>>> project!
>>>
>>> > DIH with threads and TikaEntityProcessor JDBC ISsue
>>> > ---------------------------------------------------
>>> >
>>> >                 Key: SOLR-2961
>>> >                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>>> >             Project: Solr
>>> >          Issue Type: Bug
>>> >          Components: contrib - DataImportHandler
>>> >    Affects Versions: 3.4, 3.5
>>> >         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g,
>>> ojdbc 11.2.0.1
>>> >            Reporter: David Webb
>>> >              Labels: dih, tika
>>> >         Attachments: data-config.xml
>>> >
>>> >
>>>  > I have a DIH Configuration that works great when I dont specify
>>> threads="X" in the root entity.  As soon as I give a value for threads, I
>>> get the following error messages in the stacktrace.  Please advise.
>>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>>> bug -- POSSIBLE RESOURCE LEAK!!!
>>> > Dec 10, 2011 1:18:33 PM
>>> org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
>>> > SEVERE: Ignoring Error when closing connection
>>> > java.sql.SQLRecoverableException: IO Error: Socket closed
>>> >       at
>>> oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
>>> >       at
>>> oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
>>> >       at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
>>> >       at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
>>> >       at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
>>> >       at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
>>> >       at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
>>> >       at java.lang.ref.Finalizer.access$100(Unknown Source)
>>> >       at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
>>> > Caused by: java.net.SocketException: Socket closed
>>> >       at java.net.SocketOutputStream.socketWrite(Unknown Source)
>>> >       at java.net.SocketOutputStream.write(Unknown Source)
>>> >       at oracle.net.ns.DataPacket.send(DataPacket.java:199)
>>> >       at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
>>> >       at
>>> oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
>>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
>>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
>>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
>>> >       at
>>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
>>> >       at
>>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
>>> >       at
>>> oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
>>> >       at
>>> oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
>>> >       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
>>> >       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
>>> >       at
>>> oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
>>> >       at
>>> oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
>>> >       ... 8 more
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>>> > SEVERE: Exception in entity : null
>>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>>> to initialize DataSource: f2
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>>> >       at
>>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>>> >       at
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>>> >       at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
>>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>>> Source)
>>> >       at java.lang.Thread.run(Unknown Source)
>>> > Caused by: java.lang.ClassCastException:
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>>> >       at
>>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>>> >       ... 14 more
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>>> > SEVERE: Exception in entity : null
>>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>>> to initialize DataSource: f2
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>>> >       at
>>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>>> >       at
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>>> >       at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
>>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>>> Source)
>>> >       at java.lang.Thread.run(Unknown Source)
>>> > Caused by: java.lang.ClassCastException:
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>>> >       at
>>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>>> >       ... 14 more
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.JdbcDataSource finalize
>>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>>> bug -- POSSIBLE RESOURCE LEAK!!!
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>>> > SEVERE: Exception in entity : null
>>>
>>> --
>>> This message is automatically generated by JIRA.
>>> If you think it was sent incorrectly, please contact your JIRA
>>> administrators:
>>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>>> For more information on JIRA, see:
>>> http://www.atlassian.com/software/jira
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>>
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>> Developer
>> Grid Dynamics
>> tel. 1-415-738-8644
>> Skype: mkhludnev
>> <http://www.griddynamics.com/>
>>  <mk...@griddynamics.com>
>>
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
> Developer
> Grid Dynamics
> tel. 1-415-738-8644
> Skype: mkhludnev
> <http://www.griddynamics.com/>
>  <mk...@griddynamics.com>
>



-- 
Sincerely yours
Mikhail Khludnev
Developer
Grid Dynamics
tel. 1-415-738-8644
Skype: mkhludnev
<http://www.griddynamics.com>
 <mk...@griddynamics.com>

Re: [jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by Mikhail Khludnev <mk...@griddynamics.com>.
hi,

Pls find jars and patches attached. Pls check and let me know whether it
works for you?
It should fix core multithreading issue (but a really in quick manner). And
ClassCastException as well.

Regards

On Sun, Dec 11, 2011 at 1:30 AM, David T. Webb <da...@brightmove.com>wrote:

>  Mikhail,
>
> I am not building from source, so I am not setup to apply the patch.  Is
> there any way you can provide the patched JAR file for me to use?  That
> would be a real time saver for me.  Thanks for the info.
>
> I had seen your Jira when I was searching for the solution, but it looked
> like it had been commited to the 3.4  branch already.  Thanks for the
> clarification.  Do you need me to +1 any particular jira to help our cause?
>
>
>  Sincerely,
> David Webb, President
> BrightMove, Inc. (www.brightmove.com)
> 320 High Tide Drive
> Suite 101B
> St Augustine Beach, FL 32080
> (904) 861-2396 x6050
>
>
> ------------------------------
> *From:* Mikhail Khludnev [mailto:mkhludnev@griddynamics.com]
> *Sent:* Sat 12/10/2011 2:59 PM
> *To:* dev@lucene.apache.org; David T. Webb; solr-user@lucene.apache.org
> *Subject:* Re: [jira] [Commented] (SOLR-2961) DIH with threads and
> TikaEntityProcessor JDBC ISsue
>
>
>
> On Sat, Dec 10, 2011 at 11:58 PM, Mikhail Khludnev <
> mkhludnev@griddynamics.com> wrote:
>
>> Hello David,
>>
>> I know about DIH thread problems. Some time ago I did quick fix patch for
>> 3.4, which passes tests. If you have some time pls try it.
>>
>> http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201110.mbox/%3CCANGii8cOrWXsSvP9EYcRFX_mQBoVdatzRW%2BF0Cq2c%3D6sx8czZw%40mail.gmail.com%3E
>> I'm working on fixing it in trunk.
>>
>> But I've never seen that ClassCastException, it can be an another one bug.
>>
>> Regards
>>
>>
>> On Sat, Dec 10, 2011 at 10:35 PM, David Webb (Commented) (JIRA) <
>> jira@apache.org> wrote:
>>
>>>
>>>    [
>>> https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166926#comment-13166926]
>>>
>>> David Webb commented on SOLR-2961:
>>> ----------------------------------
>>>
>>> Weird note, when threads="2", processing continues even though the
>>> stacktraces are output to the logs.  When threads="6", when the error
>>> occues, the DIH process immediately stops and performs a rollback.
>>>
>>> This is preventing me from using DIH to load and maintain my production
>>> index.  Any help is greatly appreciated since I am now at the 11th hour. :)
>>>
>>> Solr and all components have been stellar up to this point. Great
>>> project!
>>>
>>> > DIH with threads and TikaEntityProcessor JDBC ISsue
>>> > ---------------------------------------------------
>>> >
>>> >                 Key: SOLR-2961
>>> >                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>>> >             Project: Solr
>>> >          Issue Type: Bug
>>> >          Components: contrib - DataImportHandler
>>> >    Affects Versions: 3.4, 3.5
>>> >         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g,
>>> ojdbc 11.2.0.1
>>> >            Reporter: David Webb
>>> >              Labels: dih, tika
>>> >         Attachments: data-config.xml
>>> >
>>> >
>>>  > I have a DIH Configuration that works great when I dont specify
>>> threads="X" in the root entity.  As soon as I give a value for threads, I
>>> get the following error messages in the stacktrace.  Please advise.
>>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>>> bug -- POSSIBLE RESOURCE LEAK!!!
>>> > Dec 10, 2011 1:18:33 PM
>>> org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
>>> > SEVERE: Ignoring Error when closing connection
>>> > java.sql.SQLRecoverableException: IO Error: Socket closed
>>> >       at
>>> oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
>>> >       at
>>> oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
>>> >       at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
>>> >       at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
>>> >       at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
>>> >       at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
>>> >       at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
>>> >       at java.lang.ref.Finalizer.access$100(Unknown Source)
>>> >       at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
>>> > Caused by: java.net.SocketException: Socket closed
>>> >       at java.net.SocketOutputStream.socketWrite(Unknown Source)
>>> >       at java.net.SocketOutputStream.write(Unknown Source)
>>> >       at oracle.net.ns.DataPacket.send(DataPacket.java:199)
>>> >       at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
>>> >       at
>>> oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
>>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
>>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
>>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
>>> >       at
>>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
>>> >       at
>>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
>>> >       at
>>> oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
>>> >       at
>>> oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
>>> >       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
>>> >       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
>>> >       at
>>> oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
>>> >       at
>>> oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
>>> >       ... 8 more
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>>> > SEVERE: Exception in entity : null
>>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>>> to initialize DataSource: f2
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>>> >       at
>>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>>> >       at
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>>> >       at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
>>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>>> Source)
>>> >       at java.lang.Thread.run(Unknown Source)
>>> > Caused by: java.lang.ClassCastException:
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>>> >       at
>>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>>> >       ... 14 more
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>>> > SEVERE: Exception in entity : null
>>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>>> to initialize DataSource: f2
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>>> >       at
>>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>>> >       at
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>>> >       at
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>>> >       at
>>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>>> >       at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
>>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>>> Source)
>>> >       at java.lang.Thread.run(Unknown Source)
>>> > Caused by: java.lang.ClassCastException:
>>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>>> >       at
>>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>>> >       at
>>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>>> >       ... 14 more
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.JdbcDataSource finalize
>>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>>> bug -- POSSIBLE RESOURCE LEAK!!!
>>> > Dec 10, 2011 1:18:34 PM
>>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>>> > SEVERE: Exception in entity : null
>>>
>>> --
>>> This message is automatically generated by JIRA.
>>> If you think it was sent incorrectly, please contact your JIRA
>>> administrators:
>>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>>> For more information on JIRA, see:
>>> http://www.atlassian.com/software/jira
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>>
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>> Developer
>> Grid Dynamics
>> tel. 1-415-738-8644
>> Skype: mkhludnev
>> <http://www.griddynamics.com/>
>>  <mk...@griddynamics.com>
>>
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
> Developer
> Grid Dynamics
> tel. 1-415-738-8644
> Skype: mkhludnev
> <http://www.griddynamics.com/>
>  <mk...@griddynamics.com>
>



-- 
Sincerely yours
Mikhail Khludnev
Developer
Grid Dynamics
tel. 1-415-738-8644
Skype: mkhludnev
<http://www.griddynamics.com>
 <mk...@griddynamics.com>

Re: [jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by Mikhail Khludnev <mk...@griddynamics.com>.
On Sat, Dec 10, 2011 at 11:58 PM, Mikhail Khludnev <
mkhludnev@griddynamics.com> wrote:

> Hello David,
>
> I know about DIH thread problems. Some time ago I did quick fix patch for
> 3.4, which passes tests. If you have some time pls try it.
>
> http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201110.mbox/%3CCANGii8cOrWXsSvP9EYcRFX_mQBoVdatzRW%2BF0Cq2c%3D6sx8czZw%40mail.gmail.com%3E
> I'm working on fixing it in trunk.
>
> But I've never seen that ClassCastException, it can be an another one bug.
>
> Regards
>
>
> On Sat, Dec 10, 2011 at 10:35 PM, David Webb (Commented) (JIRA) <
> jira@apache.org> wrote:
>
>>
>>    [
>> https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166926#comment-13166926]
>>
>> David Webb commented on SOLR-2961:
>> ----------------------------------
>>
>> Weird note, when threads="2", processing continues even though the
>> stacktraces are output to the logs.  When threads="6", when the error
>> occues, the DIH process immediately stops and performs a rollback.
>>
>> This is preventing me from using DIH to load and maintain my production
>> index.  Any help is greatly appreciated since I am now at the 11th hour. :)
>>
>> Solr and all components have been stellar up to this point. Great project!
>>
>> > DIH with threads and TikaEntityProcessor JDBC ISsue
>> > ---------------------------------------------------
>> >
>> >                 Key: SOLR-2961
>> >                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>> >             Project: Solr
>> >          Issue Type: Bug
>> >          Components: contrib - DataImportHandler
>> >    Affects Versions: 3.4, 3.5
>> >         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g,
>> ojdbc 11.2.0.1
>> >            Reporter: David Webb
>> >              Labels: dih, tika
>> >         Attachments: data-config.xml
>> >
>> >
>> > I have a DIH Configuration that works great when I dont specify
>> threads="X" in the root entity.  As soon as I give a value for threads, I
>> get the following error messages in the stacktrace.  Please advise.
>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>> bug -- POSSIBLE RESOURCE LEAK!!!
>> > Dec 10, 2011 1:18:33 PM
>> org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
>> > SEVERE: Ignoring Error when closing connection
>> > java.sql.SQLRecoverableException: IO Error: Socket closed
>> >       at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
>> >       at
>> oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
>> >       at
>> org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
>> >       at
>> org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
>> >       at
>> org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
>> >       at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
>> >       at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
>> >       at java.lang.ref.Finalizer.access$100(Unknown Source)
>> >       at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
>> > Caused by: java.net.SocketException: Socket closed
>> >       at java.net.SocketOutputStream.socketWrite(Unknown Source)
>> >       at java.net.SocketOutputStream.write(Unknown Source)
>> >       at oracle.net.ns.DataPacket.send(DataPacket.java:199)
>> >       at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
>> >       at
>> oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
>> >       at
>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
>> >       at
>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
>> >       at
>> oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
>> >       at
>> oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
>> >       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
>> >       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
>> >       at
>> oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
>> >       at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
>> >       ... 8 more
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>> > SEVERE: Exception in entity : null
>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>> to initialize DataSource: f2
>> >       at
>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>> >       at
>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>> >       at
>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
>> Source)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> Source)
>> >       at java.lang.Thread.run(Unknown Source)
>> > Caused by: java.lang.ClassCastException:
>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>> >       at
>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>> >       ... 14 more
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>> > SEVERE: Exception in entity : null
>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>> to initialize DataSource: f2
>> >       at
>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>> >       at
>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>> >       at
>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
>> Source)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> Source)
>> >       at java.lang.Thread.run(Unknown Source)
>> > Caused by: java.lang.ClassCastException:
>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>> >       at
>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>> >       ... 14 more
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.JdbcDataSource finalize
>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>> bug -- POSSIBLE RESOURCE LEAK!!!
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>> > SEVERE: Exception in entity : null
>>
>> --
>> This message is automatically generated by JIRA.
>> If you think it was sent incorrectly, please contact your JIRA
>> administrators:
>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>> For more information on JIRA, see: http://www.atlassian.com/software/jira
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
> Developer
> Grid Dynamics
> tel. 1-415-738-8644
> Skype: mkhludnev
> <http://www.griddynamics.com>
>  <mk...@griddynamics.com>
>



-- 
Sincerely yours
Mikhail Khludnev
Developer
Grid Dynamics
tel. 1-415-738-8644
Skype: mkhludnev
<http://www.griddynamics.com>
 <mk...@griddynamics.com>

Re: [jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by Mikhail Khludnev <mk...@griddynamics.com>.
On Sat, Dec 10, 2011 at 11:58 PM, Mikhail Khludnev <
mkhludnev@griddynamics.com> wrote:

> Hello David,
>
> I know about DIH thread problems. Some time ago I did quick fix patch for
> 3.4, which passes tests. If you have some time pls try it.
>
> http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201110.mbox/%3CCANGii8cOrWXsSvP9EYcRFX_mQBoVdatzRW%2BF0Cq2c%3D6sx8czZw%40mail.gmail.com%3E
> I'm working on fixing it in trunk.
>
> But I've never seen that ClassCastException, it can be an another one bug.
>
> Regards
>
>
> On Sat, Dec 10, 2011 at 10:35 PM, David Webb (Commented) (JIRA) <
> jira@apache.org> wrote:
>
>>
>>    [
>> https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166926#comment-13166926]
>>
>> David Webb commented on SOLR-2961:
>> ----------------------------------
>>
>> Weird note, when threads="2", processing continues even though the
>> stacktraces are output to the logs.  When threads="6", when the error
>> occues, the DIH process immediately stops and performs a rollback.
>>
>> This is preventing me from using DIH to load and maintain my production
>> index.  Any help is greatly appreciated since I am now at the 11th hour. :)
>>
>> Solr and all components have been stellar up to this point. Great project!
>>
>> > DIH with threads and TikaEntityProcessor JDBC ISsue
>> > ---------------------------------------------------
>> >
>> >                 Key: SOLR-2961
>> >                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>> >             Project: Solr
>> >          Issue Type: Bug
>> >          Components: contrib - DataImportHandler
>> >    Affects Versions: 3.4, 3.5
>> >         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g,
>> ojdbc 11.2.0.1
>> >            Reporter: David Webb
>> >              Labels: dih, tika
>> >         Attachments: data-config.xml
>> >
>> >
>> > I have a DIH Configuration that works great when I dont specify
>> threads="X" in the root entity.  As soon as I give a value for threads, I
>> get the following error messages in the stacktrace.  Please advise.
>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>> bug -- POSSIBLE RESOURCE LEAK!!!
>> > Dec 10, 2011 1:18:33 PM
>> org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
>> > SEVERE: Ignoring Error when closing connection
>> > java.sql.SQLRecoverableException: IO Error: Socket closed
>> >       at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
>> >       at
>> oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
>> >       at
>> org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
>> >       at
>> org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
>> >       at
>> org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
>> >       at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
>> >       at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
>> >       at java.lang.ref.Finalizer.access$100(Unknown Source)
>> >       at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
>> > Caused by: java.net.SocketException: Socket closed
>> >       at java.net.SocketOutputStream.socketWrite(Unknown Source)
>> >       at java.net.SocketOutputStream.write(Unknown Source)
>> >       at oracle.net.ns.DataPacket.send(DataPacket.java:199)
>> >       at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
>> >       at
>> oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
>> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
>> >       at
>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
>> >       at
>> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
>> >       at
>> oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
>> >       at
>> oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
>> >       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
>> >       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
>> >       at
>> oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
>> >       at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
>> >       ... 8 more
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>> > SEVERE: Exception in entity : null
>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>> to initialize DataSource: f2
>> >       at
>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>> >       at
>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>> >       at
>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
>> Source)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> Source)
>> >       at java.lang.Thread.run(Unknown Source)
>> > Caused by: java.lang.ClassCastException:
>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>> >       at
>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>> >       ... 14 more
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>> > SEVERE: Exception in entity : null
>> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed
>> to initialize DataSource: f2
>> >       at
>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
>> >       at
>> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
>> >       at
>> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
>> >       at
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
>> >       at
>> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
>> Source)
>> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> Source)
>> >       at java.lang.Thread.run(Unknown Source)
>> > Caused by: java.lang.ClassCastException:
>> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
>> org.apache.solr.handler.dataimport.EntityProcessorWrapper
>> >       at
>> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
>> >       at
>> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
>> >       ... 14 more
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.JdbcDataSource finalize
>> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
>> bug -- POSSIBLE RESOURCE LEAK!!!
>> > Dec 10, 2011 1:18:34 PM
>> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
>> > SEVERE: Exception in entity : null
>>
>> --
>> This message is automatically generated by JIRA.
>> If you think it was sent incorrectly, please contact your JIRA
>> administrators:
>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>> For more information on JIRA, see: http://www.atlassian.com/software/jira
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
> Developer
> Grid Dynamics
> tel. 1-415-738-8644
> Skype: mkhludnev
> <http://www.griddynamics.com>
>  <mk...@griddynamics.com>
>



-- 
Sincerely yours
Mikhail Khludnev
Developer
Grid Dynamics
tel. 1-415-738-8644
Skype: mkhludnev
<http://www.griddynamics.com>
 <mk...@griddynamics.com>

Re: [jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by Mikhail Khludnev <mk...@griddynamics.com>.
Hello David,

I know about DIH thread problems. Some time ago I did quick fix patch for
3.4, which passes tests. If you have some time pls try it.
http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201110.mbox/%3CCANGii8cOrWXsSvP9EYcRFX_mQBoVdatzRW%2BF0Cq2c%3D6sx8czZw%40mail.gmail.com%3E
I'm working on fixing it in trunk.

But I've never seen that ClassCastException, it can be an another one bug.

Regards

On Sat, Dec 10, 2011 at 10:35 PM, David Webb (Commented) (JIRA) <
jira@apache.org> wrote:

>
>    [
> https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166926#comment-13166926]
>
> David Webb commented on SOLR-2961:
> ----------------------------------
>
> Weird note, when threads="2", processing continues even though the
> stacktraces are output to the logs.  When threads="6", when the error
> occues, the DIH process immediately stops and performs a rollback.
>
> This is preventing me from using DIH to load and maintain my production
> index.  Any help is greatly appreciated since I am now at the 11th hour. :)
>
> Solr and all components have been stellar up to this point. Great project!
>
> > DIH with threads and TikaEntityProcessor JDBC ISsue
> > ---------------------------------------------------
> >
> >                 Key: SOLR-2961
> >                 URL: https://issues.apache.org/jira/browse/SOLR-2961
> >             Project: Solr
> >          Issue Type: Bug
> >          Components: contrib - DataImportHandler
> >    Affects Versions: 3.4, 3.5
> >         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g,
> ojdbc 11.2.0.1
> >            Reporter: David Webb
> >              Labels: dih, tika
> >         Attachments: data-config.xml
> >
> >
> > I have a DIH Configuration that works great when I dont specify
> threads="X" in the root entity.  As soon as I give a value for threads, I
> get the following error messages in the stacktrace.  Please advise.
> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
> bug -- POSSIBLE RESOURCE LEAK!!!
> > Dec 10, 2011 1:18:33 PM
> org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> > SEVERE: Ignoring Error when closing connection
> > java.sql.SQLRecoverableException: IO Error: Socket closed
> >       at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> >       at
> oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> >       at
> org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> >       at
> org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> >       at
> org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> >       at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> >       at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> >       at java.lang.ref.Finalizer.access$100(Unknown Source)
> >       at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> > Caused by: java.net.SocketException: Socket closed
> >       at java.net.SocketOutputStream.socketWrite(Unknown Source)
> >       at java.net.SocketOutputStream.write(Unknown Source)
> >       at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> >       at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> >       at
> oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> >       at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> >       at
> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> >       at
> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> >       at
> oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> >       at
> oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> >       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> >       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> >       at
> oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> >       at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> >       ... 8 more
> > Dec 10, 2011 1:18:34 PM
> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> > SEVERE: Exception in entity : null
> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to
> initialize DataSource: f2
> >       at
> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> >       at
> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> >       at
> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> >       at
> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> >       at
> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> >       at
> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> >       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
> Source)
> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
> >       at java.lang.Thread.run(Unknown Source)
> > Caused by: java.lang.ClassCastException:
> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
> org.apache.solr.handler.dataimport.EntityProcessorWrapper
> >       at
> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> >       at
> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> >       ... 14 more
> > Dec 10, 2011 1:18:34 PM
> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> > SEVERE: Exception in entity : null
> > org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to
> initialize DataSource: f2
> >       at
> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> >       at
> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> >       at
> org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> >       at
> org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> >       at
> org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> >       at
> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> >       at
> org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> >       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
> Source)
> >       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
> >       at java.lang.Thread.run(Unknown Source)
> > Caused by: java.lang.ClassCastException:
> org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to
> org.apache.solr.handler.dataimport.EntityProcessorWrapper
> >       at
> org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> >       at
> org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> >       ... 14 more
> > Dec 10, 2011 1:18:34 PM
> org.apache.solr.handler.dataimport.JdbcDataSource finalize
> > SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a
> bug -- POSSIBLE RESOURCE LEAK!!!
> > Dec 10, 2011 1:18:34 PM
> org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> > SEVERE: Exception in entity : null
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators:
> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>


-- 
Sincerely yours
Mikhail Khludnev
Developer
Grid Dynamics
tel. 1-415-738-8644
Skype: mkhludnev
<http://www.griddynamics.com>
 <mk...@griddynamics.com>

[jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "Mikhail Khludnev (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177722#comment-13177722 ] 

Mikhail Khludnev commented on SOLR-2961:
----------------------------------------

multithreading patch is attached to SOLR-2947, after it will be committed I'll be able to solve this one.
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "James Dyer (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Dyer resolved SOLR-2961.
------------------------------

    Resolution: Won't Fix

The "threads" feature was removed from DIH in Trunk/4.x (see SOLR-3262). Some "threads" bugs were fixed in version 3.6, the last release in which "threads" is available. (see SOLR-3011).
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Issue Comment Edited] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "David Webb (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168516#comment-13168516 ] 

David Webb edited comment on SOLR-2961 at 12/13/11 5:17 PM:
------------------------------------------------------------

The ClassCastException is resolved like you said, but looks like the FieldStreamDataSource isn’t multithreaded. Or, my configuration is wrong.  Thank you for the quick help.

{noformat}
Dec 13, 2011 11:59:49 AM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
SEVERE: Exception in entity : null
java.lang.NullPointerException
                at org.apache.solr.handler.dataimport.ThreadedContext.getVariableResolver(ThreadedContext.java:43)
                at org.apache.solr.handler.dataimport.ThreadedContext.resolve(ThreadedContext.java:89)
                at org.apache.solr.handler.dataimport.FieldStreamDataSource.getData(FieldStreamDataSource.java:63)
                at org.apache.solr.handler.dataimport.FieldStreamDataSource.getData(FieldStreamDataSource.java:49)
                at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:102)
                at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:437)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:389)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:457)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:389)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:457)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$100(DocBuilder.java:353)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:396)
                at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
                at java.lang.Thread.run(Unknown Source)
{noformat}
                
      was (Author: davewebb):
    The ClassCastException is resolved like you said, but looks like the FieldStreamDataSource isn’t multithreaded. Or, my configuration is wrong.  Thank you for the quick help.

Dec 13, 2011 11:59:49 AM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
SEVERE: Exception in entity : null
java.lang.NullPointerException
                at org.apache.solr.handler.dataimport.ThreadedContext.getVariableResolver(ThreadedContext.java:43)
                at org.apache.solr.handler.dataimport.ThreadedContext.resolve(ThreadedContext.java:89)
                at org.apache.solr.handler.dataimport.FieldStreamDataSource.getData(FieldStreamDataSource.java:63)
                at org.apache.solr.handler.dataimport.FieldStreamDataSource.getData(FieldStreamDataSource.java:49)
                at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:102)
                at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:437)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:389)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:457)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:389)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:457)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$100(DocBuilder.java:353)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:396)
                at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
                at java.lang.Thread.run(Unknown Source)

                  
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "Mikhail Khludnev (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mikhail Khludnev updated SOLR-2961:
-----------------------------------

    Attachment: SOLR-2961.patch

here is the fix for  

{code}java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper{code} 
it amends FieldReaderDataSource and FieldStreamDataSource to use "context" for resolving instead downcasting to obtain resolver. 

But, multithreading support is a separate issue.
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "David Webb (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166926#comment-13166926 ] 

David Webb commented on SOLR-2961:
----------------------------------

Weird note, when threads="2", processing continues even though the stacktraces are output to the logs.  When threads="6", when the error occues, the DIH process immediately stops and performs a rollback.

This is preventing me from using DIH to load and maintain my production index.  Any help is greatly appreciated since I am now at the 11th hour. :)

Solr and all components have been stellar up to this point. Great project!
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "James Dyer (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235842#comment-13235842 ] 

James Dyer commented on SOLR-2961:
----------------------------------

{quote}
Mikhail Khludnev commented on SOLR-3011:
----------------------------------------

bq.  Is SOLR-2961 just for Tika?

yep. it seems so. Why do you ask, we don't need to support it further?
{quote}

I don't think we have to support _threads_ with everything.  (This is one reason why I want to remove "threads" on Trunk.  Its going to be very difficult to support every use-case.)  On the other hand, if you or someone else puts up a good patch in the very near-term I will try to get it into 3.6.
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "David Webb (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Webb updated SOLR-2961:
-----------------------------

    Attachment: data-config.xml

My trimmed down data config
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "David Webb (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168516#comment-13168516 ] 

David Webb commented on SOLR-2961:
----------------------------------

The ClassCastException is resolved like you said, but looks like the FieldStreamDataSource isn’t multithreaded. Or, my configuration is wrong.  Thank you for the quick help.

Dec 13, 2011 11:59:49 AM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
SEVERE: Exception in entity : null
java.lang.NullPointerException
                at org.apache.solr.handler.dataimport.ThreadedContext.getVariableResolver(ThreadedContext.java:43)
                at org.apache.solr.handler.dataimport.ThreadedContext.resolve(ThreadedContext.java:89)
                at org.apache.solr.handler.dataimport.FieldStreamDataSource.getData(FieldStreamDataSource.java:63)
                at org.apache.solr.handler.dataimport.FieldStreamDataSource.getData(FieldStreamDataSource.java:49)
                at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:102)
                at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:437)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:389)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:457)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:389)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:457)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$100(DocBuilder.java:353)
                at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:396)
                at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
                at java.lang.Thread.run(Unknown Source)

                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2961) DIH with threads and TikaEntityProcessor JDBC ISsue

Posted by "David Webb (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168518#comment-13168518 ] 

David Webb commented on SOLR-2961:
----------------------------------

Additional test confirms that the process does not die when specifying 
{code}threads="1"{code} on the root entity.
                
> DIH with threads and TikaEntityProcessor JDBC ISsue
> ---------------------------------------------------
>
>                 Key: SOLR-2961
>                 URL: https://issues.apache.org/jira/browse/SOLR-2961
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.4, 3.5
>         Environment: Windows Server 2008, Apache Tomcat 6, Oracle 11g, ojdbc 11.2.0.1
>            Reporter: David Webb
>              Labels: dih, tika
>         Attachments: SOLR-2961.patch, data-config.xml
>
>
> I have a DIH Configuration that works great when I dont specify threads="X" in the root entity.  As soon as I give a value for threads, I get the following error messages in the stacktrace.  Please advise.  
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:33 PM org.apache.solr.handler.dataimport.JdbcDataSource closeConnection
> SEVERE: Ignoring Error when closing connection
> java.sql.SQLRecoverableException: IO Error: Socket closed
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:511)
> 	at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3931)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.closeConnection(JdbcDataSource.java:401)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.close(JdbcDataSource.java:392)
> 	at org.apache.solr.handler.dataimport.JdbcDataSource.finalize(JdbcDataSource.java:380)
> 	at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
> 	at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
> 	at java.lang.ref.Finalizer.access$100(Unknown Source)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
> Caused by: java.net.SocketException: Socket closed
> 	at java.net.SocketOutputStream.socketWrite(Unknown Source)
> 	at java.net.SocketOutputStream.write(Unknown Source)
> 	at oracle.net.ns.DataPacket.send(DataPacket.java:199)
> 	at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:211)
> 	at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:227)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
> 	at oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
> 	at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1122)
> 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1099)
> 	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:288)
> 	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> 	at oracle.jdbc.driver.T4C7Ocommoncall.doOLOGOFF(T4C7Ocommoncall.java:61)
> 	at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:498)
> 	... 8 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null
> org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to initialize DataSource: f2
> 	at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:333)
> 	at org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:99)
> 	at org.apache.solr.handler.dataimport.ThreadedContext.getDataSource(ThreadedContext.java:66)
> 	at org.apache.solr.handler.dataimport.TikaEntityProcessor.nextRow(TikaEntityProcessor.java:101)
> 	at org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper.nextRow(ThreadedEntityProcessorWrapper.java:84)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:446)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.run(DocBuilder.java:399)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.runAThread(DocBuilder.java:466)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner.access$000(DocBuilder.java:353)
> 	at org.apache.solr.handler.dataimport.DocBuilder$EntityRunner$1.run(DocBuilder.java:406)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.ClassCastException: org.apache.solr.handler.dataimport.TikaEntityProcessor cannot be cast to org.apache.solr.handler.dataimport.EntityProcessorWrapper
> 	at org.apache.solr.handler.dataimport.FieldStreamDataSource.init(FieldStreamDataSource.java:58)
> 	at org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:331)
> 	... 14 more
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.JdbcDataSource finalize
> SEVERE: JdbcDataSource was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
> Dec 10, 2011 1:18:34 PM org.apache.solr.handler.dataimport.ThreadedEntityProcessorWrapper nextRow
> SEVERE: Exception in entity : null

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org