You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Steve Wolfe (Created) (JIRA)" <ji...@apache.org> on 2011/12/20 00:05:30 UTC
[jira] [Created] (SOLR-2980) DataImportHandler becomes unresponsive
with Microsoft JDBC driver
DataImportHandler becomes unresponsive with Microsoft JDBC driver
-----------------------------------------------------------------
Key: SOLR-2980
URL: https://issues.apache.org/jira/browse/SOLR-2980
Project: Solr
Issue Type: Bug
Components: contrib - DataImportHandler
Affects Versions: 3.5, 3.4
Environment: Java JRE 1.6.0_20, JRE 1.6.0_29, CentOS (kernel 2.6.18-274.3.1.e15), Microsoft SQL Server JDBC Driver 3.0
Reporter: Steve Wolfe
A solr core has been configured to use the DataImportHandler to read a set of documents from a Microsoft SQL Server database, via the Microsoft JDBC driver. A known-good configuration for the data import handler is used, and a "reload-config" followed by "full-import" command are issued to the DataImportHandler.
The handler switches to a status of "A command is still running...", and shows 1 request has been made to the data source. Subsequent status calls show the Time Elapsed growing, but the handler fails to perform any action--SQL Server confirms that a login event occurs, but no queries are issued. Solr does not throw any exceptions, even after a very long duration. The last message in Solr's output is "INFO: Creating a connection for entity {entity name} with URL: {entity datasource url}"
Attempts to issue an Abort command to the DataImportHandler appear successful, but do no stop the operation.
Running the solr instance with the "java -verbose" flag shows the following:
*IMMEDIATELY UPON EXECUTING "FULL-IMPORT" COMMAND*
[Loaded com.microsoft.sqlserver.jdbc.StreamPacket from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
[Loaded com.microsoft.sqlserver.jdbc.StreamLoginAck from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
[Loaded com.microsoft.sqlserver.jdbc.StreamDone from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
*APPROXIMATELY 40 SECONDS LATER*
[Loaded java.io.InterruptedIOException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
[Loaded java.net.SocketTimeoutException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
[Loaded sun.net.ConnectionResetException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
An issue with identical symptoms has been reported on StackOverflow (the OP found that using a 3rd party JDBC driver appeared successful): http://stackoverflow.com/questions/8269038/solr-dataimporthandler-logs-into-sql-but-never-fetches-any-data
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Closed] (SOLR-2980) DataImportHandler becomes unresponsive
with Microsoft JDBC driver
Posted by "Steve Wolfe (Closed) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Wolfe closed SOLR-2980.
-----------------------------
Resolution: Not A Problem
Determined that the issue is not Solr-specific, but rather it occurs between affected versions/builds of the JRE and the MS SQL JDBC driver. See comment for details.
> DataImportHandler becomes unresponsive with Microsoft JDBC driver
> -----------------------------------------------------------------
>
> Key: SOLR-2980
> URL: https://issues.apache.org/jira/browse/SOLR-2980
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
> Affects Versions: 3.4, 3.5
> Environment: Java JRE 1.6.0_20, JRE 1.6.0_29, CentOS (kernel 2.6.18-274.3.1.e15), Microsoft SQL Server JDBC Driver 3.0
> Reporter: Steve Wolfe
> Labels: dataimport, jdbc, solr, sql, sqlserver
>
> A solr core has been configured to use the DataImportHandler to read a set of documents from a Microsoft SQL Server database, via the Microsoft JDBC driver. A known-good configuration for the data import handler is used, and a "reload-config" followed by "full-import" command are issued to the DataImportHandler.
> The handler switches to a status of "A command is still running...", and shows 1 request has been made to the data source. Subsequent status calls show the Time Elapsed growing, but the handler fails to perform any action--SQL Server confirms that a login event occurs, but no queries are issued. Solr does not throw any exceptions, even after a very long duration. The last message in Solr's output is "INFO: Creating a connection for entity {entity name} with URL: {entity datasource url}"
> Attempts to issue an Abort command to the DataImportHandler appear successful, but do no stop the operation.
> Running the solr instance with the "java -verbose" flag shows the following:
> *IMMEDIATELY UPON EXECUTING "FULL-IMPORT" COMMAND*
> [Loaded com.microsoft.sqlserver.jdbc.StreamPacket from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamLoginAck from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamDone from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> *APPROXIMATELY 40 SECONDS LATER*
> [Loaded java.io.InterruptedIOException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded java.net.SocketTimeoutException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded sun.net.ConnectionResetException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> An issue with identical symptoms has been reported on StackOverflow (the OP found that using a 3rd party JDBC driver appeared successful): http://stackoverflow.com/questions/8269038/solr-dataimporthandler-logs-into-sql-but-never-fetches-any-data
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-2980) DataImportHandler becomes
unresponsive with Microsoft JDBC driver
Posted by "Uwe Schindler (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174044#comment-13174044 ]
Uwe Schindler commented on SOLR-2980:
-------------------------------------
See my comments about the mess with OpenJDK version numbers, you cannot read anything out of it: My advise: Don't use OpenJDK and download real Oracle JDKs - please!
http://blog.thetaphi.de/2011/12/jdk-7u2-released-how-about-linux-and.html
> DataImportHandler becomes unresponsive with Microsoft JDBC driver
> -----------------------------------------------------------------
>
> Key: SOLR-2980
> URL: https://issues.apache.org/jira/browse/SOLR-2980
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
> Affects Versions: 3.4, 3.5
> Environment: Java JRE 1.6.0_20, JRE 1.6.0_29, CentOS (kernel 2.6.18-274.3.1.e15), Microsoft SQL Server JDBC Driver 3.0
> Reporter: Steve Wolfe
> Labels: dataimport, jdbc, solr, sql, sqlserver
>
> A solr core has been configured to use the DataImportHandler to read a set of documents from a Microsoft SQL Server database, via the Microsoft JDBC driver. A known-good configuration for the data import handler is used, and a "reload-config" followed by "full-import" command are issued to the DataImportHandler.
> The handler switches to a status of "A command is still running...", and shows 1 request has been made to the data source. Subsequent status calls show the Time Elapsed growing, but the handler fails to perform any action--SQL Server confirms that a login event occurs, but no queries are issued. Solr does not throw any exceptions, even after a very long duration. The last message in Solr's output is "INFO: Creating a connection for entity {entity name} with URL: {entity datasource url}"
> Attempts to issue an Abort command to the DataImportHandler appear successful, but do no stop the operation.
> Running the solr instance with the "java -verbose" flag shows the following:
> *IMMEDIATELY UPON EXECUTING "FULL-IMPORT" COMMAND*
> [Loaded com.microsoft.sqlserver.jdbc.StreamPacket from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamLoginAck from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamDone from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> *APPROXIMATELY 40 SECONDS LATER*
> [Loaded java.io.InterruptedIOException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded java.net.SocketTimeoutException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded sun.net.ConnectionResetException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> An issue with identical symptoms has been reported on StackOverflow (the OP found that using a 3rd party JDBC driver appeared successful): http://stackoverflow.com/questions/8269038/solr-dataimporthandler-logs-into-sql-but-never-fetches-any-data
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-2980) DataImportHandler becomes
unresponsive with Microsoft JDBC driver
Posted by "Steve Wolfe (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172721#comment-13172721 ]
Steve Wolfe commented on SOLR-2980:
-----------------------------------
FYI: This issue has been isolated by testing the identical Solr configs, with successful results, on several different boxes. These tests have confirmed that the SQL Login is valid and capable of executing the required query, and that the other Solr configuration parameters (schema, solrconfig, etc) are valid and functional. Network-tests have been performed from the problem-box to ensure it has full network access to the SQL database.
> DataImportHandler becomes unresponsive with Microsoft JDBC driver
> -----------------------------------------------------------------
>
> Key: SOLR-2980
> URL: https://issues.apache.org/jira/browse/SOLR-2980
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
> Affects Versions: 3.4, 3.5
> Environment: Java JRE 1.6.0_20, JRE 1.6.0_29, CentOS (kernel 2.6.18-274.3.1.e15), Microsoft SQL Server JDBC Driver 3.0
> Reporter: Steve Wolfe
> Labels: dataimport, jdbc, solr, sql, sqlserver
>
> A solr core has been configured to use the DataImportHandler to read a set of documents from a Microsoft SQL Server database, via the Microsoft JDBC driver. A known-good configuration for the data import handler is used, and a "reload-config" followed by "full-import" command are issued to the DataImportHandler.
> The handler switches to a status of "A command is still running...", and shows 1 request has been made to the data source. Subsequent status calls show the Time Elapsed growing, but the handler fails to perform any action--SQL Server confirms that a login event occurs, but no queries are issued. Solr does not throw any exceptions, even after a very long duration. The last message in Solr's output is "INFO: Creating a connection for entity {entity name} with URL: {entity datasource url}"
> Attempts to issue an Abort command to the DataImportHandler appear successful, but do no stop the operation.
> Running the solr instance with the "java -verbose" flag shows the following:
> *IMMEDIATELY UPON EXECUTING "FULL-IMPORT" COMMAND*
> [Loaded com.microsoft.sqlserver.jdbc.StreamPacket from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamLoginAck from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamDone from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> *APPROXIMATELY 40 SECONDS LATER*
> [Loaded java.io.InterruptedIOException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded java.net.SocketTimeoutException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded sun.net.ConnectionResetException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> An issue with identical symptoms has been reported on StackOverflow (the OP found that using a 3rd party JDBC driver appeared successful): http://stackoverflow.com/questions/8269038/solr-dataimporthandler-logs-into-sql-but-never-fetches-any-data
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-2980) DataImportHandler becomes
unresponsive with Microsoft JDBC driver
Posted by "Steve Wolfe (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174042#comment-13174042 ]
Steve Wolfe commented on SOLR-2980:
-----------------------------------
After careful comparison of the working vs. non-working machines I identified that the non-working machines were using a slightly newer build of the JRE (both were using 1.6.0_20, but two different builds of that same runtime). By explicitly installing the older version all issues went away. During diagnostics I had also found that the issue was not specific to Solr, but rather appeared to be between the affected JRE and the SQL Server JDBC driver.
"Good" build of the JRE: http://pkgs.org/centos-5-rhel-5/centos-rhel-x86_64/java-1.6.0-openjdk-1.6.0.0-1.22.1.9.8.el5_6.x86_64.rpm.html
"Bad" build of the JRE: http://pkgs.org/centos-5-rhel-5/centos-rhel-updates-x86_64/java-1.6.0-openjdk-src-1.6.0.0-1.23.1.9.10.el5_7.x86_64.rpm.html
> DataImportHandler becomes unresponsive with Microsoft JDBC driver
> -----------------------------------------------------------------
>
> Key: SOLR-2980
> URL: https://issues.apache.org/jira/browse/SOLR-2980
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
> Affects Versions: 3.4, 3.5
> Environment: Java JRE 1.6.0_20, JRE 1.6.0_29, CentOS (kernel 2.6.18-274.3.1.e15), Microsoft SQL Server JDBC Driver 3.0
> Reporter: Steve Wolfe
> Labels: dataimport, jdbc, solr, sql, sqlserver
>
> A solr core has been configured to use the DataImportHandler to read a set of documents from a Microsoft SQL Server database, via the Microsoft JDBC driver. A known-good configuration for the data import handler is used, and a "reload-config" followed by "full-import" command are issued to the DataImportHandler.
> The handler switches to a status of "A command is still running...", and shows 1 request has been made to the data source. Subsequent status calls show the Time Elapsed growing, but the handler fails to perform any action--SQL Server confirms that a login event occurs, but no queries are issued. Solr does not throw any exceptions, even after a very long duration. The last message in Solr's output is "INFO: Creating a connection for entity {entity name} with URL: {entity datasource url}"
> Attempts to issue an Abort command to the DataImportHandler appear successful, but do no stop the operation.
> Running the solr instance with the "java -verbose" flag shows the following:
> *IMMEDIATELY UPON EXECUTING "FULL-IMPORT" COMMAND*
> [Loaded com.microsoft.sqlserver.jdbc.StreamPacket from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamLoginAck from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> [Loaded com.microsoft.sqlserver.jdbc.StreamDone from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
> *APPROXIMATELY 40 SECONDS LATER*
> [Loaded java.io.InterruptedIOException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded java.net.SocketTimeoutException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> [Loaded sun.net.ConnectionResetException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
> An issue with identical symptoms has been reported on StackOverflow (the OP found that using a 3rd party JDBC driver appeared successful): http://stackoverflow.com/questions/8269038/solr-dataimporthandler-logs-into-sql-but-never-fetches-any-data
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org