You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Karl Wright (Created) (JIRA)" <ji...@apache.org> on 2011/12/01 17:14:40 UTC
[jira] [Created] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Crawling using Postgresql 9.1 hangs occasionally for a while
------------------------------------------------------------
Key: CONNECTORS-299
URL: https://issues.apache.org/jira/browse/CONNECTORS-299
Project: ManifoldCF
Issue Type: Bug
Components: Framework core
Affects Versions: ManifoldCF 0.4
Reporter: Karl Wright
Assignee: Karl Wright
Fix For: ManifoldCF 0.4
The hang takes place because of this postgresql error:
---- message: ERROR: could not serialize access due to read/write dependencies among transactions
Detail: Reason code: Canceled on identification as a pivot, during conflict in checking.
Hint: The transaction might succeed if retried., ----- state: 40001
The state code 40001 should be interpreted as a "deadlock" so that the transaction is retried.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Posted by "Karl Wright (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161079#comment-13161079 ]
Karl Wright commented on CONNECTORS-299:
----------------------------------------
r1209209 for infrastructure and deployment of that infrastructure in the place we see in the exception listed above. Obviously many more places need to be worked on before the ticket is in any sense complete.
> Crawling using Postgresql 9.1 hangs occasionally for a while
> ------------------------------------------------------------
>
> Key: CONNECTORS-299
> URL: https://issues.apache.org/jira/browse/CONNECTORS-299
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The hang takes place because of this postgresql error:
> ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
> at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
> at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
> at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
> Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
> This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Posted by "Karl Wright (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161306#comment-13161306 ]
Karl Wright commented on CONNECTORS-299:
----------------------------------------
r1209309 for the rest (and fixed a bad bug I introduced)
> Crawling using Postgresql 9.1 hangs occasionally for a while
> ------------------------------------------------------------
>
> Key: CONNECTORS-299
> URL: https://issues.apache.org/jira/browse/CONNECTORS-299
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The hang takes place because of this postgresql error:
> ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
> at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
> at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
> at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
> Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
> This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Posted by "Karl Wright (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161558#comment-13161558 ]
Karl Wright commented on CONNECTORS-299:
----------------------------------------
r1209427 to rejigger transaction logging output so people can see what is going on.
> Crawling using Postgresql 9.1 hangs occasionally for a while
> ------------------------------------------------------------
>
> Key: CONNECTORS-299
> URL: https://issues.apache.org/jira/browse/CONNECTORS-299
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The hang takes place because of this postgresql error:
> ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
> at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
> at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
> at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
> Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
> This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Posted by "Karl Wright (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161548#comment-13161548 ]
Karl Wright commented on CONNECTORS-299:
----------------------------------------
r1209411 to enable exception mapping in the PostgreSQL driver on commits.
> Crawling using Postgresql 9.1 hangs occasionally for a while
> ------------------------------------------------------------
>
> Key: CONNECTORS-299
> URL: https://issues.apache.org/jira/browse/CONNECTORS-299
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The hang takes place because of this postgresql error:
> ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
> at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
> at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
> at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
> Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
> This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Posted by "Karl Wright (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karl Wright resolved CONNECTORS-299.
------------------------------------
Resolution: Fixed
> Crawling using Postgresql 9.1 hangs occasionally for a while
> ------------------------------------------------------------
>
> Key: CONNECTORS-299
> URL: https://issues.apache.org/jira/browse/CONNECTORS-299
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The hang takes place because of this postgresql error:
> ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
> at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
> at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
> at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
> Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
> This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CONNECTORS-299) Crawling using Postgresql 9.1
hangs occasionally for a while
Posted by "Karl Wright (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karl Wright updated CONNECTORS-299:
-----------------------------------
Description:
The hang takes place because of this postgresql error:
ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
Hint: The transaction might succeed if retried.
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
Hint: The transaction might succeed if retried.
at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
was:
The hang takes place because of this postgresql error:
---- message: ERROR: could not serialize access due to read/write dependencies among transactions
Detail: Reason code: Canceled on identification as a pivot, during conflict in checking.
Hint: The transaction might succeed if retried., ----- state: 40001
The state code 40001 should be interpreted as a "deadlock" so that the transaction is retried.
> Crawling using Postgresql 9.1 hangs occasionally for a while
> ------------------------------------------------------------
>
> Key: CONNECTORS-299
> URL: https://issues.apache.org/jira/browse/CONNECTORS-299
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The hang takes place because of this postgresql error:
> ERROR 2011-11-28 14:46:23,959 (Worker thread '25') - Worker thread aborting and restarting due to database connection reset: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing query: ERROR: could not serialize access due to read/write dependencies among transactions
> Detail: Reason code: Canceled on identification as a pivot, during commit attempt.
> Hint: The transaction might succeed if retried.
> at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:608)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.commitCurrentTransaction(DBInterfacePostgreSQL.java:1141)
> at org.apache.manifoldcf.core.database.Database.endTransaction(Database.java:321)
> at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.endTransaction(DBInterfacePostgreSQL.java:1112)
> at org.apache.manifoldcf.crawler.jobs.JobManager.finishDocuments(JobManager.java:4072)
> at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:567)
> Caused by: org.postgresql.util.PSQLException: ERROR: could not serialize access due to read/write dependencies among transactions
> This is happening during the commit phase of the transaction, at a point where none of the transaction blocks in ManifoldCF know to look for it. It is therefore likely that all transaction blocks throughout ManifoldCF that deal with deadlock will need to be changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira