You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jena.apache.org by "Rahul Sharma (JIRA)" <ji...@apache.org> on 2012/05/23 13:10:40 UTC
[jira] [Created] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Rahul Sharma created JENA-248:
---------------------------------
Summary: Fuseki server unresponsive when running multiple construct queries using multi-threading.
Key: JENA-248
URL: https://issues.apache.org/jira/browse/JENA-248
Project: Apache Jena
Issue Type: Bug
Components: Fuseki
Affects Versions: Fuseki 0.2.1
Environment: Windows 7 (x64)
Reporter: Rahul Sharma
Hi Andy,
We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
CONSTRUCT
{
<http://rahul.org/company/id/123456> ?predicate ?object .
?blankNode ?blankNodePredicate ?blankNodeObject .
<http://rahul.org/company/id/123456> ?pred ?blankNode1 .
?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
}
WHERE
{
SERVICE <http://localhost:3030/companies/sparql>
{
<http://rahul.org/company/id/123456> ?predicate ?object .
}
SERVICE <http://localhost:3030/rahul/sparql>
{
OPTIONAL
{
<http://rahul.org/company/id/123456> ?pred ?blankNode1 .
?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
}
}
}
Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
request.Method = "GET";
var response = request.GetResponse();
Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
Thanks,
Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Seaborne updated JENA-248:
-------------------------------
Attachment: JENA-248-materialize-result-bytes.patch
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13282502#comment-13282502 ]
Andy Seaborne commented on JENA-248:
------------------------------------
(the "500 - Currently in Transaction" error is a separate fix)
Thanks for getting back on this one. I'll close the JIRA. The code is in trunk.
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ, Fuseki
> Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Assignee: Andy Seaborne
> Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281566#comment-13281566 ]
Andy Seaborne commented on JENA-248:
------------------------------------
Could you try with the current snapshot development version of Fuseki please?
https://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.2-SNAPSHOT/
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281594#comment-13281594 ]
Andy Seaborne commented on JENA-248:
------------------------------------
Thanks - that tells me the changes since 0.2.1 aren't relevant.
I think I know a proper fix to put in which does not cause a lot of extra copying to happen. First experiments suggest it is more reliable with the test case in the email.
I'll look at putting it in the codebase and dev build as soon as possible (but not the next few hours).
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281549#comment-13281549 ]
Andy Seaborne commented on JENA-248:
------------------------------------
This looks like it's the connection saturation issue.
See the thread:
http://markmail.org/message/woxfb2kkhqddkkck
(it's probably easier to answer questions on the mailing list)
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281859#comment-13281859 ]
Hudson commented on JENA-248:
-----------------------------
Integrated in Jena_ARQ #610 (See [https://builds.apache.org/job/Jena_ARQ/610/])
JENA-248 Read all bytes after SERVICE request and close the connection. (Revision 1342006)
Result = SUCCESS
andy :
Files :
* /jena/trunk/jena-arq/src/main/java/com/hp/hpl/jena/sparql/engine/http/Service.java
* /jena/trunk/jena-arq/src/main/java/com/hp/hpl/jena/sparql/engine/iterator/QueryIter.java
* /jena/trunk/jena-arq/src/main/java/com/hp/hpl/jena/sparql/engine/main/iterator/QueryIterService.java
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Rahul Sharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281572#comment-13281572 ]
Rahul Sharma commented on JENA-248:
-----------------------------------
Tried with Fuseki 0.2.2-SNAPSHOT 20120522-0501 and same results!
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281872#comment-13281872 ]
Andy Seaborne commented on JENA-248:
------------------------------------
Committed to the codebase (and patch attached for reference).
The development build of Fuseki has the the fix in it (actually, its in ARQ which has been rebuilt then Fuseki rebuilt to pick up the fix).
Could you test please because while it works for me in my test case that used to fail 50% of the time and now does not, the Windows factor, or just being a different system, may be a factor as it is timing dependent. Thanks.
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: Fuseki
> Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Labels: Fuseki, Multi-Threading
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (JENA-248) Fuseki server unresponsive when running
multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Seaborne closed JENA-248.
------------------------------
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ, Fuseki
> Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Assignee: Andy Seaborne
> Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Seaborne reassigned JENA-248:
----------------------------------
Assignee: Andy Seaborne
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ, Fuseki
> Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Assignee: Andy Seaborne
> Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Seaborne updated JENA-248:
-------------------------------
Component/s: ARQ
Affects Version/s: ARQ 2.9.0
Fix Version/s: ARQ 2.9.1
Labels: ARQ Fuseki (was: Fuseki Multi-Threading)
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ, Fuseki
> Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Assignee: Andy Seaborne
> Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Rahul Sharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13282499#comment-13282499 ]
Rahul Sharma commented on JENA-248:
-----------------------------------
Thanks for your reply Andy.
I've picked up the latest build of Fuseki 0.2.2 (jena-fuseki-0.2.2-20120524.052111-5-distribution) and I've run 200 construct queries and it did not give me any error. Fuseki did not freeze and showed no "500 - Currently in Transaction" error.
Then I ran about 10k construct queries and it still did not give any error. This is brilliant!
Thanks a lot Andy, much appreciated.
Thanks,
Rahul
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ, Fuseki
> Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Assignee: Andy Seaborne
> Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (JENA-248) Fuseki server unresponsive when
running multiple construct queries using multi-threading.
Posted by "Andy Seaborne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Seaborne resolved JENA-248.
--------------------------------
Resolution: Fixed
> Fuseki server unresponsive when running multiple construct queries using multi-threading.
> ------------------------------------------------------------------------------------------
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ, Fuseki
> Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
> Reporter: Rahul Sharma
> Assignee: Andy Seaborne
> Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using Task Parallel Library of .Net to talk to Fuseki and get response back. We've first tried through dotNetRdf and when about 25 queries have run, the fuseki server freezes and becomes unresponsive. To make it responsive again, we had to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying two separate service endpoints. Following is the sample construct query that we're using:
> CONSTRUCT
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> ?blankNode ?blankNodePredicate ?blankNodeObject .
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
> SERVICE <http://localhost:3030/companies/sparql>
> {
> <http://rahul.org/company/id/123456> ?predicate ?object .
> }
> SERVICE <http://localhost:3030/rahul/sparql>
> {
> OPTIONAL
> {
> <http://rahul.org/company/id/123456> ?pred ?blankNode1 .
> ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so we've used a simple HttpWebRequest - something like this:
> var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query=" + GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming unresponsive in the above mentioned case.
> Thanks,
> Rahul
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira