You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Timothy Potter <th...@gmail.com> on 2017/05/19 14:44:20 UTC
Session expired when executing streaming expression, but no long GC
pauses ...
I'm executing a streaming expr and get this error:
Caused by: org.apache.solr.common.SolrException: Could not load
collection from ZK:
MovieLens_Ratings_f2e6f8b0_3199_11e7_b8ab_0242ac110002
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1098)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:638)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1482)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1092)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1057)
at org.apache.solr.client.solrj.io.stream.FacetStream.open(FacetStream.java:356)
... 38 more
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for
/collections/MovieLens_Ratings_f2e6f8b0_3199_11e7_b8ab_0242ac110002/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:356)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1110)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1096)
... 43 more
I've scoured the GC logs for solr and there are no long pauses
(nothing even over 1 second) ... any ideas why that session could be
expired?
Re: Session expired when executing streaming expression, but no long
GC pauses ...
Posted by Piyush Kunal <pi...@myntra.com>.
The reason is GC pauses mostly at the client side and not the server side.
I guess you are using solrj client and this exception is thrown in the
client logs.
On Fri, May 19, 2017 at 11:46 PM, Joel Bernstein <jo...@gmail.com> wrote:
> Odd, I haven't run into this behavior. Are you getting the disconnect from
> the client side, or is this happening in a stream being run inside Solr?
>
>
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
> On Fri, May 19, 2017 at 1:40 PM, Timothy Potter <th...@gmail.com>
> wrote:
>
> > No, not every time, but there was no GC pause on the Solr side (no
> > gaps in the log, nothing in the gc log) ... in the zk log, I do see
> > this around the same time:
> >
> > 2017-05-05T13:59:52,362 - INFO
> > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@1007] -
> > Closed socket connection for client /127.0.0.1:54140 which had
> > sessionid 0x15bd8bdd3500022
> > 2017-05-05T13:59:52,818 - WARN
> > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@357] - caught
> > end of stream exception
> > org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to
> > read additional data from client sessionid 0x15bd8bdd3500023, likely
> > client has closed socket
> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > NIOServerCnxn.java:228)
> > [zookeeper-3.4.6.jar:3.4.6-1569965]
> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > NIOServerCnxnFactory.java:208)
> > [zookeeper-3.4.6.jar:3.4.6-1569965]
> > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66-internal]
> > 2017-05-05T13:59:52,819 - INFO
> > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@1007] -
> > Closed socket connection for client /127.0.0.1:54200 which had
> > sessionid 0x15bd8bdd3500023
> > ...
> >
> > 2017-05-05T14:00:00,001 - INFO [SessionTracker:ZooKeeperServer@347] -
> > Expiring session 0x15bd8bdd3500023, timeout of 10000ms exceeded
> >
> > On Fri, May 19, 2017 at 9:48 AM, Joel Bernstein <jo...@gmail.com>
> > wrote:
> > > You get this every time you run the expression?
> > >
> > > Joel Bernstein
> > > http://joelsolr.blogspot.com/
> > >
> > > On Fri, May 19, 2017 at 10:44 AM, Timothy Potter <thelabdude@gmail.com
> >
> > > wrote:
> > >
> > >> I'm executing a streaming expr and get this error:
> > >>
> > >> Caused by: org.apache.solr.common.SolrException: Could not load
> > >> collection from ZK:
> > >> MovieLens_Ratings_f2e6f8b0_3199_11e7_b8ab_0242ac110002
> > >> at org.apache.solr.common.cloud.ZkStateReader.
> > getCollectionLive(
> > >> ZkStateReader.java:1098)
> > >> at org.apache.solr.common.cloud.ZkStateReader$
> > >> LazyCollectionRef.get(ZkStateReader.java:638)
> > >> at org.apache.solr.client.solrj.impl.CloudSolrClient.
> > >> getDocCollection(CloudSolrClient.java:1482)
> > >> at org.apache.solr.client.solrj.impl.CloudSolrClient.
> > >> requestWithRetryOnStaleState(CloudSolrClient.java:1092)
> > >> at org.apache.solr.client.solrj.impl.CloudSolrClient.request(
> > >> CloudSolrClient.java:1057)
> > >> at org.apache.solr.client.solrj.io.stream.FacetStream.open(
> > >> FacetStream.java:356)
> > >> ... 38 more
> > >> Caused by: org.apache.zookeeper.KeeperException$
> > SessionExpiredException:
> > >> KeeperErrorCode = Session expired for
> > >> /collections/MovieLens_Ratings_f2e6f8b0_3199_11e7_
> > >> b8ab_0242ac110002/state.json
> > >> at org.apache.zookeeper.KeeperException.create(
> > >> KeeperException.java:127)
> > >> at org.apache.zookeeper.KeeperException.create(
> > >> KeeperException.java:51)
> > >> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.
> java:1155)
> > >> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
> > >> SolrZkClient.java:356)
> > >> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
> > >> SolrZkClient.java:353)
> > >> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(
> > >> ZkCmdExecutor.java:60)
> > >> at org.apache.solr.common.cloud.SolrZkClient.getData(
> > >> SolrZkClient.java:353)
> > >> at org.apache.solr.common.cloud.ZkStateReader.
> > >> fetchCollectionState(ZkStateReader.java:1110)
> > >> at org.apache.solr.common.cloud.ZkStateReader.
> > getCollectionLive(
> > >> ZkStateReader.java:1096)
> > >> ... 43 more
> > >>
> > >> I've scoured the GC logs for solr and there are no long pauses
> > >> (nothing even over 1 second) ... any ideas why that session could be
> > >> expired?
> > >>
> >
>
Re: Session expired when executing streaming expression, but no long
GC pauses ...
Posted by Joel Bernstein <jo...@gmail.com>.
Odd, I haven't run into this behavior. Are you getting the disconnect from
the client side, or is this happening in a stream being run inside Solr?
Joel Bernstein
http://joelsolr.blogspot.com/
On Fri, May 19, 2017 at 1:40 PM, Timothy Potter <th...@gmail.com>
wrote:
> No, not every time, but there was no GC pause on the Solr side (no
> gaps in the log, nothing in the gc log) ... in the zk log, I do see
> this around the same time:
>
> 2017-05-05T13:59:52,362 - INFO
> [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@1007] -
> Closed socket connection for client /127.0.0.1:54140 which had
> sessionid 0x15bd8bdd3500022
> 2017-05-05T13:59:52,818 - WARN
> [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@357] - caught
> end of stream exception
> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to
> read additional data from client sessionid 0x15bd8bdd3500023, likely
> client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> NIOServerCnxn.java:228)
> [zookeeper-3.4.6.jar:3.4.6-1569965]
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:208)
> [zookeeper-3.4.6.jar:3.4.6-1569965]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66-internal]
> 2017-05-05T13:59:52,819 - INFO
> [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@1007] -
> Closed socket connection for client /127.0.0.1:54200 which had
> sessionid 0x15bd8bdd3500023
> ...
>
> 2017-05-05T14:00:00,001 - INFO [SessionTracker:ZooKeeperServer@347] -
> Expiring session 0x15bd8bdd3500023, timeout of 10000ms exceeded
>
> On Fri, May 19, 2017 at 9:48 AM, Joel Bernstein <jo...@gmail.com>
> wrote:
> > You get this every time you run the expression?
> >
> > Joel Bernstein
> > http://joelsolr.blogspot.com/
> >
> > On Fri, May 19, 2017 at 10:44 AM, Timothy Potter <th...@gmail.com>
> > wrote:
> >
> >> I'm executing a streaming expr and get this error:
> >>
> >> Caused by: org.apache.solr.common.SolrException: Could not load
> >> collection from ZK:
> >> MovieLens_Ratings_f2e6f8b0_3199_11e7_b8ab_0242ac110002
> >> at org.apache.solr.common.cloud.ZkStateReader.
> getCollectionLive(
> >> ZkStateReader.java:1098)
> >> at org.apache.solr.common.cloud.ZkStateReader$
> >> LazyCollectionRef.get(ZkStateReader.java:638)
> >> at org.apache.solr.client.solrj.impl.CloudSolrClient.
> >> getDocCollection(CloudSolrClient.java:1482)
> >> at org.apache.solr.client.solrj.impl.CloudSolrClient.
> >> requestWithRetryOnStaleState(CloudSolrClient.java:1092)
> >> at org.apache.solr.client.solrj.impl.CloudSolrClient.request(
> >> CloudSolrClient.java:1057)
> >> at org.apache.solr.client.solrj.io.stream.FacetStream.open(
> >> FacetStream.java:356)
> >> ... 38 more
> >> Caused by: org.apache.zookeeper.KeeperException$
> SessionExpiredException:
> >> KeeperErrorCode = Session expired for
> >> /collections/MovieLens_Ratings_f2e6f8b0_3199_11e7_
> >> b8ab_0242ac110002/state.json
> >> at org.apache.zookeeper.KeeperException.create(
> >> KeeperException.java:127)
> >> at org.apache.zookeeper.KeeperException.create(
> >> KeeperException.java:51)
> >> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
> >> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
> >> SolrZkClient.java:356)
> >> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
> >> SolrZkClient.java:353)
> >> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(
> >> ZkCmdExecutor.java:60)
> >> at org.apache.solr.common.cloud.SolrZkClient.getData(
> >> SolrZkClient.java:353)
> >> at org.apache.solr.common.cloud.ZkStateReader.
> >> fetchCollectionState(ZkStateReader.java:1110)
> >> at org.apache.solr.common.cloud.ZkStateReader.
> getCollectionLive(
> >> ZkStateReader.java:1096)
> >> ... 43 more
> >>
> >> I've scoured the GC logs for solr and there are no long pauses
> >> (nothing even over 1 second) ... any ideas why that session could be
> >> expired?
> >>
>
Re: Session expired when executing streaming expression, but no long
GC pauses ...
Posted by Timothy Potter <th...@gmail.com>.
No, not every time, but there was no GC pause on the Solr side (no
gaps in the log, nothing in the gc log) ... in the zk log, I do see
this around the same time:
2017-05-05T13:59:52,362 - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@1007] -
Closed socket connection for client /127.0.0.1:54140 which had
sessionid 0x15bd8bdd3500022
2017-05-05T13:59:52,818 - WARN
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@357] - caught
end of stream exception
org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to
read additional data from client sessionid 0x15bd8bdd3500023, likely
client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[zookeeper-3.4.6.jar:3.4.6-1569965]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66-internal]
2017-05-05T13:59:52,819 - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:9983:NIOServerCnxn@1007] -
Closed socket connection for client /127.0.0.1:54200 which had
sessionid 0x15bd8bdd3500023
...
2017-05-05T14:00:00,001 - INFO [SessionTracker:ZooKeeperServer@347] -
Expiring session 0x15bd8bdd3500023, timeout of 10000ms exceeded
On Fri, May 19, 2017 at 9:48 AM, Joel Bernstein <jo...@gmail.com> wrote:
> You get this every time you run the expression?
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
> On Fri, May 19, 2017 at 10:44 AM, Timothy Potter <th...@gmail.com>
> wrote:
>
>> I'm executing a streaming expr and get this error:
>>
>> Caused by: org.apache.solr.common.SolrException: Could not load
>> collection from ZK:
>> MovieLens_Ratings_f2e6f8b0_3199_11e7_b8ab_0242ac110002
>> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(
>> ZkStateReader.java:1098)
>> at org.apache.solr.common.cloud.ZkStateReader$
>> LazyCollectionRef.get(ZkStateReader.java:638)
>> at org.apache.solr.client.solrj.impl.CloudSolrClient.
>> getDocCollection(CloudSolrClient.java:1482)
>> at org.apache.solr.client.solrj.impl.CloudSolrClient.
>> requestWithRetryOnStaleState(CloudSolrClient.java:1092)
>> at org.apache.solr.client.solrj.impl.CloudSolrClient.request(
>> CloudSolrClient.java:1057)
>> at org.apache.solr.client.solrj.io.stream.FacetStream.open(
>> FacetStream.java:356)
>> ... 38 more
>> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException:
>> KeeperErrorCode = Session expired for
>> /collections/MovieLens_Ratings_f2e6f8b0_3199_11e7_
>> b8ab_0242ac110002/state.json
>> at org.apache.zookeeper.KeeperException.create(
>> KeeperException.java:127)
>> at org.apache.zookeeper.KeeperException.create(
>> KeeperException.java:51)
>> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
>> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
>> SolrZkClient.java:356)
>> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
>> SolrZkClient.java:353)
>> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(
>> ZkCmdExecutor.java:60)
>> at org.apache.solr.common.cloud.SolrZkClient.getData(
>> SolrZkClient.java:353)
>> at org.apache.solr.common.cloud.ZkStateReader.
>> fetchCollectionState(ZkStateReader.java:1110)
>> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(
>> ZkStateReader.java:1096)
>> ... 43 more
>>
>> I've scoured the GC logs for solr and there are no long pauses
>> (nothing even over 1 second) ... any ideas why that session could be
>> expired?
>>
Re: Session expired when executing streaming expression, but no long
GC pauses ...
Posted by Joel Bernstein <jo...@gmail.com>.
You get this every time you run the expression?
Joel Bernstein
http://joelsolr.blogspot.com/
On Fri, May 19, 2017 at 10:44 AM, Timothy Potter <th...@gmail.com>
wrote:
> I'm executing a streaming expr and get this error:
>
> Caused by: org.apache.solr.common.SolrException: Could not load
> collection from ZK:
> MovieLens_Ratings_f2e6f8b0_3199_11e7_b8ab_0242ac110002
> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(
> ZkStateReader.java:1098)
> at org.apache.solr.common.cloud.ZkStateReader$
> LazyCollectionRef.get(ZkStateReader.java:638)
> at org.apache.solr.client.solrj.impl.CloudSolrClient.
> getDocCollection(CloudSolrClient.java:1482)
> at org.apache.solr.client.solrj.impl.CloudSolrClient.
> requestWithRetryOnStaleState(CloudSolrClient.java:1092)
> at org.apache.solr.client.solrj.impl.CloudSolrClient.request(
> CloudSolrClient.java:1057)
> at org.apache.solr.client.solrj.io.stream.FacetStream.open(
> FacetStream.java:356)
> ... 38 more
> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException:
> KeeperErrorCode = Session expired for
> /collections/MovieLens_Ratings_f2e6f8b0_3199_11e7_
> b8ab_0242ac110002/state.json
> at org.apache.zookeeper.KeeperException.create(
> KeeperException.java:127)
> at org.apache.zookeeper.KeeperException.create(
> KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
> SolrZkClient.java:356)
> at org.apache.solr.common.cloud.SolrZkClient$7.execute(
> SolrZkClient.java:353)
> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(
> ZkCmdExecutor.java:60)
> at org.apache.solr.common.cloud.SolrZkClient.getData(
> SolrZkClient.java:353)
> at org.apache.solr.common.cloud.ZkStateReader.
> fetchCollectionState(ZkStateReader.java:1110)
> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(
> ZkStateReader.java:1096)
> ... 43 more
>
> I've scoured the GC logs for solr and there are no long pauses
> (nothing even over 1 second) ... any ideas why that session could be
> expired?
>