You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cxf.apache.org by Kiren Pillay <ki...@gmail.com> on 2013/05/07 15:29:33 UTC
OperationInfo NoClassDefFoundError: CXF under high load
Hi
We are subjecting our CXF app to high load (200 concurrent users), and are
experiencing a strange exception NoClassDefFoundError:
org/apache/cxf/service/model/OperationInfo.
When calling the loaded function in a single request (ie, no load), its
fine.
Theses are the included jars:
springsource-tc-server-developer/preprod/webapps # jar tvf pamsadms.war |
grep cxf
221826 Fri Mar 08 02:08:00 SAST 2013
WEB-INF/lib/cxf-rt-transports-http-2.6.6.jar
509217 Fri Mar 08 02:06:04 SAST 2013
WEB-INF/lib/cxf-rt-frontend-jaxrs-2.6.6.jar
368816 Fri Mar 08 02:07:36 SAST 2013 WEB-INF/lib/cxf-rt-core-2.6.6.jar
1004074 Fri Mar 08 02:07:14 SAST 2013 WEB-INF/lib/cxf-api-2.6.6.jar
38113 Fri Mar 08 02:07:44 SAST 2013
WEB-INF/lib/cxf-rt-bindings-xml-2.6.6.jar
The required jar where the OperationInfoClass (cxf-api-2.6.6.jar) is
present.
Any ideas what could be wrong here?
Regards
Kiren
26-Apr-2013 10:20:27.576 SEVERE
org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for
servlet CXFServlet threw exception
java.lang.NoClassDefFoundError: org/apache/cxf/service/model/OperationInfo
at
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:288)
at
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:237)
at
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:209)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:154)
at
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:130)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:225)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doDelete(AbstractHTTPServlet.java:156)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:201)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:563)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
Re: OperationInfo NoClassDefFoundError: CXF under high load
Posted by Kiren Pillay <ki...@gmail.com>.
Thanks Sergey!
I will investigate further.
Regards
Kiren
On Tue, May 7, 2013 at 3:40 PM, Sergey Beryozkin <sb...@gmail.com>wrote:
> Hi Kiren
>
> Looks like a memory issue to me, the only question is what kind of memory
> issue... I do not expect any leaks in CXF JAX-RS code in CXF 2.6.6. I think
> you can confirm that by having a single client do many requests. If it
> proves OK which I do expect to, then I guess it a question of increasing
> the memory resources on the server
>
> Sergey
>
>
> On 07/05/13 14:29, Kiren Pillay wrote:
>
>> Hi
>>
>> We are subjecting our CXF app to high load (200 concurrent users), and are
>> experiencing a strange exception NoClassDefFoundError:
>> org/apache/cxf/service/model/**OperationInfo.
>>
>> When calling the loaded function in a single request (ie, no load), its
>> fine.
>>
>> Theses are the included jars:
>> springsource-tc-server-**developer/preprod/webapps # jar tvf
>> pamsadms.war |
>> grep cxf
>> 221826 Fri Mar 08 02:08:00 SAST 2013
>> WEB-INF/lib/cxf-rt-transports-**http-2.6.6.jar
>> 509217 Fri Mar 08 02:06:04 SAST 2013
>> WEB-INF/lib/cxf-rt-frontend-**jaxrs-2.6.6.jar
>> 368816 Fri Mar 08 02:07:36 SAST 2013 WEB-INF/lib/cxf-rt-core-2.6.6.**jar
>> 1004074 Fri Mar 08 02:07:14 SAST 2013 WEB-INF/lib/cxf-api-2.6.6.jar
>> 38113 Fri Mar 08 02:07:44 SAST 2013
>> WEB-INF/lib/cxf-rt-bindings-**xml-2.6.6.jar
>>
>> The required jar where the OperationInfoClass (cxf-api-2.6.6.jar) is
>> present.
>>
>> Any ideas what could be wrong here?
>>
>> Regards
>> Kiren
>>
>> 26-Apr-2013 10:20:27.576 SEVERE
>> org.apache.catalina.core.**StandardWrapperValve.invoke Servlet.service()
>> for
>> servlet CXFServlet threw exception
>> java.lang.**NoClassDefFoundError: org/apache/cxf/service/model/**
>> OperationInfo
>> at
>> org.apache.cxf.phase.**PhaseInterceptorChain.**doIntercept(**
>> PhaseInterceptorChain.java:**288)
>> at
>> org.apache.cxf.transport.**ChainInitiationObserver.**onMessage(**
>> ChainInitiationObserver.java:**121)
>> at
>> org.apache.cxf.transport.http.**AbstractHTTPDestination.**invoke(**
>> AbstractHTTPDestination.java:**237)
>> at
>> org.apache.cxf.transport.**servlet.ServletController.**invokeDestination(
>> **ServletController.java:209)
>> at
>> org.apache.cxf.transport.**servlet.ServletController.**
>> invoke(ServletController.java:**154)
>> at
>> org.apache.cxf.transport.**servlet.CXFNonSpringServlet.**
>> invoke(CXFNonSpringServlet.**java:130)
>> at
>> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**handleRequest(**
>> AbstractHTTPServlet.java:225)
>> at
>> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**
>> doDelete(AbstractHTTPServlet.**java:156)
>> at javax.servlet.http.**HttpServlet.service(**
>> HttpServlet.java:643)
>> at
>> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**
>> service(AbstractHTTPServlet.**java:201)
>> at
>> org.apache.catalina.core.**ApplicationFilterChain.**internalDoFilter(**
>> ApplicationFilterChain.java:**290)
>> at
>> org.apache.catalina.core.**ApplicationFilterChain.**doFilter(**
>> ApplicationFilterChain.java:**206)
>> at
>> org.apache.catalina.core.**StandardWrapperValve.invoke(**
>> StandardWrapperValve.java:233)
>> at
>> org.apache.catalina.core.**StandardContextValve.invoke(**
>> StandardContextValve.java:191)
>> at
>> org.apache.catalina.**authenticator.**AuthenticatorBase.invoke(**
>> AuthenticatorBase.java:563)
>> at
>> org.apache.catalina.core.**StandardHostValve.invoke(**
>> StandardHostValve.java:127)
>> at
>> org.apache.catalina.valves.**ErrorReportValve.invoke(**
>> ErrorReportValve.java:102)
>> at
>> org.apache.catalina.core.**StandardEngineValve.invoke(**
>> StandardEngineValve.java:109)
>> at
>> org.apache.catalina.connector.**CoyoteAdapter.service(**
>> CoyoteAdapter.java:298)
>> at
>> org.apache.coyote.http11.**Http11Processor.process(**
>> Http11Processor.java:857)
>> at
>> org.apache.coyote.http11.**Http11Protocol$**Http11ConnectionHandler.**
>> process(Http11Protocol.java:**588)
>>
>>
>
>
Re: OperationInfo NoClassDefFoundError: CXF under high load
Posted by Kiren Pillay <ki...@gmail.com>.
Hi Philipe,
Its SpringSource tcServer, running tomcat-6.0.29.A.RELEASE.
The Java version is:
java version "1.7.0"
Java(TM) SE Runtime Environment (build 1.7.0-b147)
Java HotSpot(TM) 64-Bit Server VM (build 21.0-b17, mixed mode)
I will look at increasing PERMGEN if there are no other avenues.
There is a ramp-up time of 40seconds. I did pick up now that the first
error did happen the day before from a HibernateException, so I'm thinking
that triggered some instability in the server, investigating that now.
Regards
Kiren
On Tue, May 7, 2013 at 3:50 PM, Philippe Mouawad <
p.mouawad@ubik-ingenierie.com> wrote:
> Hello,
> What are your versions of:
>
> - Tomcat , seems it's a TC server
> - JDK
>
> When does it happen in the scenario ? at start ? you don't have a ramp up ?
> if not does it happen if you add a Ramp up ?
>
> If it's memory issue then it PERM zone issue , you can try increasing
> -XX:MaxPermSize but it would be better to be suer
> It could also be a Synchronization issue on TC Class Loader.
>
> --
> Cordialement.
> Philippe Mouawad.
> Ubik-Ingénierie
>
> UBIK LOAD PACK Web Site <http://www.ubikloadpack.com/>
>
> UBIK LOAD PACK on TWITTER <https://twitter.com/ubikloadpack>
>
> On Tue, May 7, 2013 at 3:40 PM, Sergey Beryozkin <sberyozkin@gmail.com
> >wrote:
>
> > Hi Kiren
> >
> > Looks like a memory issue to me, the only question is what kind of memory
> > issue... I do not expect any leaks in CXF JAX-RS code in CXF 2.6.6. I
> think
> > you can confirm that by having a single client do many requests. If it
> > proves OK which I do expect to, then I guess it a question of increasing
> > the memory resources on the server
> >
> > Sergey
> >
> >
> > On 07/05/13 14:29, Kiren Pillay wrote:
> >
> >> Hi
> >>
> >> We are subjecting our CXF app to high load (200 concurrent users), and
> are
> >> experiencing a strange exception NoClassDefFoundError:
> >> org/apache/cxf/service/model/**OperationInfo.
> >>
> >> When calling the loaded function in a single request (ie, no load), its
> >> fine.
> >>
> >> Theses are the included jars:
> >> springsource-tc-server-**developer/preprod/webapps # jar tvf
> >> pamsadms.war |
> >> grep cxf
> >> 221826 Fri Mar 08 02:08:00 SAST 2013
> >> WEB-INF/lib/cxf-rt-transports-**http-2.6.6.jar
> >> 509217 Fri Mar 08 02:06:04 SAST 2013
> >> WEB-INF/lib/cxf-rt-frontend-**jaxrs-2.6.6.jar
> >> 368816 Fri Mar 08 02:07:36 SAST 2013 WEB-INF/lib/cxf-rt-core-2.6.6.**jar
> >> 1004074 Fri Mar 08 02:07:14 SAST 2013 WEB-INF/lib/cxf-api-2.6.6.jar
> >> 38113 Fri Mar 08 02:07:44 SAST 2013
> >> WEB-INF/lib/cxf-rt-bindings-**xml-2.6.6.jar
> >>
> >> The required jar where the OperationInfoClass (cxf-api-2.6.6.jar) is
> >> present.
> >>
> >> Any ideas what could be wrong here?
> >>
> >> Regards
> >> Kiren
> >>
> >> 26-Apr-2013 10:20:27.576 SEVERE
> >> org.apache.catalina.core.**StandardWrapperValve.invoke Servlet.service()
> >> for
> >> servlet CXFServlet threw exception
> >> java.lang.**NoClassDefFoundError: org/apache/cxf/service/model/**
> >> OperationInfo
> >> at
> >> org.apache.cxf.phase.**PhaseInterceptorChain.**doIntercept(**
> >> PhaseInterceptorChain.java:**288)
> >> at
> >> org.apache.cxf.transport.**ChainInitiationObserver.**onMessage(**
> >> ChainInitiationObserver.java:**121)
> >> at
> >> org.apache.cxf.transport.http.**AbstractHTTPDestination.**invoke(**
> >> AbstractHTTPDestination.java:**237)
> >> at
> >>
> org.apache.cxf.transport.**servlet.ServletController.**invokeDestination(
> >> **ServletController.java:209)
> >> at
> >> org.apache.cxf.transport.**servlet.ServletController.**
> >> invoke(ServletController.java:**154)
> >> at
> >> org.apache.cxf.transport.**servlet.CXFNonSpringServlet.**
> >> invoke(CXFNonSpringServlet.**java:130)
> >> at
> >>
> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**handleRequest(**
> >> AbstractHTTPServlet.java:225)
> >> at
> >> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**
> >> doDelete(AbstractHTTPServlet.**java:156)
> >> at javax.servlet.http.**HttpServlet.service(**
> >> HttpServlet.java:643)
> >> at
> >> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**
> >> service(AbstractHTTPServlet.**java:201)
> >> at
> >> org.apache.catalina.core.**ApplicationFilterChain.**internalDoFilter(**
> >> ApplicationFilterChain.java:**290)
> >> at
> >> org.apache.catalina.core.**ApplicationFilterChain.**doFilter(**
> >> ApplicationFilterChain.java:**206)
> >> at
> >> org.apache.catalina.core.**StandardWrapperValve.invoke(**
> >> StandardWrapperValve.java:233)
> >> at
> >> org.apache.catalina.core.**StandardContextValve.invoke(**
> >> StandardContextValve.java:191)
> >> at
> >> org.apache.catalina.**authenticator.**AuthenticatorBase.invoke(**
> >> AuthenticatorBase.java:563)
> >> at
> >> org.apache.catalina.core.**StandardHostValve.invoke(**
> >> StandardHostValve.java:127)
> >> at
> >> org.apache.catalina.valves.**ErrorReportValve.invoke(**
> >> ErrorReportValve.java:102)
> >> at
> >> org.apache.catalina.core.**StandardEngineValve.invoke(**
> >> StandardEngineValve.java:109)
> >> at
> >> org.apache.catalina.connector.**CoyoteAdapter.service(**
> >> CoyoteAdapter.java:298)
> >> at
> >> org.apache.coyote.http11.**Http11Processor.process(**
> >> Http11Processor.java:857)
> >> at
> >> org.apache.coyote.http11.**Http11Protocol$**Http11ConnectionHandler.**
> >> process(Http11Protocol.java:**588)
> >>
> >>
> >
>
Re: OperationInfo NoClassDefFoundError: CXF under high load
Posted by Philippe Mouawad <p....@ubik-ingenierie.com>.
Hello,
What are your versions of:
- Tomcat , seems it's a TC server
- JDK
When does it happen in the scenario ? at start ? you don't have a ramp up ?
if not does it happen if you add a Ramp up ?
If it's memory issue then it PERM zone issue , you can try increasing
-XX:MaxPermSize but it would be better to be suer
It could also be a Synchronization issue on TC Class Loader.
--
Cordialement.
Philippe Mouawad.
Ubik-Ingénierie
UBIK LOAD PACK Web Site <http://www.ubikloadpack.com/>
UBIK LOAD PACK on TWITTER <https://twitter.com/ubikloadpack>
On Tue, May 7, 2013 at 3:40 PM, Sergey Beryozkin <sb...@gmail.com>wrote:
> Hi Kiren
>
> Looks like a memory issue to me, the only question is what kind of memory
> issue... I do not expect any leaks in CXF JAX-RS code in CXF 2.6.6. I think
> you can confirm that by having a single client do many requests. If it
> proves OK which I do expect to, then I guess it a question of increasing
> the memory resources on the server
>
> Sergey
>
>
> On 07/05/13 14:29, Kiren Pillay wrote:
>
>> Hi
>>
>> We are subjecting our CXF app to high load (200 concurrent users), and are
>> experiencing a strange exception NoClassDefFoundError:
>> org/apache/cxf/service/model/**OperationInfo.
>>
>> When calling the loaded function in a single request (ie, no load), its
>> fine.
>>
>> Theses are the included jars:
>> springsource-tc-server-**developer/preprod/webapps # jar tvf
>> pamsadms.war |
>> grep cxf
>> 221826 Fri Mar 08 02:08:00 SAST 2013
>> WEB-INF/lib/cxf-rt-transports-**http-2.6.6.jar
>> 509217 Fri Mar 08 02:06:04 SAST 2013
>> WEB-INF/lib/cxf-rt-frontend-**jaxrs-2.6.6.jar
>> 368816 Fri Mar 08 02:07:36 SAST 2013 WEB-INF/lib/cxf-rt-core-2.6.6.**jar
>> 1004074 Fri Mar 08 02:07:14 SAST 2013 WEB-INF/lib/cxf-api-2.6.6.jar
>> 38113 Fri Mar 08 02:07:44 SAST 2013
>> WEB-INF/lib/cxf-rt-bindings-**xml-2.6.6.jar
>>
>> The required jar where the OperationInfoClass (cxf-api-2.6.6.jar) is
>> present.
>>
>> Any ideas what could be wrong here?
>>
>> Regards
>> Kiren
>>
>> 26-Apr-2013 10:20:27.576 SEVERE
>> org.apache.catalina.core.**StandardWrapperValve.invoke Servlet.service()
>> for
>> servlet CXFServlet threw exception
>> java.lang.**NoClassDefFoundError: org/apache/cxf/service/model/**
>> OperationInfo
>> at
>> org.apache.cxf.phase.**PhaseInterceptorChain.**doIntercept(**
>> PhaseInterceptorChain.java:**288)
>> at
>> org.apache.cxf.transport.**ChainInitiationObserver.**onMessage(**
>> ChainInitiationObserver.java:**121)
>> at
>> org.apache.cxf.transport.http.**AbstractHTTPDestination.**invoke(**
>> AbstractHTTPDestination.java:**237)
>> at
>> org.apache.cxf.transport.**servlet.ServletController.**invokeDestination(
>> **ServletController.java:209)
>> at
>> org.apache.cxf.transport.**servlet.ServletController.**
>> invoke(ServletController.java:**154)
>> at
>> org.apache.cxf.transport.**servlet.CXFNonSpringServlet.**
>> invoke(CXFNonSpringServlet.**java:130)
>> at
>> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**handleRequest(**
>> AbstractHTTPServlet.java:225)
>> at
>> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**
>> doDelete(AbstractHTTPServlet.**java:156)
>> at javax.servlet.http.**HttpServlet.service(**
>> HttpServlet.java:643)
>> at
>> org.apache.cxf.transport.**servlet.AbstractHTTPServlet.**
>> service(AbstractHTTPServlet.**java:201)
>> at
>> org.apache.catalina.core.**ApplicationFilterChain.**internalDoFilter(**
>> ApplicationFilterChain.java:**290)
>> at
>> org.apache.catalina.core.**ApplicationFilterChain.**doFilter(**
>> ApplicationFilterChain.java:**206)
>> at
>> org.apache.catalina.core.**StandardWrapperValve.invoke(**
>> StandardWrapperValve.java:233)
>> at
>> org.apache.catalina.core.**StandardContextValve.invoke(**
>> StandardContextValve.java:191)
>> at
>> org.apache.catalina.**authenticator.**AuthenticatorBase.invoke(**
>> AuthenticatorBase.java:563)
>> at
>> org.apache.catalina.core.**StandardHostValve.invoke(**
>> StandardHostValve.java:127)
>> at
>> org.apache.catalina.valves.**ErrorReportValve.invoke(**
>> ErrorReportValve.java:102)
>> at
>> org.apache.catalina.core.**StandardEngineValve.invoke(**
>> StandardEngineValve.java:109)
>> at
>> org.apache.catalina.connector.**CoyoteAdapter.service(**
>> CoyoteAdapter.java:298)
>> at
>> org.apache.coyote.http11.**Http11Processor.process(**
>> Http11Processor.java:857)
>> at
>> org.apache.coyote.http11.**Http11Protocol$**Http11ConnectionHandler.**
>> process(Http11Protocol.java:**588)
>>
>>
>
Re: OperationInfo NoClassDefFoundError: CXF under high load
Posted by Sergey Beryozkin <sb...@gmail.com>.
Hi Kiren
Looks like a memory issue to me, the only question is what kind of
memory issue... I do not expect any leaks in CXF JAX-RS code in CXF
2.6.6. I think you can confirm that by having a single client do many
requests. If it proves OK which I do expect to, then I guess it a
question of increasing the memory resources on the server
Sergey
On 07/05/13 14:29, Kiren Pillay wrote:
> Hi
>
> We are subjecting our CXF app to high load (200 concurrent users), and are
> experiencing a strange exception NoClassDefFoundError:
> org/apache/cxf/service/model/OperationInfo.
>
> When calling the loaded function in a single request (ie, no load), its
> fine.
>
> Theses are the included jars:
> springsource-tc-server-developer/preprod/webapps # jar tvf pamsadms.war |
> grep cxf
> 221826 Fri Mar 08 02:08:00 SAST 2013
> WEB-INF/lib/cxf-rt-transports-http-2.6.6.jar
> 509217 Fri Mar 08 02:06:04 SAST 2013
> WEB-INF/lib/cxf-rt-frontend-jaxrs-2.6.6.jar
> 368816 Fri Mar 08 02:07:36 SAST 2013 WEB-INF/lib/cxf-rt-core-2.6.6.jar
> 1004074 Fri Mar 08 02:07:14 SAST 2013 WEB-INF/lib/cxf-api-2.6.6.jar
> 38113 Fri Mar 08 02:07:44 SAST 2013
> WEB-INF/lib/cxf-rt-bindings-xml-2.6.6.jar
>
> The required jar where the OperationInfoClass (cxf-api-2.6.6.jar) is
> present.
>
> Any ideas what could be wrong here?
>
> Regards
> Kiren
>
> 26-Apr-2013 10:20:27.576 SEVERE
> org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for
> servlet CXFServlet threw exception
> java.lang.NoClassDefFoundError: org/apache/cxf/service/model/OperationInfo
> at
> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:288)
> at
> org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
> at
> org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:237)
> at
> org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:209)
> at
> org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:154)
> at
> org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:130)
> at
> org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:225)
> at
> org.apache.cxf.transport.servlet.AbstractHTTPServlet.doDelete(AbstractHTTPServlet.java:156)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
> at
> org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:201)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:563)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> at
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> at
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
>