You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Shashi Vishwakarma <sh...@gmail.com> on 2016/03/01 20:26:10 UTC
Installing SPARK using Ambari REST API
Hi
I am trying to install SPARK service using Ambari REST API. I am getting
following exception while adding component to service.
curl -u admin:admin -H 'X-Requested-By: ambari' -i -X POST
http://yhostnaem:8080/api/v1/clusters/mycluster/services/SPARK/components/SPARK_THRIFTSERVER
02 Mar 2016 00:07:58,925 ERROR [qtp-client-51827]
BaseManagementHandler:66 - Caught a runtime exception while attempting
to create a resource
java.lang.RuntimeException: Trying to create a ServiceComponent not
recognized in stack info, clusterName=mycluster, serviceName=SPARK,
componentName=SPARK_THRIFTSERVER, stackInfo=HDP-2.3
at org.apache.ambari.server.state.ServiceComponentImpl.<init>(ServiceComponentImpl.java:107)
at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$c4f0850b.<init>(<generated>)
at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$c4f0850b$$FastClassByGuice$$d9e7a832.newInstance(<generated>)
at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at com.google.inject.internal.ProxyFactory$ProxyConstructor.newInstance(ProxyFactory.java:260)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:974)
at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:632)
at com.sun.proxy.$Proxy17.createNew(Unknown Source)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider.createComponents(ComponentResourceProvider.java:408)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider$1.invoke(ComponentResourceProvider.java:130)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider$1.invoke(ComponentResourceProvider.java:127)
at org.apache.ambari.server.controller.internal.AbstractResourceProvider.createResources(AbstractResourceProvider.java:272)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider.createResources(ComponentResourceProvider.java:127)
at org.apache.ambari.server.controller.internal.ClusterControllerImpl.createResources(ClusterControllerImpl.java:289)
at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.create(PersistenceManagerImpl.java:76)
at org.apache.ambari.server.api.handlers.CreateHandler.persist(CreateHandler.java:36)
at org.apache.ambari.server.api.handlers.BaseManagementHandler.handleRequest(BaseManagementHandler.java:72)
at org.apache.ambari.server.api.services.BaseRequest.process(BaseRequest.java:135)
at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:105)
at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:74)
at org.apache.ambari.server.api.services.ComponentService.createComponent(ComponentService.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
Any suggestion. Thanks in advance.
Shashi
Re: Installing SPARK using Ambari REST API
Posted by Shashi Vishwakarma <sh...@gmail.com>.
Thanks Jaimin for pointing this out...
On 2 Mar 2016 3:05 am, "Jaimin Jetly" <ja...@hortonworks.com> wrote:
> Hi Shashi,
>
>
> From the error, it looks that the HDP-2.3 stack being used does not have
> definition for SPARK_THRIFTSERVER.
>
>
> This is likely if you are using older Ambari version whose HDP-2.3
> stack did not support Spark ThriftServer.
>
> Support for ThriftServer was first added for HDP-2.3 stack in Ambari
> in 2.1.2 release.
>
> The commit that added this support:
> https://issues.apache.org/jira/browse/AMBARI-13094
>
>
>
>
> --Thanks
>
> Jaimin
> ------------------------------
> *From:* Shashi Vishwakarma <sh...@gmail.com>
> *Sent:* Tuesday, March 01, 2016 11:26 AM
> *To:* user@ambari.apache.org
> *Subject:* Installing SPARK using Ambari REST API
>
>
> Hi
>
> I am trying to install SPARK service using Ambari REST API. I am getting
> following exception while adding component to service.
>
> curl -u admin:admin -H 'X-Requested-By: ambari' -i -X POST http://yhostnaem:8080/api/v1/clusters/mycluster/services/SPARK/components/SPARK_THRIFTSERVER
>
> 02 Mar 2016 00:07:58,925 ERROR [qtp-client-51827] BaseManagementHandler:66 - Caught a runtime exception while attempting to create a resource
> java.lang.RuntimeException: Trying to create a ServiceComponent not recognized in stack info, clusterName=mycluster, serviceName=SPARK, componentName=SPARK_THRIFTSERVER, stackInfo=HDP-2.3
> at org.apache.ambari.server.state.ServiceComponentImpl.<init>(ServiceComponentImpl.java:107)
> at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$c4f0850b.<init>(<generated>)
> at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$c4f0850b$$FastClassByGuice$$d9e7a832.newInstance(<generated>)
> at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
> at com.google.inject.internal.ProxyFactory$ProxyConstructor.newInstance(ProxyFactory.java:260)
> at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
> at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
> at com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
> at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
> at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:974)
> at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:632)
> at com.sun.proxy.$Proxy17.createNew(Unknown Source)
> at org.apache.ambari.server.controller.internal.ComponentResourceProvider.createComponents(ComponentResourceProvider.java:408)
> at org.apache.ambari.server.controller.internal.ComponentResourceProvider$1.invoke(ComponentResourceProvider.java:130)
> at org.apache.ambari.server.controller.internal.ComponentResourceProvider$1.invoke(ComponentResourceProvider.java:127)
> at org.apache.ambari.server.controller.internal.AbstractResourceProvider.createResources(AbstractResourceProvider.java:272)
> at org.apache.ambari.server.controller.internal.ComponentResourceProvider.createResources(ComponentResourceProvider.java:127)
> at org.apache.ambari.server.controller.internal.ClusterControllerImpl.createResources(ClusterControllerImpl.java:289)
> at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.create(PersistenceManagerImpl.java:76)
> at org.apache.ambari.server.api.handlers.CreateHandler.persist(CreateHandler.java:36)
> at org.apache.ambari.server.api.handlers.BaseManagementHandler.handleRequest(BaseManagementHandler.java:72)
> at org.apache.ambari.server.api.services.BaseRequest.process(BaseRequest.java:135)
> at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:105)
> at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:74)
> at org.apache.ambari.server.api.services.ComponentService.createComponent(ComponentService.java:137)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
> at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>
>
> Any suggestion. Thanks in advance.
>
>
> Shashi
>
>
Re: Installing SPARK using Ambari REST API
Posted by Jaimin Jetly <ja...@hortonworks.com>.
Hi Shashi,
From the error, it looks that the HDP-2.3 stack being used does not have definition for SPARK_THRIFTSERVER.
This is likely if you are using older Ambari version whose HDP-2.3 stack did not support Spark ThriftServer.
Support for ThriftServer was first added for HDP-2.3 stack in Ambari in 2.1.2 release.
The commit that added this support: https://issues.apache.org/jira/browse/AMBARI-13094
--Thanks
Jaimin
________________________________
From: Shashi Vishwakarma <sh...@gmail.com>
Sent: Tuesday, March 01, 2016 11:26 AM
To: user@ambari.apache.org
Subject: Installing SPARK using Ambari REST API
Hi
I am trying to install SPARK service using Ambari REST API. I am getting following exception while adding component to service.
curl -u admin:admin -H 'X-Requested-By: ambari' -i -X POST http://yhostnaem:8080/api/v1/clusters/mycluster/services/SPARK/components/SPARK_THRIFTSERVER
02 Mar 2016 00:07:58,925 ERROR [qtp-client-51827] BaseManagementHandler:66 - Caught a runtime exception while attempting to create a resource
java.lang.RuntimeException: Trying to create a ServiceComponent not recognized in stack info, clusterName=mycluster, serviceName=SPARK, componentName=SPARK_THRIFTSERVER, stackInfo=HDP-2.3
at org.apache.ambari.server.state.ServiceComponentImpl.<init>(ServiceComponentImpl.java:107)
at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$c4f0850b.<init>(<generated>)
at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$c4f0850b$$FastClassByGuice$$d9e7a832.newInstance(<generated>)
at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at com.google.inject.internal.ProxyFactory$ProxyConstructor.newInstance(ProxyFactory.java:260)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:974)
at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:632)
at com.sun.proxy.$Proxy17.createNew(Unknown Source)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider.createComponents(ComponentResourceProvider.java:408)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider$1.invoke(ComponentResourceProvider.java:130)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider$1.invoke(ComponentResourceProvider.java:127)
at org.apache.ambari.server.controller.internal.AbstractResourceProvider.createResources(AbstractResourceProvider.java:272)
at org.apache.ambari.server.controller.internal.ComponentResourceProvider.createResources(ComponentResourceProvider.java:127)
at org.apache.ambari.server.controller.internal.ClusterControllerImpl.createResources(ClusterControllerImpl.java:289)
at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.create(PersistenceManagerImpl.java:76)
at org.apache.ambari.server.api.handlers.CreateHandler.persist(CreateHandler.java:36)
at org.apache.ambari.server.api.handlers.BaseManagementHandler.handleRequest(BaseManagementHandler.java:72)
at org.apache.ambari.server.api.services.BaseRequest.process(BaseRequest.java:135)
at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:105)
at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:74)
at org.apache.ambari.server.api.services.ComponentService.createComponent(ComponentService.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
Any suggestion. Thanks in advance.
Shashi