You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by "Raja.Aravapalli" <Ra...@target.com> on 2015/09/04 19:23:46 UTC
not able to submit samza job to resource manager
Hi
Please help me identify the problem:
I am not able to submit the samza job to yarn RM. Found this when I ran the "yarn application -status <app_id>"
========================================================
Application Report :
Application-Id : <APP_ID>
Application-Name : samza-testing_1
Application-Type : Samza
User : <USER_ID>
Queue : default
Start-Time : 1441387039186
Finish-Time : 1441387039210
Progress : 0%
State : FAILED
Final-State : FAILED
Tracking-URL : N/A
RPC Port : -1
AM Host : N/A
Aggregate Resource Allocation : 0 MB-seconds, 0 vcore-seconds
Diagnostics : User: <CLUSTER_RESOURCE_MGR_PRINCIPAL> is not allowed to impersonate <USER_ID>
========================================================
Please help me identify, what's stopping me submitting in to cluster ?
Thank you.
Regards,
Raja Mahesh Aravapalli.
Re: not able to submit samza job to resource manager
Posted by Yan Fang <ya...@gmail.com>.
Hi Raja,
For the log, even though it does not present in the URL, you may still be
able to see the logs by using *yarn logs -applicationId <application ID>* (or
go to the logs directory)
If you are using the 0.9.0 samza, I am afraid this version may not work
with the secured cluster. If you are using the master branch (compile it by
yourself), can you try to apply the patch
https://issues.apache.org/jira/browse/SAMZA-727, if it works, we can commit
this patch?
Thanks,
Fang, Yan
yanfang724@gmail.com
On Fri, Sep 4, 2015 at 11:23 AM, Raja.Aravapalli <Raja.Aravapalli@target.com
> wrote:
> Hi Yan,
>
> I couldn't see application present in the ResourceManager / JHS for the
> application id. And as you can see in my below email, tracking url is also
> showing as N/A.
>
> Only one thing that is working is: "yarn application -status <APP_ID>"
>
> ========================================================
> Application Report :
> Application-Id : <APP_ID>
> Application-Name : samza-testing_1
> Application-Type : Samza
> User : <USER_ID>
> Queue : default
> Start-Time : 1441387039186
> Finish-Time : 1441387039210
> Progress : 0%
> State : FAILED
> Final-State : FAILED
> Tracking-URL : N/A
> RPC Port : -1
> AM Host : N/A
> Aggregate Resource Allocation : 0 MB-seconds, 0 vcore-seconds
> Diagnostics : User: <CLUSTER_RESOURCE_MGR_PRINCIPAL> is not
> allowed to impersonate <USER_ID>
> ========================================================
>
>
> Our cluster is secured with Kerberos. Any specific setting I should set
> when working in secure cluster ??
>
>
>
> Regards,
> Raja Mahesh Aravapalli.
>
> -----Original Message-----
> From: Yan Fang [mailto:yanfang724@gmail.com]
> Sent: Friday, September 04, 2015 11:48 PM
> To: dev@samza.apache.org
> Subject: Re: not able to submit samza job to resource manager
>
> Hi Raja,
>
> Can you check the yarn's log? This gives us more information to see what
> is the problem.
>
> Thanks,
>
> Fang, Yan
> yanfang724@gmail.com
>
> On Fri, Sep 4, 2015 at 10:23 AM, Raja.Aravapalli <
> Raja.Aravapalli@target.com
> > wrote:
>
> > Hi
> >
> > Please help me identify the problem:
> >
> > I am not able to submit the samza job to yarn RM. Found this when I
> > ran the "yarn application -status <app_id>"
> >
> > ========================================================
> > Application Report :
> > Application-Id : <APP_ID>
> > Application-Name : samza-testing_1
> > Application-Type : Samza
> > User : <USER_ID>
> > Queue : default
> > Start-Time : 1441387039186
> > Finish-Time : 1441387039210
> > Progress : 0%
> > State : FAILED
> > Final-State : FAILED
> > Tracking-URL : N/A
> > RPC Port : -1
> > AM Host : N/A
> > Aggregate Resource Allocation : 0 MB-seconds, 0 vcore-seconds
> > Diagnostics : User: <CLUSTER_RESOURCE_MGR_PRINCIPAL> is not
> > allowed to impersonate <USER_ID>
> > ========================================================
> >
> > Please help me identify, what's stopping me submitting in to cluster ?
> >
> > Thank you.
> >
> >
> > Regards,
> > Raja Mahesh Aravapalli.
> >
> >
>
RE: not able to submit samza job to resource manager
Posted by "Raja.Aravapalli" <Ra...@target.com>.
Hi Yan,
I couldn't see application present in the ResourceManager / JHS for the application id. And as you can see in my below email, tracking url is also showing as N/A.
Only one thing that is working is: "yarn application -status <APP_ID>"
========================================================
Application Report :
Application-Id : <APP_ID>
Application-Name : samza-testing_1
Application-Type : Samza
User : <USER_ID>
Queue : default
Start-Time : 1441387039186
Finish-Time : 1441387039210
Progress : 0%
State : FAILED
Final-State : FAILED
Tracking-URL : N/A
RPC Port : -1
AM Host : N/A
Aggregate Resource Allocation : 0 MB-seconds, 0 vcore-seconds
Diagnostics : User: <CLUSTER_RESOURCE_MGR_PRINCIPAL> is not allowed to impersonate <USER_ID>
========================================================
Our cluster is secured with Kerberos. Any specific setting I should set when working in secure cluster ??
Regards,
Raja Mahesh Aravapalli.
-----Original Message-----
From: Yan Fang [mailto:yanfang724@gmail.com]
Sent: Friday, September 04, 2015 11:48 PM
To: dev@samza.apache.org
Subject: Re: not able to submit samza job to resource manager
Hi Raja,
Can you check the yarn's log? This gives us more information to see what is the problem.
Thanks,
Fang, Yan
yanfang724@gmail.com
On Fri, Sep 4, 2015 at 10:23 AM, Raja.Aravapalli <Raja.Aravapalli@target.com
> wrote:
> Hi
>
> Please help me identify the problem:
>
> I am not able to submit the samza job to yarn RM. Found this when I
> ran the "yarn application -status <app_id>"
>
> ========================================================
> Application Report :
> Application-Id : <APP_ID>
> Application-Name : samza-testing_1
> Application-Type : Samza
> User : <USER_ID>
> Queue : default
> Start-Time : 1441387039186
> Finish-Time : 1441387039210
> Progress : 0%
> State : FAILED
> Final-State : FAILED
> Tracking-URL : N/A
> RPC Port : -1
> AM Host : N/A
> Aggregate Resource Allocation : 0 MB-seconds, 0 vcore-seconds
> Diagnostics : User: <CLUSTER_RESOURCE_MGR_PRINCIPAL> is not
> allowed to impersonate <USER_ID>
> ========================================================
>
> Please help me identify, what's stopping me submitting in to cluster ?
>
> Thank you.
>
>
> Regards,
> Raja Mahesh Aravapalli.
>
>
Re: not able to submit samza job to resource manager
Posted by Yan Fang <ya...@gmail.com>.
Hi Raja,
Can you check the yarn's log? This gives us more information to see what is
the problem.
Thanks,
Fang, Yan
yanfang724@gmail.com
On Fri, Sep 4, 2015 at 10:23 AM, Raja.Aravapalli <Raja.Aravapalli@target.com
> wrote:
> Hi
>
> Please help me identify the problem:
>
> I am not able to submit the samza job to yarn RM. Found this when I ran
> the "yarn application -status <app_id>"
>
> ========================================================
> Application Report :
> Application-Id : <APP_ID>
> Application-Name : samza-testing_1
> Application-Type : Samza
> User : <USER_ID>
> Queue : default
> Start-Time : 1441387039186
> Finish-Time : 1441387039210
> Progress : 0%
> State : FAILED
> Final-State : FAILED
> Tracking-URL : N/A
> RPC Port : -1
> AM Host : N/A
> Aggregate Resource Allocation : 0 MB-seconds, 0 vcore-seconds
> Diagnostics : User: <CLUSTER_RESOURCE_MGR_PRINCIPAL> is not
> allowed to impersonate <USER_ID>
> ========================================================
>
> Please help me identify, what's stopping me submitting in to cluster ?
>
> Thank you.
>
>
> Regards,
> Raja Mahesh Aravapalli.
>
>