You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2014/10/06 14:28:25 UTC

Review Request 26358: Oozie and Falcon service checks fail on HDP2.2

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26358/
-----------------------------------------------------------

Review request for Ambari and Andrew Onischuk.


Bugs: AMBARI-7647
    https://issues.apache.org/jira/browse/AMBARI-7647


Repository: ambari


Description
-------

oozie
Job ID : 0000005-140926172757766-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : map-reduce-wf
App Path      : hdfs://c6405.ambari.apache.org:8020/user/ambari-qa/examples/apps/map-reduce
Status        : KILLED
Run           : 0
User          : ambari-qa
Group         : -
Created       : 2014-09-26 18:12 GMT
Started       : 2014-09-26 18:12 GMT
Last Modified : 2014-09-26 18:13 GMT
Ended         : 2014-09-26 18:13 GMT
CoordAction ID: -

Actions
------------------------------------------------------------------------------------------------------------------------------------
ID                                                                            Status    Ext ID                 Ext Status Err Code  
------------------------------------------------------------------------------------------------------------------------------------
0000005-140926172757766-oozie-oozi-W@:start:                                  OK        -                      OK         -         
------------------------------------------------------------------------------------------------------------------------------------
0000005-140926172757766-oozie-oozi-W@mr-node                                  ERROR     job_1411751639016_0006 FAILED/KILLED-         
------------------------------------------------------------------------------------------------------------------------------------
0000005-140926172757766-oozie-oozi-W@fail                                     OK        -                      OK         E0729     
------------------------------------------------------------------------------------------------------------------------------------
workflow_status=KILLED
falcon
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.1/services/FALCON/package/scripts/service_check.py", line 36, in service_check
    try_sleep = 20
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of '/usr/hdp/current/falcon/bin/falcon admin -version' returned 255. log4j:WARN No appenders could be found for logger (org.apache.hadoop.security.authentication.client.KerberosAuthenticator).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Stacktrace:
org.apache.falcon.client.FalconCLIException: Unable to initialize Falcon Client object
	at org.apache.falcon.client.FalconClient.<init>(FalconClient.java:144)
	at org.apache.falcon.cli.FalconCLI.run(FalconCLI.java:190)
	at org.apache.falcon.cli.FalconCLI.main(FalconCLI.java:144)
Caused by: org.apache.falcon.client.FalconCLIException: Could not authenticate, Authentication failed, status: 503, message: Service Unavailable
	at org.apache.falcon.client.FalconClient.getToken(FalconClient.java:171)
	at org.apache.falcon.client.FalconClient.<init>(FalconClient.java:142)
	... 2 more
Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Authentication failed, status: 503, message: Service Unavailable
	at org.apache.hadoop.security.authentication.client.AuthenticatedURL.extractToken(AuthenticatedURL.java:272)
	at org.apache.hadoop.security.authentication.client.PseudoAuthenticator.authenticate(PseudoAuthenticator.java:77)
	at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:205)
	at org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:216)
	at org.apache.falcon.client.FalconClient.getToken(FalconClient.java:169)
	... 3 more


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 608b9b1 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py aeccc75 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/OOZIE/configuration/oozie-site.xml dc56d8b 
  ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_server.py 576990e 

Diff: https://reviews.apache.org/r/26358/diff/


Testing
-------

manual deoployment on HDP2.1 and HDP2.2

+

Unit tests:

Ran 232 tests in 1.628s

OK
----------------------------------------------------------------------
Total run:641
Total errors:0
Total failures:0
OK


Thanks,

Dmytro Sen


Re: Review Request 26358: Oozie and Falcon service checks fail on HDP2.2

Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26358/#review55496
-----------------------------------------------------------

Ship it!


Ship It!

- Andrew Onischuk


On Oct. 6, 2014, 12:28 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/26358/
> -----------------------------------------------------------
> 
> (Updated Oct. 6, 2014, 12:28 p.m.)
> 
> 
> Review request for Ambari and Andrew Onischuk.
> 
> 
> Bugs: AMBARI-7647
>     https://issues.apache.org/jira/browse/AMBARI-7647
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> oozie
> Job ID : 0000005-140926172757766-oozie-oozi-W
> ------------------------------------------------------------------------------------------------------------------------------------
> Workflow Name : map-reduce-wf
> App Path      : hdfs://c6405.ambari.apache.org:8020/user/ambari-qa/examples/apps/map-reduce
> Status        : KILLED
> Run           : 0
> User          : ambari-qa
> Group         : -
> Created       : 2014-09-26 18:12 GMT
> Started       : 2014-09-26 18:12 GMT
> Last Modified : 2014-09-26 18:13 GMT
> Ended         : 2014-09-26 18:13 GMT
> CoordAction ID: -
> 
> Actions
> ------------------------------------------------------------------------------------------------------------------------------------
> ID                                                                            Status    Ext ID                 Ext Status Err Code  
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000005-140926172757766-oozie-oozi-W@:start:                                  OK        -                      OK         -         
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000005-140926172757766-oozie-oozi-W@mr-node                                  ERROR     job_1411751639016_0006 FAILED/KILLED-         
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000005-140926172757766-oozie-oozi-W@fail                                     OK        -                      OK         E0729     
> ------------------------------------------------------------------------------------------------------------------------------------
> workflow_status=KILLED
> falcon
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.1/services/FALCON/package/scripts/service_check.py", line 36, in service_check
>     try_sleep = 20
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
>     self.env.run()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
>     self.run_action(resource, action)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
>     provider_action()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
>     raise ex
> Fail: Execution of '/usr/hdp/current/falcon/bin/falcon admin -version' returned 255. log4j:WARN No appenders could be found for logger (org.apache.hadoop.security.authentication.client.KerberosAuthenticator).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> Stacktrace:
> org.apache.falcon.client.FalconCLIException: Unable to initialize Falcon Client object
> 	at org.apache.falcon.client.FalconClient.<init>(FalconClient.java:144)
> 	at org.apache.falcon.cli.FalconCLI.run(FalconCLI.java:190)
> 	at org.apache.falcon.cli.FalconCLI.main(FalconCLI.java:144)
> Caused by: org.apache.falcon.client.FalconCLIException: Could not authenticate, Authentication failed, status: 503, message: Service Unavailable
> 	at org.apache.falcon.client.FalconClient.getToken(FalconClient.java:171)
> 	at org.apache.falcon.client.FalconClient.<init>(FalconClient.java:142)
> 	... 2 more
> Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Authentication failed, status: 503, message: Service Unavailable
> 	at org.apache.hadoop.security.authentication.client.AuthenticatedURL.extractToken(AuthenticatedURL.java:272)
> 	at org.apache.hadoop.security.authentication.client.PseudoAuthenticator.authenticate(PseudoAuthenticator.java:77)
> 	at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:205)
> 	at org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:216)
> 	at org.apache.falcon.client.FalconClient.getToken(FalconClient.java:169)
> 	... 3 more
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 608b9b1 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py aeccc75 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/OOZIE/configuration/oozie-site.xml dc56d8b 
>   ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_server.py 576990e 
> 
> Diff: https://reviews.apache.org/r/26358/diff/
> 
> 
> Testing
> -------
> 
> manual deoployment on HDP2.1 and HDP2.2
> 
> +
> 
> Unit tests:
> 
> Ran 232 tests in 1.628s
> 
> OK
> ----------------------------------------------------------------------
> Total run:641
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>