You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2017/03/16 12:41:59 UTC

Review Request 57685: Security status commands fill ambari-agent.log with stack traces

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/57685/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-20480
    https://issues.apache.org/jira/browse/AMBARI-20480


Repository: ambari


Description
-------

Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file
        imp.load_source('__main__', script)
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 162, in <module>
        WebHCatServer().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 317, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 122, in security_status
        {'webhcat-site.xml': FILE_TYPE_XML}))
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py", line 163, in get_params_from_filesystem
        configuration = ET.parse(conf_dir + os.sep + config_file)
      File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 862, in parse
        tree.parse(source, parser)
      File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 579, in parse
        source = open(source, "rb")
    IOError: [Errno 2] No such file or directory: '/usr/hdp/current/hive-webhcat/etc/webhcat/webhcat-site.xml'
    INFO 2017-03-16 12:35:24,455 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component ZEPPELIN_MASTER of service ZEPPELIN of cluster c1 to the queue.
    INFO 2017-03-16 12:35:24,507 FileCache.py:171 - Updated directory /var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package
    INFO 2017-03-16 12:35:24,609 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component ACCUMULO_TSERVER of service ACCUMULO of cluster c1 to the queue.
    INFO 2017-03-16 12:35:24,704 PythonReflectiveExecutor.py:67 - Reflective command failed with exception:
    Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file
        imp.load_source('__main__', script)
      File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_tserver.py", line 24, in <module>
        AccumuloScript('tserver').execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 317, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_script.py", line 140, in security_status
        {'accumulo-site.xml': FILE_TYPE_XML})
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py", line 163, in get_params_from_filesystem
        configuration = ET.parse(conf_dir + os.sep + config_file)
      File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 862, in parse
        tree.parse(source, parser)
      File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 579, in parse
        source = open(source, "rb")
    IOError: [Errno 2] No such file or directory: '/usr/hdp/current/accumulo-client/conf/accumulo-site.xml'
    INFO 2017-03-16 12:35:24,755 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component ACCUMULO_CLIENT of service ACCUMULO of cluster c1 to the queue.
    INFO 2017-03-16 12:35:24,897 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component FALCON_CLIENT of service FALCON of cluster c1 to the queue.
    INFO 2017-03-16 12:35:25,049 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component OOZIE_CLIENT of service OOZIE of cluster c1 to the queue.
    INFO 2017-03-16 12:35:25,194 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component METRICS_GRAFANA of service AMBARI_METRICS of cluster c1 to the queue.
    INFO 2017-03-16 12:35:25,345 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component SPARK_CLIENT of service SPARK of cluster c1 to the queue.
    INFO 2017-03-16 12:35:25,483 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component NIMBUS of service STORM of cluster c1 to the queue.
    INFO 2017-03-16 12:35:25,629 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component HIVE_SERVER of service HIVE of cluster c1 to the queue.
    INFO 2017-03-16 12:35:25,728 PythonReflectiveExecutor.py:67 - Reflective command failed with exception:
    Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file
        imp.load_source('__main__', script)
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 227, in <module>
        HiveServer().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 317, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 161, in security_status
        {'hive-site.xml': FILE_TYPE_XML})
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py", line 163, in get_params_from_filesystem
        configuration = ET.parse(conf_dir + os.sep + config_file)
      File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 862, in parse
        tree.parse(source, parser)
      File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 579, in parse
        source = open(source, "rb")
    IOError: [Errno 2] No such file or directory: '/usr/hdp/current/hive-client/conf/conf.server/hive-site.xml'


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/functions/security_commons.py 96d60da 


Diff: https://reviews.apache.org/r/57685/diff/1/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Re: Review Request 57685: Security status commands fill ambari-agent.log with stack traces

Posted by Eugene Chekanskiy <ec...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/57685/#review169145
-----------------------------------------------------------


Ship it!




Ship It!

- Eugene Chekanskiy


On \u0411\u0435\u0440\u0435\u0437\u0435\u043d\u044c 16, 2017, 12:41 \u043f\u0456\u0441\u043b\u044f \u043f\u043e\u043b\u0443\u0434\u043d\u044f, Andrew Onischuk wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/57685/
> -----------------------------------------------------------
> 
> (Updated \u0411\u0435\u0440\u0435\u0437\u0435\u043d\u044c 16, 2017, 12:41 \u043f\u0456\u0441\u043b\u044f \u043f\u043e\u043b\u0443\u0434\u043d\u044f)
> 
> 
> Review request for Ambari and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-20480
>     https://issues.apache.org/jira/browse/AMBARI-20480
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Traceback (most recent call last):
>       File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file
>         imp.load_source('__main__', script)
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 162, in <module>
>         WebHCatServer().execute()
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 317, in execute
>         method(env)
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 122, in security_status
>         {'webhcat-site.xml': FILE_TYPE_XML}))
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py", line 163, in get_params_from_filesystem
>         configuration = ET.parse(conf_dir + os.sep + config_file)
>       File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 862, in parse
>         tree.parse(source, parser)
>       File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 579, in parse
>         source = open(source, "rb")
>     IOError: [Errno 2] No such file or directory: '/usr/hdp/current/hive-webhcat/etc/webhcat/webhcat-site.xml'
>     INFO 2017-03-16 12:35:24,455 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component ZEPPELIN_MASTER of service ZEPPELIN of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:24,507 FileCache.py:171 - Updated directory /var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package
>     INFO 2017-03-16 12:35:24,609 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component ACCUMULO_TSERVER of service ACCUMULO of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:24,704 PythonReflectiveExecutor.py:67 - Reflective command failed with exception:
>     Traceback (most recent call last):
>       File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file
>         imp.load_source('__main__', script)
>       File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_tserver.py", line 24, in <module>
>         AccumuloScript('tserver').execute()
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 317, in execute
>         method(env)
>       File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_script.py", line 140, in security_status
>         {'accumulo-site.xml': FILE_TYPE_XML})
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py", line 163, in get_params_from_filesystem
>         configuration = ET.parse(conf_dir + os.sep + config_file)
>       File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 862, in parse
>         tree.parse(source, parser)
>       File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 579, in parse
>         source = open(source, "rb")
>     IOError: [Errno 2] No such file or directory: '/usr/hdp/current/accumulo-client/conf/accumulo-site.xml'
>     INFO 2017-03-16 12:35:24,755 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component ACCUMULO_CLIENT of service ACCUMULO of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:24,897 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component FALCON_CLIENT of service FALCON of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:25,049 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component OOZIE_CLIENT of service OOZIE of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:25,194 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component METRICS_GRAFANA of service AMBARI_METRICS of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:25,345 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component SPARK_CLIENT of service SPARK of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:25,483 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component NIMBUS of service STORM of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:25,629 StatusCommandsExecutor.py:264 - Adding STATUS_COMMAND for component HIVE_SERVER of service HIVE of cluster c1 to the queue.
>     INFO 2017-03-16 12:35:25,728 PythonReflectiveExecutor.py:67 - Reflective command failed with exception:
>     Traceback (most recent call last):
>       File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file
>         imp.load_source('__main__', script)
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 227, in <module>
>         HiveServer().execute()
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 317, in execute
>         method(env)
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 161, in security_status
>         {'hive-site.xml': FILE_TYPE_XML})
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py", line 163, in get_params_from_filesystem
>         configuration = ET.parse(conf_dir + os.sep + config_file)
>       File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 862, in parse
>         tree.parse(source, parser)
>       File "/usr/lib64/python2.6/xml/etree/ElementTree.py", line 579, in parse
>         source = open(source, "rb")
>     IOError: [Errno 2] No such file or directory: '/usr/hdp/current/hive-client/conf/conf.server/hive-site.xml'
> 
> 
> Diffs
> -----
> 
>   ambari-common/src/main/python/resource_management/libraries/functions/security_commons.py 96d60da 
> 
> 
> Diff: https://reviews.apache.org/r/57685/diff/1/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>