You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "matteo brancaleoni (JIRA)" <ji...@apache.org> on 2016/02/04 17:34:39 UTC
[jira] [Updated] (AMBARI-14926) ambari cached hdfs.py conflicts
with python hdfs lib resulting into monitoring errors
[ https://issues.apache.org/jira/browse/AMBARI-14926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
matteo brancaleoni updated AMBARI-14926:
----------------------------------------
Description:
On systems with datanode and journal node monitored by ambari-agent,
if in the standard python path the hdfs lib is installed ( https://pypi.python.org/pypi/hdfs/ ) it makes datanode + journalnode monitoring fail:
* datanodes are seen up in global live datanodes
* but the service is down into the host service list
looking into the logs I get:
DEBUG 2016-02-04 16:54:49,160 PythonReflectiveExecutor.py:47 - Running command reflectively ['/usr/bin/python2',
u'/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py',
'SECURITY_STATUS',
--
'/var/lib/ambari-agent/tmp']
DEBUG 2016-02-04 16:54:49,170 PythonReflectiveExecutor.py:61 - Reflective command failed with exception:
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 55, in run_file
imp.load_source('__main__', script)
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py", line 30, in <module>
from utils import service
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/utils.py", line 37, in <module>
from zkfc_slave import ZkfcSlave
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/zkfc_slave.py", line 21, in <module>
from hdfs import hdfs
ImportError: cannot import name hdfs
I think that ambari is including its cache files after the python path, so if an hdfs module is present into python path makes the scripts goes crazy.
(basically using the system hdfs py module and not his own)
maybe cache files path must be included before the python path or imported with local imports?
was:
On systems with datanode and journal node monitored by ambari-agent,
if in the standard python path the hdfs lib is installed ( https://pypi.python.org/pypi/hdfs/ ) it makes datanode + journalnode monitoring fails:
* datanodes are seen up in global live datanodes
* but the service is down into the host service list
looking into the logs I get:
DEBUG 2016-02-04 16:54:49,160 PythonReflectiveExecutor.py:47 - Running command reflectively ['/usr/bin/python2',
u'/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py',
'SECURITY_STATUS',
--
'/var/lib/ambari-agent/tmp']
DEBUG 2016-02-04 16:54:49,170 PythonReflectiveExecutor.py:61 - Reflective command failed with exception:
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 55, in run_file
imp.load_source('__main__', script)
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py", line 30, in <module>
from utils import service
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/utils.py", line 37, in <module>
from zkfc_slave import ZkfcSlave
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/zkfc_slave.py", line 21, in <module>
from hdfs import hdfs
ImportError: cannot import name hdfs
I think that ambari is including its cache files after the python path, so if an hdfs module is present into python path makes the scripts goes crazy.
(basically using the system hdfs py module and not his own)
maybe cache files path must be included before the python path or imported with local imports?
> ambari cached hdfs.py conflicts with python hdfs lib resulting into monitoring errors
> -------------------------------------------------------------------------------------
>
> Key: AMBARI-14926
> URL: https://issues.apache.org/jira/browse/AMBARI-14926
> Project: Ambari
> Issue Type: Bug
> Components: ambari-agent
> Affects Versions: 2.2.0
> Environment: Linux CentOS 7 x86_64
> Reporter: matteo brancaleoni
>
> On systems with datanode and journal node monitored by ambari-agent,
> if in the standard python path the hdfs lib is installed ( https://pypi.python.org/pypi/hdfs/ ) it makes datanode + journalnode monitoring fail:
> * datanodes are seen up in global live datanodes
> * but the service is down into the host service list
> looking into the logs I get:
> DEBUG 2016-02-04 16:54:49,160 PythonReflectiveExecutor.py:47 - Running command reflectively ['/usr/bin/python2',
> u'/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py',
> 'SECURITY_STATUS',
> --
> '/var/lib/ambari-agent/tmp']
> DEBUG 2016-02-04 16:54:49,170 PythonReflectiveExecutor.py:61 - Reflective command failed with exception:
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 55, in run_file
> imp.load_source('__main__', script)
> File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py", line 30, in <module>
> from utils import service
> File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/utils.py", line 37, in <module>
> from zkfc_slave import ZkfcSlave
> File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/zkfc_slave.py", line 21, in <module>
> from hdfs import hdfs
> ImportError: cannot import name hdfs
> I think that ambari is including its cache files after the python path, so if an hdfs module is present into python path makes the scripts goes crazy.
> (basically using the system hdfs py module and not his own)
> maybe cache files path must be included before the python path or imported with local imports?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)