You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2015/05/21 17:26:20 UTC
Review Request 34547: Hive service check fails after moving Webhcat
Server
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34547/
-----------------------------------------------------------
Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, and Vitalyi Brodetskyi.
Bugs: AMBARI-11305
https://issues.apache.org/jira/browse/AMBARI-11305
Repository: ambari
Description
-------
Ater moving webhcat server hive service check fails with the below error
2015-05-19 20:42:40,763 - Error while executing command 'service_check':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py", line 78, in service_check
webhcat_service_check()
File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
return fn(*args, **kwargs)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py", line 72, in webhcat_service_check
params.HdfsResource(None, action = "execute")
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 114, in action_execute
logoutput=logoutput,
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 246, in action_run
raise ex
Fail: Execution of 'hadoop --config /usr/hdp/current/hadoop-client/conf jar /var/lib/ambari-agent/lib/fast-hdfs-resource.jar /var/lib/ambari-agent/data/hdfs_resources.json' returned 1. WARNING: Use "yarn jar" to launch YARN applications.
Using filesystem uri: hdfs://ip-172-31-48-99.ec2.internal:8020
Creating: Resource [source=/var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig, target=/tmp/idtest.ambari-qa.1432068155.46.pig, type=file, action=create, owner=ambari-qa, group=null, mode=null, recursiveChown=false, recursiveChmod=false, changePermissionforParents=false]
Exception in thread "main" java.io.FileNotFoundException: /var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig (Permission denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.<init>(RawLocalFileSystem.java:106)
at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:202)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:141)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:364)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1965)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1933)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1898)
at org.apache.ambari.fast_hdfs_resource.Resource.createResource(Resource.java:206)
at org.apache.ambari.fast_hdfs_resource.Runner.main(Runner.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Diffs
-----
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py 09fb690
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 86d348f
Diff: https://reviews.apache.org/r/34547/diff/
Testing
-------
unit tests passed
Thanks,
Dmytro Sen
Re: Review Request 34547: Hive service check fails after moving
Webhcat Server
Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34547/#review84709
-----------------------------------------------------------
Ship it!
Ship It!
- Vitalyi Brodetskyi
On Травень 21, 2015, 3:26 після полудня, Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34547/
> -----------------------------------------------------------
>
> (Updated Травень 21, 2015, 3:26 після полудня)
>
>
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-11305
> https://issues.apache.org/jira/browse/AMBARI-11305
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Ater moving webhcat server hive service check fails with the below error
> 2015-05-19 20:42:40,763 - Error while executing command 'service_check':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py", line 78, in service_check
> webhcat_service_check()
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
> return fn(*args, **kwargs)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py", line 72, in webhcat_service_check
> params.HdfsResource(None, action = "execute")
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 114, in action_execute
> logoutput=logoutput,
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 246, in action_run
> raise ex
> Fail: Execution of 'hadoop --config /usr/hdp/current/hadoop-client/conf jar /var/lib/ambari-agent/lib/fast-hdfs-resource.jar /var/lib/ambari-agent/data/hdfs_resources.json' returned 1. WARNING: Use "yarn jar" to launch YARN applications.
> Using filesystem uri: hdfs://ip-172-31-48-99.ec2.internal:8020
> Creating: Resource [source=/var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig, target=/tmp/idtest.ambari-qa.1432068155.46.pig, type=file, action=create, owner=ambari-qa, group=null, mode=null, recursiveChown=false, recursiveChmod=false, changePermissionforParents=false]
> Exception in thread "main" java.io.FileNotFoundException: /var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig (Permission denied)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.<init>(RawLocalFileSystem.java:106)
> at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:202)
> at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:141)
> at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:364)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1965)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1933)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1898)
> at org.apache.ambari.fast_hdfs_resource.Resource.createResource(Resource.java:206)
> at org.apache.ambari.fast_hdfs_resource.Runner.main(Runner.java:77)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py 09fb690
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 86d348f
>
> Diff: https://reviews.apache.org/r/34547/diff/
>
>
> Testing
> -------
>
> unit tests passed
>
>
> Thanks,
>
> Dmytro Sen
>
>
Re: Review Request 34547: Hive service check fails after moving
Webhcat Server
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34547/#review84708
-----------------------------------------------------------
Ship it!
Ship It!
- Dmitro Lisnichenko
On May 21, 2015, 3:26 p.m., Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34547/
> -----------------------------------------------------------
>
> (Updated May 21, 2015, 3:26 p.m.)
>
>
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-11305
> https://issues.apache.org/jira/browse/AMBARI-11305
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Ater moving webhcat server hive service check fails with the below error
> 2015-05-19 20:42:40,763 - Error while executing command 'service_check':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py", line 78, in service_check
> webhcat_service_check()
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
> return fn(*args, **kwargs)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py", line 72, in webhcat_service_check
> params.HdfsResource(None, action = "execute")
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 114, in action_execute
> logoutput=logoutput,
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 246, in action_run
> raise ex
> Fail: Execution of 'hadoop --config /usr/hdp/current/hadoop-client/conf jar /var/lib/ambari-agent/lib/fast-hdfs-resource.jar /var/lib/ambari-agent/data/hdfs_resources.json' returned 1. WARNING: Use "yarn jar" to launch YARN applications.
> Using filesystem uri: hdfs://ip-172-31-48-99.ec2.internal:8020
> Creating: Resource [source=/var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig, target=/tmp/idtest.ambari-qa.1432068155.46.pig, type=file, action=create, owner=ambari-qa, group=null, mode=null, recursiveChown=false, recursiveChmod=false, changePermissionforParents=false]
> Exception in thread "main" java.io.FileNotFoundException: /var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig (Permission denied)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.<init>(RawLocalFileSystem.java:106)
> at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:202)
> at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:141)
> at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:364)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1965)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1933)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1898)
> at org.apache.ambari.fast_hdfs_resource.Resource.createResource(Resource.java:206)
> at org.apache.ambari.fast_hdfs_resource.Runner.main(Runner.java:77)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py 09fb690
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 86d348f
>
> Diff: https://reviews.apache.org/r/34547/diff/
>
>
> Testing
> -------
>
> unit tests passed
>
>
> Thanks,
>
> Dmytro Sen
>
>
Re: Review Request 34547: Hive service check fails after moving
Webhcat Server
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34547/#review84707
-----------------------------------------------------------
Ship it!
Ship It!
- Andrew Onischuk
On May 21, 2015, 3:26 p.m., Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34547/
> -----------------------------------------------------------
>
> (Updated May 21, 2015, 3:26 p.m.)
>
>
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-11305
> https://issues.apache.org/jira/browse/AMBARI-11305
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Ater moving webhcat server hive service check fails with the below error
> 2015-05-19 20:42:40,763 - Error while executing command 'service_check':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py", line 78, in service_check
> webhcat_service_check()
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
> return fn(*args, **kwargs)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py", line 72, in webhcat_service_check
> params.HdfsResource(None, action = "execute")
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 114, in action_execute
> logoutput=logoutput,
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 246, in action_run
> raise ex
> Fail: Execution of 'hadoop --config /usr/hdp/current/hadoop-client/conf jar /var/lib/ambari-agent/lib/fast-hdfs-resource.jar /var/lib/ambari-agent/data/hdfs_resources.json' returned 1. WARNING: Use "yarn jar" to launch YARN applications.
> Using filesystem uri: hdfs://ip-172-31-48-99.ec2.internal:8020
> Creating: Resource [source=/var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig, target=/tmp/idtest.ambari-qa.1432068155.46.pig, type=file, action=create, owner=ambari-qa, group=null, mode=null, recursiveChown=false, recursiveChmod=false, changePermissionforParents=false]
> Exception in thread "main" java.io.FileNotFoundException: /var/lib/ambari-agent/data/tmp/idtest.ambari-qa.1432068155.46.pig (Permission denied)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.<init>(RawLocalFileSystem.java:106)
> at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:202)
> at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:141)
> at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:364)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1965)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1933)
> at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1898)
> at org.apache.ambari.fast_hdfs_resource.Resource.createResource(Resource.java:206)
> at org.apache.ambari.fast_hdfs_resource.Runner.main(Runner.java:77)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_service_check.py 09fb690
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 86d348f
>
> Diff: https://reviews.apache.org/r/34547/diff/
>
>
> Testing
> -------
>
> unit tests passed
>
>
> Thanks,
>
> Dmytro Sen
>
>