You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Sid Wagle <sw...@hortonworks.com> on 2014/03/04 02:21:58 UTC

Review Request 18721: Cannot launch Hive CLI due to HDFS permission issues

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18721/
-----------------------------------------------------------

Review request for Ambari, Mahadev Konar and Sumit Mohanty.


Bugs: AMBARI-4928
    https://issues.apache.org/jira/browse/AMBARI-4928


Repository: ambari


Description
-------

I couldnt launch the hive cli with the following exception being dumped
{code}
Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=READ_EXECUTE, inode="/apps/hive/install":hive:hdfs:drw-r-xr-x
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:182)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5441)
{code}

There were no JARs under {{/apps/hive/install}}. 

These were the following hdfs permissions. Notable is {{/apps/hive/insatll}} permissions of 0655. 
{code}
$ hadoop fs -ls /apps
Found 5 items
drwxrwxrwx   - falcon hdfs          0 2014-03-03 14:21 /apps/falcon
drwxr-xr-x   - hdfs   hdfs          0 2014-03-03 14:21 /apps/hbase
drwxr-xr-x   - hdfs   hdfs          0 2014-03-03 14:23 /apps/hive
drw-r-xr-x   - tez    hdfs          0 2014-03-03 14:23 /apps/tez
drwxr-xr-x   - hcat   hdfs          0 2014-03-03 14:29 /apps/webhcat
$ hadoop fs -ls /apps/hive
Found 2 items
drw-r-xr-x   - hive hdfs          0 2014-03-03 14:23 /apps/hive/install
drwxrwxrwx   - hive hdfs          0 2014-03-03 14:23 /apps/hive/warehouse
{code}


Diffs
-----

  ambari-agent/src/main/python/resource_management/libraries/providers/copy_from_local.py 6d04e72 
  ambari-agent/src/test/python/resource_management/TestCopyFromLocal.py 40b7fc8 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py c883cc1 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/scripts/webhcat.py 67bb1a6 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 37e073b 
  ambari-server/src/test/python/stacks/2.0.6/WEBHCAT/test_webhcat_server.py 7fb7b57 

Diff: https://reviews.apache.org/r/18721/diff/


Testing
-------


Thanks,

Sid Wagle


Re: Review Request 18721: Cannot launch Hive CLI due to HDFS permission issues

Posted by Mahadev Konar <ma...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18721/#review36086
-----------------------------------------------------------

Ship it!


Ship It!

- Mahadev Konar


On March 4, 2014, 1:23 a.m., Sid Wagle wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18721/
> -----------------------------------------------------------
> 
> (Updated March 4, 2014, 1:23 a.m.)
> 
> 
> Review request for Ambari, Mahadev Konar and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-4928
>     https://issues.apache.org/jira/browse/AMBARI-4928
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> I couldnt launch the hive cli with the following exception being dumped
> {code}
> Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=READ_EXECUTE, inode="/apps/hive/install":hive:hdfs:drw-r-xr-x
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:182)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5441)
> {code}
> 
> There were no JARs under {{/apps/hive/install}}. 
> 
> These were the following hdfs permissions. Notable is {{/apps/hive/insatll}} permissions of 0655. 
> {code}
> $ hadoop fs -ls /apps
> Found 5 items
> drwxrwxrwx   - falcon hdfs          0 2014-03-03 14:21 /apps/falcon
> drwxr-xr-x   - hdfs   hdfs          0 2014-03-03 14:21 /apps/hbase
> drwxr-xr-x   - hdfs   hdfs          0 2014-03-03 14:23 /apps/hive
> drw-r-xr-x   - tez    hdfs          0 2014-03-03 14:23 /apps/tez
> drwxr-xr-x   - hcat   hdfs          0 2014-03-03 14:29 /apps/webhcat
> $ hadoop fs -ls /apps/hive
> Found 2 items
> drw-r-xr-x   - hive hdfs          0 2014-03-03 14:23 /apps/hive/install
> drwxrwxrwx   - hive hdfs          0 2014-03-03 14:23 /apps/hive/warehouse
> {code}
> 
> 
> Diffs
> -----
> 
>   ambari-agent/src/main/python/resource_management/libraries/providers/copy_from_local.py 6d04e72 
>   ambari-agent/src/test/python/resource_management/TestCopyFromLocal.py 40b7fc8 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py c883cc1 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/scripts/webhcat.py 67bb1a6 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 37e073b 
>   ambari-server/src/test/python/stacks/2.0.6/WEBHCAT/test_webhcat_server.py 7fb7b57 
> 
> Diff: https://reviews.apache.org/r/18721/diff/
> 
> 
> Testing
> -------
> 
> ----------------------------------------------------------------------
> Ran 188 tests in 2.637s
> 
> OK
> ----------------------------------------------------------------------
> Total run:503
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Sid Wagle
> 
>


Re: Review Request 18721: Cannot launch Hive CLI due to HDFS permission issues

Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18721/
-----------------------------------------------------------

(Updated March 4, 2014, 1:23 a.m.)


Review request for Ambari, Mahadev Konar and Sumit Mohanty.


Bugs: AMBARI-4928
    https://issues.apache.org/jira/browse/AMBARI-4928


Repository: ambari


Description
-------

I couldnt launch the hive cli with the following exception being dumped
{code}
Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=READ_EXECUTE, inode="/apps/hive/install":hive:hdfs:drw-r-xr-x
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:182)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5441)
{code}

There were no JARs under {{/apps/hive/install}}. 

These were the following hdfs permissions. Notable is {{/apps/hive/insatll}} permissions of 0655. 
{code}
$ hadoop fs -ls /apps
Found 5 items
drwxrwxrwx   - falcon hdfs          0 2014-03-03 14:21 /apps/falcon
drwxr-xr-x   - hdfs   hdfs          0 2014-03-03 14:21 /apps/hbase
drwxr-xr-x   - hdfs   hdfs          0 2014-03-03 14:23 /apps/hive
drw-r-xr-x   - tez    hdfs          0 2014-03-03 14:23 /apps/tez
drwxr-xr-x   - hcat   hdfs          0 2014-03-03 14:29 /apps/webhcat
$ hadoop fs -ls /apps/hive
Found 2 items
drw-r-xr-x   - hive hdfs          0 2014-03-03 14:23 /apps/hive/install
drwxrwxrwx   - hive hdfs          0 2014-03-03 14:23 /apps/hive/warehouse
{code}


Diffs
-----

  ambari-agent/src/main/python/resource_management/libraries/providers/copy_from_local.py 6d04e72 
  ambari-agent/src/test/python/resource_management/TestCopyFromLocal.py 40b7fc8 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py c883cc1 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/scripts/webhcat.py 67bb1a6 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 37e073b 
  ambari-server/src/test/python/stacks/2.0.6/WEBHCAT/test_webhcat_server.py 7fb7b57 

Diff: https://reviews.apache.org/r/18721/diff/


Testing (updated)
-------

----------------------------------------------------------------------
Ran 188 tests in 2.637s

OK
----------------------------------------------------------------------
Total run:503
Total errors:0
Total failures:0
OK


Thanks,

Sid Wagle