You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2014/05/07 17:39:39 UTC

Review Request 21164: Need to update HIVE_AUX_JARS_PATH in hive-env.sh

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21164/
-----------------------------------------------------------

Review request for Ambari and Myroslav Papirkovskyy.


Bugs: AMBARI-5700
    https://issues.apache.org/jira/browse/AMBARI-5700


Repository: ambari


Description
-------

On 1.3.x stack, hive data deployment is failing because of following error:

    
    
    Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hcatalog.security.HdfsAuthorizationProvider
    	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:280)
    	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)
    	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    	at 25613sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:601)
    	at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hcatalog.security.HdfsAuthorizationProvider
    	at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:342)
    	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:274)
    	... 7 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hcatalog.security.HdfsAuthorizationProvider
    	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    	at java.security.AccessController.doPrivileged(Native Method)
    	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
    	at java.lang.Class.forName0(Native Method)
    	at java.lang.Class.forName(Class.java:266)
    	at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:335)
    	... 8 more
    

To resolve this issue, we need to update HIVE_AUX_JARS_PATH similar to this:  
<https://github.com/hortonworks/gsInstaller/commit/f2f46bd88d7c0db986eef3cdb43
ebbebab18b243>

Current HIVE_AUX_JARS_PATH:

    
    
    if [ "${HIVE_AUX_JARS_PATH}" != "" ]; then
      export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}
    else
      export HIVE_AUX_JARS_PATH=/usr/lib/hcatalog/share/hcatalog/hcatalog-core.jar
    fi

Expected:

    
    
    if [ "${HIVE_AUX_JARS_PATH}" != "" ]; then
      export HIVE_AUX_JARS_PATH=/usr/lib/hcatalog/share/hcatalog/hcatalog-core.jar:${HIVE_AUX_JARS_PATH}
    else
      export HIVE_AUX_JARS_PATH=/usr/lib/hcatalog/share/hcatalog/hcatalog-core.jar
    fi
    


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/templates/hive-env.sh.j2 8826519 

Diff: https://reviews.apache.org/r/21164/diff/


Testing
-------


Thanks,

Andrew Onischuk


Re: Review Request 21164: Need to update HIVE_AUX_JARS_PATH in hive-env.sh

Posted by Myroslav Papirkovskyy <mp...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21164/#review42408
-----------------------------------------------------------

Ship it!


Ship It!

- Myroslav Papirkovskyy


On May 7, 2014, 6:39 p.m., Andrew Onischuk wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21164/
> -----------------------------------------------------------
> 
> (Updated May 7, 2014, 6:39 p.m.)
> 
> 
> Review request for Ambari and Myroslav Papirkovskyy.
> 
> 
> Bugs: AMBARI-5700
>     https://issues.apache.org/jira/browse/AMBARI-5700
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> On 1.3.x stack, hive data deployment is failing because of following error:
> 
>     
>     
>     Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hcatalog.security.HdfsAuthorizationProvider
>     	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:280)
>     	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)
>     	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
>     	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     	at 25613sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     	at java.lang.reflect.Method.invoke(Method.java:601)
>     	at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
>     Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hcatalog.security.HdfsAuthorizationProvider
>     	at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:342)
>     	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:274)
>     	... 7 more
>     Caused by: java.lang.ClassNotFoundException: org.apache.hcatalog.security.HdfsAuthorizationProvider
>     	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>     	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>     	at java.security.AccessController.doPrivileged(Native Method)
>     	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>     	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
>     	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
>     	at java.lang.Class.forName0(Native Method)
>     	at java.lang.Class.forName(Class.java:266)
>     	at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:335)
>     	... 8 more
>     
> 
> To resolve this issue, we need to update HIVE_AUX_JARS_PATH similar to this:  
> <https://github.com/hortonworks/gsInstaller/commit/f2f46bd88d7c0db986eef3cdb43
> ebbebab18b243>
> 
> Current HIVE_AUX_JARS_PATH:
> 
>     
>     
>     if [ "${HIVE_AUX_JARS_PATH}" != "" ]; then
>       export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}
>     else
>       export HIVE_AUX_JARS_PATH=/usr/lib/hcatalog/share/hcatalog/hcatalog-core.jar
>     fi
> 
> Expected:
> 
>     
>     
>     if [ "${HIVE_AUX_JARS_PATH}" != "" ]; then
>       export HIVE_AUX_JARS_PATH=/usr/lib/hcatalog/share/hcatalog/hcatalog-core.jar:${HIVE_AUX_JARS_PATH}
>     else
>       export HIVE_AUX_JARS_PATH=/usr/lib/hcatalog/share/hcatalog/hcatalog-core.jar
>     fi
>     
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/templates/hive-env.sh.j2 8826519 
> 
> Diff: https://reviews.apache.org/r/21164/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>