[jira] [Commented] (HIVE-6499) Using Metastore-side Auth errors on non-resolvable IF/OF/SerDe

["Hive QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934209#comment-13934209 ] 

Hive QA commented on HIVE-6499:
-------------------------------



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12634158/HIVE-6499.patch

Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1767/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1767/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]]
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1767/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ svn = \s\v\n ]]
+ [[ -n '' ]]
+ [[ -d apache-svn-trunk-source ]]
+ [[ ! -d apache-svn-trunk-source/.svn ]]
+ [[ ! -d apache-svn-trunk-source ]]
+ cd apache-svn-trunk-source
+ svn revert -R .
Reverted 'contrib/src/test/results/clientnegative/udtf_explode2.q.out'
Reverted 'contrib/src/test/results/clientnegative/case_with_row_sequence.q.out'
Reverted 'contrib/src/test/results/clientnegative/invalid_row_sequence.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_min_n.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_max_n.q.out'
Reverted 'contrib/src/test/results/clientpositive/lateral_view_explode2.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_avg.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_example_arraymapstruct.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_group_concat.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_min.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_row_sequence.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_max.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_example_add.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_example_format.q.out'
Reverted 'contrib/src/test/results/clientpositive/udtf_output_on_close.q.out'
Reverted 'contrib/src/test/results/clientpositive/udtf_explode2.q.out'
Reverted 'contrib/src/test/results/clientpositive/dboutput.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_local_resource.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_function_does_not_implement_udf.q.out'
Reverted 'ql/src/test/results/clientnegative/create_unknown_udf_udaf.q.out'
Reverted 'ql/src/test/results/clientnegative/create_function_nonudf_class.q.out'
Reverted 'ql/src/test/results/clientnegative/create_function_nonexistent_db.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_test_error_reduce.q.out'
Reverted 'ql/src/test/results/clientnegative/drop_native_udf.q.out'
Reverted 'ql/src/test/results/clientnegative/create_udaf_failure.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_nonexistent_resource.q.out'
Reverted 'ql/src/test/results/clientnegative/create_unknown_genericudf.q.out'
Reverted 'ql/src/test/results/clientnegative/cluster_tasklog_retrieval.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_test_error.q.out'
Reverted 'ql/src/test/results/clientnegative/create_function_nonexistent_class.q.out'
Reverted 'ql/src/test/results/clientpositive/create_func1.q.out'
Reverted 'ql/src/test/results/clientpositive/macro.q.out'
Reverted 'ql/src/test/results/clientpositive/create_view.q.out'
Reverted 'ql/src/test/results/clientpositive/udaf_sum_list.q.out'
Reverted 'ql/src/test/results/clientpositive/create_genericudaf.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_logic_java_boolean.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_compare_java_string.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_testlength.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_testlength2.q.out'
Reverted 'ql/src/test/results/clientpositive/drop_udf.q.out'
Reverted 'ql/src/test/results/clientpositive/autogen_colalias.q.out'
Reverted 'ql/src/test/results/clientpositive/create_udaf.q.out'
Reverted 'ql/src/test/results/clientpositive/create_genericudf.q.out'
Reverted 'ql/src/test/results/clientpositive/ptf_register_tblfn.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_context_aware.q.out'
Reverted 'ql/src/test/results/clientpositive/windowing_udaf2.q.out'
Reverted 'ql/src/test/results/clientpositive/compile_processor.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_using.q.out'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/FunctionSemanticAnalyzer.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/MacroSemanticAnalyzer.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/Operation2Privilege.java'
++ awk '{print $2}'
++ egrep -v '^X|^Performing status on external'
++ svn status --no-ignore
+ rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit/target itests/custom-serde/target itests/util/target hcatalog/target hcatalog/storage-handlers/hbase/target hcatalog/server-extensions/target hcatalog/core/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target hwi/target common/target common/src/gen service/target contrib/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientnegative/authorization_create_macro1.q.out ql/src/test/results/clientnegative/authorization_create_func1.q.out ql/src/test/results/clientnegative/authorization_create_func2.q.out ql/src/test/results/clientpositive/authorization_create_func1.q.out ql/src/test/results/clientpositive/authorization_create_macro1.q.out ql/src/test/queries/clientnegative/authorization_create_macro1.q ql/src/test/queries/clientnegative/authorization_create_func1.q ql/src/test/queries/clientnegative/authorization_create_func2.q ql/src/test/queries/clientpositive/authorization_create_macro1.q ql/src/test/queries/clientpositive/authorization_create_func1.q
+ svn update

Fetching external item into 'hcatalog/src/test/e2e/harness'
External at revision 1577348.

At revision 1577348.
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12634158

> Using Metastore-side Auth errors on non-resolvable IF/OF/SerDe
> --------------------------------------------------------------
>
>                 Key: HIVE-6499
>                 URL: https://issues.apache.org/jira/browse/HIVE-6499
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore, Security
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-6499.patch, HIVE-6499.patch
>
>
> In cases where a user needs to use a custom IF/OF/SerDe that is not accessible from the metastore, calls like msc.createTable and msc.dropTable should still work without being able to load the class. This is possible as long as one does not enable MetaStore-side authorization, at which point this becomes impossible, erroring out with a ClassNotFoundException.
> The reason this happens is that since the AuthorizationProvider interface is defined against a ql.metadata.Table, we wind up needing to instantiate a ql.metadata.Table object, which, in its constructor tries to instantiate IF/OF/SerDe elements in an attempt to pre-load those fields. And if we do not have access to those classes in the metastore, this is when that fails. The constructor/initialize methods of Table and Partition do not really need to pre-initialize these fields, since the fields are accessed only through the accessor, and will be instantiated on first-use.



--
This message was sent by Atlassian JIRA
(v6.2#6252)