[jira] [Commented] (HIVE-9181) Fix SkewJoinOptimizer related Java 8 ordering differences

["Hive QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254565#comment-14254565 ] 

Hive QA commented on HIVE-9181:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12688485/HIVE-9181.patch

{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 6718 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_db_owner
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_owner_actions_db
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_database_properties
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_describe_database_json
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonmr_fetch
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_virtual_column
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
org.apache.hadoop.hive.ql.security.TestStorageBasedMetastoreAuthorizationReads.testReadDbSuccess
org.apache.hive.hcatalog.cli.TestSemanticAnalysis.testDescDB
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2152/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2152/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2152/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12688485 - PreCommit-HIVE-TRUNK-Build

> Fix SkewJoinOptimizer related Java 8 ordering differences
> ---------------------------------------------------------
>
>                 Key: HIVE-9181
>                 URL: https://issues.apache.org/jira/browse/HIVE-9181
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Tests
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>         Attachments: HIVE-9181.patch
>
>
> (1) {{SkewJoinOptimizer}} adds items to {{ParseContext.topOps}} is different order in Java 8 vs Java 7. This leads to differences in EXPLAIN output related to {{MapWork}}.
> (2) Dbproperties order for a "desc database" query is non-deterministic at the HiveMetastore end between Java 8 and Java 7 (because Thrift maps are un-ordered). 
> {code}
> create database test_db with dbproperties ('key1' = 'value1', 'key2' = 'value2');
> desc database extended test_db;
> {code}
> At client side, we serialize the dbproperties map returned from HMS as string and write it to a temp file. The {{FetchTask}} then reads the temp file and returns the string back to the user. In test environment, for consistent ordering, we should sort the map before it is serialized to the temp file.  
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)