[jira] [Commented] (HIVE-14323) Reduce number of FS permissions and redundant FS operations

["Hive QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403108#comment-15403108 ] 

Hive QA commented on HIVE-14323:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12821291/HIVE-14323.3.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 10419 tests executed
*Failed tests:*
{noformat}
TestMsgBusConnection - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avro_nullable_union
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_13
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_orc_llap_counters
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_avro_non_nullable_union
org.apache.hadoop.hive.metastore.TestHiveMetaStoreTxns.stringifyValidTxns
org.apache.hadoop.hive.metastore.TestHiveMetaStoreTxns.testTxnRange
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/726/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/726/console
Test logs: http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-726/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 8 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12821291 - PreCommit-HIVE-MASTER-Build

> Reduce number of FS permissions and redundant FS operations
> -----------------------------------------------------------
>
>                 Key: HIVE-14323
>                 URL: https://issues.apache.org/jira/browse/HIVE-14323
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HIVE-14323.1.patch, HIVE-14323.2.patch, HIVE-14323.3.patch
>
>
> Some examples are given below.
> 1. When creating stage directory, FileUtils sets the directory permissions by running a set of chgrp and chmod commands. In systems like S3, this would not be relevant.
> 2. In some cases, fs.delete() is followed by fs.exists(). In this case, it might be redundant to check for exists() (lookup ops are expensive in systems like S3). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)