You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Chris Nauroth (JIRA)" <ji...@apache.org> on 2016/09/30 13:56:21 UTC
[jira] [Commented] (HIVE-14050) Hive attempts to 'chgrp' files on
s3a://
[ https://issues.apache.org/jira/browse/HIVE-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536067#comment-15536067 ]
Chris Nauroth commented on HIVE-14050:
--------------------------------------
Linking to HADOOP-13309, which will document the current limitations of the S3A ownership and permissions model, and HADOOP-13310, which might start returning a non-empty stub value for the group.
> Hive attempts to 'chgrp' files on s3a://
> ----------------------------------------
>
> Key: HIVE-14050
> URL: https://issues.apache.org/jira/browse/HIVE-14050
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.2.1
> Reporter: Sean Roberts
> Assignee: Chris Nauroth
> Labels: s3
>
> When inserting to a table on s3a://, Hive attempts to `chgrp` the files but files in s3a:// do not have group ownership.
> {code}
> hive> insert into INVENTORY select * from INVENTORY_Q1_2006;
> -chgrp: '' does not match expected pattern for group
> Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...
> {code}
> Full output of the query here:
> {code}
> hive> insert into INVENTORY select * from INVENTORY_Q1_2006;
> -chgrp: '' does not match expected pattern for group
> Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...
> Query ID = admin_20160617201151_5f953fbe-acde-4774-9ad7-06cffc76dd72
> Total jobs = 1
> Launching Job 1 out of 1
> Status: Running (Executing on YARN cluster with App id application_1466165341299_0011)
> --------------------------------------------------------------------------------
> VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> --------------------------------------------------------------------------------
> Map 1 .......... SUCCEEDED 1 1 0 0 0 0
> --------------------------------------------------------------------------------
> VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 8.71 s
> --------------------------------------------------------------------------------
> Loading data to table mydb.inventory
> -chgrp: '' does not match expected pattern for group
> Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...
> Table mydb.inventory stats: [numFiles=12, numRows=6020352, totalSize=25250706, rawDataSize=96325632]
> OK
> Time taken: 19.123 seconds
> {code}
> The table:
> {code}
> CREATE TABLE IF NOT EXISTS inventory
> (
> MONTH_ID int,
> ITEM_ID int,
> BOH_QTY float,
> EOH_QTY float
> ) row format delimited fields terminated by '|' escaped by '\\' stored as ORC
> LOCATION 's3a://mybucket/hive/warehouse/mydb.db/inventory'
> tblproperties ("orc.compress"="SNAPPY");
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)