You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Haymant Mangla (Jira)" <ji...@apache.org> on 2021/09/17 05:49:00 UTC
[jira] [Updated] (HIVE-25534) Don't preserve FileAttribute.XATTR to
initialise distcp.
[ https://issues.apache.org/jira/browse/HIVE-25534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Haymant Mangla updated HIVE-25534:
----------------------------------
Description:
Remove the preserve xattr while calling distcp.
{code:java}
2021-08-23 10:06:18,485 ERROR org.apache.hadoop.tools.DistCp: [HiveServer2-Background-Pool: Thread-73]: XAttrs not supported on at least one file system:
org.apache.hadoop.tools.CopyListing$XAttrsNotSupportedException: XAttrs not supported for file system: s3a://hmangla1-dev
at org.apache.hadoop.tools.util.DistCpUtils.checkFileSystemXAttrSupport(DistCpUtils.java:513) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:337) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:304) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:214) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.execute(DistCp.java:193) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]{code}
was:
Remove the preserve xattr while calling distcp.
2021-08-23 10:06:18,485 ERROR org.apache.hadoop.tools.DistCp: [HiveServer2-Background-Pool: Thread-73]: XAttrs not supported on at least one file system:
org.apache.hadoop.tools.CopyListing$XAttrsNotSupportedException: XAttrs not supported for file system: s3a://hmangla1-dev
at org.apache.hadoop.tools.util.DistCpUtils.checkFileSystemXAttrSupport(DistCpUtils.java:513) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:337) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:304) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:214) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
at org.apache.hadoop.tools.DistCp.execute(DistCp.java:193) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
> Don't preserve FileAttribute.XATTR to initialise distcp.
> --------------------------------------------------------
>
> Key: HIVE-25534
> URL: https://issues.apache.org/jira/browse/HIVE-25534
> Project: Hive
> Issue Type: Bug
> Reporter: Haymant Mangla
> Assignee: Haymant Mangla
> Priority: Major
>
> Remove the preserve xattr while calling distcp.
> {code:java}
> 2021-08-23 10:06:18,485 ERROR org.apache.hadoop.tools.DistCp: [HiveServer2-Background-Pool: Thread-73]: XAttrs not supported on at least one file system:
> org.apache.hadoop.tools.CopyListing$XAttrsNotSupportedException: XAttrs not supported for file system: s3a://hmangla1-dev
> at org.apache.hadoop.tools.util.DistCpUtils.checkFileSystemXAttrSupport(DistCpUtils.java:513) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
> at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:337) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
> at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:304) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
> at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:214) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]
> at org.apache.hadoop.tools.DistCp.execute(DistCp.java:193) ~[hadoop-distcp-3.1.1.7.1.6.0-297.jar:?]{code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)