You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Duong (Jira)" <ji...@apache.org> on 2023/05/03 17:28:00 UTC
[jira] [Updated] (HDDS-8496) Hive with s3a connector for OBS bucket hits error
[ https://issues.apache.org/jira/browse/HDDS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Duong updated HDDS-8496:
------------------------
Summary: Hive with s3a connector for OBS bucket hits error (was: Hive with s3a connector for OBS bucket hits KEY_NOT_FOUND error)
> Hive with s3a connector for OBS bucket hits error
> -------------------------------------------------
>
> Key: HDDS-8496
> URL: https://issues.apache.org/jira/browse/HDDS-8496
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Manager
> Affects Versions: 1.4.0
> Reporter: Saketa Chalamchala
> Assignee: Sumit Agrawal
> Priority: Blocker
> Labels: proton
>
> Error: seen
> {code:java}
> ... 16 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename output from:
> [s3a://obs-bucket-link/mytable1/.hive-staging_hive_2023-04-23_07-38-52_965_8384866535295320062-1/_task_tmp.-ext-10000/_tmp.000000_3]
> to:
> [s3a://obs-bucket-link/mytable1/.hive-staging_hive_2023-04-23_07-38-52_965_8384866535295320062-1/_tmp.-ext-10000/000000_3]
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:296)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:254)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:157)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1458)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:731)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:482)
> ... 17 more
> {code}
>
> Steps to reproduce
>
> {code:java}
> ozone volume create /vol1
> ozone sh bucket create /vol1/obs-bucket --layout OBJECT_STORE
> ozone sh bucket link /vol1/obs-bucket /s3v/obs-bucket-link
> beeline -u "jdbc:
> [hive2://<host>:10000/default;principal=hive/<host>@<REALM>;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;sslTrustStorePassword=<redacted>]
> "
> > create external table mytable1(key string, value int) location '
> [s3a://obs-bucket-link/mytable1]
> ';
> > insert into mytable1 values("cldr",1);
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org