You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Xiaoyu Yao (JIRA)" <ji...@apache.org> on 2018/03/22 21:56:00 UTC
[jira] [Commented] (HDFS-13323) Ozone: freon should not retry
creating keys immediately after chilli mode failures
[ https://issues.apache.org/jira/browse/HDFS-13323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410367#comment-16410367 ]
Xiaoyu Yao commented on HDFS-13323:
-----------------------------------
Here is the repeated error message from the create key loop.
{code}
0-00293, with hadoop as owner and quota set to 1152921504606846976 bytes.
2018-03-22 21:53:03 INFO Configuration:3204 - Removed undeclared tags:
2018-03-22 21:53:03 INFO RpcClient:339 - Creating Bucket: vol-0-00293/bucket-0-53141, with Versioning false and Storage Type set to DISK
2018-03-22 21:53:03 ERROR Freon:788 - Exception while adding key: key-0-45674 in bucket: org.apache.hadoop.ozone.client.OzoneBucket@1c16c8c9 of volume: org.apache.hadoop.ozone.client.OzoneVolume@19059e54.
java.io.IOException: Create key failed, error:INTERNAL_ERROR
at org.apache.hadoop.ozone.ksm.protocolPB.KeySpaceManagerProtocolClientSideTranslatorPB.openKey(KeySpaceManagerProtocolClientSideTranslatorPB.java:545)
at org.apache.hadoop.ozone.client.rpc.RpcClient.createKey(RpcClient.java:467)
at org.apache.hadoop.ozone.client.OzoneBucket.createKey(OzoneBucket.java:255)
at org.apache.hadoop.ozone.tools.Freon$OfflineProcessor.run(Freon.java:749)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-03-22 21:53:03 ERROR Freon:788 - Exception while adding key: key-1-00648 in bucket: org.apache.hadoop.ozone.client.OzoneBucket@1c16c8c9 of volume: org.apache.hadoop.ozone.client.OzoneVolume@19059e54.
{code}
> Ozone: freon should not retry creating keys immediately after chilli mode failures
> ----------------------------------------------------------------------------------
>
> Key: HDFS-13323
> URL: https://issues.apache.org/jira/browse/HDFS-13323
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Xiaoyu Yao
> Assignee: Xiaoyu Yao
> Priority: Major
>
> I've seen may create key failures immediately after spin up the docker based ozone cluster. The error stack does not reveal this is caused by chili mode (SCM log has it).
> freon could handle chili mode better without too many create key retry failures in a short period of time.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org