You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Hongbing Wang (Jira)" <ji...@apache.org> on 2024/07/20 08:14:00 UTC
[jira] [Updated] (HDDS-11209) Avoid insufficient EC pipelines in the container pipeline cache
[ https://issues.apache.org/jira/browse/HDDS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hongbing Wang updated HDDS-11209:
---------------------------------
Description:
OM cached pipeline may not cache container's all datanode information (for example, some DNs may not report in time), which can be problematic for EC files. If the nodes num is less than the EC data-blocks num, an error will occur when reading data:
{code:java}
There are insufficient datanodes to read the EC block {code}
This err will persist until the cache expires (after 6 hours) even if all DNs corresponding to the EC file are completely normal.
So, we should not cache EC pipelines with incomplete data-nodes.
was:
OM cached pipeline may not have completed caching container's all datanode information (for example, some DNs may not have reported back yet after the SCM restarts, or some DNs may not report due to some reasons ), which can be problematic for EC files. If the nodes num is less than the EC data-blocks num, an error will occur when reading data:
{code:java}
There are insufficient datanodes to read the EC block {code}
This err will persist until the cache expires (after 6 hours).
So, we should not cache EC pipelines with incomplete data-nodes.
> Avoid insufficient EC pipelines in the container pipeline cache
> ---------------------------------------------------------------
>
> Key: HDDS-11209
> URL: https://issues.apache.org/jira/browse/HDDS-11209
> Project: Apache Ozone
> Issue Type: Bug
> Components: EC, OM
> Affects Versions: 1.4.0
> Reporter: Hongbing Wang
> Assignee: Hongbing Wang
> Priority: Major
>
> OM cached pipeline may not cache container's all datanode information (for example, some DNs may not report in time), which can be problematic for EC files. If the nodes num is less than the EC data-blocks num, an error will occur when reading data:
> {code:java}
> There are insufficient datanodes to read the EC block {code}
> This err will persist until the cache expires (after 6 hours) even if all DNs corresponding to the EC file are completely normal.
> So, we should not cache EC pipelines with incomplete data-nodes.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org