You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Attila Doroszlai (Jira)" <ji...@apache.org> on 2019/10/08 20:46:00 UTC
[jira] [Created] (HDDS-2268) Incorrect container checksum upon
downgrade
Attila Doroszlai created HDDS-2268:
--------------------------------------
Summary: Incorrect container checksum upon downgrade
Key: HDDS-2268
URL: https://issues.apache.org/jira/browse/HDDS-2268
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: Ozone Datanode, upgrade
Reporter: Attila Doroszlai
Container file checksum is calculated based on all YAML fields in a given Ozone version. If the same container file is used in older Ozone, which has fewer fields, the expected checksum will be different.
Example: origin pipeline ID and origin node ID were added for HDDS-837 in Ozone 0.4.0. Starting Ozone 0.3.0 with the same data results in checksum error.
{noformat}
datanode_1 | ... ERROR ContainerReader:166 - Failed to parse ContainerFile for ContainerID: 1
datanode_1 | org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException: Container checksum error for ContainerID: 1.
datanode_1 | Stored Checksum: 7a6ec508d6e3796c5fe5fd52574b3d3437b0a0eaa4e053f7a96a5e39f4abb374
datanode_1 | Expected Checksum: fee023a02d3ced2f7b0b42c116cce5f03da6b57b29965ca878dc46d1213230b6
datanode_1 | at org.apache.hadoop.ozone.container.common.helpers.ContainerUtils.verifyChecksum(ContainerUtils.java:259)
datanode_1 | at org.apache.hadoop.ozone.container.keyvalue.helpers.KeyValueContainerUtil.parseKVContainerData(KeyValueContainerUtil.java:165)
datanode_1 | at org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader.verifyContainerData(ContainerReader.java:180)
datanode_1 | at org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader.verifyContainerFile(ContainerReader.java:164)
datanode_1 | at org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader.readVolume(ContainerReader.java:142)
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org