You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/03/18 12:30:03 UTC
[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #694:
HDDS-2943. Parameterize unit tests for chunk manager implementation
adoroszlai opened a new pull request #694: HDDS-2943. Parameterize unit tests for chunk manager implementation
URL: https://github.com/apache/hadoop-ozone/pull/694
## What changes were proposed in this pull request?
1. Apply some unit tests for both kinds of chunk layout (per-chunk, per-block).
2. Fix a bug in container data scrubber, which was still using per-chunk layout regardless of config. This can result in marking containers unhealthy:
```
[ContainerDataScanner(/data/hdds/hdds)] ERROR interfaces.Container: Corruption detected in container: [1] Exception: [Missing chunk file /data/hdds/hdds/1560ebb4-2052-44ee-b16e-d74caaca055e/current/containerDir0/1/chunks/103843356633071616_chunk_1]
[ContainerDataScanner(/data/hdds/hdds)] INFO ozoneimpl.ContainerDataScanner: Completed an iteration of container data scrubber in 0 minutes. Number of iterations (since the data-node restart) : 1, Number of containers scanned in this iteration : 1, Number of unhealthy containers found in this iteration : 1
```
https://issues.apache.org/jira/browse/HDDS-2943
## How was this patch tested?
https://github.com/adoroszlai/hadoop-ozone/runs/516276869
Verified that data scrubber does not mark container as unhealthy:
```
$ ozone freon ockg -n 1 -p test
$ ozone scmcli container close 1
$ ozone freon ockv -n 1 -p test
...
Successful executions: 1
```
```
[ContainerDataScanner(/data/hdds/hdds)] INFO ozoneimpl.ContainerDataScanner: Completed an iteration of container data scrubber in 0 minutes. Number of iterations (since the data-node restart) : 1, Number of containers scanned in this iteration : 1, Number of unhealthy containers found in this iteration : 0
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] adoroszlai commented on issue #694: HDDS-2943.
Parameterize unit tests for chunk manager implementation
Posted by GitBox <gi...@apache.org>.
adoroszlai commented on issue #694: HDDS-2943. Parameterize unit tests for chunk manager implementation
URL: https://github.com/apache/hadoop-ozone/pull/694#issuecomment-606456767
Thanks @bshashikant for reviewing and merging it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bshashikant merged pull request #694: HDDS-2943.
Parameterize unit tests for chunk manager implementation
Posted by GitBox <gi...@apache.org>.
bshashikant merged pull request #694: HDDS-2943. Parameterize unit tests for chunk manager implementation
URL: https://github.com/apache/hadoop-ozone/pull/694
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org