[jira] [Commented] (HDDS-2411) Create DataChunkValidator Freon test

["François Risch (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDDS-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185747#comment-17185747 ] 

François Risch commented on HDDS-2411:
--------------------------------------

Issue is solved as PR #1312 was merged into master.

Hence a DatanodeChunkValidator is available for Ozone Freon by using following command:
{code:java}
ozone freon dcv -p tester{code}
A validation must be run on generated chunk of data with same size and same name.

Generation could be made with: 
{code:java}
ozone freon dcg -p tester{code}
Documentation on DatanodeChunkValidator is available with:
{code:java}
ozone freon dcv -h

Usage: ozone freon dcv [-fhV] [-l=<pipelineId>] [-n=<testNo>] [-p=<prefix>]
                       [-s=<chunkSize>] [-t=<threadNo>]
Validate generated Chunks are the same
  -f, --fail-at-end        If turned on, all the tasks will be executed even if
                             there are failures.
  -h, --help               Show this help message and exit.
  -l, --pipeline=<pipelineId>
                           Pipeline to use. By default the first RATIS/THREE
                             pipeline will be used.
                             Default:
  -n, --number-of-tests=<testNo>
                           Number of the generated objects.
                             Default: 1000
  -p, --prefix=<prefix>    Unique identifier of the test execution. Usually
                             used as a prefix of the generated object names. If
                             empty, a random name will be generated
                             Default:
  -s, --size=<chunkSize>   Size of the generated chunks (in bytes)
                             Default: 1024
  -t, --thread, --threads=<threadNo>
                           Number of threads used to execute
                             Default: 10
  -V, --version            Print version information and exit.{code}
 

 

> Create DataChunkValidator Freon test
> ------------------------------------
>
>                 Key: HDDS-2411
>                 URL: https://issues.apache.org/jira/browse/HDDS-2411
>             Project: Hadoop Distributed Data Store
>          Issue Type: Task
>          Components: freon
>            Reporter: Marton Elek
>            Priority: Major
>              Labels: newbie, pull-request-available
>
> HDDS-2327 introduced a new load test which generates a lot of WriteChunk request.
> As with other freon test (for example with. HadoopFsGenerator/HadoopFsValidator) we need an other load test for validation/read path.
> It should be almost the same DatanodeChunkGenerator but it should read the first chunk and compare all the others (very similar to the HadoopFsValidator or OzoneClientKeyValidator)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org