You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/05/18 17:36:00 UTC

[jira] [Commented] (IMPALA-12052) Update tests for new Ozone EC chunk size format

    [ https://issues.apache.org/jira/browse/IMPALA-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723988#comment-17723988 ] 

ASF subversion and git services commented on IMPALA-12052:
----------------------------------------------------------

Commit 8f35c7f4aae81be9e47e3bfe3bb0fa6895d9ef8b in impala's branch refs/heads/master from Michael Smith
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=8f35c7f4a ]

IMPALA-12052: Update EC policy string for Ozone

HDDS-7122 changed how Ozone prints chunk size from bytes to KB, as in
1024k rather than 1048576. That makes it consistent with HDFS reporting.

Our tests verify the chunk size reported in SHOW output. Updates the
expected erasure code policy string to match the new format.

Updates CDP_OZONE_VERSION to a build that includes HDDS-7122. However
this build includes two regressions that we work around for the moment:
- HDDS-8543: FSO layout reports incorrect replication config for
             directories in EC buckets
- HDDS-8289: FSO layout listStatus operations get slower with lots of
             files and filesystem operations

Testing:
- ran test suite with Ozone Erasure Coding

Change-Id: I5354de61bbc507931a1d5bc86f6466c0dd50fc30
Reviewed-on: http://gerrit.cloudera.org:8080/19870
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Laszlo Gaal <la...@cloudera.com>
Reviewed-by: Joe McDonnell <jo...@cloudera.com>


> Update tests for new Ozone EC chunk size format
> -----------------------------------------------
>
>                 Key: IMPALA-12052
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12052
>             Project: IMPALA
>          Issue Type: Task
>            Reporter: Michael Smith
>            Assignee: Michael Smith
>            Priority: Major
>             Fix For: Impala 4.3.0
>
>
> HDDS-7122 changed how Ozone prints chunk size from bytes to KB, as in 1024k rather than 1048576. Our tests verify the chunk size reported in SHOW output, so this will need to be updated for the new format.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org