You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Tsz-wo Sze (Jira)" <ji...@apache.org> on 2023/05/17 14:56:00 UTC

[jira] [Commented] (HDDS-8635) Automatically select createKey and createStreamKey in Ozone FileSystem

    [ https://issues.apache.org/jira/browse/HDDS-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723497#comment-17723497 ] 

Tsz-wo Sze commented on HDDS-8635:
----------------------------------

We may buffer user data in OzoneFSOutputStream.
 # If user closes the file and the file size is within a certain limit, use the createKey API to send the data.
 -- We may use PutSmallFile to further optimize it in the future.
 # If user keeps writing and the bytes written is larger than the limit, use createStreamKey.

> Automatically select createKey and createStreamKey in Ozone FileSystem
> ----------------------------------------------------------------------
>
>                 Key: HDDS-8635
>                 URL: https://issues.apache.org/jira/browse/HDDS-8635
>             Project: Apache Ozone
>          Issue Type: Sub-task
>          Components: Ozone Filesystem
>            Reporter: Tsz-wo Sze
>            Assignee: Tsz-wo Sze
>            Priority: Major
>
> When streaming is enabled (OZONE_FS_DATASTREAM_ENABLED), currently it always uses the createStreamKey API for creating a file.  However, streaming is inefficient when creating small files.  It should automatically select createKey API when the file size is small.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org