You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Joe Witt (Jira)" <ji...@apache.org> on 2023/04/07 22:50:00 UTC

[jira] [Commented] (NIFI-11408) PutGCSObject appears to send GZIP compressed content by default

    [ https://issues.apache.org/jira/browse/NIFI-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17709811#comment-17709811 ] 

Joe Witt commented on NIFI-11408:
---------------------------------

I did check BlobSourceOption for the case of FetchGCSObject and there does not appear to be any option to disable compression.

> PutGCSObject appears to send GZIP compressed content by default
> ---------------------------------------------------------------
>
>                 Key: NIFI-11408
>                 URL: https://issues.apache.org/jira/browse/NIFI-11408
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Joe Witt
>            Assignee: Joe Witt
>            Priority: Major
>             Fix For: 1.latest, 2.latest
>
>
> In looking at a stack trace from a live system it was observed that many threads were spending time on PutGCSObject specifically routing through a GZIP compression stream in use by the GCS storage library.
> In some searching I found https://github.com/sonatype-nexus-community/nexus-blobstore-google-cloud/pull/53/files
> It appears we should make it optional to take advantage of disabling this as default performance can be quite hampered especially for data which won't benefit from additional compression.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)