You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "zeroshade (via GitHub)" <gi...@apache.org> on 2023/03/07 16:37:24 UTC

[GitHub] [arrow] zeroshade commented on a diff in pull request #34476: GH-34385: [Go] Read IPC files with compression enabled but uncompressed buffers

zeroshade commented on code in PR #34476:
URL: https://github.com/apache/arrow/pull/34476#discussion_r1128180015


##########
go/arrow/ipc/ipc.go:
##########
@@ -168,6 +169,26 @@ func WithDictionaryDeltas(v bool) Option {
 	}
 }
 
+// WithMinSpaceSavings specifies a percentage of space savings for
+// compression to be applied to buffers.
+//
+// Space savings is calculated as (1.0 - compressedSize / uncompressedSize).
+//
+// For example, if minSpaceSavings = 0.1, a 100-byte body buffer won't
+// undergo compression if its expected compressed size exceeds 90 bytes.
+// If this option is unset, compression will be used indiscriminately. If
+// no codec was supplied, this option is ignored.
+//
+// Values outside of the range [0,1] are handled as errors.
+//
+// Note that enabling this option may result in unreadable data for Arrow
+// C++ versions prior to 12.0.0.

Review Comment:
   gah, my fault for copying the comment, i'll fix it and update.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org