issues@parquet.apache.org, 2026-05

You are viewing a plain text version of this content. The canonical link for it is here.

- [I] Blog on ALP [parquet-site] - posted by "alamb (via GitHub)" <gi...@apache.org> on 2026/05/01 15:27:53 UTC, 0 replies.
- Re: [PR] GH-3414: Add parseJson to VariantBuilder for JSON-to-Variant conversion [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/01 15:30:27 UTC, 7 replies.
- Re: [PR] GH-533: Add ALP (Adaptive Lossless floating-Point) encoding specification [parquet-format] - posted by "alamb (via GitHub)" <gi...@apache.org> on 2026/05/01 15:35:47 UTC, 8 replies.
- Re: [PR] GH-3457: Validate column index for null_pages/null_counts contradiction [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/01 15:44:38 UTC, 0 replies.
- Re: [I] Column index with null_pages=true and null_counts=0 causes silent data loss during filter pushdown [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/01 15:44:40 UTC, 0 replies.
- Re: [PR] GH-3520: Cleanup binary write path (DeltaByteArrayWriter copy + FLBA LE wrapper) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/01 22:17:16 UTC, 1 replies.
- [PR] GH-3522: Optimize IntList.size() from O(slabs) to O(1) with running counter [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/01 22:19:44 UTC, 5 replies.
- [PR] GH-3522: Optimize delta binary packing with batch unpack32/pack32 and cached packers (+13-37% decode) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/01 22:19:56 UTC, 2 replies.
- [PR] GH-3522: Add batch read APIs to ValuesReader hierarchy [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/01 22:20:06 UTC, 2 replies.
- [PR] GH-3522: Eliminate unnecessary page-size copies in compressed page assembly and CRC checksums [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/01 22:20:16 UTC, 2 replies.
- [PR] GH-3522: Reduce peak memory during row group flush by eagerly releasing column buffers [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/01 22:20:28 UTC, 2 replies.
- [PR] Bump jackson.version from 2.21.2 to 2.21.3 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/03 02:22:39 UTC, 4 replies.
- [PR] Bump com.google.api.grpc:proto-google-common-protos from 2.68.0 to 2.70.0 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/03 02:22:50 UTC, 2 replies.
- [PR] Bump com.fasterxml.jackson.core:jackson-databind from 2.21.2 to 2.21.3 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/03 02:23:01 UTC, 3 replies.
- [PR] Bump com.github.luben:zstd-jni from 1.5.7-7 to 1.5.7-8 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/03 02:23:05 UTC, 1 replies.
- Re: [I] Hadoop parquet reader (and parquet-CLI) fails on some files from parquet-testing [parquet-java] - posted by "ccleva (via GitHub)" <gi...@apache.org> on 2026/05/03 12:07:59 UTC, 0 replies.
- Re: [PR] ARROW-18420: [Parquet] Add fixed_length_byte_array.parquet for page index test [parquet-testing] - posted by "ccleva (via GitHub)" <gi...@apache.org> on 2026/05/03 12:52:01 UTC, 2 replies.
- [I] Fix `LocalInputFile` `ByteBuffer` read methods to support direct and non-zero-position buffers [parquet-java] - posted by "arouel (via GitHub)" <gi...@apache.org> on 2026/05/04 09:03:37 UTC, 0 replies.
- [PR] GH-3542 Fix `LocalInputFile` `ByteBuffer` read methods to support direct and non-zero-position buffers [parquet-java] - posted by "arouel (via GitHub)" <gi...@apache.org> on 2026/05/04 09:08:40 UTC, 1 replies.
- Re: [PR] GH-3464: Improve `DeltaByteArrayWriter.writeBytes` to avoid unnecessary allocation and scalar prefix comparison [parquet-java] - posted by "arouel (via GitHub)" <gi...@apache.org> on 2026/05/04 09:17:55 UTC, 2 replies.
- Re: [PR] GH-3112: Fix reading of proto Uint32Value [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/05 05:38:48 UTC, 1 replies.
- Re: [I] Fail to read google.protobuf.UInt32Value from parquet [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/05 05:38:50 UTC, 0 replies.
- Re: [PR] PARQUET-1367 upgrade a few libs for security reasons [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/05 06:07:38 UTC, 1 replies.
- Re: [PR] PARQUET-1573: Add a docker development image and use it in travis [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/05 06:07:53 UTC, 1 replies.
- Re: [PR] Uniformizing booleans naming in ParquetWriter [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/05 06:08:49 UTC, 1 replies.
- [PR] Bump version to 1.17.1-SNAPSHOT [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/05 07:02:11 UTC, 2 replies.
- Re: [PR] Bump commons-io:commons-io from 2.21.0 to 2.22.0 [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/05 08:42:26 UTC, 0 replies.
- Re: [PR] Optimizing Variant read path with lazy caching [parquet-java] - posted by "nssalian (via GitHub)" <gi...@apache.org> on 2026/05/05 21:27:25 UTC, 8 replies.
- Re: [PR] GH-3482: parquet-hadoop tests to work behind a web proxy [parquet-java] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/06 05:32:18 UTC, 4 replies.
- Re: [PR] PARQUET-3261: Fix integer overflow in CapacityByteArrayOutputStream [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/06 15:36:55 UTC, 0 replies.
- Re: [PR] GH-3513: Optimize dictionary writers with OpenHashMap + ArrayList (up to ~70x encodeDictionary) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/06 16:17:47 UTC, 2 replies.
- Re: [I] Apache Parquet Java Performance Improvements [parquet-java] - posted by "alamb (via GitHub)" <gi...@apache.org> on 2026/05/06 17:54:54 UTC, 7 replies.
- [I] Pom.xml SCM block has the wrong repository (parquet-mr) and not (parquet-java) [parquet-java] - posted by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2026/05/06 18:44:27 UTC, 1 replies.
- [PR] GH-#3545: Use parquet-java in SCM block [parquet-java] - posted by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2026/05/06 18:48:39 UTC, 0 replies.
- Re: [I] Improve `DeltaByteArrayWriter.writeBytes` to avoid unnecessary allocation and scalar prefix comparison [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 19:30:37 UTC, 0 replies.
- Re: [PR] GH-3478: Fix LZ4_RAW heap decompression [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 19:54:05 UTC, 0 replies.
- Re: [I] LZ4_RAW heap decompression fails on chunked `BytesInput` materialization for large pages [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 19:54:06 UTC, 0 replies.
- Re: [PR] GH-3497: Fix thread-unsafe singleton in `DefaultValuesWriterFactory` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 19:56:41 UTC, 0 replies.
- Re: [I] `DefaultValuesWriterFactory` uses thread-unsafe static singletons, causing cross-writer allocator contamination [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 19:56:42 UTC, 0 replies.
- Re: [PR] GH-3516: Optimize DeltaByteArrayWriter and DeltaLengthByteArrayValuesWriter [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 20:05:41 UTC, 2 replies.
- Re: [PR] GH-3261: Fix integer overflow in `CapacityByteArrayOutputStream` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 20:28:34 UTC, 1 replies.
- [I] Automate the Release Process [parquet-java] - posted by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2026/05/06 20:39:45 UTC, 4 replies.
- [PR] GH-3547: Add semi-automated release pipeline for Apache Parquet Java [parquet-java] - posted by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2026/05/06 21:09:01 UTC, 16 replies.
- [I] Leverage JDK11 `readNBytes` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 21:20:55 UTC, 1 replies.
- Re: [PR] GH-3545: Use parquet-java in SCM block [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 21:21:26 UTC, 0 replies.
- [PR] GH-3549: Leverage JDK11 `readNBytes` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 21:22:41 UTC, 4 replies.
- Re: [PR] Remove Avro reflection [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/06 21:38:41 UTC, 0 replies.
- Re: [PR] GH-3410: Bump jackson dependencies from 2.19.2 to 2.21.2 [parquet-java] - posted by "imsayari404 (via GitHub)" <gi...@apache.org> on 2026/05/07 08:01:45 UTC, 1 replies.
- Re: [I] Variant getFieldByKey() on large objects silently fails if variant metadata is unsorted [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/07 14:11:24 UTC, 1 replies.
- [PR] MINOR: Fix Spotless formatting in TestCompressionCodec [parquet-java] - posted by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2026/05/07 19:33:56 UTC, 3 replies.
- [I] Upgrade parquet-hadoop dependency from aircompressor 2.0.2 due to CVE-2025-67721 [parquet-java] - posted by "rajesh-chandrashekar (via GitHub)" <gi...@apache.org> on 2026/05/08 05:33:48 UTC, 7 replies.
- Re: [PR] GH-3468: Fix lint error which block compilation [parquet-java] - posted by "Yao-MR (via GitHub)" <gi...@apache.org> on 2026/05/08 09:28:43 UTC, 0 replies.
- [PR] Bump com.google.api.grpc:proto-google-common-protos from 2.68.0 to 2.71.0 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 02:22:28 UTC, 1 replies.
- [PR] Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.25.6 to 0.25.7 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 02:22:33 UTC, 1 replies.
- [PR] Optimize compression hot paths: bypass Hadoop codec abstraction for Snappy, LZ4_RAW, ZSTD, and GZIP [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/11 15:11:27 UTC, 3 replies.
- Re: [PR] Bump avro.version from 1.11.5 to 1.12.1 [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/11 15:13:23 UTC, 2 replies.
- Re: [I] Add support for Parquet Input Stream optimisations. [parquet-java] - posted by "atris (via GitHub)" <gi...@apache.org> on 2026/05/11 17:22:10 UTC, 3 replies.
- Re: [PR] GH-3507: Reduce allocation overhead of no-op `GeospatialStatistics.Builder` [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/11 18:31:34 UTC, 0 replies.
- Re: [PR] GH-3451. Add a JMH benchmark for variants [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/11 18:52:20 UTC, 2 replies.
- Re: [I] Add a JMH benchmark for variants [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/11 18:52:21 UTC, 0 replies.
- [PR] Use the LIST 3-level structure [parquet-testing] - posted by "hsiang-c (via GitHub)" <gi...@apache.org> on 2026/05/11 19:00:37 UTC, 6 replies.
- Re: [I] `RequiresFallback.isCompressionSatisfying` is too aggressive with current default page size [parquet-java] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/11 20:10:08 UTC, 0 replies.
- [PR] PARQUET-3479: Add configuration to disable early dictionary compression check [parquet-java] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/11 22:17:25 UTC, 0 replies.
- [I] Convention of Metadata Placement [parquet-testing] - posted by "CliffBakalian (via GitHub)" <gi...@apache.org> on 2026/05/11 23:33:21 UTC, 1 replies.
- Re: [I] parseJson implementation in VariantBuilder [parquet-java] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/12 07:41:48 UTC, 0 replies.
- Re: [PR] GH-563: Make `ColumnMetaData.path_in_schema` optional [parquet-format] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/12 07:56:32 UTC, 11 replies.
- [PR] GH-3354: Override LocalInputFile.toString to return the path [parquet-java] - posted by "1fanwang (via GitHub)" <gi...@apache.org> on 2026/05/12 08:25:59 UTC, 0 replies.
- Re: [PR] Bump actions/stale from 9 to 10 [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/12 13:47:02 UTC, 0 replies.
- Re: [PR] Bump org.apache.hadoop:hadoop-common from 3.3.0 to 3.4.0 [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/12 18:20:58 UTC, 2 replies.
- Re: [I] parquet-hadoop tests fail if working behind a web proxy [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/12 18:33:38 UTC, 1 replies.
- [PR] Add test file with no `path_in_schema` fields [parquet-testing] - posted by "etseidl (via GitHub)" <gi...@apache.org> on 2026/05/12 19:25:09 UTC, 0 replies.
- [PR] Add Geospatial geography files with statistics [parquet-testing] - posted by "paleolimbot (via GitHub)" <gi...@apache.org> on 2026/05/12 19:41:06 UTC, 4 replies.
- Re: [PR] GH-3484: Eliminate per-page heap allocation for CRC32 checksums when using direct `ByteBufferAllocator` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/12 20:46:20 UTC, 3 replies.
- Re: [PR] PARQUET-2249: Introduce IEEE 754 total order & NaN-counts [parquet-format] - posted by "emkornfield (via GitHub)" <gi...@apache.org> on 2026/05/12 20:51:10 UTC, 15 replies.
- [I] RSS Feed Broken [parquet-site] - posted by "corasaurus-hex (via GitHub)" <gi...@apache.org> on 2026/05/13 00:19:07 UTC, 1 replies.
- [I] Properly close buffers [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/13 04:42:56 UTC, 0 replies.
- [PR] GH-3558: Properly close buffers [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/13 04:44:12 UTC, 8 replies.
- Re: [I] TestParquetReader fails with hadoop 3.4.2 [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/13 04:46:43 UTC, 1 replies.
- Re: [PR] GH-3511: Add JMH encoding benchmarks and fix parquet-benchmarks shaded jar [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/13 18:47:02 UTC, 2 replies.
- [PR] GH-3493: Optimize PlainValuesReader with direct ByteBuffer reads and batch methods [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/13 19:08:09 UTC, 2 replies.
- [I] Harden variant decoding [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/14 11:36:28 UTC, 0 replies.
- [PR] Harden variants against malformed metadata. [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/14 11:53:52 UTC, 0 replies.
- Re: [I] Cleanup binary write path: avoid Binary.getBytes() copy in DeltaByteArrayWriter and remove LE wrapper from FixedLenByteArrayPlainValuesWriter [parquet-java] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/15 18:40:03 UTC, 2 replies.
- Re: [PR] GH-3471: Fix `ByteBuffer` handling in `VariantUtil` and `VariantBuilder` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/15 18:45:34 UTC, 0 replies.
- Re: [I] VariantUtil.getMetadataMap reads from wrong position for non-array ByteBuffer; VariantBuilder.appendBinary mutates caller's ByteBuffer [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/15 18:45:35 UTC, 0 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [parquet-format] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:39:01 UTC, 1 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [parquet-java] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:39:05 UTC, 0 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [parquet-testing] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:39:13 UTC, 0 replies.
- [PR] Bump org.apache:apache from 37 to 38 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/17 02:22:15 UTC, 1 replies.
- Re: [PR] GH-506: Clarify field ordering for partially shredded object union [parquet-format] - posted by "nssalian (via GitHub)" <gi...@apache.org> on 2026/05/17 18:20:06 UTC, 3 replies.
- Re: [I] Optimize PlainValuesReader by reading directly from ByteBuffer (12x decode speedup) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:39:29 UTC, 0 replies.
- Re: [I] Optimize PlainValuesWriter by writing directly to ByteBuffer slabs (up to 2x encode speedup) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:39:37 UTC, 0 replies.
- Re: [I] Cache hashCode() for non-reused Binary instances (huge dictionary-encode speedup) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:39:44 UTC, 0 replies.
- Re: [I] Optimize ByteStreamSplitValuesWriter: remove per-value allocation and batch single-byte writes [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:39:49 UTC, 0 replies.
- Re: [I] Optimize ByteStreamSplitValuesReader page transposition [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:39:55 UTC, 0 replies.
- Re: [I] Optimize BinaryPlainValuesReader by reading directly from ByteBuffer [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:40:00 UTC, 0 replies.
- Re: [I] Add JMH benchmarks for encoding/decoding paths and fix parquet-benchmarks shaded jar [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:40:06 UTC, 0 replies.
- Re: [I] Optimize dictionary writers by replacing fastutil Linked maps with OpenHashMap + ArrayList [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:40:12 UTC, 0 replies.
- Re: [I] Optimize DeltaByteArrayWriter and DeltaLengthByteArrayValuesWriter: remove per-value allocation and LittleEndianDataOutputStream wrapper [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:40:17 UTC, 0 replies.
- Re: [I] Reuse intermediate buffers in RunLengthBitPackingHybridDecoder PACKED path (~22% throughput on dictionary-id decode) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 21:41:07 UTC, 0 replies.
- [PR] GH-3530: Optimize PLAIN encoding and decoding with direct ByteBuffer I/O [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:38:35 UTC, 1 replies.
- [PR] GH-3530: Optimize DICTIONARY encoding/decoding data structures and use ByteBuffer [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:38:40 UTC, 0 replies.
- [PR] GH-3530: Optimize DELTA_BINARY_PACKED, DELTA_LENGTH_BYTE_ARRAY, and DELTA_BYTE_ARRAY encoding/decoding [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:38:46 UTC, 0 replies.
- [PR] GH-3530: Optimize RLE hybrid encoder/decoder scalar hot-path performance [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:38:52 UTC, 0 replies.
- [PR] GH-3530: Optimize BYTE_STREAM_SPLIT encoding/decoding [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:38:57 UTC, 1 replies.
- [PR] GH-3530: Bypass Hadoop codec abstraction to optimize compression performance [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:39:03 UTC, 0 replies.
- [PR] GH-3530: Eagerly release column buffers during row group flush [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:39:09 UTC, 1 replies.
- Re: [PR] GH-3493: Optimize PlainValuesReader with direct ByteBuffer reads [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:41:19 UTC, 1 replies.
- Re: [PR] GH-3495: Optimize PlainValuesWriter with direct ByteBuffer slab writes (~2.5x encode speedup) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:41:22 UTC, 1 replies.
- Re: [PR] GH-3509: Optimize BinaryPlainValuesReader by reading directly from ByteBuffer [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:41:24 UTC, 1 replies.
- Re: [PR] GH-3499: Cache hashCode() for non-reused Binary instances (up to 73x dictionary-encode speedup) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:41:32 UTC, 1 replies.
- Re: [PR] GH-3522: Reuse intermediate buffers in RunLengthBitPackingHybridDecoder PACKED path (~22% throughput on dictionary-id decode) [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:41:53 UTC, 1 replies.
- Re: [PR] GH-3503: Optimize ByteStreamSplitValuesWriter with batched scatter writes [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:41:58 UTC, 1 replies.
- Re: [PR] GH-3505: Optimize ByteStreamSplitValuesReader page transposition [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 22:42:00 UTC, 1 replies.
- Re: [I] Avoid heap materialization for CRC32 page checksums in `ColumnChunkPageWriteStore` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/18 04:04:18 UTC, 0 replies.
- Re: [PR] GH-3487: Fix `PageReadStore` buffer leak in `ParquetFileReader` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/18 04:17:54 UTC, 0 replies.
- Re: [PR] GH-3501: Speed up `DictionaryValuesWriter.shouldFallBack()` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/18 04:20:26 UTC, 0 replies.
- [PR] Correct `fixed_length_byte_array.parquet` [parquet-testing] - posted by "ccleva (via GitHub)" <gi...@apache.org> on 2026/05/18 17:59:07 UTC, 7 replies.
- Re: [PR] GH-3083: Make DELTA_LENGTH_BYTE_ARRAY default encoding for binary [parquet-java] - posted by "raunaqmorarka (via GitHub)" <gi...@apache.org> on 2026/05/19 06:11:44 UTC, 0 replies.
- [I] Add examples of malformed variants to bad_data [parquet-testing] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/19 12:12:16 UTC, 0 replies.
- [PR] GH-112 Harden variant decoding [parquet-testing] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/19 12:12:51 UTC, 0 replies.
- Re: [PR] GH-3561 Harden variants against malformed metadata. [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/21 13:10:27 UTC, 2 replies.
- Re: [I] Breaking change in Avro 1.12.1 affects parquet-avro users: logical types now deserialize to different Java types [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/21 13:13:08 UTC, 0 replies.
- [I] Update thrift to 0.23.0 to eliminate warnings about CVE-2026-43870 [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/22 10:59:13 UTC, 1 replies.
- [I] VariantUtil decodes string bytes using platform default charset instead of UTF-8 [parquet-java] - posted by "mikhail-melnik (via GitHub)" <gi...@apache.org> on 2026/05/22 11:18:09 UTC, 1 replies.
- [I] null_count is omitted for large columns in parquet files [parquet-java] - posted by "mdibaiee (via GitHub)" <gi...@apache.org> on 2026/05/22 11:19:00 UTC, 0 replies.
- [PR] GH-3574: parquet-hadoop: Statistics.toParquetStatistics: always set null_count [parquet-java] - posted by "mdibaiee (via GitHub)" <gi...@apache.org> on 2026/05/22 11:21:55 UTC, 2 replies.
- [PR] GH-3573: Fix VariantUtil string decoding to use explicit UTF-8 charset [parquet-java] - posted by "mikhail-melnik (via GitHub)" <gi...@apache.org> on 2026/05/22 11:26:13 UTC, 3 replies.
- Re: [PR] Bump org.apache:apache from 35 to 37 [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/22 12:08:56 UTC, 0 replies.
- Re: [PR] Bump org.apache.maven.plugins:maven-shade-plugin from 3.6.0 to 3.6.2 [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/22 12:09:29 UTC, 0 replies.
- [I] Remove some Java 8 coding conventions [parquet-java] - posted by "dossett (via GitHub)" <gi...@apache.org> on 2026/05/22 13:59:59 UTC, 1 replies.
- [PR] Approach 2 (micro-row-group) reader prototype [parquet-java] - posted by "alkis (via GitHub)" <gi...@apache.org> on 2026/05/22 22:28:37 UTC, 0 replies.
- Re: [PR] [parquet-thrift] start removing things marked for deprecation [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:21:51 UTC, 1 replies.
- Re: [PR] GH-3289: Introduce Parquet E2E test harness to support CLI testing [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:21:53 UTC, 1 replies.
- Re: [PR] GH-3282: Add encryption info CLI support for Parquet file encryption metadata [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:21:54 UTC, 1 replies.
- Re: [PR] GH-3279: Introduce StorageProvider to de-couple Hadoop vs NIO constructs [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:21:56 UTC, 1 replies.
- Re: [PR] GH-2914: Add documentation for the Java library [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:21:57 UTC, 1 replies.
- Re: [PR] GH-3142: Add strict validation for unsigned types in ExampleParquetWriter [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:21:59 UTC, 1 replies.
- Re: [PR] GH-3246: Clarify the behaviour of big decimal for BYTE_ARRAY [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/23 00:22:00 UTC, 1 replies.
- [PR] Upgrade Hadoop 3.3.0 -> 3.4.3, Spotless 2.46.1 -> 3.5.1, fix vectored I/O buffer leak [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/23 08:47:27 UTC, 0 replies.
- [PR] Simplify CI: collapse codec matrix and add zstd coverage [parquet-java] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/23 10:07:25 UTC, 0 replies.
- Re: [PR] Test Variant implementation with external test cases [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 00:20:45 UTC, 1 replies.
- Re: [PR] GH-3242: Emit and Read min/max statistics for int96 timestamp columns [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 00:20:47 UTC, 8 replies.
- Re: [PR] GH-1452: implement Size() filter for repeated columns [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 00:20:51 UTC, 0 replies.
- Re: [PR] GH-3080: HadoopStreams to support ByteBufferPositionedReadable [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 00:20:53 UTC, 1 replies.
- Re: [PR] GH-3074: read footer using 1 call readFully(byte[8]) instead of 5 calls [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 00:20:54 UTC, 0 replies.
- [PR] Bump com.github.luben:zstd-jni from 1.5.7-8 to 1.5.7-9 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 02:21:31 UTC, 1 replies.
- [PR] Bump protobuf.version from 4.34.1 to 4.35.0 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 02:21:51 UTC, 1 replies.
- [PR] Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.25.7 to 0.26.0 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 02:22:06 UTC, 1 replies.
- [PR] chore: Deprecate `H1SeekableInputStream` [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/24 05:56:58 UTC, 0 replies.
- [PR] Bump org.apache:apache from 37 to 38 [parquet-format] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 13:22:16 UTC, 1 replies.
- [PR] Bump org.apache.thrift:libthrift from 0.22.0 to 0.23.0 [parquet-format] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 13:22:21 UTC, 3 replies.
- Re: [PR] GH-3226: Improve performance of InternalParquetRecordReader (1%) [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/25 00:21:42 UTC, 1 replies.
- Re: [PR] PARQUET-570: Added support to write to stdout [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/25 00:21:44 UTC, 1 replies.
- Re: [PR] GH-3004: Add Parquet BOM [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/25 00:21:48 UTC, 0 replies.
- Re: [PR] Add force and check all columns options for CheckParquet251Command. [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/25 00:21:50 UTC, 0 replies.
- [I] DataPageHeaderV2.num_nulls=-1 when column statistics are disabled [parquet-java] - posted by "keuin (via GitHub)" <gi...@apache.org> on 2026/05/25 06:15:58 UTC, 0 replies.
- [PR] GH-3585: Fix DataPageHeaderV2.num_nulls=-1 when column statistics are disabled [parquet-java] - posted by "keuin (via GitHub)" <gi...@apache.org> on 2026/05/25 06:18:31 UTC, 6 replies.
- Re: [PR] Add test file for floating types with different column orders and nan_counts [parquet-testing] - posted by "etseidl (via GitHub)" <gi...@apache.org> on 2026/05/25 16:53:49 UTC, 2 replies.
- Re: [PR] PARQUET-2249: Add column order for IEEE 754 total order [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/26 00:21:52 UTC, 1 replies.
- Re: [PR] GH-2926: Fix issue reading buggy parquet files with incorrect compressed size [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/26 00:21:57 UTC, 0 replies.
- Re: [PR] PARQUET-2495: Update merge script to python3 [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/26 00:21:58 UTC, 0 replies.
- Re: [PR] PARQUET-781. Direct support for PathOutputCommitter [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/26 00:22:00 UTC, 0 replies.
- Re: [PR] [GH-105] Add ALP dataset for floating point columns [parquet-testing] - posted by "vinooganesh (via GitHub)" <gi...@apache.org> on 2026/05/26 00:33:48 UTC, 1 replies.
- [I] Setting parquet.thrift.string.size.limit = -1 incorrectly throws [parquet-java] - posted by "divjotarora (via GitHub)" <gi...@apache.org> on 2026/05/26 15:11:39 UTC, 0 replies.
- [PR] [GH-3587]: Fix parquet.thrift.string.size.limit validation [parquet-java] - posted by "divjotarora (via GitHub)" <gi...@apache.org> on 2026/05/26 15:22:59 UTC, 0 replies.
- [PR] GH-3572: Bump thrift to 0.23 [parquet-java] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/05/26 16:40:01 UTC, 7 replies.
- Re: [PR] [WIP] [PREVIEW] use ByteBuddy code generation to write proto to parquet faster [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/27 00:23:37 UTC, 1 replies.
- Re: [PR] PARQUET-2477: close readers opened by ParquetFileWriter [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/27 00:23:42 UTC, 0 replies.
- Re: [PR] PARQUET-2464: Fix dictionaryPageOffset flag setting in toParquetMetadata method [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/27 00:23:44 UTC, 0 replies.
- Re: [PR] PARQUET-1511: Pass the parameters in a configuration object to Schema… [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/28 00:21:50 UTC, 0 replies.
- Re: [PR] [WIP][Proposal] PARQUET-2430: Add parquet joiner [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/28 00:21:55 UTC, 0 replies.
- Re: [PR] PARQUET-2249: Introduce IEEE 754 total order [parquet-format] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/28 02:37:09 UTC, 1 replies.
- Re: [PR] PARQUET-2249: Add nan_count to handle NaNs in statistics [parquet-format] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/28 02:37:52 UTC, 0 replies.
- Re: [I] [VariantShredding] Union of partially shredded objects has undefined field order in result object [parquet-format] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/28 04:01:53 UTC, 0 replies.
- [I] Blog on Floating Point Statistics Improvement [parquet-site] - posted by "alamb (via GitHub)" <gi...@apache.org> on 2026/05/28 11:47:15 UTC, 0 replies.
- [PR] [minor] [parquet-hadoop] Remove Java 8 direct buffer cleaner path [parquet-java] - posted by "dossett (via GitHub)" <gi...@apache.org> on 2026/05/28 17:50:25 UTC, 0 replies.
- Re: [PR] GH-3394: Cache FileStatus in Footer to reduce redundant NameNode RPC calls [parquet-java] - posted by "dossett (via GitHub)" <gi...@apache.org> on 2026/05/28 20:51:09 UTC, 1 replies.
- Re: [PR] GH-3307: Replace deprecated BIT_PACKED with RLE in DevNullValuesWriter [parquet-java] - posted by "dossett (via GitHub)" <gi...@apache.org> on 2026/05/28 21:13:05 UTC, 1 replies.
- Re: [PR] [GH] Optimize the code struct of ColumnChunkMetaData. [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/29 00:25:24 UTC, 1 replies.
- Re: [PR] PARQUET-2415: Reuse hadoop file status and footer in ParquetRecordReader [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/29 00:25:31 UTC, 1 replies.
- Re: [I] Blog on Floating Point Statistics Improvement (order + Nan counts) [parquet-site] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2026/05/29 05:55:03 UTC, 0 replies.
- [I] Bump Parquet to 0.23.0 [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/29 08:05:46 UTC, 0 replies.
- [PR] GH-569: Bump Thrift to 0.23.0 [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/29 08:06:49 UTC, 0 replies.
- Re: [I] Make `path_in_schema` optional [parquet-format] - posted by "rdblue (via GitHub)" <gi...@apache.org> on 2026/05/29 19:16:13 UTC, 2 replies.
- Re: [I] Parquet spec (parquet.thrift) is inconsistent w.r.t. ColumnIndex + NaNs [parquet-format] - posted by "etseidl (via GitHub)" <gi...@apache.org> on 2026/05/29 22:04:01 UTC, 1 replies.
- Re: [PR] PARQUET-2412: Reduce excessive synchronization in MemoryManager [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/30 00:23:09 UTC, 0 replies.
- Re: [PR] GH-3587: Fix `parquet.thrift.string.size.limit` validation [parquet-java] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/05/30 05:40:10 UTC, 1 replies.
- Re: [PR] allow read old parquet file which is maked by old api with old avro version which allow wrong default value in schema [parquet-java] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/31 00:22:48 UTC, 0 replies.
- [PR] Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.26.0 to 0.26.1 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/31 02:23:28 UTC, 0 replies.
- [PR] Bump com.fasterxml.jackson.core:jackson-databind from 2.21.3 to 2.21.4 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/31 02:23:38 UTC, 0 replies.
- [PR] Bump jackson.version from 2.21.3 to 2.21.4 [parquet-java] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/31 02:24:06 UTC, 0 replies.