issues@parquet.apache.org, 2024-02

You are viewing a plain text version of this content. The canonical link for it is here.

- [jira] [Commented] (PARQUET-2424) Encrypted parquet files can't have more than 32767 pages per chunk: 32768 - posted by "Gidon Gershinsky (Jira)" <ji...@apache.org> on 2024/02/01 15:56:00 UTC, 12 replies.
- Re: [PR] PARQUET-2415: Reuse hadoop file status and footer in ParquetRecordReader [parquet-mr] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2024/02/01 16:08:09 UTC, 4 replies.
- Re: [PR] Bump jackson.version from 2.16.0 to 2.16.1 [parquet-mr] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/02/02 11:16:18 UTC, 1 replies.
- Re: [PR] PARQUET-2171: Support Hadoop vectored IO [parquet-mr] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2024/02/02 14:07:25 UTC, 5 replies.
- [PR] Bump org.apache:apache from 29 to 31 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/04 02:22:01 UTC, 2 replies.
- [PR] Bump com.google.api.grpc:proto-google-common-protos from 2.30.0 to 2.33.0 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/04 02:22:04 UTC, 3 replies.
- [PR] Bump com.google.truth.extensions:truth-proto-extension from 1.3.0 to 1.4.0 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/04 02:22:27 UTC, 2 replies.
- [PR] Bump org.apache.maven.plugins:maven-dependency-plugin from 3.3.0 to 3.6.1 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/04 02:22:30 UTC, 4 replies.
- [jira] [Updated] (PARQUET-2424) Encrypted parquet files can't have more than 32767 pages per chunk: 32768 - posted by "Ence Wang (Jira)" <ji...@apache.org> on 2024/02/04 11:22:00 UTC, 0 replies.
- [PR] Bump org.apache.rat:apache-rat-plugin from 0.16 to 0.16.1 [parquet-format] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/04 13:27:00 UTC, 1 replies.
- Re: [PR] [PARQUET-2422] Prevent unwrapping of Hadoop filestreams [parquet-mr] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2024/02/06 04:54:15 UTC, 2 replies.
- Re: [PR] MINOR: Fix missing word in Compression [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/02/06 20:24:04 UTC, 1 replies.
- Re: [PR] Bump org.apache.maven.plugins:maven-shade-plugin from 3.4.1 to 3.5.1 [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/02/06 20:24:27 UTC, 0 replies.
- Re: [PR] Bump org.apache:apache from 29 to 31 [parquet-format] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/02/06 20:24:36 UTC, 0 replies.
- [jira] [Created] (PARQUET-2426) Add lz4_raw compression to README - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2024/02/07 04:24:00 UTC, 0 replies.
- [PR] [PARQUET-2426] Add lz4_raw compression to README [parquet-mr] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/02/07 04:25:51 UTC, 1 replies.
- [PR] MINOR: try to fix github workflow timeout [parquet-mr] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2024/02/07 05:31:44 UTC, 5 replies.
- Re: [PR] PARQUET-2426: Add lz4_raw compression to README [parquet-mr] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/02/07 08:25:09 UTC, 1 replies.
- [jira] [Created] (PARQUET-2427) The page compressedSize printed by the ShowPagesCommand is actually uncompressedSize - posted by "Yujiang Zhong (Jira)" <ji...@apache.org> on 2024/02/07 08:49:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-2427) The page compressedSize printed by the ShowPagesCommand is actually uncompressedSize - posted by "Yujiang Zhong (Jira)" <ji...@apache.org> on 2024/02/07 08:50:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2428) Make RawPagesReader support specified columns - posted by "Yujiang Zhong (Jira)" <ji...@apache.org> on 2024/02/07 08:55:00 UTC, 0 replies.
- [PR] PARQUET-2428: Make RawPagesReader accpet specificed columns. [parquet-mr] - posted by "zhongyujiang (via GitHub)" <gi...@apache.org> on 2024/02/07 09:14:21 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-2426) Add lz4_raw compression to README - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/07 09:21:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2426) Add lz4_raw compression to README - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/07 09:21:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2429) Direct buffer churn in NonBlockedDecompressor - posted by "Gian Merlino (Jira)" <ji...@apache.org> on 2024/02/07 23:59:00 UTC, 0 replies.
- [PR] Grow input buffers by doubling in NonBlockedCompressor and NonBlockedDecompressor. [parquet-mr] - posted by "gianm (via GitHub)" <gi...@apache.org> on 2024/02/08 00:01:31 UTC, 0 replies.
- [jira] [Updated] (PARQUET-2429) Direct buffer churn in NonBlockedDecompressor - posted by "Gian Merlino (Jira)" <ji...@apache.org> on 2024/02/08 04:18:00 UTC, 1 replies.
- [jira] [Commented] (PARQUET-1889) Register a MIME type for the Parquet format. - posted by "Bryce Mecum (Jira)" <ji...@apache.org> on 2024/02/11 01:57:00 UTC, 9 replies.
- [PR] Bump commons-io:commons-io from 2.7 to 2.15.1 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/11 02:43:52 UTC, 1 replies.
- [PR] Bump org.scalactic:scalactic_2.12 from 3.0.1 to 3.2.18 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/11 02:44:05 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1889) Register a MIME type for the Parquet format. - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/11 12:07:00 UTC, 0 replies.
- Re: [PR] PARQUET-2171. Implement vectored IO in parquet file format [parquet-mr] - posted by "mukund-thakur (via GitHub)" <gi...@apache.org> on 2024/02/12 21:57:18 UTC, 1 replies.
- Re: [PR] [DRAFT] PR to show Vectored IO integration, compilation fails now. [parquet-mr] - posted by "mukund-thakur (via GitHub)" <gi...@apache.org> on 2024/02/12 21:58:31 UTC, 1 replies.
- [jira] [Created] (PARQUET-2430) Add ParquetJoiner feature - posted by "Maksim Konstantinov (Jira)" <ji...@apache.org> on 2024/02/13 01:18:00 UTC, 0 replies.
- [PR] [WIP][Proposal] PARQUET-2430: Add parquet joiner [parquet-mr] - posted by "MaxNevermind (via GitHub)" <gi...@apache.org> on 2024/02/13 01:18:18 UTC, 3 replies.
- [jira] [Created] (PARQUET-2431) Handle ByteBufferAllocator gracefully - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/13 09:03:00 UTC, 0 replies.
- [PR] PARQUET-2431: Handle ByteBufferAllocator gracefully [parquet-mr] - posted by "gszadovszky (via GitHub)" <gi...@apache.org> on 2024/02/13 12:47:32 UTC, 6 replies.
- Re: [PR] PARQUET-2425: Support non-grouped repeated fields in AvroSchemaConverter [parquet-mr] - posted by "clairemcginty (via GitHub)" <gi...@apache.org> on 2024/02/13 15:34:08 UTC, 1 replies.
- [jira] [Created] (PARQUET-2432) Use ByteBufferAllocator instead of hardcoded heap allocation - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/15 09:46:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2428) Make RawPagesReader support specified columns - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/18 05:38:00 UTC, 0 replies.
- Re: [PR] PARQUET-2261: Implement SizeStatistics [parquet-mr] - posted by "shangxinli (via GitHub)" <gi...@apache.org> on 2024/02/18 22:36:49 UTC, 15 replies.
- [jira] [Created] (PARQUET-2433) CLI supports printing SizeStatistics - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/19 01:55:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2434) ParquetRewriter should keep SizeStatistics - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/19 01:57:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2425) AvroSchemaConverter doesn't support non-grouped repeated fields - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/19 08:41:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2431) Handle ByteBufferAllocator gracefully - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/19 09:08:00 UTC, 0 replies.
- [PR] [DO NOT MERGE] PARQUET-2414: Add test file for additional BYTE_STREAM_SPLIT types [parquet-testing] - posted by "pitrou (via GitHub)" <gi...@apache.org> on 2024/02/19 15:46:18 UTC, 3 replies.
- [jira] [Updated] (PARQUET-2414) [Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY, INT32 and INT64 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/02/19 15:47:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2435) Clarify behavior of DELTA_BINARY_PACKED encoders/decoders - posted by "Edward Seidl (Jira)" <ji...@apache.org> on 2024/02/20 02:24:00 UTC, 0 replies.
- [PR] PARQUET-2435: Clarify behavior of DELTA_BINARY_PACKED encoding [parquet-format] - posted by "etseidl (via GitHub)" <gi...@apache.org> on 2024/02/20 02:32:00 UTC, 18 replies.
- [PR] PARQUET-2432: Use ByteBufferAllocator over hardcoded heap allocation [parquet-mr] - posted by "gszadovszky (via GitHub)" <gi...@apache.org> on 2024/02/21 13:19:35 UTC, 8 replies.
- [jira] [Updated] (PARQUET-2432) Use ByteBufferAllocator instead of hardcoded heap allocation - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/21 13:33:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2436) More optimal memory usage in compression codecs - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/21 13:38:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-2436) More optimal memory usage in compression codecs - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/21 13:41:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2437) Avoid flushing at Parquet writes after an exception - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/22 10:27:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2438) Fixes minMaxSize for BinaryColumnIndexBuilder - posted by "Xianyang Liu (Jira)" <ji...@apache.org> on 2024/02/23 07:33:00 UTC, 0 replies.
- [PR] PARQUET-2438: Fixes minMaxSize for BinaryColumnIndexBuilder [parquet-mr] - posted by "ConeyLiu (via GitHub)" <gi...@apache.org> on 2024/02/23 07:34:39 UTC, 6 replies.
- [jira] [Resolved] (PARQUET-2432) Use ByteBufferAllocator instead of hardcoded heap allocation - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/23 16:16:00 UTC, 0 replies.
- [PR] PARQUET-2436: More optimal memory usage in compression codecs [parquet-mr] - posted by "gszadovszky (via GitHub)" <gi...@apache.org> on 2024/02/23 17:15:24 UTC, 5 replies.
- [PR] Bump org.scalatest:scalatest_2.12 from 3.0.1 to 3.2.18 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/25 02:20:56 UTC, 0 replies.
- [PR] Bump com.google.truth.extensions:truth-proto-extension from 1.4.0 to 1.4.1 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/25 02:21:07 UTC, 1 replies.
- [PR] Bump org.apache.maven.plugins:maven-shade-plugin from 3.5.1 to 3.5.2 [parquet-mr] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/25 02:21:13 UTC, 1 replies.
- [PR] Bump org.codehaus.mojo:exec-maven-plugin from 3.1.1 to 3.2.0 [parquet-format] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/25 13:39:13 UTC, 0 replies.
- [PR] Bump org.apache.maven.plugins:maven-shade-plugin from 3.5.1 to 3.5.2 [parquet-format] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/02/25 13:39:18 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2438) Fixes minMaxSize for BinaryColumnIndexBuilder - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/27 01:44:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2436) More optimal memory usage in compression codecs - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/27 08:55:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2439) Upgrade ZSTD-JNI to 1.5.5-11 - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2024/02/28 04:20:00 UTC, 0 replies.
- [PR] PARQUET-2439: Upgrade ZSTD-JNI to 1.5.5-11 [parquet-mr] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/02/28 04:21:50 UTC, 1 replies.
- [jira] [Assigned] (PARQUET-2435) Clarify behavior of DELTA_BINARY_PACKED encoders/decoders - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/28 11:37:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2435) Clarify behavior of DELTA_BINARY_PACKED encoders/decoders - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/28 11:38:00 UTC, 0 replies.
- [PR] PARQUET-2437: Avoid flushing at Parquet writes after an exception [parquet-mr] - posted by "gszadovszky (via GitHub)" <gi...@apache.org> on 2024/02/28 15:47:13 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-2422) Prevent unwrapping of Hadoop filestreams - posted by "Gang Wu (Jira)" <ji...@apache.org> on 2024/02/29 07:50:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-2440) Don't get Hadoop codec for internal compressor/decompressor - posted by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/29 09:05:00 UTC, 0 replies.
- [PR] PARQUET-2440: Avoid getting Hadoop codec for internal compressor/decompressor [parquet-mr] - posted by "gszadovszky (via GitHub)" <gi...@apache.org> on 2024/02/29 10:23:09 UTC, 2 replies.
- [jira] [Resolved] (PARQUET-2423) Avoid allocating buffer obeject in RecordReader's SkipRecords - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/29 16:08:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-2423) Avoid allocating buffer obeject in RecordReader's SkipRecords - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/29 16:08:00 UTC, 1 replies.
- [jira] [Updated] (PARQUET-2099) [C++] Statistics::num_values() is misleading - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/29 16:09:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1646) [C++] Use arrow::Buffer for buffered dictionary indices in DictEncoder instead of std::vector - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/29 16:09:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-2423) Avoid allocating buffer obeject in RecordReader's SkipRecords - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2024/02/29 16:10:00 UTC, 0 replies.
- Re: [PR] PARQUET-2414: Extend BYTE_STREAM_SPLIT to support INT32, INT64 and FIXED_LEN_BYTE_ARRAY data [parquet-format] - posted by "etseidl (via GitHub)" <gi...@apache.org> on 2024/02/29 18:23:29 UTC, 2 replies.
- [jira] [Commented] (PARQUET-34) Add support for repeated columns in the filter2 API - posted by "Sean Scott (Jira)" <ji...@apache.org> on 2024/02/29 19:25:00 UTC, 0 replies.