You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@parquet.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2026/09/08 11:14:58 UTC

[PR] Add parquet-format 2.14.0 features to the feature matrix [parquet-site]

alamb opened a new pull request, #202:
URL: https://github.com/apache/parquet-site/pull/202

   ## Rationale
   
   parquet-format 2.14.0 is being voted on now: [[VOTE] Release Apache Parquet Format 2.14.0 RC1](https://lists.apache.org/thread/ovo7vhh2gp31v32xzq6wm5f0grk97bs3). The RC is cut from commit [`04d56f2`](https://github.com/apache/parquet-format/commit/04d56f291ff963e98bc37ab8100e2fc133ff583c) (tag `apache-parquet-2.14.0-rc1`).
   
   This PR adds all the format features included in that release to the [Features and Versions](https://parquet.apache.org/docs/file-format/versions/) page and the [Implementation Status](https://parquet.apache.org/docs/file-format/implementationstatus/) matrix.
   
   Replaces #199, which covered only ALP.
   
   ## Changes
   
   New feature rows, one per format change in 2.14.0:
   
   | Feature | Spec PRs | Approval vote |
   |---|---|---|
   | ALP encoding (marked as in Preview per [#604](https://github.com/apache/parquet-format/pull/604)) | [#557](https://github.com/apache/parquet-format/pull/557), [#604](https://github.com/apache/parquet-format/pull/604), [#608](https://github.com/apache/parquet-format/pull/608) | [2026-07-23](https://lists.apache.org/thread/ld025dzycrhm6dgh8p6157to7d9x8pon) |
   | FILE logical type | [#585](https://github.com/apache/parquet-format/pull/585), [#603](https://github.com/apache/parquet-format/pull/603) | [2026-07-18](https://lists.apache.org/thread/lbtdvq63382fgl2049zb6vn396h9lmfz) |
   | INT96 chronological timestamp order (`ColumnOrder->INT96_TIMESTAMP_ORDER`) | [#584](https://github.com/apache/parquet-format/pull/584) | [2026-07-06](https://lists.apache.org/thread/4kq2gfgx3cmow26h8ofd93653z9zhs2t) |
   
   Also adds the 2.14.0 release metadata to `parquet-format-releases.yaml`.
   
   Notes:
   * The INT96 ordering row is hidden from the implementation status matrix (`implementation_status: false`), following the precedent of the IEEE 754 total order row from 2.13.0. ALP and FILE do appear there, with no support data yet.
   * 2.14.0 also includes [#606](https://github.com/apache/parquet-format/pull/606) (specify handling for unrecognized logical types) and [#574](https://github.com/apache/parquet-format/pull/574) (Variant doc fixes). These are spec clarifications rather than new features, so no matrix rows were added for them.
   
   ## Preview
   
   Rendered preview (may take a few minutes to deploy):
   * https://alamb.github.io/parquet-site/docs/file-format/versions/
   * https://alamb.github.io/parquet-site/docs/file-format/implementationstatus/
   
   **Note:** parquet-format 2.14.0 has not been released yet, so the release tag and compare links will not resolve until it ships. This PR will stay in draft and must not be merged until the [2.14.0 RC1 release vote](https://lists.apache.org/thread/ovo7vhh2gp31v32xzq6wm5f0grk97bs3) passes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r4041244126


##########
data/implementations/support/polars.yaml:
##########
@@ -79,6 +81,8 @@ support:
     status: read
   encoding-byte-stream-split:
     status: read
+  encoding-alp:

Review Comment:
   Actually, I double checked, and I think a missing entry renders as a blank "no data" cell, and status: none renders as ❌. 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "divjotarora (via GitHub)" <gi...@apache.org>.
divjotarora commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r4031815631


##########
data/implementations/features/format-features.yaml:
##########


Review Comment:
   missing `release_date`, not sure if that's intentional



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "emkornfield (via GitHub)" <gi...@apache.org>.
emkornfield commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r4030946735


##########
data/implementations/support/polars.yaml:
##########
@@ -79,6 +81,8 @@ support:
     status: read
   encoding-byte-stream-split:
     status: read
+  encoding-alp:

Review Comment:
   are the entries needed for rending?  No objection to adding them, just curious



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r4030973571


##########
data/implementations/support/polars.yaml:
##########
@@ -79,6 +81,8 @@ support:
     status: read
   encoding-byte-stream-split:
     status: read
+  encoding-alp:

Review Comment:
   yes, when they weren't in there somehow the "2023 features" / "2024 features" table got messed up (didn't render)



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r4041251801


##########
data/implementations/features/format-features.yaml:
##########


Review Comment:
   it wasn't -- good catch. I have fixed in https://github.com/apache/parquet-site/pull/202/commits/976e67a6cb55be2849026102de35afdd0a19fafb



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "sdf-jkl (via GitHub)" <gi...@apache.org>.
sdf-jkl commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r4028256326


##########
data/implementations/support/arrow-rs.yaml:
##########
@@ -94,6 +96,8 @@ support:
     status: full
     since_version_read: "52.2.0"
     since_version_write: "52.2.0"
+  encoding-alp:
+    status: none

Review Comment:
   ```suggestion
       status: full
       since_version_read: "60.0.0"
       since_version_write: "60.0.0"
   ```
   🚀 



##########
data/implementations/support/arrow-rs.yaml:
##########
@@ -67,6 +67,8 @@ support:
     status: full
     since_version_read: "57.0.0"
     since_version_write: "57.0.0"
+  logical-file:
+    status: none

Review Comment:
   ```suggestion
       status: full
       since_version_read: "60.0.0"
       since_version_write: "60.0.0"
   ```
   https://github.com/apache/arrow-rs/issues/10900



##########
data/implementations/features/logical-types.yaml:
##########
@@ -130,6 +130,16 @@ features:
     feature_url: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#geography
     prs: "[#240](https://github.com/apache/parquet-format/pull/240)"
     approval: "[2025-02-09](https://lists.apache.org/thread/s6s714c98cn9gg22mnk5nsn7xymym8xo)"
+  - id: logical-file
+    display_name: FILE
+    version_display_name: FILE (group)
+    compatibility: forward_compatible
+    released_in: "2.14.0"
+    # TODO: placeholder date; update when the parquet-format 2.14.0 release vote is finalized
+    release_date: '2026-09-09'

Review Comment:
   ```suggestion
       release_date: '2026-09-11'
   ```



##########
data/implementations/parquet-format-releases.yaml:
##########
@@ -54,3 +54,8 @@
   tag: apache-parquet-format-2.13.0
   source_url: https://github.com/apache/parquet-format/compare/apache-parquet-format-2.12.0...apache-parquet-format-2.13.0
   source_display: 2.12.0..2.13.0
+# Note: 2.14.0 has not yet been released; these links will resolve once it is.

Review Comment:
   ```suggestion
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #202:
URL: https://github.com/apache/parquet-site/pull/202#issuecomment-5720898242

   > we technically added that unrecognized logical type to physical type mappings should be ignored, not sure if want to include this as well?
   
   I am not sure that is really a feature per se (though I suppose one could argue that we could test readers to see if they ignored unknown logical types 🤔 )
   
   I think what I will do instead is to remove some of the other extraneous detail (like everything other than the main ALP commit) to try and avoid this becoming a github changelog


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #202:
URL: https://github.com/apache/parquet-site/pull/202#issuecomment-5721038636

   Thank you very much @prtkgaur @sdf-jkl @divjotarora @Fokko and @emkornfield 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #202:
URL: https://github.com/apache/parquet-site/pull/202#discussion_r3988393284


##########
data/implementations/features/encodings.yaml:
##########
@@ -48,6 +48,16 @@ features:
     feature_url: https://github.com/apache/parquet-format/blob/master/Encodings.md#byte-stream-split-byte_stream_split--9
     prs: "[#144](https://github.com/apache/parquet-format/pull/144)"
     approval: "[2019-12-03](https://lists.apache.org/thread/xs5qt2odm299pxgqb22mty2csc1so5yr)"
+  - id: encoding-alp
+    display_name: ALP
+    compatibility: forward_incompatible
+    released_in: "2.14.0"
+    # TODO: placeholder date; update when the parquet-format 2.14.0 release vote is finalized
+    release_date: '2026-09-09'

Review Comment:
   ```suggestion
       release_date: '2026-09-11'
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Add parquet-format 2.14.0 features to the support features page [parquet-site]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb merged PR #202:
URL: https://github.com/apache/parquet-site/pull/202


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org