You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2024/05/09 11:17:21 UTC

[PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

alamb opened a new pull request, #5737:
URL: https://github.com/apache/arrow-rs/pull/5737

   # Which issue does this PR close?
   
   Related to https://github.com/apache/arrow-rs/issues/5368
   
   # Rationale for this change
    
   We spent a while discussing release cadence in https://github.com/apache/arrow-rs/issues/5368 so let's document that clearly on in the readmes
   
   # What changes are included in this PR?
   
   Document the planed release cadence. 
   
   Add links in parquet / arrow-rs readme
   
   # Are there any user-facing changes?
   
   Documentation, no functional changes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb merged PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1595358360


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).
+
+Due to available maintainer and testing bandwidth, `arrow` crates (`arrow`,
+`arrow-flight`, etc.) are released on the same schedule with the same versions
+as the `parquet` and `parquet-derive` crates.
+
+Starting June 2024, we plan to release new major versions with potentially
+breaking API changes once a quarter, and release incremental minor versions in
+the intervening months. See [this ticket] for more details.
+
+For example:
+
+| Approximate Date | Version  | Notes                                   |
+| ---------------- | -------- | --------------------------------------- |
+| Jun 2024         | `52.0.0` | Major, potentially breaking API changes |
+| Jul 2024         | `52.1.0` | Minor, NO breaking API changes          |
+| Aug 2024         | `52.2.0` | Minor, NO breaking API changes          |
+| Sep 2024         | `52.0.0` | Major, potentially breaking API changes |

Review Comment:
   Thank you -- good eyes -- I fixed that



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#issuecomment-2102982661

   > Do we have a plan to object_store? I'm guessing a breaking change to object_store could also affect parquet?
   
   Nothing formal, but a natural implication of this would be that if we made a breaking release to object_store we would be unable to incorporate this into arrow until the next arrow breaking release. In practice this means object_store will likely follow a similar cadence for breaking releases, if not slower.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "GPSnoopy (via GitHub)" <gi...@apache.org>.
GPSnoopy commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1595325009


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).
+
+Due to available maintainer and testing bandwidth, `arrow` crates (`arrow`,
+`arrow-flight`, etc.) are released on the same schedule with the same versions
+as the `parquet` and `parquet-derive` crates.
+
+Starting June 2024, we plan to release new major versions with potentially
+breaking API changes once a quarter, and release incremental minor versions in
+the intervening months. See [this ticket] for more details.
+
+For example:
+
+| Approximate Date | Version  | Notes                                   |
+| ---------------- | -------- | --------------------------------------- |
+| Jun 2024         | `52.0.0` | Major, potentially breaking API changes |
+| Jul 2024         | `52.1.0` | Minor, NO breaking API changes          |
+| Aug 2024         | `52.2.0` | Minor, NO breaking API changes          |
+| Sep 2024         | `52.0.0` | Major, potentially breaking API changes |

Review Comment:
   Potential typo: likely should be `53.0.0`



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1607287684


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).

Review Comment:
   > I am a little confused by this statement and others here. My understanding from https://github.com/apache/arrow-rs/issues/5368 and elsewhere was that arrow-rs doesn't follow semver, except maybe with its minor and patch releases. 
   
   From my perspective arrow-rs follows semver as implemented by rust / cargo. 
   
   > My understanding of the spirit of semver is that major releases absolutely include breaking changes 
   
   That may be the "spirit" or ideal, but my understanding is that semver means breaking changes only occur in major versions. 
   
   > so if arrow-rs releases majors on a schedule and those majors only may include breaking changes, that wouldn't be following semver. Does that match your interpretation?
   
   No. 
   
   However, what we have done in the past is if a scheduled release includes no breaking changes, we did a minor release. However, the API is so large practically all releases have had at least one breaking change (I think I remember one that did not) 
   
   what I expect to happen is that each quarterly release will include breaking API changes (however small). If they don't have breaking changes we can do a minor relese 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1607269045


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).

Review Comment:
   Hey @alamb, sorry I missed this when it was open.
   
   I am a little confused by this statement and others here. My understanding from https://github.com/apache/arrow-rs/issues/5368 and elsewhere was that arrow-rs doesn't follow semver, except maybe with its minor and patch releases. My understanding of the spirit of semver is that major releases absolutely include breaking changes so if arrow-rs releases majors on a schedule and those majors only _may_ include breaking changes, that wouldn't be following semver. Does that match your interpretation?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#issuecomment-2104553239

   I plan to add a note about object_store release schedules, likely as a follow on PR


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#issuecomment-2105660789

   I am working on a follow up PR for object_store cadence


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1595316732


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).
+
+Due to available maintainer and testing bandwidth, `arrow` crates (`arrow`,
+`arrow-flight`, etc.) are released on the same schedule with the same versions
+as the `parquet` and `parquet-derive` crates.
+
+Starting June 2024, we plan to release new major versions with potentially

Review Comment:
   I believe this accurately summarizes the plan from https://github.com/apache/arrow-rs/issues/5368



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1595358120


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).
+
+Due to available maintainer and testing bandwidth, `arrow` crates (`arrow`,
+`arrow-flight`, etc.) are released on the same schedule with the same versions
+as the `parquet` and `parquet-derive` crates.
+
+Starting June 2024, we plan to release new major versions with potentially
+breaking API changes once a quarter, and release incremental minor versions in
+the intervening months. See [this ticket] for more details.
+
+For example:
+
+| Approximate Date | Version  | Notes                                   |
+| ---------------- | -------- | --------------------------------------- |
+| Jun 2024         | `52.0.0` | Major, potentially breaking API changes |
+| Jul 2024         | `52.1.0` | Minor, NO breaking API changes          |
+| Aug 2024         | `52.2.0` | Minor, NO breaking API changes          |
+| Sep 2024         | `52.0.0` | Major, potentially breaking API changes |

Review Comment:
   ```suggestion
   | Sep 2024         | `53.0.0` | Major, potentially breaking API changes |
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#issuecomment-2102788926

   Do we have a plan to object_store? I'm guessing a breaking change to `object_store` could also affect parquet?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1595676959


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).
+
+Due to available maintainer and testing bandwidth, `arrow` crates (`arrow`,
+`arrow-flight`, etc.) are released on the same schedule with the same versions
+as the `parquet` and `parquet-derive` crates.
+
+Starting June 2024, we plan to release new major versions with potentially
+breaking API changes once a quarter, and release incremental minor versions in

Review Comment:
   ```suggestion
   breaking API changes at most once a quarter, and release incremental minor versions in
   ```
   
   Let's be optimistic :laughing: 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Document planned release cadence for arrow/parquet/etc [arrow-rs]

Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on code in PR #5737:
URL: https://github.com/apache/arrow-rs/pull/5737#discussion_r1607306524


##########
README.md:
##########
@@ -34,7 +34,33 @@ This repo contains the following main components:
 
 The current development version the API documentation in this repo can be found [here](https://arrow.apache.org/rust).
 
-There are two related crates in a different repository
+## Release Versioning and Schedule
+
+The Arrow Rust project releases approximately monthly and follows [Semantic
+Versioning](https://semver.org/).

Review Comment:
   That makes sense, thanks. I think the fuzziness around scheduled releases having a high likelihood of including breaking changes was where I was confused. Thanks for the quick response!



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org