You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "chamikaramj (via GitHub)" <gi...@apache.org> on 2024/03/05 21:38:52 UTC

[I] [Bug]: Upgrade compatibility broken when upgrading Beam read/write transforms to 2.55.0.dev [beam]

chamikaramj opened a new issue, #30534:
URL: https://github.com/apache/beam/issues/30534

   ### What happened?
   
   Seems like we added two required constructions properties in https://github.com/apache/beam/commit/6a8c27ef6fb945921b4f70766c1f1bd6c493dadc.
   
   These properties are not available in previous BQ transform versions, hence upgrade compatibility will be broken.
   
   Is it possible to make these properties optional in the transform ?
   
   If above can be done, we can also avoid adding such properties during construction (see https://github.com/apache/beam/pull/30032) which would preserve upgrade compatibility.
   
   ### Issue Priority
   
   Priority: 3 (minor)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30534: [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev 
URL: https://github.com/apache/beam/issues/30534


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30534: [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev 
URL: https://github.com/apache/beam/issues/30534


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1979682142

   cc: @kennknowles @robertwb we might run into other similar upgrade compatibility issues in the future, hence we should think about how to detect/avoid them.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1986090586

   The fix #30551 breaks XVR PythonUsingJavaSql tests (for all runners). See 
   - https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow.yml?query=event%3Aschedule
   - https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_Samza.yml?query=event%3Aschedule
   - https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_Spark3.yml?query=event%3Aschedule
   
   and revert can make the test run: https://github.com/apache/beam/pull/30577
   
   It fails early at failing to start expansion service


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1986170051

   Sorry, I now pretty sure it is gradle cache issue. Initiated the test locally it passed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1982068658

   Should be fixed by https://github.com/apache/beam/issues/30534.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1986169236

   Ack. Checking.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1981934491

   I'm working on a fix.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj closed issue #30534: [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev 
URL: https://github.com/apache/beam/issues/30534


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1981879397

   What is the plan as for 2.55.0 release ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1984177455

   Need to open a cherry-pick to 2.55.0 branch.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Upgrade compatibility broken when upgrading BQ read/write transforms to 2.55.0.dev [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30534:
URL: https://github.com/apache/beam/issues/30534#issuecomment-1986256638

   Opened https://issues.apache.org/jira/browse/INFRA-25595 request delete remote Gradle cache


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org