You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 01:21:32 UTC

[GitHub] [beam] damccorm opened a new issue, #21698: Docker Snapshots failing to be published since April 14th

damccorm opened a new issue, #21698:
URL: https://github.com/apache/beam/issues/21698

   https://ci-beam.apache.org/job/beam_Publish_Docker_Snapshots/
   
   13:50:44 \> Task :sdks:go:container:docker FAILED
   13:50:44 ADD failed: stat /var/lib/docker/tmp/docker-builder845277900/target/linux_amd64/boot: no such file or directory
   
   
   Started in https://ci-beam.apache.org/job/beam_Publish_Docker_Snapshots/585/ or https://ci-beam.apache.org/job/beam_Publish_Docker_Snapshots/586/
   
   Imported from Jira [BEAM-14459](https://issues.apache.org/jira/browse/BEAM-14459). Original Jira may contain additional context.
   Reported by: lostluck.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] lostluck commented on issue #21698: Docker Snapshots failing to be published since April 14th

Posted by GitBox <gi...@apache.org>.
lostluck commented on issue #21698:
URL: https://github.com/apache/beam/issues/21698#issuecomment-1170535864

   No difference. Moving forward with removing Go from this publishing, and switching the load tests to use the snapshots that are actually published. AFAICT there's no meaningful difference between the two tasks that should cause the Docker build to fail this way, so it's perplexing to me.
   
   Confirmed moving to the normal snapshot containers fixes the load tests on Dataflow, while Flink remains busted.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] lostluck commented on issue #21698: Docker Snapshots failing to be published since April 14th

Posted by GitBox <gi...@apache.org>.
lostluck commented on issue #21698:
URL: https://github.com/apache/beam/issues/21698#issuecomment-1170380087

   I've been able to verify that the target should be building, but not why it's not being copied to the docker working directory.
   
   But the bewildering bit is that the only difference between the broken task and the successful task is using "dockerTagPush" instead of "dockerPush".
   
   Successful snapshot push task:
   https://ci-beam.apache.org/job/beam_Publish_Beam_SDK_Snapshots
   
   https://github.com/apache/beam/blob/243128a8fc52798e1b58b0cf1a271d95ee7aa241/.test-infra/jenkins/job_Publish_SDK_Image_Snapshots.groovy
   
   So I think the real fix is to simply switch the load tests to use the snapshot images for the Go SDK LoadTests instead, and remove building and pushing to the relatively unused "beam_portability" images directory (Java doesn't use them for example) instead. A separate task can be filed for decommissioning the Docker Publish Snapshots task (which also includes flink images).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] lostluck commented on issue #21698: Docker Snapshots failing to be published since April 14th

Posted by GitBox <gi...@apache.org>.
lostluck commented on issue #21698:
URL: https://github.com/apache/beam/issues/21698#issuecomment-1170385003

   But first, lets just try using tagPush in this task instead of throwing everything away...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] lostluck closed issue #21698: Docker Snapshots failing to be published since April 14th

Posted by GitBox <gi...@apache.org>.
lostluck closed issue #21698: Docker Snapshots failing to be published since April 14th
URL: https://github.com/apache/beam/issues/21698


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] lostluck commented on issue #21698: Docker Snapshots failing to be published since April 14th

Posted by GitBox <gi...@apache.org>.
lostluck commented on issue #21698:
URL: https://github.com/apache/beam/issues/21698#issuecomment-1169211124

   Looks like the lack of built containers has caught up with us since we've made breaking changes to the container version.
   
   SDK containers haven't been built in some time, and the breaking change has broken Load Test metrics gathering. 
   http://metrics.beam.apache.org/d/UYZ-oJ3Zk/gbk-load-tests?orgId=1&var-processingType=batch&var-sdk=go


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org