You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "tvalentyn (via GitHub)" <gi...@apache.org> on 2024/02/01 22:50:56 UTC
[I] [Failing Test]: MLTransform IT [beam]
tvalentyn opened a new issue, #30191:
URL: https://github.com/apache/beam/issues/30191
### What happened?
apache_beam/examples/ml_transform/ml_transform_it_test.py::LargeMovieReviewDatasetProcessTest::test_process_large_movie_review_dataset is perma-failing:
FileNotFoundError: [Errno 2] No such file or directory: 'gs://temp-storage-for-end-to-end-tests/tft/8825e9c2853143f289c2673feb3bc64b'
Sample run: https://github.com/apache/beam/actions/runs/7732452652/job/21082406012#step:29:2783
cc: @AnandInguva
### Issue Failure
Failure: Test is continually failing
### Issue Priority
Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)
### Issue Components
- [X] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is faling [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #30191:
URL: https://github.com/apache/beam/issues/30191#issuecomment-1922487103
Actually, not a regression since it was already in 2.53.0-RC1. But I think it limit usability of MLTransform.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is faling [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #30191:
URL: https://github.com/apache/beam/issues/30191#issuecomment-1922441823
interestingly, files are there, so maybe it's a permission issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is faling [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #30191:
URL: https://github.com/apache/beam/issues/30191#issuecomment-1922467958
Probably failing after https://github.com/apache/beam/pull/29564.
We should use Beam FileSystem in these cases:
https://github.com/apache/beam/blob/574e7bfbc1d30b86f0ff33a01653ebe525b0c964/sdks/python/apache_beam/ml/transforms/utils.py#L33
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is faling [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #30191:
URL: https://github.com/apache/beam/issues/30191#issuecomment-1922441246
```
gsutil ls gs://temp-storage-for-end-to-end-tests/tft/8825e9c2853143f289c2673feb3bc64b
gs://temp-storage-for-end-to-end-tests/tft/8825e9c2853143f289c2673feb3bc64b/attributes.json
gs://temp-storage-for-end-to-end-tests/tft/8825e9c2853143f289c2673feb3bc64b/c4f900/
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is failing [beam]
Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva closed issue #30191: [Failing Test]: MLTransform IT test is failing
URL: https://github.com/apache/beam/issues/30191
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is faling [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #30191:
URL: https://github.com/apache/beam/issues/30191#issuecomment-1922462536
Repro:
```
pip install tensorflow-transform apache-beam
```
```
from apache_beam.ml.transforms.utils import ArtifactsFetcher
artifact_location='gs://temp-storage-for-end-to-end-tests/tft/8825e9c2853143f289c2673feb3bc64b'
artifacts_fetcher = ArtifactsFetcher(artifact_location=artifact_location)
actual_vocab_list = artifacts_fetcher.get_vocab_list()
```
FileNotFoundError: [Errno 2] No such file or directory: 'gs://temp-storage-for-end-to-end-tests/tft/8825e9c2853143f289c2673feb3bc64b'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Failing Test]: MLTransform IT test is faling [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #30191:
URL: https://github.com/apache/beam/issues/30191#issuecomment-1922470497
It might be a regression in the currently cut release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org