You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 01:07:01 UTC
[GitHub] [beam] damccorm opened a new issue, #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
damccorm opened a new issue, #21643:
URL: https://github.com/apache/beam/issues/21643
See [https://github.com/apache/beam/pull/17384#issuecomment-1117418018](https://github.com/apache/beam/pull/17384#issuecomment-1117418018)
```
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:141:
_ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/pipeline.py:573: in run
return self.runner.run_pipeline(self,
self._options)
apache_beam/runners/portability/fn_api_runner/fn_runner.py:200: in run_pipeline
pipeline.to_runner_api(default_environment=self._default_environment))
apache_beam/runners/portability/fn_api_runner/fn_runner.py:208:
in run_via_runner_api
return self.run_stages(stage_context, stages)
apache_beam/runners/portability/fn_api_runner/fn_runner.py:409:
in run_stages
runner_execution_context, bundle_context_manager, bundle_input)
apache_beam/runners/portability/fn_api_runner/fn_runner.py:742:
in _execute_bundle
bundle_manager))
apache_beam/runners/portability/fn_api_runner/fn_runner.py:966:
in _run_bundle
data_input, data_output, input_timers, expected_timer_output)
apache_beam/runners/portability/fn_api_runner/fn_runner.py:1309:
in process_bundle
output.transform_id).append(output.data)
apache_beam/runners/portability/fn_api_runner/execution.py:242:
in append
windowed_key_value = coder_impl.decode_from_stream(input_stream, True)
apache_beam/coders/coder_impl.py:1446:
in decode_from_stream
value = self._value_coder.decode_from_stream(in_stream, nested)
apache_beam/coders/coder_impl.py:994:
in decode_from_stream
c in enumerate(self._coder_impls)
apache_beam/coders/coder_impl.py:994:
in <listcomp>
c in enumerate(self._coder_impls)
apache_beam/coders/coder_impl.py:617: in decode_from_stream
return in_stream.read_all(nested)
apache_beam/coders/slow_stream.py:137: in read_all
return
self.read(self.read_var_int64() if nested else self.size())
apache_beam/coders/slow_stream.py:148:
in read_var_int64
byte = self.read_byte()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <apache_beam.coders.slow_stream.InputStream object at 0x7f8433d63190>
def read_byte(self):
# type: () -> int
self.pos += 1
> return self.data[self.pos
- 1]
E IndexError: index out of rangeapache_beam/coders/slow_stream.py:142: IndexError
```
Imported from Jira [BEAM-14410](https://issues.apache.org/jira/browse/BEAM-14410). Original Jira may contain additional context.
Reported by: bhulette.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1289667672
clicked on random error in #23788 and saw:
```
...
E File "/home/runner/work/beam/beam/sdks/python/apache_beam/coders/slow_stream.py", line 145, in read_byte
E return self.data[self.pos - 1]
E IndexError: index out of range
```
seems similar to what's reported in this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] BjornPrime commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
BjornPrime commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1285899599
.close-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] TheNeuralBit commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
TheNeuralBit commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1287529871
Did we just decide to close this because the test is disabled?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] github-actions[bot] closed issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
URL: https://github.com/apache/beam/issues/21643
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] BjornPrime commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
BjornPrime commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1282561876
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1341285215
@BjornPrime are you still working on this, or perhaps we should unassign so someone else knows it is available?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1347016393
Then let us unassign.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] BjornPrime commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
BjornPrime commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1289675483
Hmm, may be more than one thing. Some of the failures from `portable_runner_test` aren't due to IndexErrors.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] BjornPrime commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
BjornPrime commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1289329036
I closed it (probably prematurely) because I couldn't repro the test failure. I created https://github.com/apache/beam/pull/23788 to re-enable the test but now that's failing a lot of checks so I'll need to look into it further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] BjornPrime commented on issue #21643: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment
Posted by GitBox <gi...@apache.org>.
BjornPrime commented on issue #21643:
URL: https://github.com/apache/beam/issues/21643#issuecomment-1344563094
I picked it up during the last fixit but am not actively working on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org