You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 16:39:10 UTC
[GitHub] [beam] kennknowles opened a new issue, #18238: Python word count with DirectRunner gets stuck during application termination on Windows
kennknowles opened a new issue, #18238:
URL: https://github.com/apache/beam/issues/18238
Using virtualenv 15 **** python 2.7.13 **** pip 9.0.1 on Windows 2016
Example logs from DirectRunner:
```
(beamRC2)PS C:\Users\lcwik\.virtualenvs\beamRC2> python -m apache_beam.examples.wordcount --input ".\input\*"
--output l
ocal_counts
No handlers could be found for logger "oauth2client.contrib.multistore_file"
INFO:root:Missing
pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:root:Running
pipeline with DirectRunner.
```
Application gets stuck here, pressing ctrl-z gets it unstuck and the remainder below is logged
```
INFO:root:Starting finalize_write threads with num_shards: 1, batches: 1, num_threads: 1
INFO:root:Renamed
1 shards in 0.14 seconds.
INFO:root:number of empty lines: 47851
INFO:root:average word length: 4
```
Output is correct, so it seems as though the bug is somewhere in shutdown.
Happens when using a local or gs path with the DirectRunner. Enabling DEBUG logging did not add any additional details.
Imported from Jira [BEAM-2265](https://issues.apache.org/jira/browse/BEAM-2265). Original Jira may contain additional context.
Reported by: lcwik.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org