[jira] [Commented] (BEAM-3237) Logs from python custom commands are not visible at installation time

["Kamil Wasilewski (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200088#comment-17200088 ] 

Kamil Wasilewski commented on BEAM-3237:
----------------------------------------

It looks like the output of custom commands is no longer logged in, even in the worker-startup log. This is all what I got after running a job with custom setup.py:


Building wheels for collected packages: example 
Building wheel for example (setup.py): started 
Building wheel for example (setup.py): finished with status 'done' 
Created wheel for example: filename=example-0.0.1-py3-none-any.whl size=1039 sha256=9a12e64c4690c2f1183599ccaaf0f6094fba1180733ce03f133258f9bcbe7518 
Stored in directory: /tmp/pip-ephem-wheel-cache-j_0qi3fg/wheels/3b/74/63/a19ebe216edb94a0eb77b70a7ffebfc04517b580414a51692b 
Successfully built example 
Installing collected packages: example 
Successfully installed example-0.0.1

 

Judging from how logs look like, Dataflow runs "pip install . ", which is not enough. At least "pip install . -v" must be used in order to include the output of custom commands.

 

 

> Logs from python custom commands are not visible at installation time
> ---------------------------------------------------------------------
>
>                 Key: BEAM-3237
>                 URL: https://issues.apache.org/jira/browse/BEAM-3237
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Ahmet Altay
>            Priority: P3
>
> Outputs from the custom commands in the julia set example does not show in the DataflowRunner logs.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)