You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dian Fu (Jira)" <ji...@apache.org> on 2020/05/09 10:40:00 UTC

[jira] [Commented] (FLINK-17596) Unstable PyFlinkBlinkStreamUserDefinedFunctionTests testMethod#test_udf_in_join_condition_2

    [ https://issues.apache.org/jira/browse/FLINK-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103244#comment-17103244 ] 

Dian Fu commented on FLINK-17596:
---------------------------------

cc [~zhongwei]

> Unstable PyFlinkBlinkStreamUserDefinedFunctionTests testMethod#test_udf_in_join_condition_2
> -------------------------------------------------------------------------------------------
>
>                 Key: FLINK-17596
>                 URL: https://issues.apache.org/jira/browse/FLINK-17596
>             Project: Flink
>          Issue Type: Bug
>          Components: API / Python
>    Affects Versions: 1.11.0
>            Reporter: Yun Tang
>            Priority: Major
>
> Unlike FLINK-14865, this failure of PyFlinkBlinkStreamUserDefinedFunctionTests testMethod#test_udf_in_join_condition_2 is caused by "no such file" IO exception.
> instance link: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=826&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=455fddbf-5921-5b71-25ac-92992ad80b28
> {code:java}
>  Caused by: java.lang.RuntimeException: Failed to create stage bundle factory!
>  	at org.apache.flink.python.AbstractPythonFunctionRunner.createStageBundleFactory(AbstractPythonFunctionRunner.java:197)
>  	at org.apache.flink.python.AbstractPythonFunctionRunner.open(AbstractPythonFunctionRunner.java:164)
>  	at org.apache.flink.table.runtime.runners.python.scalar.AbstractGeneralPythonScalarFunctionRunner.open(AbstractGeneralPythonScalarFunctionRunner.java:65)
>  	at org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator$ProjectUdfInputPythonScalarFunctionRunner.open(AbstractStatelessFunctionOperator.java:186)
>  	at org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.open(AbstractPythonFunctionOperator.java:142)
>  	at org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator.open(AbstractStatelessFunctionOperator.java:131)
>  	at org.apache.flink.table.runtime.operators.python.scalar.AbstractPythonScalarFunctionOperator.open(AbstractPythonScalarFunctionOperator.java:88)
>  	at org.apache.flink.table.runtime.operators.python.scalar.AbstractRowDataPythonScalarFunctionOperator.open(AbstractRowDataPythonScalarFunctionOperator.java:80)
>  	at org.apache.flink.table.runtime.operators.python.scalar.RowDataPythonScalarFunctionOperator.open(RowDataPythonScalarFunctionOperator.java:64)
>  	at org.apache.flink.streaming.runtime.tasks.OperatorChain.initializeStateAndOpenOperators(OperatorChain.java:288)
>  	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$beforeInvoke$0(StreamTask.java:459)
>  	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$SynchronizedStreamTaskActionExecutor.runThrowing(StreamTaskActionExecutor.java:92)
>  	at org.apache.flink.streaming.runtime.tasks.StreamTask.beforeInvoke(StreamTask.java:455)
>  	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:475)
>  	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:713)
>  	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:539)
>  	at java.lang.Thread.run(Thread.java:748)
>  Caused by: org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException: java.io.IOException: Cannot run program "/tmp/python-dist-38f0c31e-9801-4d53-9694-2e16fd4b2fc5/pyflink-udf-runner.sh": error=2, No such file or directory
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
>  	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:331)
>  	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:320)
>  	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:250)
>  	at org.apache.flink.python.AbstractPythonFunctionRunner.createStageBundleFactory(AbstractPythonFunctionRunner.java:195)
>  	... 16 more
>  Caused by: java.io.IOException: Cannot run program "/tmp/python-dist-38f0c31e-9801-4d53-9694-2e16fd4b2fc5/pyflink-udf-runner.sh": error=2, No such file or directory
>  	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
>  	at org.apache.beam.runners.fnexecution.environment.ProcessManager.startProcess(ProcessManager.java:144)
>  	at org.apache.beam.runners.fnexecution.environment.ProcessManager.startProcess(ProcessManager.java:119)
>  	at org.apache.beam.runners.fnexecution.environment.ProcessEnvironmentFactory.createEnvironment(ProcessEnvironmentFactory.java:131)
>  	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:200)
>  	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:184)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
>  	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
>  	... 20 more
>  	Suppressed: java.lang.NullPointerException: Process for id does not exist: 87-1
>  		at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:895)
>  		at org.apache.beam.runners.fnexecution.environment.ProcessManager.stopProcess(ProcessManager.java:169)
>  		at org.apache.beam.runners.fnexecution.environment.ProcessEnvironmentFactory.createEnvironment(ProcessEnvironmentFactory.java:151)
>  		... 30 more
>  Caused by: java.io.IOException: error=2, No such file or directory
>  	at java.lang.UNIXProcess.forkAndExec(Native Method)
>  	at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
>  	at java.lang.ProcessImpl.start(ProcessImpl.java:134)
>  	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
>  	... 33 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)