You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dian Fu (Jira)" <ji...@apache.org> on 2020/05/14 02:40:00 UTC
[jira] [Closed] (FLINK-17597) JavaSqlTests#test_java_sql_ddl is
instable
[ https://issues.apache.org/jira/browse/FLINK-17597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dian Fu closed FLINK-17597.
---------------------------
Resolution: Duplicate
This cause of this issue should be the same as FLINK-17454 and so should have been addressed in FLINK-17454.
> JavaSqlTests#test_java_sql_ddl is instable
> ------------------------------------------
>
> Key: FLINK-17597
> URL: https://issues.apache.org/jira/browse/FLINK-17597
> Project: Flink
> Issue Type: Bug
> Components: API / Python
> Affects Versions: 1.11.0
> Reporter: Dian Fu
> Priority: Major
> Labels: pull-request-available, test-stability
> Fix For: 1.11.0
>
>
> It failed with the following log:
> {code}
> 2020-05-09T04:56:56.6224030Z =================================== FAILURES ===================================
> 2020-05-09T04:56:56.6224556Z ________________________ JavaSqlTests.test_java_sql_ddl ________________________
> 2020-05-09T04:56:56.6224784Z
> 2020-05-09T04:56:56.6228394Z self = <pyflink.table.tests.test_sql.JavaSqlTests testMethod=test_java_sql_ddl>
> 2020-05-09T04:56:56.6228859Z
> 2020-05-09T04:56:56.6229177Z def test_java_sql_ddl(self):
> 2020-05-09T04:56:56.6229574Z test_class = "org.apache.flink.client.python.PythonFunctionFactoryTest"
> 2020-05-09T04:56:56.6230781Z test_jar_pattern = "flink-python/target/javaDDL/flink-python*-tests.jar"
> 2020-05-09T04:56:56.6231254Z test_jar_path = self.get_jar_path(test_jar_pattern)
> 2020-05-09T04:56:56.6231764Z test_classpath = self.get_classpath() + os.pathsep + test_jar_path
> 2020-05-09T04:56:56.6232094Z java_executable = self.get_java_executable()
> 2020-05-09T04:56:56.6232961Z > subprocess.check_output([java_executable, "-cp", test_classpath, test_class], shell=False)
> 2020-05-09T04:56:56.6233303Z
> 2020-05-09T04:56:56.6234039Z pyflink/table/tests/test_sql.py:112:
> 2020-05-09T04:56:56.6234547Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> 2020-05-09T04:56:56.6234989Z dev/.conda/lib/python3.7/subprocess.py:395: in check_output
> 2020-05-09T04:56:56.6235318Z **kwargs).stdout
> 2020-05-09T04:56:56.6235678Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> 2020-05-09T04:56:56.6236089Z
> 2020-05-09T04:56:56.6236401Z input = None, capture_output = False, timeout = None, check = True
> 2020-05-09T04:56:56.6238251Z popenargs = (['/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java', '-cp', '/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1...arget/javaDDL/flink-python_2.11-1.11-SNAPSHOT-tests.jar', 'org.apache.flink.client.python.PythonFunctionFactoryTest'],)
> 2020-05-09T04:56:56.6239344Z kwargs = {'shell': False, 'stdout': -1}
> 2020-05-09T04:56:56.6239738Z process = <subprocess.Popen object at 0x7fdfd94e6400>
> 2020-05-09T04:56:56.6241028Z stdout = b'Traceback (most recent call last):\n File "/__w/3/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/py4j/...g, e)\npy4j.protocol.Py4JNetworkError: An error occurred while trying to start the callback server (127.0.0.1:33053)\n'
> 2020-05-09T04:56:56.6241856Z stderr = None, retcode = 1
> 2020-05-09T04:56:56.6242065Z
> 2020-05-09T04:56:56.6242275Z def run(*popenargs,
> 2020-05-09T04:56:56.6242725Z input=None, capture_output=False, timeout=None, check=False, **kwargs):
> 2020-05-09T04:56:56.6243284Z """Run command with arguments and return a CompletedProcess instance.
> 2020-05-09T04:56:56.6243650Z
> 2020-05-09T04:56:56.6244429Z The returned instance will have attributes args, returncode, stdout and
> 2020-05-09T04:56:56.6244820Z stderr. By default, stdout and stderr are not captured, and those attributes
> 2020-05-09T04:56:56.6245396Z will be None. Pass stdout=PIPE and/or stderr=PIPE in order to capture them.
> 2020-05-09T04:56:56.6245853Z
> 2020-05-09T04:56:56.6246479Z If check is True and the exit code was non-zero, it raises a
> 2020-05-09T04:56:56.6246973Z CalledProcessError. The CalledProcessError object will have the return code
> 2020-05-09T04:56:56.6247512Z in the returncode attribute, and output & stderr attributes if those streams
> 2020-05-09T04:56:56.6248004Z were captured.
> 2020-05-09T04:56:56.6248256Z
> 2020-05-09T04:56:56.6248584Z If timeout is given, and the process takes too long, a TimeoutExpired
> 2020-05-09T04:56:56.6249113Z exception will be raised.
> 2020-05-09T04:56:56.6249397Z
> 2020-05-09T04:56:56.6249730Z There is an optional argument "input", allowing you to
> 2020-05-09T04:56:56.6250478Z pass bytes or a string to the subprocess's stdin. If you use this argument
> 2020-05-09T04:56:56.6251232Z you may not also use the Popen constructor's "stdin" argument, as
> 2020-05-09T04:56:56.6251613Z it will be used internally.
> 2020-05-09T04:56:56.6251884Z
> 2020-05-09T04:56:56.6252261Z By default, all communication is in bytes, and therefore any "input" should
> 2020-05-09T04:56:56.6252795Z be bytes, and the stdout and stderr will be bytes. If in text mode, any
> 2020-05-09T04:56:56.6253458Z "input" should be a string, and stdout and stderr will be strings decoded
> 2020-05-09T04:56:56.6254141Z according to locale encoding, or by "encoding" if set. Text mode is
> 2020-05-09T04:56:56.6254746Z triggered by setting any of text, encoding, errors or universal_newlines.
> 2020-05-09T04:56:56.6255079Z
> 2020-05-09T04:56:56.6255308Z The other arguments are the same as for the Popen constructor.
> 2020-05-09T04:56:56.6255568Z """
> 2020-05-09T04:56:56.6255849Z if input is not None:
> 2020-05-09T04:56:56.6256363Z if 'stdin' in kwargs:
> 2020-05-09T04:56:56.6256834Z raise ValueError('stdin and input arguments may not both be used.')
> 2020-05-09T04:56:56.6257269Z kwargs['stdin'] = PIPE
> 2020-05-09T04:56:56.6257444Z
> 2020-05-09T04:56:56.6257631Z if capture_output:
> 2020-05-09T04:56:56.6258130Z if ('stdout' in kwargs) or ('stderr' in kwargs):
> 2020-05-09T04:56:56.6258657Z raise ValueError('stdout and stderr arguments may not be used '
> 2020-05-09T04:56:56.6259116Z 'with capture_output.')
> 2020-05-09T04:56:56.6259512Z kwargs['stdout'] = PIPE
> 2020-05-09T04:56:56.6259866Z kwargs['stderr'] = PIPE
> 2020-05-09T04:56:56.6260060Z
> 2020-05-09T04:56:56.6260283Z with Popen(*popenargs, **kwargs) as process:
> 2020-05-09T04:56:56.6260544Z try:
> 2020-05-09T04:56:56.6260808Z stdout, stderr = process.communicate(input, timeout=timeout)
> 2020-05-09T04:56:56.6261110Z except TimeoutExpired:
> 2020-05-09T04:56:56.6261335Z process.kill()
> 2020-05-09T04:56:56.6261592Z stdout, stderr = process.communicate()
> 2020-05-09T04:56:56.6261892Z raise TimeoutExpired(process.args, timeout, output=stdout,
> 2020-05-09T04:56:56.6262205Z stderr=stderr)
> 2020-05-09T04:56:56.6262515Z except: # Including KeyboardInterrupt, communicate handled that.
> 2020-05-09T04:56:56.6262851Z process.kill()
> 2020-05-09T04:56:56.6263293Z # We don't call process.wait() as .__exit__ does that for us.
> 2020-05-09T04:56:56.6263576Z raise
> 2020-05-09T04:56:56.6263924Z retcode = process.poll()
> 2020-05-09T04:56:56.6264174Z if check and retcode:
> 2020-05-09T04:56:56.6264445Z raise CalledProcessError(retcode, process.args,
> 2020-05-09T04:56:56.6264969Z > output=stdout, stderr=stderr)
> 2020-05-09T04:56:56.6276488Z E subprocess.CalledProcessError: Command '['/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java', '-cp', '/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-slf4j-impl-2.12.1.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-core-2.12.1.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-api-2.12.1.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-shaded-zookeeper-3.4.10.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2-api-2.12.1.jar:/__w/3/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/opt/flink-python_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-table/flink-table-planner/target/flink-table-planner_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-runtime/target/flink-runtime_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-streaming-java/target/flink-streaming-java_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-formats/flink-csv/target/flink-csv-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-formats/flink-csv/target/flink-csv-1.11-SNAPSHOT-sql-jar.jar:/__w/3/s/flink-formats/flink-csv/target/flink-csv-1.11-SNAPSHOT.jar:/__w/3/s/flink-formats/flink-avro/target/flink-avro-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-formats/flink-avro/target/flink-avro-1.11-SNAPSHOT-sql-jar.jar:/__w/3/s/flink-formats/flink-avro/target/flink-avro-1.11-SNAPSHOT.jar:/__w/3/s/flink-formats/flink-avro/target/avro-1.8.2.jar:/__w/3/s/flink-formats/flink-json/target/flink-json-1.11-SNAPSHOT.jar:/__w/3/s/flink-formats/flink-json/target/flink-json-1.11-SNAPSHOT-sql-jar.jar:/__w/3/s/flink-formats/flink-json/target/flink-json-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-connectors/flink-connector-elasticsearch-base/target/flink-connector-elasticsearch-base_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-connectors/flink-connector-elasticsearch-base/target/flink-connector-elasticsearch-base_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-connectors/flink-connector-kafka-base/target/flink-connector-kafka-base_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-connectors/flink-connector-kafka-base/target/flink-connector-kafka-base_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-connectors/flink-hbase/target/flink-hbase_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-connectors/flink-hbase/target/flink-hbase_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-ml-parent/flink-ml-api/target/flink-ml-api-1.11-SNAPSHOT.jar:/__w/3/s/flink-ml-parent/flink-ml-api/target/flink-ml-api-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-ml-parent/flink-ml-lib/target/flink-ml-lib_2.11-1.11-SNAPSHOT-tests.jar:/__w/3/s/flink-ml-parent/flink-ml-lib/target/flink-ml-lib_2.11-1.11-SNAPSHOT.jar:/__w/3/s/flink-python/target/javaDDL/flink-python_2.11-1.11-SNAPSHOT-tests.jar', 'org.apache.flink.client.python.PythonFunctionFactoryTest']' returned non-zero exit status 1.
> 2020-05-09T04:56:56.6282572Z
> 2020-05-09T04:56:56.6282962Z dev/.conda/lib/python3.7/subprocess.py:487: CalledProcessError
> 2020-05-09T04:56:56.6283907Z ----------------------------- Captured stderr call -----------------------------
> 2020-05-09T04:56:56.6284948Z Exception in thread "main" java.lang.IllegalStateException: Instantiating python function 'test1.func1' failed.
> 2020-05-09T04:56:56.6285849Z at org.apache.flink.table.functions.python.utils.PythonFunctionUtils.getPythonFunction(PythonFunctionUtils.java:48)
> 2020-05-09T04:56:56.6286638Z at org.apache.flink.table.functions.FunctionDefinitionUtil.createFunctionDefinition(FunctionDefinitionUtil.java:42)
> 2020-05-09T04:56:56.6287483Z at org.apache.flink.table.catalog.FunctionCatalog.getFunctionDefinition(FunctionCatalog.java:646)
> 2020-05-09T04:56:56.6288088Z at org.apache.flink.table.catalog.FunctionCatalog.resolvePreciseFunctionReference(FunctionCatalog.java:576)
> 2020-05-09T04:56:56.6288642Z at org.apache.flink.table.catalog.FunctionCatalog.lambda$resolveAmbiguousFunctionReference$2(FunctionCatalog.java:613)
> 2020-05-09T04:56:56.6289075Z at java.util.Optional.orElseGet(Optional.java:267)
> 2020-05-09T04:56:56.6289502Z at org.apache.flink.table.catalog.FunctionCatalog.resolveAmbiguousFunctionReference(FunctionCatalog.java:613)
> 2020-05-09T04:56:56.6289986Z at org.apache.flink.table.catalog.FunctionCatalog.lookupFunction(FunctionCatalog.java:370)
> 2020-05-09T04:56:56.6290557Z at org.apache.flink.table.catalog.FunctionCatalog$1.lookupFunction(FunctionCatalog.java:351)
> 2020-05-09T04:56:56.6291014Z at org.apache.flink.table.catalog.FunctionCatalog$1.lookupFunction(FunctionCatalog.java:346)
> 2020-05-09T04:56:56.6291716Z at org.apache.flink.table.expressions.resolver.LookupCallResolver.visit(LookupCallResolver.java:48)
> 2020-05-09T04:56:56.6292448Z at org.apache.flink.table.expressions.resolver.LookupCallResolver.visit(LookupCallResolver.java:38)
> 2020-05-09T04:56:56.6293220Z at org.apache.flink.table.expressions.ApiExpressionVisitor.visit(ApiExpressionVisitor.java:37)
> 2020-05-09T04:56:56.6293758Z at org.apache.flink.table.expressions.LookupCallExpression.accept(LookupCallExpression.java:65)
> 2020-05-09T04:56:56.6294568Z at org.apache.flink.table.api.ApiExpression.accept(ApiExpression.java:64)
> 2020-05-09T04:56:56.6295284Z at org.apache.flink.table.api.internal.TableImpl.lambda$preprocessExpressions$0(TableImpl.java:592)
> 2020-05-09T04:56:56.6296026Z at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> 2020-05-09T04:56:56.6296711Z at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
> 2020-05-09T04:56:56.6297250Z at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> 2020-05-09T04:56:56.6298023Z at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> 2020-05-09T04:56:56.6298590Z at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> 2020-05-09T04:56:56.6299246Z at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> 2020-05-09T04:56:56.6299743Z at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)
> 2020-05-09T04:56:56.6300452Z at org.apache.flink.table.api.internal.TableImpl.preprocessExpressions(TableImpl.java:593)
> 2020-05-09T04:56:56.6301137Z at org.apache.flink.table.api.internal.TableImpl.select(TableImpl.java:128)
> 2020-05-09T04:56:56.6301727Z at org.apache.flink.client.python.PythonFunctionFactoryTest.testPythonFunctionFactory(PythonFunctionFactoryTest.java:90)
> 2020-05-09T04:56:56.6302286Z at org.apache.flink.client.python.PythonFunctionFactoryTest.main(PythonFunctionFactoryTest.java:54)
> 2020-05-09T04:56:56.6302817Z Caused by: java.lang.reflect.InvocationTargetException
> 2020-05-09T04:56:56.6303131Z at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2020-05-09T04:56:56.6303490Z at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2020-05-09T04:56:56.6304029Z at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2020-05-09T04:56:56.6304410Z at java.lang.reflect.Method.invoke(Method.java:498)
> 2020-05-09T04:56:56.6304852Z at org.apache.flink.table.functions.python.utils.PythonFunctionUtils.getPythonFunction(PythonFunctionUtils.java:44)
> 2020-05-09T04:56:56.6305204Z ... 26 more
> 2020-05-09T04:56:56.6305488Z Caused by: java.lang.RuntimeException: Python callback server start failed!
> 2020-05-09T04:56:56.6306024Z at org.apache.flink.client.python.PythonFunctionFactory.getPythonFunctionFactory(PythonFunctionFactory.java:111)
> 2020-05-09T04:56:56.6306548Z at org.apache.flink.client.python.PythonFunctionFactory.getPythonFunction(PythonFunctionFactory.java:84)
> 2020-05-09T04:56:56.6307039Z ... 31 more
> {code}
> instance: https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_apis/build/builds/852/logs/138
--
This message was sent by Atlassian Jira
(v8.3.4#803005)