You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Vincent Long (Jira)" <ji...@apache.org> on 2022/10/19 07:44:00 UTC
[jira] [Updated] (FLINK-29686) There are bugs in Flink-SQL using Hive dialect
[ https://issues.apache.org/jira/browse/FLINK-29686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vincent Long updated FLINK-29686:
---------------------------------
Description:
我在使用sql-cli提交任务到session集群的过程中, 我通过Flink-sql-connectors-hive 使用hive方言执行sql代码时发生了如下报错:
Exception in thread "main" org.apache.flink.table.client.SqlClientException: {color:#ff0000}Unexpected exception. This is a bug. Please consider filing an issue.{color}
at org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:201)
at org.apache.flink.table.client.SqlClient.main(SqlClient.java:161)
{color:#ff0000}Caused by: java.lang.ExceptionInInitializerError{color}
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hive.common.util.ReflectionUtil.newInstance(ReflectionUtil.java:83)
at org.apache.hadoop.hive.ql.exec.Registry.registerUDAF(Registry.java:238)
at org.apache.hadoop.hive.ql.exec.Registry.registerUDAF(Registry.java:231)
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.<clinit>(FunctionRegistry.java:430)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.table.catalog.hive.client.HiveShimV120.registerTemporaryFunction(HiveShimV120.java:262)
at org.apache.flink.table.planner.delegation.hive.HiveParser.parse(HiveParser.java:207)
at org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$parseStatement$1(LocalExecutor.java:172)
at org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88)
at org.apache.flink.table.client.gateway.local.LocalExecutor.parseStatement(LocalExecutor.java:172)
at org.apache.flink.table.client.cli.CliClient.parseCommand(CliClient.java:396)
at org.apache.flink.table.client.cli.CliClient.executeStatement(CliClient.java:324)
at org.apache.flink.table.client.cli.CliClient.executeInteractive(CliClient.java:297)
at org.apache.flink.table.client.cli.CliClient.executeInInteractiveMode(CliClient.java:221)
at org.apache.flink.table.client.SqlClient.openCli(SqlClient.java:151)
at org.apache.flink.table.client.SqlClient.start(SqlClient.java:95)
at org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:187)
... 1 more
{color:#ff0000}Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2{color}
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:102)
at org.apache.hadoop.hive.ql.udf.UDAFPercentile.<clinit>(UDAFPercentile.java:51)
... 25 more
Caused by: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2
at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:177)
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:144)
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:99)
... 26 more
Shutting down the session...
done.
was:
我在使用sql-cli提交任务到session集群的过程中, 我通过Flink-sql-connectors-hive 使用hive方言执行sql代码时发生了如下报错:
Exception in thread "main" org.apache.flink.table.client.SqlClientException: {color:#FF0000}Unexpected exception. This is a bug. Please consider filing an issue.{color}
at org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:201)
at org.apache.flink.table.client.SqlClient.main(SqlClient.java:161)
{color:#FF0000}Caused by: java.lang.ExceptionInInitializerError{color}
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hive.common.util.ReflectionUtil.newInstance(ReflectionUtil.java:83)
at org.apache.hadoop.hive.ql.exec.Registry.registerUDAF(Registry.java:238)
at org.apache.hadoop.hive.ql.exec.Registry.registerUDAF(Registry.java:231)
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.<clinit>(FunctionRegistry.java:430)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.table.catalog.hive.client.HiveShimV120.registerTemporaryFunction(HiveShimV120.java:262)
at org.apache.flink.table.planner.delegation.hive.HiveParser.parse(HiveParser.java:207)
at org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$parseStatement$1(LocalExecutor.java:172)
at org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88)
at org.apache.flink.table.client.gateway.local.LocalExecutor.parseStatement(LocalExecutor.java:172)
at org.apache.flink.table.client.cli.CliClient.parseCommand(CliClient.java:396)
at org.apache.flink.table.client.cli.CliClient.executeStatement(CliClient.java:324)
at org.apache.flink.table.client.cli.CliClient.executeInteractive(CliClient.java:297)
at org.apache.flink.table.client.cli.CliClient.executeInInteractiveMode(CliClient.java:221)
at org.apache.flink.table.client.SqlClient.openCli(SqlClient.java:151)
at org.apache.flink.table.client.SqlClient.start(SqlClient.java:95)
at org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:187)
... 1 more
{color:#FF0000}Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2{color}
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:102)
at org.apache.hadoop.hive.ql.udf.UDAFPercentile.<clinit>(UDAFPercentile.java:51)
... 25 more
Caused by: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2
at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:177)
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:144)
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:99)
... 26 more
Shutting down the session...
done.
Summary: There are bugs in Flink-SQL using Hive dialect (was: Flink-SQL使用Hive方言出现bug)
> There are bugs in Flink-SQL using Hive dialect
> ----------------------------------------------
>
> Key: FLINK-29686
> URL: https://issues.apache.org/jira/browse/FLINK-29686
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive, Table SQL / Client
> Affects Versions: 1.14.4
> Environment: Flink-ver : 1.14.4-on-cdh6.3.2
> Flink-sql-cli : 1.14.4
> Reporter: Vincent Long
> Priority: Blocker
>
> 我在使用sql-cli提交任务到session集群的过程中, 我通过Flink-sql-connectors-hive 使用hive方言执行sql代码时发生了如下报错:
> Exception in thread "main" org.apache.flink.table.client.SqlClientException: {color:#ff0000}Unexpected exception. This is a bug. Please consider filing an issue.{color}
> at org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:201)
> at org.apache.flink.table.client.SqlClient.main(SqlClient.java:161)
> {color:#ff0000}Caused by: java.lang.ExceptionInInitializerError{color}
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at org.apache.hive.common.util.ReflectionUtil.newInstance(ReflectionUtil.java:83)
> at org.apache.hadoop.hive.ql.exec.Registry.registerUDAF(Registry.java:238)
> at org.apache.hadoop.hive.ql.exec.Registry.registerUDAF(Registry.java:231)
> at org.apache.hadoop.hive.ql.exec.FunctionRegistry.<clinit>(FunctionRegistry.java:430)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.flink.table.catalog.hive.client.HiveShimV120.registerTemporaryFunction(HiveShimV120.java:262)
> at org.apache.flink.table.planner.delegation.hive.HiveParser.parse(HiveParser.java:207)
> at org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$parseStatement$1(LocalExecutor.java:172)
> at org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88)
> at org.apache.flink.table.client.gateway.local.LocalExecutor.parseStatement(LocalExecutor.java:172)
> at org.apache.flink.table.client.cli.CliClient.parseCommand(CliClient.java:396)
> at org.apache.flink.table.client.cli.CliClient.executeStatement(CliClient.java:324)
> at org.apache.flink.table.client.cli.CliClient.executeInteractive(CliClient.java:297)
> at org.apache.flink.table.client.cli.CliClient.executeInInteractiveMode(CliClient.java:221)
> at org.apache.flink.table.client.SqlClient.openCli(SqlClient.java:151)
> at org.apache.flink.table.client.SqlClient.start(SqlClient.java:95)
> at org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:187)
> ... 1 more
> {color:#ff0000}Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2{color}
> at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:102)
> at org.apache.hadoop.hive.ql.udf.UDAFPercentile.<clinit>(UDAFPercentile.java:51)
> ... 25 more
> Caused by: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2
> at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:177)
> at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:144)
> at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:99)
> ... 26 more
> Shutting down the session...
> done.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)