You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2021/02/03 23:35:00 UTC
[jira] [Resolved] (IMPALA-10462)
TestIcebergTable::test_create_iceberg_tables fails with
ClassNotFoundException on newer Hive/Iceberg
[ https://issues.apache.org/jira/browse/IMPALA-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joe McDonnell resolved IMPALA-10462.
------------------------------------
Fix Version/s: Impala 4.0
Resolution: Fixed
> TestIcebergTable::test_create_iceberg_tables fails with ClassNotFoundException on newer Hive/Iceberg
> ----------------------------------------------------------------------------------------------------
>
> Key: IMPALA-10462
> URL: https://issues.apache.org/jira/browse/IMPALA-10462
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 4.0
> Reporter: Joe McDonnell
> Assignee: Joe McDonnell
> Priority: Blocker
> Fix For: Impala 4.0
>
>
> When testing against a newer version of Hive/Iceberg, TestIcebergTable.test_create_iceberg_tables fails with a ClassNotFoundException for org.apache.hadoop.hive.common.type.Date:
> {noformat}
> 23:35:39 TestIcebergTable.test_create_iceberg_tables[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: parquet/none]
> 23:35:39 [gw5] linux2 -- Python 2.7.16 /data/jenkins/workspace/impala-private-basic-parameterized/repos/Impala/bin/../infra/python/env-gcc7.5.0/bin/python
> 23:35:39 query_test/test_iceberg.py:47: in test_create_iceberg_tables
> 23:35:39 self.run_test_case('QueryTest/iceberg-create', vector, use_db=unique_database)
> 23:35:39 common/impala_test_suite.py:662: in run_test_case
> 23:35:39 result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
> 23:35:39 common/impala_test_suite.py:600: in __exec_in_impala
> 23:35:39 result = self.__execute_query(target_impalad_client, query, user=user)
> 23:35:39 common/impala_test_suite.py:920: in __execute_query
> 23:35:39 return impalad_client.execute(query, user=user)
> 23:35:39 common/impala_connection.py:205: in execute
> 23:35:39 return self.__beeswax_client.execute(sql_stmt, user=user)
> 23:35:39 beeswax/impala_beeswax.py:187: in execute
> 23:35:39 handle = self.__execute_query(query_string.strip(), user=user)
> 23:35:39 beeswax/impala_beeswax.py:363: in __execute_query
> 23:35:39 handle = self.execute_query_async(query_string, user=user)
> 23:35:39 beeswax/impala_beeswax.py:357: in execute_query_async
> 23:35:39 handle = self.__do_rpc(lambda: self.imp_service.query(query,))
> 23:35:39 beeswax/impala_beeswax.py:520: in __do_rpc
> 23:35:39 raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> 23:35:39 E ImpalaBeeswaxException: ImpalaBeeswaxException:
> 23:35:39 E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> 23:35:39 E MESSAGE: NoClassDefFoundError: org/apache/hadoop/hive/common/type/Date
> 23:35:39 E CAUSED BY: ClassNotFoundException: org.apache.hadoop.hive.common.type.Date{noformat}
> Maybe org.apache.hadoop.hive.common.type.* needs to be added to the impala-minimal-hive-exec shaded jar.
> [https://github.com/apache/impala/blob/master/java/shaded-deps/hive-exec/pom.xml#L34]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)