You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tamas Mate (Jira)" <ji...@apache.org> on 2021/01/04 16:17:00 UTC
[jira] [Commented] (IMPALA-10379) NoClassDefFoundError:
org/apache/hadoop/hive/ql/parse/Quotation
[ https://issues.apache.org/jira/browse/IMPALA-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258302#comment-17258302 ]
Tamas Mate commented on IMPALA-10379:
-------------------------------------
Both the parser and the lexer is part of the {{org.apache.hadoop.hive.ql.parse}}, there are about 1000 classes and subclasses in this package, Impala needs the lexer which uses about 15, which are generated by the following:
{code:java}
HiveLexer
GenericHiveLexer
ANTLRNoCaseStringStream
ParseError
Quotation
{code}
This feels a lot to import for a small amount of classes, I will check if we could detect changes in the lexer with some tests.
> NoClassDefFoundError: org/apache/hadoop/hive/ql/parse/Quotation
> ---------------------------------------------------------------
>
> Key: IMPALA-10379
> URL: https://issues.apache.org/jira/browse/IMPALA-10379
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 4.0
> Reporter: Quanlong Huang
> Assignee: Tamas Mate
> Priority: Major
> Attachments: org.apache.hadoop.hive.ql.parse.txt
>
>
> Found a NoClassDefFoundError when reexamining IMPALA-9641:
> {code}
> [localhost:21050] default> select 1 as "``";
> Query: select 1 as "``"
> Query submitted at: 2020-12-07 15:30:26 (Coordinator: http://quanlong-OptiPlex-BJ:25000)
> ERROR: NoClassDefFoundError: org/apache/hadoop/hive/ql/parse/Quotation
> {code}
> Logs:
> {code}
> I1207 15:30:26.218670 9245 Frontend.java:1581] bc464dbe4cf418b9:7173a0bd00000000] Analyzing query: select 1 as "``" db: default
> I1207 15:30:26.220055 9245 jni-util.cc:288] bc464dbe4cf418b9:7173a0bd00000000] java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/parse/Quotation
> at org.apache.hadoop.hive.ql.parse.GenericHiveLexer.allowQuotedId(GenericHiveLexer.java:75)
> at org.apache.hadoop.hive.ql.parse.HiveLexer_HiveLexerParent.mIdentifier(HiveLexer_HiveLexerParent.java:10075)
> at org.apache.hadoop.hive.ql.parse.HiveLexer_HiveLexerParent.mTokens(HiveLexer_HiveLexerParent.java:13028)
> at org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:671)
> at org.antlr.runtime.Lexer.nextToken(Lexer.java:89)
> at org.apache.impala.analysis.ToSqlUtils.hiveNeedsQuotes(ToSqlUtils.java:163)
> at org.apache.impala.analysis.ToSqlUtils.getIdentSql(ToSqlUtils.java:217)
> at org.apache.impala.analysis.SlotRef.<init>(SlotRef.java:58)
> at org.apache.impala.analysis.SelectStmt$SelectAnalyzer.analyzeSelectClause(SelectStmt.java:370)
> at org.apache.impala.analysis.SelectStmt$SelectAnalyzer.analyze(SelectStmt.java:286)
> at org.apache.impala.analysis.SelectStmt$SelectAnalyzer.access$100(SelectStmt.java:270)
> at org.apache.impala.analysis.SelectStmt.analyze(SelectStmt.java:263)
> at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:481)
> at org.apache.impala.analysis.AnalysisContext.analyzeAndAuthorize(AnalysisContext.java:445)
> at org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:1621)
> at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:1588)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1558)
> at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:159)
> I1207 15:30:26.220113 9245 status.cc:129] bc464dbe4cf418b9:7173a0bd00000000] NoClassDefFoundError: org/apache/hadoop/hive/ql/parse/Quotation
> @ 0x1d88eff impala::Status::Status()
> @ 0x27436c3 impala::JniUtil::GetJniExceptionMsg()
> @ 0x2540aa4 impala::JniCall::Call<>()
> @ 0x253d793 impala::JniUtil::CallJniMethod<>()
> @ 0x253b9f6 impala::Frontend::GetExecRequest()
> @ 0x2debc9b impala::QueryDriver::RunFrontendPlanner()
> @ 0x256d6de impala::ImpalaServer::ExecuteInternal()
> @ 0x256d09c impala::ImpalaServer::Execute()
> @ 0x2616082 impala::ImpalaServer::ExecuteStatement()
> @ 0x2c44ec9 apache::hive::service::cli::thrift::TCLIServiceProcessor::process_ExecuteStatement()
> @ 0x2c4359d apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall()
> @ 0x2c02d48 impala::ImpalaHiveServer2ServiceProcessor::dispatchCall()
> @ 0x1d35d81 apache::thrift::TDispatchProcessor::process()
> @ 0x226573a apache::thrift::server::TAcceptQueueServer::Task::run()
> @ 0x225ab4e impala::ThriftThread::RunRunnable()
> @ 0x225c18a boost::_mfi::mf2<>::operator()()
> @ 0x225c01e boost::_bi::list3<>::operator()<>()
> @ 0x225bd64 boost::_bi::bind_t<>::operator()()
> @ 0x225bc76 boost::detail::function::void_function_obj_invoker0<>::invoke()
> @ 0x21d45f5 boost::function0<>::operator()()
> @ 0x27f34f3 impala::Thread::SuperviseThread()
> @ 0x27fb490 boost::_bi::list5<>::operator()<>()
> @ 0x27fb3b4 boost::_bi::bind_t<>::operator()()
> @ 0x27fb375 boost::detail::thread_data<>::run()
> @ 0x3fee0f1 thread_proxy
> @ 0x7f22b0d846b9 start_thread
> @ 0x7f22ad8434dc clone
> {code}
> I think it happens after we bump the CDP build number in 8243a97ec2ff698e1cf605928d48055160111a09. IMPALA-10118 may be related.
> cc [~fangyurao], [~vihangk1]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org