You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Karl Fredrickson (Jira)" <ji...@apache.org> on 2019/12/24 17:47:00 UTC
[jira] [Commented] (NIFI-6969) Error when parsing backtick in Hive
query
[ https://issues.apache.org/jira/browse/NIFI-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002948#comment-17002948 ]
Karl Fredrickson commented on NIFI-6969:
----------------------------------------
I think this is related to:
https://issues.apache.org/jira/browse/HIVE-13101
When NiFi calls the Hive parser to parse the query, it doesn't pass a HiveConf. Without a HiveConf, the HIVE-13101 NullPointerException is always going to pop up if it runs into a backtick.
2019-12-23 17:14:40,814 WARN [Timer-Driven Process Thread-6] o.a.nifi.processors.hive.SelectHiveQL SelectHiveQL[id=456ae0a2-0168-1000-d6d0-e7f57c95b943] Failed to parse query: select 'qasdf' as `asdf` due to java.lang.NullPointerException: java.lang.NullPointerException
java.lang.NullPointerException: null
at org.apache.hadoop.hive.conf.HiveConf.getVar(HiveConf.java:2605)
at org.apache.hadoop.hive.ql.parse.HiveLexer.allowQuotedId(HiveLexer.java:354)
at org.apache.hadoop.hive.ql.parse.HiveLexer$DFA21.specialStateTransition(HiveLexer.java:11307)
at org.antlr.runtime.DFA.predict(DFA.java:80)
at org.apache.hadoop.hive.ql.parse.HiveLexer.mIdentifier(HiveLexer.java:8213)
at org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:11202)
at org.antlr.runtime.Lexer.nextToken(Lexer.java:89)
at org.antlr.runtime.BufferedTokenStream.fetch(BufferedTokenStream.java:133)
at org.antlr.runtime.BufferedTokenStream.sync(BufferedTokenStream.java:127)
at org.antlr.runtime.CommonTokenStream.consume(CommonTokenStream.java:70)
at org.antlr.runtime.DFA.predict(DFA.java:120)
> Error when parsing backtick in Hive query
> -----------------------------------------
>
> Key: NIFI-6969
> URL: https://issues.apache.org/jira/browse/NIFI-6969
> Project: Apache NiFi
> Issue Type: Bug
> Reporter: Dennis Jaheruddin
> Priority: Minor
>
> Logging this based on the inputs from
> * report1: [https://community.cloudera.com/t5/Support-Questions/NiFi-1-10-Hive-processors-and-backticks/m-p/286205]
> * report2: [http://mail-archives.apache.org/mod_mbox/nifi-users/201803.mbox/%3CCA+WJ-+LVH2O22MYY66n5Z-3Rd4qkrJVQSPJuBwA9LrKfUmdVWg@mail.gmail.com%3E |http://mail-archives.apache.org/mod_mbox/nifi-users/201803.mbox/%3CCA+WJ-+LVH2O22MYY66n5Z-3Rd4qkrJVQSPJuBwA9LrKfUmdVWg@mail.gmail.com%3E]
> * report3: [https://www.mail-archive.com/dev@nifi.apache.org/msg14005.html]
> When running a (valid) hive query with Nifi, the query succeeds but throws an error.
> Presumably the error started in Nifi 1.5 and is caused when parsing it for lineage purposes as mentioned in report 2.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)