You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Adi Reddy <to...@gmail.com> on 2014/07/24 12:20:12 UTC
Hive exception while getting duplicate records with in the table
Hi Team,
I am looking for to get duplicate records with in the table (using hive
version : 0.11.0 ) .
Below is my query : select a.* from tmp_source_fs_price1 a, ( select
fund_id,nav_date,CURRENCY,nav,count(1) from tmp_source_fs_price1 group by
fund_id,nav_date,CURRENCY,nav having count(1) > 1) b where a.fund_id =
b.fund_id ;
Exception : NoViableAltException(10@[175:43: (alias= identifier )?])
at org.antlr.runtime.DFA.noViableAlt(DFA.java:158)
at org.antlr.runtime.DFA.predict(DFA.java:144)
at
org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.tableSource(HiveParser_FromClauseParser.java:3616)
at
org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.fromSource(HiveParser_FromClauseParser.java:2815)
at
org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.joinSource(HiveParser_FromClauseParser.java:1316)
at
org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.fromClause(HiveParser_FromClauseParser.java:1189)
at
org.apache.hadoop.hive.ql.parse.HiveParser.fromClause(HiveParser.java:30719)
at
org.apache.hadoop.hive.ql.parse.HiveParser.selectStatement(HiveParser.java:28858)
at
org.apache.hadoop.hive.ql.parse.HiveParser.regular_body(HiveParser.java:28766)
at
org.apache.hadoop.hive.ql.parse.HiveParser.queryStatement(HiveParser.java:28306)
at
org.apache.hadoop.hive.ql.parse.HiveParser.queryStatementExpression(HiveParser.java:28100)
at
org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:1213)
at
org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:928)
at
org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:190)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:418)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:902)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
FAILED: ParseException line 1:39 cannot recognize input near 'a' ',' '(' in
table source
Could you please anyone help me on this.
Thanks,
AdiReddy
Re: Hive exception while getting duplicate records with in the table
Posted by Navis류승우 <na...@nexr.com>.
Try,
select a.* from tmp_source_fs_price1 a join ( select
fund_id,nav_date,CURRENCY,nav,count(1) from tmp_source_fs_price1 group by
fund_id,nav_date,CURRENCY,nav having count(1) > 1) b on a.fund_id =
b.fund_id ;
The grammar you've mentioned is not supported in hive-0.11.0 (hive-0.13.0,
by HIVE-6393)
Thanks,
Navis
2014-07-24 19:20 GMT+09:00 Adi Reddy <to...@gmail.com>:
> Hi Team,
>
>
> I am looking for to get duplicate records with in the table (using hive
> version : 0.11.0 ) .
>
>
>
> Below is my query : select a.* from tmp_source_fs_price1 a, ( select
> fund_id,nav_date,CURRENCY,nav,count(1) from tmp_source_fs_price1 group by
> fund_id,nav_date,CURRENCY,nav having count(1) > 1) b where a.fund_id =
> b.fund_id ;
>
>
>
> Exception : NoViableAltException(10@[175:43: (alias= identifier )?])
>
> at org.antlr.runtime.DFA.noViableAlt(DFA.java:158)
>
> at org.antlr.runtime.DFA.predict(DFA.java:144)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.tableSource(HiveParser_FromClauseParser.java:3616)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.fromSource(HiveParser_FromClauseParser.java:2815)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.joinSource(HiveParser_FromClauseParser.java:1316)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser_FromClauseParser.fromClause(HiveParser_FromClauseParser.java:1189)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser.fromClause(HiveParser.java:30719)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser.selectStatement(HiveParser.java:28858)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser.regular_body(HiveParser.java:28766)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser.queryStatement(HiveParser.java:28306)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser.queryStatementExpression(HiveParser.java:28100)
>
> at
>
> org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:1213)
>
> at
> org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:928)
>
> at
> org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:190)
>
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:418)
>
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337)
>
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:902)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
>
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)
>
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:601)
>
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
> FAILED: ParseException line 1:39 cannot recognize input near 'a' ',' '(' in
> table source
>
>
>
>
>
> Could you please anyone help me on this.
>
>
> Thanks,
>
> AdiReddy
>