You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Will Benton <wi...@redhat.com> on 2014/06/19 00:22:54 UTC

question about Hive compatiblilty tests

Hi all,

Does a "Failed to generate golden answer for query" message from HiveComparisonTests indicate that it isn't possible to run the query in question under Hive from Spark's test suite rather than anything about Spark's implementation of HiveQL?  The stack trace I'm getting implicates Hive code and not Spark code, but I wanted to make sure I wasn't missing something.


thanks,
wb

Re: question about Hive compatiblilty tests

Posted by Will Benton <wi...@redhat.com>.
> I assume you are adding tests?  because that is the only time you should
> see that message.

Yes, I had added the HAVING test to the whitelist.

> That error could mean a couple of things:
>  1) The query is invalid and hive threw an exception
>  2) Your Hive setup is bad.
> 
> Regarding #2, you need to have the source for Hive 0.12.0 available and
> built as well as a hadoop installation.  You also have to have the
> environment vars set as specified here:
> https://github.com/apache/spark/tree/master/sql

Thanks!  The other Hive compatibility tests seem to work, so I'll dig in a bit more to see if I can figure out what's happening here.


best,
wb

Re: question about Hive compatiblilty tests

Posted by Michael Armbrust <mi...@databricks.com>.
I assume you are adding tests?  because that is the only time you should
see that message.

That error could mean a couple of things:
 1) The query is invalid and hive threw an exception
 2) Your Hive setup is bad.

Regarding #2, you need to have the source for Hive 0.12.0 available and
built as well as a hadoop installation.  You also have to have the
environment vars set as specified here:
https://github.com/apache/spark/tree/master/sql

Michael


On Thu, Jun 19, 2014 at 12:22 AM, Will Benton <wi...@redhat.com> wrote:

> Hi all,
>
> Does a "Failed to generate golden answer for query" message from
> HiveComparisonTests indicate that it isn't possible to run the query in
> question under Hive from Spark's test suite rather than anything about
> Spark's implementation of HiveQL?  The stack trace I'm getting implicates
> Hive code and not Spark code, but I wanted to make sure I wasn't missing
> something.
>
>
> thanks,
> wb
>