Re: Integration Testing with Hive

[Nishant Kelkar <ni...@gmail.com>]

Hey All,

I was looking into integration testing Hive for some of my code. What I
need is something that creates an in-memory HDFS ecosystem, and an
on-the-fly HiveServer2 instance along with the Hive metastore. It is
interesting to note that HBase currently does have something that you can
use to write test cases against your code (see:
http://hbase.apache.org/book/ch19s04.html). However, I haven't been able to
find anything that works in a similar way for Hive.

I have written a StackOverflow question about this, to no avail:
http://stackoverflow.com/questions/26665768/pointing-hiveserver2-to-minimrcluster-for-hive-testing

Another related StackOverflow post that I've found highly useful:
http://stackoverflow.com/questions/16719541/integration-testing-hive-jobs

Does someone out there have a *minimal test case setup* (along with the
associated *pom.xml*) that does something as basic as creating a Hive
table, inserting a single row of data into that table, and fetching results
from the table? I would be very grateful.

Thanks!

Best Regards,
Nishant Kelkar

Re: Integration Testing with Hive

[Nishant Kelkar <ni...@gmail.com>]

Note: I've looked into the HiveRunner and hive_test projects as mentioned
in my SO post. However, neither of these support a CDH Hadoop version,
which is what I need to use. Specifically, my CDH version is 2.0.0-cdh4.7.0.

Best Regards,
Nishant Kelkar

On Wed, Nov 5, 2014 at 12:29 AM, Nishant Kelkar <ni...@gmail.com>
wrote:

> Hey All,
>
> I was looking into integration testing Hive for some of my code. What I
> need is something that creates an in-memory HDFS ecosystem, and an
> on-the-fly HiveServer2 instance along with the Hive metastore. It is
> interesting to note that HBase currently does have something that you can
> use to write test cases against your code (see:
> http://hbase.apache.org/book/ch19s04.html). However, I haven't been able
> to find anything that works in a similar way for Hive.
>
> I have written a StackOverflow question about this, to no avail:
>
> http://stackoverflow.com/questions/26665768/pointing-hiveserver2-to-minimrcluster-for-hive-testing
>
> Another related StackOverflow post that I've found highly useful:
> http://stackoverflow.com/questions/16719541/integration-testing-hive-jobs
>
> Does someone out there have a *minimal test case setup* (along with the
> associated *pom.xml*) that does something as basic as creating a Hive
> table, inserting a single row of data into that table, and fetching results
> from the table? I would be very grateful.
>
> Thanks!
>
> Best Regards,
> Nishant Kelkar
>
>