You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Cary Cherng <cc...@foursquare.com> on 2020/04/30 20:27:58 UTC
Unit Test (MRUnit) for Hadoop with Parquet Input
Is there a way to create a unit test (mrunit) for a hadoop job that
reads in Parquet. I have the following class
import org.apache.parquet.example.data.Group;
class MyMapper extends Mapper<LongWritable, Group, NullWritable, Text>
and I try to create a unit test using the withInput method
driver.withInput(new LongWritable(), group)
However I get the message
No applicable class implementing Serialization in conf at
io.serializations: class
org.apache.parquet.example.data.simple.SimpleGroup
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org