You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Cary Cherng <cc...@foursquare.com> on 2020/04/30 20:27:58 UTC

Unit Test (MRUnit) for Hadoop with Parquet Input

Is there a way to create a unit test (mrunit) for a hadoop job that
reads in Parquet. I have the following class

    import org.apache.parquet.example.data.Group;
    class MyMapper extends Mapper<LongWritable, Group, NullWritable, Text>

and I try to create a unit test using the withInput method

    driver.withInput(new LongWritable(), group)

However I get the message

No applicable class implementing Serialization in conf at
io.serializations: class
org.apache.parquet.example.data.simple.SimpleGroup

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org