Issue with Custom Key Class

[Bahubali Jain <ba...@gmail.com>]

Hi,
I have a custom key class.In this class equals() and hashcode() have been
overridden.
I have a javaPairRDD which has this class as the key .When  groupbykey() or
reducebykey() is called  a null object is being passed to the function
*equals*(Object obj) as a result the grouping is failing.
Is this a known issue?
I am using Spark 0.9 version.

Thanks,
Baahu


-- 
Twitter:http://twitter.com/Baahu

Re: Issue with Custom Key Class

[Sean Owen <so...@cloudera.com>]

Does your RDD contain a null key?

On Sat, Nov 8, 2014 at 11:15 AM, Bahubali Jain <ba...@gmail.com> wrote:
> Hi,
> I have a custom key class.In this class equals() and hashcode() have been
> overridden.
> I have a javaPairRDD which has this class as the key .When  groupbykey() or
> reducebykey() is called  a null object is being passed to the function
> equals(Object obj) as a result the grouping is failing.
> Is this a known issue?
> I am using Spark 0.9 version.
>
> Thanks,
> Baahu
>
>
> --
> Twitter:http://twitter.com/Baahu
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org