You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Leonid Toshchev <lt...@gmail.com> on 2017/06/15 17:11:40 UTC

Serialization of fastutils reference collections

Hi all,

As a part of memory optimization we move almost every collection to
fastutils. It works fine with primitive to primitive collections
(like Int2LongOpenHashMap, Long2LongOpenHashMap or IntArrayList), but at
the same moment as we start to use Int2ReferenceOpenHashMap<int[]> we got
an error:
Caused by: com.esotericsoftware.kryo.KryoException:
java.lang.ClassCastException: java.lang.Integer cannot be cast to [I

Question: is there possibility to use reference to array or I need to move
everything back to Map<Integer, List<Integer>> ?

Thanks in advance,
Leonid