Broadcasting Non Serializable Objects

[pedroT <tu...@gmail.com>]

Hi guys. 

I know this is a well known topic, but reading about (a lot) I'm not sure
about the answer..

I need to broadcast a complex estructure with a lot of objects as fields,
including some of external libraries which I can't happily turn in
serializable ones. 

I tried making a static method returning the data, following this post (I
use Java API):
https://www.nicolaferraro.me/2016/02/22/using-non-serializable-objects-in-apache-spark/
but the same serializable exception arise.

Is there a way to achieve this?








--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Broadcasting-Non-Serializable-Objects-tp27919.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org

Re: Broadcasting Non Serializable Objects

[Daniel Imberman <da...@gmail.com>]

Hi Pedro,

Can you please post your code?

Daniel

On Tue, Oct 18, 2016 at 12:27 PM pedroT <tu...@gmail.com> wrote:

> Hi guys.
>
> I know this is a well known topic, but reading about (a lot) I'm not sure
> about the answer..
>
> I need to broadcast a complex estructure with a lot of objects as fields,
> including some of external libraries which I can't happily turn in
> serializable ones.
>
> I tried making a static method returning the data, following this post (I
> use Java API):
>
> https://www.nicolaferraro.me/2016/02/22/using-non-serializable-objects-in-apache-spark/
> but the same serializable exception arise.
>
> Is there a way to achieve this?
>
>
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Broadcasting-Non-Serializable-Objects-tp27919.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>