You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by salexln <sa...@gmail.com> on 2014/10/25 15:03:23 UTC

Matix operations in Scala \ Spark

Hi guys,

I'm working on the implementation of the FuzzyCMeans algorithm (Jira
https://issues.apache.org/jira/browse/SPARK-2344)
and I need to use some operations on Matrices (norm & subtraction)

I could not find any Scala\ Spark Matrix class that will support these
actions.

Should I implement the Matrix as a two dimensional array and make my own
code for the norm & subtraction ?







--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Matix-operations-in-Scala-Spark-tp8959.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: Matix operations in Scala \ Spark

Posted by Zongheng Yang <zo...@gmail.com>.
We recently released a research prototype of a lightweight matrix library
for Spark here: https://github.com/amplab/ml-matrix which does support norm
and subtraction. Feel free to base your implementation on top of it.

Zongheng
On Sat, Oct 25, 2014 at 07:12 Xuefeng Wu <be...@gmail.com> wrote:

> how about non/spire or twitter/scalding
>
>
> Yours, Xuefeng Wu 吴雪峰 敬上
>
> > On 2014年10月25日, at 下午9:03, salexln <sa...@gmail.com> wrote:
> >
> > Hi guys,
> >
> > I'm working on the implementation of the FuzzyCMeans algorithm (Jira
> > https://issues.apache.org/jira/browse/SPARK-2344)
> > and I need to use some operations on Matrices (norm & subtraction)
> >
> > I could not find any Scala\ Spark Matrix class that will support these
> > actions.
> >
> > Should I implement the Matrix as a two dimensional array and make my own
> > code for the norm & subtraction ?
> >
> >
> >
> >
> >
> >
> >
> > --
> > View this message in context: http://apache-spark-
> developers-list.1001551.n3.nabble.com/Matix-operations-
> in-Scala-Spark-tp8959.html
> > Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Re: Matix operations in Scala \ Spark

Posted by Xuefeng Wu <be...@gmail.com>.
how about non/spire or twitter/scalding


Yours, Xuefeng Wu 吴雪峰 敬上

> On 2014年10月25日, at 下午9:03, salexln <sa...@gmail.com> wrote:
> 
> Hi guys,
> 
> I'm working on the implementation of the FuzzyCMeans algorithm (Jira
> https://issues.apache.org/jira/browse/SPARK-2344)
> and I need to use some operations on Matrices (norm & subtraction)
> 
> I could not find any Scala\ Spark Matrix class that will support these
> actions.
> 
> Should I implement the Matrix as a two dimensional array and make my own
> code for the norm & subtraction ?
> 
> 
> 
> 
> 
> 
> 
> --
> View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Matix-operations-in-Scala-Spark-tp8959.html
> Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org