You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by mateiz <gi...@git.apache.org> on 2014/03/21 21:40:53 UTC

[GitHub] spark pull request: [SPARK-1212] Adding sparse data support and up...

Github user mateiz commented on the pull request:

    https://github.com/apache/spark/pull/117#issuecomment-38321698
  
    @mengxr I think this approach is fine, and we'll just have to change the other algorithms to take `RDD[Vector]` for Spark 1.0. It's unfortunate that we had to do this -- we started with `Array[Double]` thinking it's an interface we can always support, but we didn't realize that type erasure would create this problem. We can add a utility function to `Vectors` to create an `RDD[Vector]` from `RDD[Array[Double]]`.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---