You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Mike Dusenberry (JIRA)" <ji...@apache.org> on 2016/09/28 22:28:20 UTC
[jira] [Commented] (SYSTEMML-969) Add Vector As Supported Type In
Frame Conversions
[ https://issues.apache.org/jira/browse/SYSTEMML-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531065#comment-15531065 ]
Mike Dusenberry commented on SYSTEMML-969:
------------------------------------------
[~mboehm7] I wanted to try the workaround of converting a DataFrame I have to a SystemML {{frame}} to avoid shuffles, but the frame converters do not yet allow for {{Vector}} types.
> Add Vector As Supported Type In Frame Conversions
> -------------------------------------------------
>
> Key: SYSTEMML-969
> URL: https://issues.apache.org/jira/browse/SYSTEMML-969
> Project: SystemML
> Issue Type: New Feature
> Reporter: Mike Dusenberry
>
> Currently, we are able to pass in Spark DataFrames with Vector type columns as input to SystemML scripts to be converted to a SystemML {{matrix}}. We should add the Vector type to the {{frame}} conversion code too.
> Example: Given a Spark DataFrame of schema <double, vector, string>, we should be able to convert that to a SystemML {{frame}} with a bunch of double columns and the final string column.
> cc [~mboehm7], [~acs_s]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)