You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Mike Dusenberry (JIRA)" <ji...@apache.org> on 2016/09/28 22:28:20 UTC

[jira] [Commented] (SYSTEMML-969) Add Vector As Supported Type In Frame Conversions

    [ https://issues.apache.org/jira/browse/SYSTEMML-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531065#comment-15531065 ] 

Mike Dusenberry commented on SYSTEMML-969:
------------------------------------------

[~mboehm7]  I wanted to try the workaround of converting a DataFrame I have to a SystemML {{frame}} to avoid shuffles, but the frame converters do not yet allow for {{Vector}} types.

> Add Vector As Supported Type In Frame Conversions
> -------------------------------------------------
>
>                 Key: SYSTEMML-969
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-969
>             Project: SystemML
>          Issue Type: New Feature
>            Reporter: Mike Dusenberry
>
> Currently, we are able to pass in Spark DataFrames with Vector type columns as input to SystemML scripts to be converted to a SystemML {{matrix}}.  We should add the Vector type to the {{frame}} conversion code too.
> Example:  Given a Spark DataFrame of schema <double, vector, string>, we should be able to convert that to a SystemML {{frame}} with a bunch of double columns and the final string column.
> cc [~mboehm7], [~acs_s]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)