You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2019/01/16 18:09:00 UTC

[jira] [Resolved] (SPARK-26550) New datasource for benchmarking

     [ https://issues.apache.org/jira/browse/SPARK-26550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Herman van Hovell resolved SPARK-26550.
---------------------------------------
       Resolution: Fixed
         Assignee: Maxim Gekk
    Fix Version/s: 3.0.0

> New datasource for benchmarking
> -------------------------------
>
>                 Key: SPARK-26550
>                 URL: https://issues.apache.org/jira/browse/SPARK-26550
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Maxim Gekk
>            Assignee: Maxim Gekk
>            Priority: Major
>             Fix For: 3.0.0
>
>
> Purpose of new datasource is materialisation of dataset without additional overhead associated with actions and converting row's values to other types. This can be used in benchmarking as well as in cases when need to materialise a dataset for side effects like in caching.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org