You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/01/05 23:15:00 UTC

[jira] [Commented] (SPARK-26550) New datasource for benchmarking

    [ https://issues.apache.org/jira/browse/SPARK-26550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735040#comment-16735040 ] 

Dongjoon Hyun commented on SPARK-26550:
---------------------------------------

The PR title looks more intuitive to me.

> New datasource for benchmarking
> -------------------------------
>
>                 Key: SPARK-26550
>                 URL: https://issues.apache.org/jira/browse/SPARK-26550
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Maxim Gekk
>            Priority: Major
>
> Purpose of new datasource is materialisation of dataset without additional overhead associated with actions and converting row's values to other types. This can be used in benchmarking as well as in cases when need to materialise a dataset for side effects like in caching.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org