You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@orc.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2018/07/13 21:35:00 UTC

[jira] [Resolved] (ORC-386) Add new spark file format benchmark

     [ https://issues.apache.org/jira/browse/ORC-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved ORC-386.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 1.6.0

I just committed this.

> Add new spark file format benchmark
> -----------------------------------
>
>                 Key: ORC-386
>                 URL: https://issues.apache.org/jira/browse/ORC-386
>             Project: ORC
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Major
>             Fix For: 1.6.0
>
>
> I've done a new set of benchmarks that compare the performance of the file formats as they are read from Spark.
> As part of this, I've refactored a lot of the benchmark code into different modules so that we don't need to fight quite as many dependency hell fires when trying to build an uber jar with both Spark and Hive in it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)