You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Chao Sun (Jira)" <ji...@apache.org> on 2020/07/14 01:11:00 UTC
[jira] [Commented] (ARROW-9452) [Rust] [DateFusion] Improve
performance of parquet scan
[ https://issues.apache.org/jira/browse/ARROW-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157060#comment-17157060 ]
Chao Sun commented on ARROW-9452:
---------------------------------
Interesting. I saw that some perf comparison has been done between this and Spark. Curious what is the result after this optimization?
> [Rust] [DateFusion] Improve performance of parquet scan
> -------------------------------------------------------
>
> Key: ARROW-9452
> URL: https://issues.apache.org/jira/browse/ARROW-9452
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Rust, Rust - DataFusion
> Reporter: Andy Grove
> Assignee: Andy Grove
> Priority: Major
> Fix For: 1.0.0
>
>
> I found a trivial optimization to significantly speed up the parquet scan by changing the channel communication between threads. PR coming up shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)