You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Josh Taylor (Jira)" <ji...@apache.org> on 2020/10/09 04:22:00 UTC
[jira] [Comment Edited] (ARROW-10242) Parquet reader thread
terminated due to error: ExecutionError("sending on a disconnected
channel")
[ https://issues.apache.org/jira/browse/ARROW-10242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210605#comment-17210605 ]
Josh Taylor edited comment on ARROW-10242 at 10/9/20, 4:21 AM:
---------------------------------------------------------------
Hi [~andygrove],
I'm not sure if i'm using a nested type, they should all be pretty primitive types. I'll start by removing all the fields and field types and adding one at a time and see what causes it to explode.
I'm not seeing any other errors.
Thanks for the swift response!
was (Author: joshx):
Hi [~andygrove],
I'm not sure if i'm using a nested type, they should all be pretty primitive types. I'll start by removing all the fields and field types and adding one at a time and see what causes it to explode.
Thanks for the swift response!
> Parquet reader thread terminated due to error: ExecutionError("sending on a disconnected channel")
> --------------------------------------------------------------------------------------------------
>
> Key: ARROW-10242
> URL: https://issues.apache.org/jira/browse/ARROW-10242
> Project: Apache Arrow
> Issue Type: Bug
> Components: Rust, Rust - DataFusion
> Affects Versions: 2.0.0
> Reporter: Josh Taylor
> Assignee: Andy Grove
> Priority: Major
>
> *Running the latest code from github for datafusion & parquet.*
> When trying to read a directory of around ~210 parquet files (3.2gb total, each file around 13-18mb), doing the following:
> {code:java}
> let mut ctx = ExecutionContext::new();
> // register parquet file with the execution context
> ctx.register_parquet(
> "something",
> "/home/josh/dev/pat/fff/"
> )?;
> // execute the query
> let df = ctx.sql(
> "select * from something",
> )?;
> let results = df.collect().await?;
>
> {code}
> I get the following error shown ~204 times:
> {code:java}
> Parquet reader thread terminated due to error: ExecutionError("sending on a disconnected channel"){code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)