You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Josh Taylor (Jira)" <ji...@apache.org> on 2020/10/09 04:22:00 UTC

[jira] [Comment Edited] (ARROW-10242) Parquet reader thread terminated due to error: ExecutionError("sending on a disconnected channel")

    [ https://issues.apache.org/jira/browse/ARROW-10242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210605#comment-17210605 ] 

Josh Taylor edited comment on ARROW-10242 at 10/9/20, 4:21 AM:
---------------------------------------------------------------

Hi [~andygrove],

I'm not sure if i'm using a nested type, they should all be pretty primitive types. I'll start by removing all the fields and field types and adding one at a time and see what causes it to explode.

I'm not seeing any other errors.

Thanks for the swift response!


was (Author: joshx):
Hi [~andygrove],

I'm not sure if i'm using a nested type, they should all be pretty primitive types. I'll start by removing all the fields and field types and adding one at a time and see what causes it to explode.

Thanks for the swift response!

> Parquet reader thread terminated due to error: ExecutionError("sending on a disconnected channel")
> --------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-10242
>                 URL: https://issues.apache.org/jira/browse/ARROW-10242
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Rust, Rust - DataFusion
>    Affects Versions: 2.0.0
>            Reporter: Josh Taylor
>            Assignee: Andy Grove
>            Priority: Major
>
> *Running the latest code from github for datafusion & parquet.*
> When trying to read a directory of around ~210 parquet files (3.2gb total, each file around 13-18mb), doing the following:
> {code:java}
> let mut ctx = ExecutionContext::new();
> // register parquet file with the execution context
> ctx.register_parquet(
>  "something",
>  "/home/josh/dev/pat/fff/"
> )?;
> // execute the query
> let df = ctx.sql(
>  "select * from something",
> )?;
> let results = df.collect().await?;
>  
> {code}
> I get the following error shown ~204 times:
> {code:java}
> Parquet reader thread terminated due to error: ExecutionError("sending on a disconnected channel"){code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)