You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/05/16 11:27:56 UTC
[GitHub] [arrow-datafusion] alamb opened a new issue, #2543: Reading parquet with (pre-release) arrow fails with "out of order projection is not supported"
alamb opened a new issue, #2543:
URL: https://github.com/apache/arrow-datafusion/issues/2543
**Describe the bug**
When testing using a pre-release version of arrow-rs with https://github.com/apache/arrow-rs/pull/1682 from @tustvold which added stricter error checking two datafusion tests fail with "out of order projection is not supported"
```
---- physical_plan::file_format::parquet::tests::evolved_schema_filter stdout ----
thread 'physical_plan::file_format::parquet::tests::evolved_schema_filter' panicked at 'called `Result::unwrap()` on an `Err` value: ArrowError(ExternalError(ParquetError(General("out of order projection is not supported"))))', datafusion/core/src/physical_plan/file_format/parquet.rs:968:14
---- physical_plan::file_format::parquet::tests::evolved_schema_inconsistent_order stdout ----
thread 'physical_plan::file_format::parquet::tests::evolved_schema_inconsistent_order' panicked at 'called `Result::unwrap()` on an `Err` value: ArrowError(ExternalError(ParquetError(General("out of order projection is not supported"))))', datafusion/core/src/physical_plan/file_format/parquet.rs:819:14
```
**To Reproduce**
See https://github.com/apache/arrow-datafusion/pull/2530
**Expected behavior**
Tests should succeed
**Additional context**
@tustvold suggests there is some interplay of the parquet schema adapter logic that was silently masking a bug in arrow-rs. Now that arrow-rs has stricter error checking, the query is erroring https://github.com/apache/arrow-datafusion/pull/2530#issuecomment-1126346437
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #2543: Reading parquet with (pre-release) arrow fails with "out of order projection is not supported"
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #2543:
URL: https://github.com/apache/arrow-datafusion/issues/2543#issuecomment-1127553323
Filed https://github.com/apache/arrow-datafusion/issues/2543 to track
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #2543: Reading parquet with (pre-release) arrow fails with "out of order projection is not supported"
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #2543:
URL: https://github.com/apache/arrow-datafusion/issues/2543#issuecomment-1199190920
This has since been fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed issue #2543: Reading parquet with (pre-release) arrow fails with "out of order projection is not supported"
Posted by GitBox <gi...@apache.org>.
alamb closed issue #2543: Reading parquet with (pre-release) arrow fails with "out of order projection is not supported"
URL: https://github.com/apache/arrow-datafusion/issues/2543
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org