You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jonahgao (via GitHub)" <gi...@apache.org> on 2023/07/24 14:10:20 UTC
[GitHub] [arrow-datafusion] jonahgao commented on issue #7039: Error with partitioned dataset: Cannot infer common argument type for comparison operation Binary != Utf8
jonahgao commented on issue #7039:
URL: https://github.com/apache/arrow-datafusion/issues/7039#issuecomment-1647995376
The schemas of these two datasets in Parquet format are different.
```shell
$ parquet-schema data/hits.parquet|grep MobilePhoneModel
REQUIRED BYTE_ARRAY MobilePhoneModel (STRING);
$ parquet-schema hits_partitioned/hits_0.parquet| grep MobilePhoneModel
OPTIONAL BYTE_ARRAY MobilePhoneModel;
```
The single file dataset has specified the logical type for MobilePhoneModel.
I think we may need to support type coercion from `Utf8` to `Binary` here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org