You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jonahgao (via GitHub)" <gi...@apache.org> on 2023/07/24 14:10:20 UTC

[GitHub] [arrow-datafusion] jonahgao commented on issue #7039: Error with partitioned dataset: Cannot infer common argument type for comparison operation Binary != Utf8

jonahgao commented on issue #7039:
URL: https://github.com/apache/arrow-datafusion/issues/7039#issuecomment-1647995376

   The schemas of these two datasets in Parquet format are different.
   ```shell
   $ parquet-schema data/hits.parquet|grep MobilePhoneModel
     REQUIRED BYTE_ARRAY MobilePhoneModel (STRING);
   
   $ parquet-schema hits_partitioned/hits_0.parquet| grep MobilePhoneModel
     OPTIONAL BYTE_ARRAY MobilePhoneModel;
   
   ```
   The single file dataset  has specified the logical type for MobilePhoneModel.
   
   
   I think we may need to support type coercion from `Utf8` to `Binary` here.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org