You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2023/03/09 12:33:33 UTC

[GitHub] [arrow-datafusion] alamb opened a new issue, #5530: Support casting from UTF8 --> FixedSizeBinary, Binary --> FixedSizedBinary

alamb opened a new issue, #5530:
URL: https://github.com/apache/arrow-datafusion/issues/5530

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   A user reported on discord that they were trying to use  DataFusion to query FixedSizeBinary fields stored in parquet?
   
   There is probably a whole project to fully support FixedSizeBinary fields, but initially at least it would be nice to be able to cast them to types that DataFusion has better support for (like Binary)
   
   
   **Describe the solution you'd like**
   
   @tustvold  filed https://github.com/apache/arrow-rs/issues/3826 to track adding conversion between binary <-> fixed size binary
   
   Once that is available, I expect this to work
   
   ```
   ❯ select arrow_cast('002920a3044b3c9f56e797b8'::bytea, 'FixedSizeBinary(12)');
   Error during planning: Cannot automatically convert Binary to FixedSizeBinary(12)
   ```
   
   Once there is direct support to cast between Utf8 and FixedSizeBinary, I would also expect this to work
   
   ```
    select arrow_cast('002920a3044b3c9f56e797b8', 'FixedSizeBinary(12)');
   Error during planning: Cannot automatically convert Utf8 to FixedSizeBinary(12)
   ```
   
   **Describe alternatives you've considered**
   <!--
   A clear and concise description of any alternative solutions or features you've considered.
   -->
   
   **Additional context**
   <!--
   Add any other context or screenshots about the feature request here.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow-datafusion] alamb commented on issue #5530: Support casting from UTF8 --> FixedSizeBinary, Binary --> FixedSizedBinary

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #5530:
URL: https://github.com/apache/arrow-datafusion/issues/5530#issuecomment-1462034226

   See note from tustvold on https://github.com/apache/arrow-rs/issues/3826#issuecomment-1461991619 -- casting from Utf8 to FixedSizeBinary may be more confusing than helpful, which is something to consider


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org