You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/04/25 12:16:16 UTC

[GitHub] [arrow-rs] vlushn opened a new issue, #1619: Infer JSON fields of arrays of natural numbers <255 as `ByteArray`

vlushn opened a new issue, #1619:
URL: https://github.com/apache/arrow-rs/issues/1619

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   I am generating sample JSON data using a tool that does not support parquet. I am trying to import the JSON into a parquet file using the inference logic. I found that this does not work when I want a byte array column to be generated because the inference does not support it.
   
   **Describe the solution you'd like**
   JSON arrays of natural numbers that fit into u8 are inferred as byte array type instead of array<i64>
   
   **Describe alternatives you've considered**
   Change JSON -> Parquet generation tool to force the column schema to be byte array without relying on inference. Alternatively, add special support for hexadecimal strings (but this sounds even more hacky as such strings are not standardized in JSON).
   
   **Additional context**
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org