You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "WaterKnight1998 (via GitHub)" <gi...@apache.org> on 2023/02/28 11:36:40 UTC

[GitHub] [arrow-rs] WaterKnight1998 opened a new issue, #3774: arrow_json::LineDelimitedWriter: Write nulls

WaterKnight1998 opened a new issue, #3774:
URL: https://github.com/apache/arrow-rs/issues/3774

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   I am trying to convert Parquet data written using Avro Parquet Writer of Java. This parquet includes the Avro Schema inside the key `parquet.avro.schema` of the metadata, I want to convert this parquet data back to Avro using this schema and programmed in Rust.
   
   I have tried to solve this challenge by converting Parquet into a json with string `arrow_json::LineDelimitedWriter` and then read this data with `serde_json` and serialise to Avro. In Avro Serializer I need that nullable fields are provided as `Option<T>`. The problem is that when I write the data into JSON null fields are skipped and I can't recover them as Options with `serde_json`
   
   **Describe the solution you'd like**
   
   I would like that `arrow_json` has a parameter for specifying if you want to output the null field.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] arrow_json::LineDelimitedWriter: Write nulls [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #3774: arrow_json::LineDelimitedWriter: Write nulls
URL: https://github.com/apache/arrow-rs/issues/3774


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org