[GitHub] [arrow-rs] viirya opened a new issue, #1669: flight_client_scenarios integration test should receive schema from flight data

[GitBox <gi...@apache.org>]

viirya opened a new issue, #1669:
URL: https://github.com/apache/arrow-rs/issues/1669

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   Part of https://github.com/apache/arrow-rs/issues/1404. This is for `generate_nested_dictionary_case`, C++ producing, Rust consuming case.
   
   Currently we take the schema of uploaded data as expected schema, using it when reading dictionary and record batches. But it causes some errors when integrating with C++ producing cases. After uploading data, the received schema from flight data could be different in dictionary ids. So it looks like C++ assigns different dictionary ids, although the actual dictionary encoded batches are the same.
   
   Because we use dictionary ids to find correspond dictionary encoded data, incorrect dictionary ids cause unexpected error. As the scenarios is to test flight client, we should use the schema received from flight data too.
   
   After #1635 and #1646, this is the last piece for fully enabling `generate_nested_dictionary_case` in `archery --debug integration --run-flight --with-cpp=true --with-rust=true`.
   
   **Describe the solution you'd like**
   `generate_nested_dictionary_case` should be passed.
   
   **Describe alternatives you've considered**
   
   
   **Additional context**
   https://github.com/apache/arrow-rs/issues/1404
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold closed issue #1669: flight_client_scenarios integration test should receive schema from flight data

[GitBox <gi...@apache.org>]

tustvold closed issue #1669: flight_client_scenarios integration test should receive schema from flight data
URL: https://github.com/apache/arrow-rs/issues/1669


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org