You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "CurtHagenlocher (via GitHub)" <gi...@apache.org> on 2024/04/17 02:14:25 UTC
[I] csharp/src/Drivers/Apache: data types should be returned as-is instead of being converted [arrow-adbc]
CurtHagenlocher opened a new issue, #1727:
URL: https://github.com/apache/arrow-adbc/issues/1727
### What happened?
I expect structured types and intervals to be returned as their Arrow representation instead of being converted to string.
### How can we reproduce the bug?
_No response_
### Environment/Setup
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] csharp/src/Drivers/Apache: data types should be returned as-is instead of being converted [arrow-adbc]
Posted by "birschick-bq (via GitHub)" <gi...@apache.org>.
birschick-bq commented on issue #1727:
URL: https://github.com/apache/arrow-adbc/issues/1727#issuecomment-2102990754
@CurtHagenlocher - So initially, this option was set. Unfortunately, the server did not return enough metadata for us to reconstruct the data structure to dereference the buffer.
How/who do we work with to get the server to return the necessary metadata?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] csharp/src/Drivers/Apache: data types should be returned as-is instead of being converted [arrow-adbc]
Posted by "CurtHagenlocher (via GitHub)" <gi...@apache.org>.
CurtHagenlocher commented on issue #1727:
URL: https://github.com/apache/arrow-adbc/issues/1727#issuecomment-2103006499
I think what would need to happen to make this work is not to return until we've read the first Arrow batch and to take the schema from that instead of the Thrift-based metadata. I'm not sure yet how worthwhile this is. I'm pretty convinced that "Spark Connect" is the right path forward for Spark in the future and AFAIK Arrow results aren't supported from Impala or non-Spark implementations of HiveServer2. What I don't know is how quickly Spark users adopt newer versions: Spark Connect requires 3.4 which is barely a year old.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org