You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "joao-p-pereira (via GitHub)" <gi...@apache.org> on 2023/07/27 14:51:08 UTC
[GitHub] [arrow] joao-p-pereira opened a new issue, #36912: Flight sql jdbc driver stops receiving RecordBatches when it encounters one empty RecordBatch.
joao-p-pereira opened a new issue, #36912:
URL: https://github.com/apache/arrow/issues/36912
### Describe the bug, including details regarding any error messages, version, and platform.
When reading the result of a query that returns more than one RecordBatch, if it encounters an empty one, it appears to stop the reading process. However, in reality, there is still data present in the subsequent record batches. We tested this behavior using the driver with SQuirreL SQL Client and a Java program, and the result was the same.
We have an internal Flight SQL command-line client built in Rust, which allows us to validate this observation. When we run the example query below, we can see that there are empty RecordBatches, but there are subsequent RecordBatches that contain data.
```
> query "select city from csv1 union select city from csv3"
+------+
| city |
+------+
+------+
+------+
| city |
+------+
+------+
+------+
| city |
+------+
+------+
+------+
| city |
+------+
+------+
+------+
| city |
+------+
+------+
+-------+
| city |
+-------+
| Porto |
+-------+
+--------+
| city |
+--------+
| Lisboa |
+--------+
+------+
| city |
+------+
+------+
```
Version:
flight-sql-jdbc-driver version 11.0.0
### Component(s)
Java
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Java] Flight SQL JDBC driver stops receiving RecordBatches when it encounters one empty RecordBatch. [arrow]
Posted by "jduo (via GitHub)" <gi...@apache.org>.
jduo commented on issue #36912:
URL: https://github.com/apache/arrow/issues/36912#issuecomment-1787785531
While working on another issue, it looks as though the driver evaluates FlightStream#getRoot()#getRowCount() > 0 as a stopping condition rather than evaluating FlightStream#next() or FlightStream#hasRoot().
https://github.com/apache/arrow/blob/66844e9f16e9cf26bd5d260de9150973f94f4d5a/java/flight/flight-sql-jdbc-core/src/main/java/org/apache/arrow/driver/jdbc/utils/FlightStreamQueue.java#L106
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Java] Flight SQL JDBC driver stops receiving RecordBatches when it encounters one empty RecordBatch. [arrow]
Posted by "jduo (via GitHub)" <gi...@apache.org>.
jduo commented on issue #36912:
URL: https://github.com/apache/arrow/issues/36912#issuecomment-1792936778
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Java] Flight SQL JDBC driver stops receiving RecordBatches when it encounters one empty RecordBatch. [arrow]
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm closed issue #36912: [Java] Flight SQL JDBC driver stops receiving RecordBatches when it encounters one empty RecordBatch.
URL: https://github.com/apache/arrow/issues/36912
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org