[GitHub] [spark] dongjoon-hyun edited a comment on pull request #35368: [SPARK-38075][SQL] Fix hasNext in HiveScriptTransformationExec's process output iterator

[GitBox <gi...@apache.org>]

dongjoon-hyun edited a comment on pull request #35368:
URL: https://github.com/apache/spark/pull/35368#issuecomment-1025348321


   Oh, never mind. I realized that the `spark-shell` add `limit` automatically. You're right. This is `ORDER BY .. LIMIT` issue.
   ```
   spark-sql> SELECT version();
   3.2.1 4f25b3f71238a00508a356591553f2dfa89f8290
   Time taken: 0.208 seconds, Fetched 1 row(s)
   
   spark-sql> SELECT transform(a) USING 'cat' AS (a int) FROM VALUES (1) t(a) ORDER BY a;
   1
   Time taken: 0.282 seconds, Fetched 1 row(s)
   
   spark-sql> SELECT transform(a) USING 'cat' AS (a int) FROM VALUES (1) t(a) ORDER BY a LIMIT 3;
   NULL
   1
   Time taken: 0.09 seconds, Fetched 2 row(s)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org