[GitHub] [iceberg] singhpk234 commented on issue #5593: Reading records inserted using Athena throws UOE exception when read using Spark (AWS)

[GitBox <gi...@apache.org>]

singhpk234 commented on issue #5593:
URL: https://github.com/apache/iceberg/issues/5593#issuecomment-1221477912

   iceberg doesn't uses spark's vectorized reader, the conf above will not work if you are trying to disable vectorized reads.
   Can you please try with setting this table property to false.
   `read.parquet.vectorization.enabled`, ref [PR](https://github.com/apache/iceberg/pull/4196/files)
   
   ```
   spark.sql("ALTER TABLE my_catalog.default.iceberg_demo SET TBLPROPERTIES ('read.parquet.vectorization.enabled'='false')");
   ```
   
   As per this [PR](https://github.com/apache/iceberg/pull/2749#issue-932081813) looks like this is a know issue with DELTA encoding.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org