[GitHub] [spark] HyukjinKwon commented on pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

[GitBox <gi...@apache.org>]

HyukjinKwon commented on PR #38064:
URL: https://github.com/apache/spark/pull/38064#issuecomment-1314714912

   I actually don't think we can have a test with 2GB because GA is already using a lot of memory in fact. One way would be to add a test, and mark it as `ignore` so other people can verify that manually in the future.
   
   Another way is to skip the tests in GitHub Actions enviornment (e.g., `assume(!sys.env.contains("GITHUB_ACTIONS"))`)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org