You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/01/24 23:03:07 UTC

[GitHub] [spark] HyukjinKwon commented on pull request #31303: [SPARK-34211][SQL][TESTS] Benchmark TPC-DS with 1GB scale factor

HyukjinKwon commented on pull request #31303:
URL: https://github.com/apache/spark/pull/31303#issuecomment-766455425


   Is the perf inconsistency big? It will give you a rough numbers to check. I was also thinking this as a test. I remember we faced a case that TPSDS was broken whereas the Spark tests pass.
   
   The resource is indeed a problem. It has been a problem so far. I think we have added some jobs if they are worthwhile though.
   
   I'm okay to wait until we have some more resources and don't add new jobs for the time being.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org