You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/03/26 13:44:19 UTC
[GitHub] [spark] srowen commented on issue #23580: [SPARK-26660]Add warning
logs when broadcasting large task binary
srowen commented on issue #23580: [SPARK-26660]Add warning logs when broadcasting large task binary
URL: https://github.com/apache/spark/pull/23580#issuecomment-476643712
I don't think performance is an issue; it's just a log message.
In retrospect, the threshold for broadcasts might legitimately be different. While a task is rarely about 100KB, a broadcast might 'normally' be 1MB or more. Maybe just a different hard-coded threshold?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org