You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/10/13 14:53:46 UTC

[GitHub] [spark] gaoyajun02 commented on pull request #34231: [SPARK-36964][CORE][YARN] Share cached dnsToSwitchMapping for yarn locality container requests

gaoyajun02 commented on pull request #34231:
URL: https://github.com/apache/spark/pull/34231#issuecomment-942387570


   ```
   21/10/13 22:17:37 INFO Reporter YarnAllocator: Submitted 10 localized container requests took 183469 ms.
   21/10/13 22:17:37 INFO Reporter YarnAllocator: Submitted 32 localized container requests took 32 ms.
   21/10/13 22:17:39 INFO Reporter YarnAllocator: Submitted 64 localized container requests took 1306 ms.
   21/10/13 22:17:40 INFO Reporter YarnAllocator: Submitted 128 localized container requests took 65 ms.
   21/10/13 22:17:41 INFO Reporter YarnAllocator: Submitted 256 localized container requests took 115 ms.
   21/10/13 22:17:43 INFO Reporter YarnAllocator: Submitted 512 localized container requests took 209 ms.
   21/10/13 22:17:48 INFO Reporter YarnAllocator: Submitted 1024 localized container requests took 485 ms.
   21/10/13 22:17:51 INFO Reporter YarnAllocator: Submitted 780 localized container requests took 417 ms.
   ```
   
   ```
   21/10/13 22:07:23 INFO Reporter YarnAllocator: Submitted 18 localized container requests took 58 ms.
   21/10/13 22:07:24 INFO Reporter YarnAllocator: Submitted 64 localized container requests took 72 ms.
   21/10/13 22:07:25 INFO Reporter YarnAllocator: Submitted 128 localized container requests took 106 ms.
   21/10/13 22:07:26 INFO Reporter YarnAllocator: Submitted 256 localized container requests took 116 ms.
   21/10/13 22:07:30 INFO Reporter YarnAllocator: Submitted 512 localized container requests took 241 ms.
   21/10/13 22:07:37 INFO Reporter YarnAllocator: Submitted 1024 localized container requests took 570 ms.
   21/10/13 22:07:41 INFO Reporter YarnAllocator: Submitted 770 localized container requests took 535 ms.
   
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org