You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2020/12/12 00:13:26 UTC
[GitHub] [hadoop] ericbadger edited a comment on pull request #2513: YARN-10494 CLI tool for docker-to-squashfs conversion (pure Java).
ericbadger edited a comment on pull request #2513:
URL: https://github.com/apache/hadoop/pull/2513#issuecomment-743489488
Here's some additional info. The times aren't exact for the docker-to-squash though. They would actually be smaller than the values listed, because those times include the time it takes to convert the layer to squashfs as well as the time to upload it to hdfs. I performed this test on an internal image, so I can't exactly show it to you or tell you what's in it other than that it's some ML stuff and it's huge. I'll try and find a similar image on dockerhub that I can use
| fds | Layer Size | Java CLI | docker-to-squash |
| ------------- | ------------- | -------------- | ------------|
Download Time | | 00:04:39 | 00:02:50
Layer 1 Conversion | 89646470 | 00:01:49 | 00:00:35
Layer 2 Conversion | 67519574 | 00:00:34 | 00:00:23
Layer 3 Conversion | 154819384 | 00:00:39 | 00:00:24
Layer 4 Conversion | 782 | 00:00:00 | 00:00:15
Layer 5 Conversion | 183 | 00:00:00 | 00:00:15
Layer 6 Conversion | 240 | 00:00:00 | 00:00:14
Layer 7 Conversion | 157 | 00:00:00 | 00:00:15
Layer 8 Conversion | 2277074491 | 00:09:10 | 00:02:35
Layer 9 Conversion | 80814130 | 00:00:37 | 00:00:26
Layer 10 Conversion | 673 | 00:00:00 | 00:00:15
Layer 11 Conversion | 376 | 00:00:00 | 00:00:15
Layer 12 Conversion | 1091 | 00:00:00 | 00:00:15
Layer 13 Conversion | 522 | 00:00:00 | 00:00:15
Layer 14 Conversion | 421395753 | 00:00:23 | 00:00:24
Layer 15 Conversion | 205884 | 00:00:00 | 00:00:15
Layer 16 Conversion | 428290011 | 00:00:21 | 00:00:24
Layer 17 Conversion | 34387 | 00:00:00 | 00:00:15
Layer 18 Conversion | 9419 | 00:00:00 | 00:00:15
Layer 19 Conversion | 1628341 | 00:00:01 | 00:00:16
Layer 20 Conversion | 4098138 | 00:00:00 | 00:00:15
Layer 21 Conversion | 1214299550 | 00:09:20 | 00:02:41
Layer 22 Conversion | 3222 | 00:00:00 | 00:00:16
Layer 23 Conversion | 57882209 | 00:00:07 | 00:00:17
Layer 24 Conversion | 2247852313 | 00:07:50 | 00:02:24
Layer 25 Conversion | 20900285 | 00:00:12 | 00:00:18
Layer 26 Conversion | 168992501 | 00:00:59 | 00:00:30
Layer 27 Conversion | 3780 | 00:00:00 | 00:00:15
Layer 28 Conversion | 4885 | 00:00:00 | 00:00:16
Layer 29 Conversion | 1345108 | 00:00:00 | 00:00:15
Layer 30 Conversion | 31320991 | 00:00:02 | 00:00:16
Layer 31 Conversion | 31697060 | 00:00:02 | 00:00:16
Layer 32 Conversion | 527452 | 00:00:00 | 00:00:15
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org