You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "Dale Richardson (Jira)" <ji...@apache.org> on 2019/09/04 09:59:00 UTC
[jira] [Commented] (METRON-2246) rpm-docker: minimise use of bind
mounts due to performance
[ https://issues.apache.org/jira/browse/METRON-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922340#comment-16922340 ]
Dale Richardson commented on METRON-2246:
-----------------------------------------
Original code performance (On 2019 MacBook Pro):
{{mvn package -DskipTests -T 2C -P HDP-2.5.0.0,mpack}}
{{cd metron-deployment/}}
{{time mvn clean package -Pbuild-rpms -T 2C}}{{[INFO] ------------------------------------------------------------------------}}
{{[INFO] Reactor Summary:}}
{{[INFO] }}
{{[INFO] metron-deployment 0.7.2 ............................ SUCCESS [ 0.763 s]}}
{{[INFO] metron-rpm 0.7.2 ................................... SUCCESS [12:21 min]}}
{{[INFO] ------------------------------------------------------------------------}}
{{[INFO] BUILD SUCCESS}}
{{[INFO] ------------------------------------------------------------------------}}
{{[INFO] Total time: 12:22 min (Wall Clock)}}
{{[INFO] Finished at: 2019-09-04T18:35:12+10:00}}
{{[INFO] ------------------------------------------------------------------------}}
{{real 12m23.361s}}
{{user 0m11.263s}}
{{sys 0m8.577s}}
{{This PR:}}
{{mvn package -DskipTests -T 2C -P HDP-2.5.0.0,mpack}}
{{cd metron-deployment/}}
{{time mvn clean package -Pbuild-rpms -T 2C}}{{[INFO] ------------------------------------------------------------------------}}
{{[INFO] Reactor Summary:}}
{{[INFO] }}
{{[INFO] metron-deployment 0.7.2 ............................ SUCCESS [ 0.848 s]}}
{{[INFO] metron-rpm 0.7.2 ................................... SUCCESS [09:28 min]}}
{{[INFO] ------------------------------------------------------------------------}}
{{[INFO] BUILD SUCCESS}}
{{[INFO] ------------------------------------------------------------------------}}
{{[INFO] Total time: 09:29 min (Wall Clock)}}
{{[INFO] Finished at: 2019-09-04T19:16:38+10:00}}
{{[INFO] ------------------------------------------------------------------------}}{{real 9m30.377s}}
{{user 0m10.831s}}
{{sys 0m7.999s}}
> rpm-docker: minimise use of bind mounts due to performance
> ----------------------------------------------------------
>
> Key: METRON-2246
> URL: https://issues.apache.org/jira/browse/METRON-2246
> Project: Metron
> Issue Type: Improvement
> Reporter: Dale Richardson
> Priority: Minor
>
> Docker bind mounts on MacOS have a reputation for being extremely slow. The rpm-docker module uses bind mounts to share out the rpm-docker project directory to the RPM creation docker image, which then uses it as a workspace when creating the METRON RPMS, and means of pushing the resulting RPM's back to the hosting build box.
> Bind mounts remain the most convenient way of bulk file export from a docker image, but the processes can be sped up by building the rpm-docker image with the input file already included, so that any file I/O by the rpm building process in its workspace does not suffer a performance penalty.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)