[jira] [Commented] (YETUS-421) archiver should be smarter

["Casey Brotherton (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YETUS-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431099#comment-15431099 ] 

Casey Brotherton commented on YETUS-421:
----------------------------------------

Replacing the find to a temp file followed by a while loop with just a find command may not provide much speedup.

The longest part of the process is probably the rsync copying across disk.

Maybe a better way to make the archive step smarter would be to have multiple processes copying at the same time.

I will look later in the week.  If I can answer the following questions, I would be glad to try and submit a patch for this:

1)  Is there a reason rsync is used instead of a cp command?
2)  Is there a tunable parameter in YETUS for the number of concurrent threads to run at the same time? ( Thinking that number of simultaneous copies should be less than any other concurrent thread parameter. )



> archiver should be smarter
> --------------------------
>
>                 Key: YETUS-421
>                 URL: https://issues.apache.org/jira/browse/YETUS-421
>             Project: Yetus
>          Issue Type: Bug
>          Components: Test Patch
>    Affects Versions: 0.4.0
>            Reporter: Allen Wittenauer
>            Priority: Minor
>
> Ideally, the archiver functionality should use a single find statement rather than running in a for loop.  As the list gets bigger and the repo gets more clogged with files, the slower it runs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)