You are viewing a plain text version of this content. The canonical link for it is here.
Posted to ivy-commits@incubator.apache.org by "John Williams (JIRA)" <ji...@apache.org> on 2007/01/08 17:07:27 UTC
[jira] Created: (IVY-378) Downloads from filesystem repositories
are slow
Downloads from filesystem repositories are slow
-----------------------------------------------
Key: IVY-378
URL: https://issues.apache.org/jira/browse/IVY-378
Project: Ivy
Issue Type: Improvement
Components: Core
Affects Versions: 1.4
Environment: Linux 2.6.11 (Fedora Core 4) i686 + NFS
Reporter: John Williams
Priority: Minor
I've found that Ivy takes a long time to download files via NFS. In particular, I tried downloading a large jar file through Ivy and then copied the same file using 'cp'; Ivy took about twice as long as 'cp'.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (IVY-378) Downloads from filesystem repositories
are slow
Posted by "Xavier Hanin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/IVY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12463208 ]
Xavier Hanin commented on IVY-378:
----------------------------------
NIO could improve things, but I think we should first investigate on the problem more closely. The way to copy streams is very similar to what is done in ant, except for two things: trigger events at each buffer copy, and test if the thread has been interrupted. I suspect the latter to be a possible cause of slowness...
> Downloads from filesystem repositories are slow
> -----------------------------------------------
>
> Key: IVY-378
> URL: https://issues.apache.org/jira/browse/IVY-378
> Project: Ivy
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.4
> Environment: Linux 2.6.11 (Fedora Core 4) i686 + NFS
> Reporter: John Williams
> Priority: Minor
>
> I've found that Ivy takes a long time to download files via NFS. In particular, I tried downloading a large jar file through Ivy and then copied the same file using 'cp'; Ivy took about twice as long as 'cp'.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (IVY-378) Downloads from filesystem repositories
are slow
Posted by "Maarten Coene (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/IVY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12463138 ]
Maarten Coene commented on IVY-378:
-----------------------------------
Maybe we can improve performance here by using nio?
> Downloads from filesystem repositories are slow
> -----------------------------------------------
>
> Key: IVY-378
> URL: https://issues.apache.org/jira/browse/IVY-378
> Project: Ivy
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.4
> Environment: Linux 2.6.11 (Fedora Core 4) i686 + NFS
> Reporter: John Williams
> Priority: Minor
>
> I've found that Ivy takes a long time to download files via NFS. In particular, I tried downloading a large jar file through Ivy and then copied the same file using 'cp'; Ivy took about twice as long as 'cp'.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (IVY-378) Downloads from filesystem repositories
are slow
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/IVY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12463282 ]
Steve Loughran commented on IVY-378:
------------------------------------
I dont see how NIO is going to deliver magic speedup. the purpose of NIO is to let a pool of threads service a larger number of IO operations, rather one thread/operation.
If NFS is the problem, it may be the block size used for copies is somehow inefficient with NFS.
> Downloads from filesystem repositories are slow
> -----------------------------------------------
>
> Key: IVY-378
> URL: https://issues.apache.org/jira/browse/IVY-378
> Project: Ivy
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.4
> Environment: Linux 2.6.11 (Fedora Core 4) i686 + NFS
> Reporter: John Williams
> Priority: Minor
>
> I've found that Ivy takes a long time to download files via NFS. In particular, I tried downloading a large jar file through Ivy and then copied the same file using 'cp'; Ivy took about twice as long as 'cp'.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (IVY-378) Downloads from filesystem repositories
are slow
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/IVY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12463283 ]
Steve Loughran commented on IVY-378:
------------------------------------
John,
1. what is the fstab entry for the nfs mount? You can increase the block size
http://www.linuxselfhelp.com/HOWTO/NFS-HOWTO/performance.html
2. is the connection an LAN or WAN, and are you using UDP or TCP NFS?
> Downloads from filesystem repositories are slow
> -----------------------------------------------
>
> Key: IVY-378
> URL: https://issues.apache.org/jira/browse/IVY-378
> Project: Ivy
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.4
> Environment: Linux 2.6.11 (Fedora Core 4) i686 + NFS
> Reporter: John Williams
> Priority: Minor
>
> I've found that Ivy takes a long time to download files via NFS. In particular, I tried downloading a large jar file through Ivy and then copied the same file using 'cp'; Ivy took about twice as long as 'cp'.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (IVY-378) Downloads from filesystem repositories
are slow
Posted by "Xavier Hanin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/IVY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12463380 ]
Xavier Hanin commented on IVY-378:
----------------------------------
The block size we use for copy is the same as the one used in ant: 8 * 1024 bytes. And thanks for your insight on NIO Steve.
> Downloads from filesystem repositories are slow
> -----------------------------------------------
>
> Key: IVY-378
> URL: https://issues.apache.org/jira/browse/IVY-378
> Project: Ivy
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.4
> Environment: Linux 2.6.11 (Fedora Core 4) i686 + NFS
> Reporter: John Williams
> Priority: Minor
>
> I've found that Ivy takes a long time to download files via NFS. In particular, I tried downloading a large jar file through Ivy and then copied the same file using 'cp'; Ivy took about twice as long as 'cp'.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira