You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Yoram Arnon (JIRA)" <ji...@apache.org> on 2006/09/26 18:50:52 UTC
[jira] Created: (HADOOP-561) one replica of a file should be
written locally if possible
one replica of a file should be written locally if possible
-----------------------------------------------------------
Key: HADOOP-561
URL: http://issues.apache.org/jira/browse/HADOOP-561
Project: Hadoop
Issue Type: Bug
Components: dfs
Reporter: Yoram Arnon
one replica of a file should be written locally if possible. That's currently not the case.
Copying a 1GB file using hadoop dfs -cp running on one of the cluster nodes, all the blocks were written to remote nodes, as seen by fsck -files -blocks -locations on the newly created file.
as long as there is sufficient space locally, a local copy has significant performance benefits.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-561) one replica of a file should be
written locally if possible
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-561?page=all ]
dhruba borthakur updated HADOOP-561:
------------------------------------
Attachment: localreplica.patch
This fixesd two bugs in chooseTarget() routine that was causing the local machine to not get picked as a replica
> one replica of a file should be written locally if possible
> -----------------------------------------------------------
>
> Key: HADOOP-561
> URL: http://issues.apache.org/jira/browse/HADOOP-561
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Reporter: Yoram Arnon
> Assigned To: dhruba borthakur
> Attachments: localreplica.patch
>
>
> one replica of a file should be written locally if possible. That's currently not the case.
> Copying a 1GB file using hadoop dfs -cp running on one of the cluster nodes, all the blocks were written to remote nodes, as seen by fsck -files -blocks -locations on the newly created file.
> as long as there is sufficient space locally, a local copy has significant performance benefits.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (HADOOP-561) one replica of a file should be
written locally if possible
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-561?page=all ]
dhruba borthakur reassigned HADOOP-561:
---------------------------------------
Assignee: dhruba borthakur
> one replica of a file should be written locally if possible
> -----------------------------------------------------------
>
> Key: HADOOP-561
> URL: http://issues.apache.org/jira/browse/HADOOP-561
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Reporter: Yoram Arnon
> Assigned To: dhruba borthakur
>
> one replica of a file should be written locally if possible. That's currently not the case.
> Copying a 1GB file using hadoop dfs -cp running on one of the cluster nodes, all the blocks were written to remote nodes, as seen by fsck -files -blocks -locations on the newly created file.
> as long as there is sufficient space locally, a local copy has significant performance benefits.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-561) one replica of a file should be
written locally if possible
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-561?page=all ]
dhruba borthakur updated HADOOP-561:
------------------------------------
Status: Patch Available (was: Open)
TThis fixed two bugs in chooseTarget(0 that was causing the local machine to not get oicked as a replica. There was a comparision between UTF8 and String.
> one replica of a file should be written locally if possible
> -----------------------------------------------------------
>
> Key: HADOOP-561
> URL: http://issues.apache.org/jira/browse/HADOOP-561
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Reporter: Yoram Arnon
> Assigned To: dhruba borthakur
> Attachments: localreplica.patch
>
>
> one replica of a file should be written locally if possible. That's currently not the case.
> Copying a 1GB file using hadoop dfs -cp running on one of the cluster nodes, all the blocks were written to remote nodes, as seen by fsck -files -blocks -locations on the newly created file.
> as long as there is sufficient space locally, a local copy has significant performance benefits.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira