You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Dave Thompson (Created) (JIRA)" <ji...@apache.org> on 2012/03/06 17:18:58 UTC
[jira] [Created] (HADOOP-8143) Change distcp to have -pb on by
default
Change distcp to have -pb on by default
---------------------------------------
Key: HADOOP-8143
URL: https://issues.apache.org/jira/browse/HADOOP-8143
Project: Hadoop Common
Issue Type: Improvement
Reporter: Dave Thompson
Assignee: Dave Thompson
Priority: Minor
We should have the preserve blocksize (-pb) on in distcp by default.
checksum which is on by default will always fail if blocksize is not the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-8143) Change distcp to have -pb on by
default
Posted by "Dave Thompson (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dave Thompson resolved HADOOP-8143.
-----------------------------------
Resolution: Won't Fix
Closing out issue for an alternate approach.
> Change distcp to have -pb on by default
> ---------------------------------------
>
> Key: HADOOP-8143
> URL: https://issues.apache.org/jira/browse/HADOOP-8143
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Dave Thompson
> Assignee: Dave Thompson
> Priority: Minor
>
> We should have the preserve blocksize (-pb) on in distcp by default.
> checksum which is on by default will always fail if blocksize is not the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8143) Change distcp to have -pb on by
default
Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223962#comment-13223962 ]
Aaron T. Myers commented on HADOOP-8143:
----------------------------------------
Hey Dave, can you comment on what version of Hadoop you were running where you encountered this issue? If so, could you please update the "affects version" and "target version" fields? Thanks a lot.
> Change distcp to have -pb on by default
> ---------------------------------------
>
> Key: HADOOP-8143
> URL: https://issues.apache.org/jira/browse/HADOOP-8143
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Dave Thompson
> Assignee: Dave Thompson
> Priority: Minor
>
> We should have the preserve blocksize (-pb) on in distcp by default.
> checksum which is on by default will always fail if blocksize is not the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8143) Change distcp to have -pb on by
default
Posted by "Allen Wittenauer (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225570#comment-13225570 ]
Allen Wittenauer commented on HADOOP-8143:
------------------------------------------
Checksuming should get fixed vs. forcing the block size. I suspect forcing block size will break non-HDFS methods in surprising ways.
> Change distcp to have -pb on by default
> ---------------------------------------
>
> Key: HADOOP-8143
> URL: https://issues.apache.org/jira/browse/HADOOP-8143
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Dave Thompson
> Assignee: Dave Thompson
> Priority: Minor
>
> We should have the preserve blocksize (-pb) on in distcp by default.
> checksum which is on by default will always fail if blocksize is not the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8143) Change distcp to have -pb on by
default
Posted by "Dave Thompson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13242823#comment-13242823 ]
Dave Thompson commented on HADOOP-8143:
---------------------------------------
Sounds good Allen. I've considered your comment and decided on an alternate approach. I've created HADOOP-8233, which targets dropping checksum on different blocksize between source and target.
> Change distcp to have -pb on by default
> ---------------------------------------
>
> Key: HADOOP-8143
> URL: https://issues.apache.org/jira/browse/HADOOP-8143
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Dave Thompson
> Assignee: Dave Thompson
> Priority: Minor
>
> We should have the preserve blocksize (-pb) on in distcp by default.
> checksum which is on by default will always fail if blocksize is not the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira