[GitHub] [hadoop] symious commented on pull request #5603: HADOOP-18723. Add detail logs if distcp checksum mismatch

["symious (via GitHub)" <gi...@apache.org>]

symious commented on PR #5603:
URL: https://github.com/apache/hadoop/pull/5603#issuecomment-1532347000

   The issue we met was not "source file needs copying again", but source file uploaded with a different checksum type.
   
   Because it's distcp, so the temp file was removed after the exception. We need to first skip the crc check, then run "hadoop fs -checksum" on the source file and target file to find out the root cause of this one. 
   
   The initial idea of this addition of log was to help others with the same issue to save to process of redundant works and just check the log for mismatch reasons.
   
   @steveloughran @ayushtkn 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org