You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Mukund Thakur (JIRA)" <ji...@apache.org> on 2018/06/07 10:20:00 UTC

[jira] [Assigned] (HDFS-13660) DistCp job fails when new data is appended in the file while the distCp copy job is running

     [ https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mukund Thakur reassigned HDFS-13660:
------------------------------------

    Assignee: Mukund Thakur

> DistCp job fails when new data is appended in the file while the distCp copy job is running
> -------------------------------------------------------------------------------------------
>
>                 Key: HDFS-13660
>                 URL: https://issues.apache.org/jira/browse/HDFS-13660
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: distcp
>            Reporter: Mukund Thakur
>            Assignee: Mukund Thakur
>            Priority: Critical
>         Attachments: distcp_failure_when_file_append.log
>
>
> Steps to reproduce: 
> Suppose distcp MR job is copying the file /tmp/web_returns_merged/data-m-002 and 
> we append some more data to this file using command 
> hadoop fs -appendToFile xaa  /tmp/web_returns_merged/data-m-002
> the job fails with exception 
>  Mismatch in length of source:hdfs://mycluster0/tmp/web_returns_merged/data-m-002 and target.
> Attached the logs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org