You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@apex.apache.org by Pradeep Kumbhar <pr...@datatorrent.com> on 2016/02/19 12:46:18 UTC

Copy data to HDFS with PAUSE and RESUME support

Hi,

I want to perform data copy to HDFS with pause and resume support. The
usecase is copying a large file from some filesystem (e.g. NFS) onto the
HDFS, but with the ability to stop anytime and next time continue from
wherever I left off earlier.
e.g. I have a *single* file of size 1TB and I finish copying 200GB of data
and stopped. When resumed next time, the copying should start again from
200GB onwards.

Can this be achieved using Apex?

*~pradeep*