You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2012/10/21 08:54:12 UTC
[jira] [Commented] (HDFS-4094) Specific file type bulk Transfer
into HDFS to a specified HDFS location with a track of the transfer number
[ https://issues.apache.org/jira/browse/HDFS-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13480910#comment-13480910 ]
Hadoop QA commented on HDFS-4094:
---------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12550170/hadoopBulkTransfer.txt
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3373//console
This message is automatically generated.
> Specific file type bulk Transfer into HDFS to a specified HDFS location with a track of the transfer number
> ------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-4094
> URL: https://issues.apache.org/jira/browse/HDFS-4094
> Project: Hadoop HDFS
> Issue Type: Wish
> Components: scripts
> Affects Versions: 3.0.0
> Environment: Unix
> Reporter: Anurag G Vyas
> Fix For: 3.0.0
>
> Attachments: hadoopBulkTransfer.txt
>
>
> Need a script for a bulk transfer process into HDFS in such a way that the script must be able to identify a specific file type and move only that file type into the specified HDFS location.
> For example : Say I have a local directory called user/dir . In it I have txt files such as anurag123 , anurag234, vyas678 , ganesh345 , anurag277 , vyas345 ganesh789 etc. The script must take 2 inputs. One is the file type , say anurag. And the other an HDFS location. Then it must move all the files which has the name anurag in the directory to the specified HDFS location.
> Also it would be good if the script could keep track of the number of files it moved to HDFS by saving the details in a new file either in HDFS or in the local directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira