You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by unmesha sreeveni <un...@gmail.com> on 2014/01/14 09:34:00 UTC
Adding file to HDFs
How to add a *csv* file to hdfs using Mapreduce Code
Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do .
BUt i would like to write mapreduce code.
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
I tried to copy a 2.5 gb to hdfs. it took 3 -4 min.
Are we able to reduce that time.
On Tue, Jan 14, 2014 at 3:07 PM, unmesha sreeveni <un...@gmail.com>wrote:
> Thank you sudhakar
>
>
> On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
>>
>> Read file from local file system and write to file in HDFS using
>> *FSDataOutputStream*
>>
>> FSDataOutputStream outStream = fs.create(new
>> Path("demo.csv"););
>> outStream.writeUTF(stream);
>> outStream.close();
>>
>>
>> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>>
>>> How to add a *csv* file to hdfs using Mapreduce Code
>>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to
>>> do .
>>> BUt i would like to write mapreduce code.
>>>
>>> --
>>> *Thanks & Regards*
>>>
>>> Unmesha Sreeveni U.B
>>> Junior Developer
>>>
>>> http://www.unmeshasreeveni.blogspot.in/
>>>
>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
I tried to copy a 2.5 gb to hdfs. it took 3 -4 min.
Are we able to reduce that time.
On Tue, Jan 14, 2014 at 3:07 PM, unmesha sreeveni <un...@gmail.com>wrote:
> Thank you sudhakar
>
>
> On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
>>
>> Read file from local file system and write to file in HDFS using
>> *FSDataOutputStream*
>>
>> FSDataOutputStream outStream = fs.create(new
>> Path("demo.csv"););
>> outStream.writeUTF(stream);
>> outStream.close();
>>
>>
>> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>>
>>> How to add a *csv* file to hdfs using Mapreduce Code
>>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to
>>> do .
>>> BUt i would like to write mapreduce code.
>>>
>>> --
>>> *Thanks & Regards*
>>>
>>> Unmesha Sreeveni U.B
>>> Junior Developer
>>>
>>> http://www.unmeshasreeveni.blogspot.in/
>>>
>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
I tried to copy a 2.5 gb to hdfs. it took 3 -4 min.
Are we able to reduce that time.
On Tue, Jan 14, 2014 at 3:07 PM, unmesha sreeveni <un...@gmail.com>wrote:
> Thank you sudhakar
>
>
> On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
>>
>> Read file from local file system and write to file in HDFS using
>> *FSDataOutputStream*
>>
>> FSDataOutputStream outStream = fs.create(new
>> Path("demo.csv"););
>> outStream.writeUTF(stream);
>> outStream.close();
>>
>>
>> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>>
>>> How to add a *csv* file to hdfs using Mapreduce Code
>>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to
>>> do .
>>> BUt i would like to write mapreduce code.
>>>
>>> --
>>> *Thanks & Regards*
>>>
>>> Unmesha Sreeveni U.B
>>> Junior Developer
>>>
>>> http://www.unmeshasreeveni.blogspot.in/
>>>
>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
I tried to copy a 2.5 gb to hdfs. it took 3 -4 min.
Are we able to reduce that time.
On Tue, Jan 14, 2014 at 3:07 PM, unmesha sreeveni <un...@gmail.com>wrote:
> Thank you sudhakar
>
>
> On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
>>
>> Read file from local file system and write to file in HDFS using
>> *FSDataOutputStream*
>>
>> FSDataOutputStream outStream = fs.create(new
>> Path("demo.csv"););
>> outStream.writeUTF(stream);
>> outStream.close();
>>
>>
>> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>>
>>> How to add a *csv* file to hdfs using Mapreduce Code
>>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to
>>> do .
>>> BUt i would like to write mapreduce code.
>>>
>>> --
>>> *Thanks & Regards*
>>>
>>> Unmesha Sreeveni U.B
>>> Junior Developer
>>>
>>> http://www.unmeshasreeveni.blogspot.in/
>>>
>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
Thank you sudhakar
On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
> Read file from local file system and write to file in HDFS using
> *FSDataOutputStream*
>
> FSDataOutputStream outStream = fs.create(new
> Path("demo.csv"););
> outStream.writeUTF(stream);
> outStream.close();
>
>
> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>
>> How to add a *csv* file to hdfs using Mapreduce Code
>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do
>> .
>> BUt i would like to write mapreduce code.
>>
>> --
>> *Thanks & Regards*
>>
>> Unmesha Sreeveni U.B
>> Junior Developer
>>
>> http://www.unmeshasreeveni.blogspot.in/
>>
>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
Thank you sudhakar
On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
> Read file from local file system and write to file in HDFS using
> *FSDataOutputStream*
>
> FSDataOutputStream outStream = fs.create(new
> Path("demo.csv"););
> outStream.writeUTF(stream);
> outStream.close();
>
>
> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>
>> How to add a *csv* file to hdfs using Mapreduce Code
>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do
>> .
>> BUt i would like to write mapreduce code.
>>
>> --
>> *Thanks & Regards*
>>
>> Unmesha Sreeveni U.B
>> Junior Developer
>>
>> http://www.unmeshasreeveni.blogspot.in/
>>
>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
Thank you sudhakar
On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
> Read file from local file system and write to file in HDFS using
> *FSDataOutputStream*
>
> FSDataOutputStream outStream = fs.create(new
> Path("demo.csv"););
> outStream.writeUTF(stream);
> outStream.close();
>
>
> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>
>> How to add a *csv* file to hdfs using Mapreduce Code
>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do
>> .
>> BUt i would like to write mapreduce code.
>>
>> --
>> *Thanks & Regards*
>>
>> Unmesha Sreeveni U.B
>> Junior Developer
>>
>> http://www.unmeshasreeveni.blogspot.in/
>>
>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by unmesha sreeveni <un...@gmail.com>.
Thank you sudhakar
On Tue, Jan 14, 2014 at 2:51 PM, sudhakara st <su...@gmail.com>wrote:
>
> Read file from local file system and write to file in HDFS using
> *FSDataOutputStream*
>
> FSDataOutputStream outStream = fs.create(new
> Path("demo.csv"););
> outStream.writeUTF(stream);
> outStream.close();
>
>
> On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
>
>> How to add a *csv* file to hdfs using Mapreduce Code
>> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do
>> .
>> BUt i would like to write mapreduce code.
>>
>> --
>> *Thanks & Regards*
>>
>> Unmesha Sreeveni U.B
>> Junior Developer
>>
>> http://www.unmeshasreeveni.blogspot.in/
>>
>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: Adding file to HDFs
Posted by sudhakara st <su...@gmail.com>.
Read file from local file system and write to file in HDFS using
*FSDataOutputStream*
FSDataOutputStream outStream = fs.create(new Path("demo.csv"););
outStream.writeUTF(stream);
outStream.close();
On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
> How to add a *csv* file to hdfs using Mapreduce Code
> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do .
> BUt i would like to write mapreduce code.
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
Regards,
...Sudhakara.st
Re: Adding file to HDFs
Posted by sudhakara st <su...@gmail.com>.
Read file from local file system and write to file in HDFS using
*FSDataOutputStream*
FSDataOutputStream outStream = fs.create(new Path("demo.csv"););
outStream.writeUTF(stream);
outStream.close();
On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
> How to add a *csv* file to hdfs using Mapreduce Code
> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do .
> BUt i would like to write mapreduce code.
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
Regards,
...Sudhakara.st
Re: Adding file to HDFs
Posted by sudhakara st <su...@gmail.com>.
Read file from local file system and write to file in HDFS using
*FSDataOutputStream*
FSDataOutputStream outStream = fs.create(new Path("demo.csv"););
outStream.writeUTF(stream);
outStream.close();
On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
> How to add a *csv* file to hdfs using Mapreduce Code
> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do .
> BUt i would like to write mapreduce code.
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
Regards,
...Sudhakara.st
Re: Adding file to HDFs
Posted by sudhakara st <su...@gmail.com>.
Read file from local file system and write to file in HDFS using
*FSDataOutputStream*
FSDataOutputStream outStream = fs.create(new Path("demo.csv"););
outStream.writeUTF(stream);
outStream.close();
On Tue, Jan 14, 2014 at 2:04 PM, unmesha sreeveni <un...@gmail.com>wrote:
> How to add a *csv* file to hdfs using Mapreduce Code
> Using hadoop fs -copyFromLocal /local/path /hdfs/location i am able to do .
> BUt i would like to write mapreduce code.
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
> Junior Developer
>
> http://www.unmeshasreeveni.blogspot.in/
>
>
>
--
Regards,
...Sudhakara.st