You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Cristian Carranza <cr...@hotmail.com> on 2013/01/04 17:30:45 UTC
Hello and request some advice.
Hi all in this list!
My name is Cristián Carranza, a statistician and quality consultant that for the second time, intends to learn Hadoop and Big Data related issues.
I’am requesting advice in order to plan my learning.
I read the page “ Products that include Apache Hadoop or derivative works and Commercial Support”
but after that, I am still with doubts.
Please, as a newcomer, I want some advice about the following topics:
- I want to begin by learning how to find specified strings of text in a hiuge data set (csv, txt format, huge means 10 Gb.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
- Is there a way to learn Hadoop without a static IP address? That was really a problem for me when dealing with Infosphere, since I travel frequently.
That’s all for now.
Any help will be greatly appreciated.
thanks!
Cristián Carranza
Brazil.
Re: Hello and request some advice.
Posted by Jay Vyas <ja...@gmail.com>.
for the basics, all you need is a java IDE . Hadoop Map/Reduce can run in
local filesystem mode without any kind of HDFS backing.
On Fri, Jan 4, 2013 at 12:45 PM, Nitin Pawar <ni...@gmail.com>wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Following is the configuration i put in config.
core-site.xml
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
</property>
hdfs-site.xml
<property>
<name>dfs.name.dir</name>
<value>C:/cygwin/dfs/logs</value>
</property>
<property>
<name>dfs.data.dir</name>
<value>C:/cygwin/dfs/data</value>
</property>
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <ni...@gmail.com>wrote:
> what about other directories like hdfs directories and tmp directories ?
>
>
> On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Yes user owns the directory and had right permissions, still i don't
>> understand what could be the issue.
>>
>>
>> ls -ltr ~/hadoop-1.0.4/logs/history
>> total 0
>> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>>
>> Thanks
>> -Gangadhar
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> Does your user have permissions to read/write on the dfs directories you
>>> made?
>>>
>>> try changing the directory ownerships to the user which is running
>>> hadoop.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>>
>>>> Hi Nitin,
>>>>
>>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>>> following error in JobTracker logs. Do you have any advice?
>>>>
>>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>>> at
>>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>>> at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>>> Thanks
>>>> -Gangadhar
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>>
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>>
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>>> and you can use it with localhost all the time.
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>>
>>>>>> Hi all in this list!
>>>>>>
>>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>>> issues.
>>>>>> I’am requesting advice in order to plan my learning.
>>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>>> works and Commercial Support”
>>>>>> but after that, I am still with doubts.
>>>>>>
>>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>>
>>>>>> - I want to begin by learning how to find specified strings of text
>>>>>> in a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>>> - Is there a way to learn Hadoop without a static IP address? That
>>>>>> was really a problem for me when dealing with Infosphere, since I travel
>>>>>> frequently.
>>>>>>
>>>>>> That’s all for now.
>>>>>> Any help will be greatly appreciated.
>>>>>>
>>>>>> thanks!
>>>>>>
>>>>>> Cristián Carranza
>>>>>> Brazil.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nitin Pawar
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Following is the configuration i put in config.
core-site.xml
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
</property>
hdfs-site.xml
<property>
<name>dfs.name.dir</name>
<value>C:/cygwin/dfs/logs</value>
</property>
<property>
<name>dfs.data.dir</name>
<value>C:/cygwin/dfs/data</value>
</property>
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <ni...@gmail.com>wrote:
> what about other directories like hdfs directories and tmp directories ?
>
>
> On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Yes user owns the directory and had right permissions, still i don't
>> understand what could be the issue.
>>
>>
>> ls -ltr ~/hadoop-1.0.4/logs/history
>> total 0
>> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>>
>> Thanks
>> -Gangadhar
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> Does your user have permissions to read/write on the dfs directories you
>>> made?
>>>
>>> try changing the directory ownerships to the user which is running
>>> hadoop.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>>
>>>> Hi Nitin,
>>>>
>>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>>> following error in JobTracker logs. Do you have any advice?
>>>>
>>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>>> at
>>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>>> at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>>> Thanks
>>>> -Gangadhar
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>>
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>>
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>>> and you can use it with localhost all the time.
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>>
>>>>>> Hi all in this list!
>>>>>>
>>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>>> issues.
>>>>>> I’am requesting advice in order to plan my learning.
>>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>>> works and Commercial Support”
>>>>>> but after that, I am still with doubts.
>>>>>>
>>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>>
>>>>>> - I want to begin by learning how to find specified strings of text
>>>>>> in a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>>> - Is there a way to learn Hadoop without a static IP address? That
>>>>>> was really a problem for me when dealing with Infosphere, since I travel
>>>>>> frequently.
>>>>>>
>>>>>> That’s all for now.
>>>>>> Any help will be greatly appreciated.
>>>>>>
>>>>>> thanks!
>>>>>>
>>>>>> Cristián Carranza
>>>>>> Brazil.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nitin Pawar
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Following is the configuration i put in config.
core-site.xml
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
</property>
hdfs-site.xml
<property>
<name>dfs.name.dir</name>
<value>C:/cygwin/dfs/logs</value>
</property>
<property>
<name>dfs.data.dir</name>
<value>C:/cygwin/dfs/data</value>
</property>
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <ni...@gmail.com>wrote:
> what about other directories like hdfs directories and tmp directories ?
>
>
> On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Yes user owns the directory and had right permissions, still i don't
>> understand what could be the issue.
>>
>>
>> ls -ltr ~/hadoop-1.0.4/logs/history
>> total 0
>> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>>
>> Thanks
>> -Gangadhar
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> Does your user have permissions to read/write on the dfs directories you
>>> made?
>>>
>>> try changing the directory ownerships to the user which is running
>>> hadoop.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>>
>>>> Hi Nitin,
>>>>
>>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>>> following error in JobTracker logs. Do you have any advice?
>>>>
>>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>>> at
>>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>>> at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>>> Thanks
>>>> -Gangadhar
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>>
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>>
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>>> and you can use it with localhost all the time.
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>>
>>>>>> Hi all in this list!
>>>>>>
>>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>>> issues.
>>>>>> I’am requesting advice in order to plan my learning.
>>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>>> works and Commercial Support”
>>>>>> but after that, I am still with doubts.
>>>>>>
>>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>>
>>>>>> - I want to begin by learning how to find specified strings of text
>>>>>> in a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>>> - Is there a way to learn Hadoop without a static IP address? That
>>>>>> was really a problem for me when dealing with Infosphere, since I travel
>>>>>> frequently.
>>>>>>
>>>>>> That’s all for now.
>>>>>> Any help will be greatly appreciated.
>>>>>>
>>>>>> thanks!
>>>>>>
>>>>>> Cristián Carranza
>>>>>> Brazil.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nitin Pawar
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Following is the configuration i put in config.
core-site.xml
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
</property>
hdfs-site.xml
<property>
<name>dfs.name.dir</name>
<value>C:/cygwin/dfs/logs</value>
</property>
<property>
<name>dfs.data.dir</name>
<value>C:/cygwin/dfs/data</value>
</property>
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <ni...@gmail.com>wrote:
> what about other directories like hdfs directories and tmp directories ?
>
>
> On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Yes user owns the directory and had right permissions, still i don't
>> understand what could be the issue.
>>
>>
>> ls -ltr ~/hadoop-1.0.4/logs/history
>> total 0
>> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>>
>> Thanks
>> -Gangadhar
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> Does your user have permissions to read/write on the dfs directories you
>>> made?
>>>
>>> try changing the directory ownerships to the user which is running
>>> hadoop.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>>
>>>> Hi Nitin,
>>>>
>>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>>> following error in JobTracker logs. Do you have any advice?
>>>>
>>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>>> at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>>> at
>>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>>> at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>>> at
>>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>>> Thanks
>>>> -Gangadhar
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>>
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>>
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>>> and you can use it with localhost all the time.
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>>
>>>>>> Hi all in this list!
>>>>>>
>>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>>> issues.
>>>>>> I’am requesting advice in order to plan my learning.
>>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>>> works and Commercial Support”
>>>>>> but after that, I am still with doubts.
>>>>>>
>>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>>
>>>>>> - I want to begin by learning how to find specified strings of text
>>>>>> in a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>>> - Is there a way to learn Hadoop without a static IP address? That
>>>>>> was really a problem for me when dealing with Infosphere, since I travel
>>>>>> frequently.
>>>>>>
>>>>>> That’s all for now.
>>>>>> Any help will be greatly appreciated.
>>>>>>
>>>>>> thanks!
>>>>>>
>>>>>> Cristián Carranza
>>>>>> Brazil.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nitin Pawar
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
what about other directories like hdfs directories and tmp directories ?
On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Yes user owns the directory and had right permissions, still i don't
> understand what could be the issue.
>
>
> ls -ltr ~/hadoop-1.0.4/logs/history
> total 0
> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>
> Thanks
> -Gangadhar
>
>
>
>
>
>
>
>
> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> Does your user have permissions to read/write on the dfs directories you
>> made?
>>
>> try changing the directory ownerships to the user which is running
>> hadoop.
>>
>>
>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>
>>> Hi Nitin,
>>>
>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>> following error in JobTracker logs. Do you have any advice?
>>>
>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>> at
>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>> at
>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>> Thanks
>>> -Gangadhar
>>>
>>>
>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>> and you can use it with localhost all the time.
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>
>>>>> Hi all in this list!
>>>>>
>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>> issues.
>>>>> I’am requesting advice in order to plan my learning.
>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>> works and Commercial Support”
>>>>> but after that, I am still with doubts.
>>>>>
>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>
>>>>> - I want to begin by learning how to find specified strings of text in
>>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>>
>>>>> That’s all for now.
>>>>> Any help will be greatly appreciated.
>>>>>
>>>>> thanks!
>>>>>
>>>>> Cristián Carranza
>>>>> Brazil.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Nitin Pawar
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
what about other directories like hdfs directories and tmp directories ?
On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Yes user owns the directory and had right permissions, still i don't
> understand what could be the issue.
>
>
> ls -ltr ~/hadoop-1.0.4/logs/history
> total 0
> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>
> Thanks
> -Gangadhar
>
>
>
>
>
>
>
>
> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> Does your user have permissions to read/write on the dfs directories you
>> made?
>>
>> try changing the directory ownerships to the user which is running
>> hadoop.
>>
>>
>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>
>>> Hi Nitin,
>>>
>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>> following error in JobTracker logs. Do you have any advice?
>>>
>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>> at
>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>> at
>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>> Thanks
>>> -Gangadhar
>>>
>>>
>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>> and you can use it with localhost all the time.
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>
>>>>> Hi all in this list!
>>>>>
>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>> issues.
>>>>> I’am requesting advice in order to plan my learning.
>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>> works and Commercial Support”
>>>>> but after that, I am still with doubts.
>>>>>
>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>
>>>>> - I want to begin by learning how to find specified strings of text in
>>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>>
>>>>> That’s all for now.
>>>>> Any help will be greatly appreciated.
>>>>>
>>>>> thanks!
>>>>>
>>>>> Cristián Carranza
>>>>> Brazil.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Nitin Pawar
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
what about other directories like hdfs directories and tmp directories ?
On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Yes user owns the directory and had right permissions, still i don't
> understand what could be the issue.
>
>
> ls -ltr ~/hadoop-1.0.4/logs/history
> total 0
> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>
> Thanks
> -Gangadhar
>
>
>
>
>
>
>
>
> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> Does your user have permissions to read/write on the dfs directories you
>> made?
>>
>> try changing the directory ownerships to the user which is running
>> hadoop.
>>
>>
>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>
>>> Hi Nitin,
>>>
>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>> following error in JobTracker logs. Do you have any advice?
>>>
>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>> at
>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>> at
>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>> Thanks
>>> -Gangadhar
>>>
>>>
>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>> and you can use it with localhost all the time.
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>
>>>>> Hi all in this list!
>>>>>
>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>> issues.
>>>>> I’am requesting advice in order to plan my learning.
>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>> works and Commercial Support”
>>>>> but after that, I am still with doubts.
>>>>>
>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>
>>>>> - I want to begin by learning how to find specified strings of text in
>>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>>
>>>>> That’s all for now.
>>>>> Any help will be greatly appreciated.
>>>>>
>>>>> thanks!
>>>>>
>>>>> Cristián Carranza
>>>>> Brazil.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Nitin Pawar
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
what about other directories like hdfs directories and tmp directories ?
On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Yes user owns the directory and had right permissions, still i don't
> understand what could be the issue.
>
>
> ls -ltr ~/hadoop-1.0.4/logs/history
> total 0
> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
>
> Thanks
> -Gangadhar
>
>
>
>
>
>
>
>
> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> Does your user have permissions to read/write on the dfs directories you
>> made?
>>
>> try changing the directory ownerships to the user which is running
>> hadoop.
>>
>>
>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>>
>>> Hi Nitin,
>>>
>>> I tried latest stable Hadoop version on windows with cygwin, I see
>>> following error in JobTracker logs. Do you have any advice?
>>>
>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>> at
>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>> at
>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>> at
>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>> at
>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>> at java.security.AccessController.doPrivileged(Native Method)^M
>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>> at
>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>> Thanks
>>> -Gangadhar
>>>
>>>
>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>>
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>> and you can use it with localhost all the time.
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>
>>>>> Hi all in this list!
>>>>>
>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>> issues.
>>>>> I’am requesting advice in order to plan my learning.
>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>> works and Commercial Support”
>>>>> but after that, I am still with doubts.
>>>>>
>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>
>>>>> - I want to begin by learning how to find specified strings of text in
>>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>>
>>>>> That’s all for now.
>>>>> Any help will be greatly appreciated.
>>>>>
>>>>> thanks!
>>>>>
>>>>> Cristián Carranza
>>>>> Brazil.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Nitin Pawar
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Yes user owns the directory and had right permissions, still i don't
understand what could be the issue.
ls -ltr ~/hadoop-1.0.4/logs/history
total 0
drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com> wrote:
> Does your user have permissions to read/write on the dfs directories you
> made?
>
> try changing the directory ownerships to the user which is running hadoop.
>
>
> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Hi Nitin,
>>
>> I tried latest stable Hadoop version on windows with cygwin, I see
>> following error in JobTracker logs. Do you have any advice?
>>
>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>> at
>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>> at
>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>> at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>> at java.security.AccessController.doPrivileged(Native Method)^M
>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>> Thanks
>> -Gangadhar
>>
>>
>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>> If you got a laptop with you then thats all you need to learn hadoop.
>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>> and you can use it with localhost all the time.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>> cristiancarranza_1@hotmail.com> wrote:
>>>
>>>> Hi all in this list!
>>>>
>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>> issues.
>>>> I’am requesting advice in order to plan my learning.
>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>> works and Commercial Support”
>>>> but after that, I am still with doubts.
>>>>
>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>
>>>> - I want to begin by learning how to find specified strings of text in
>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>>
>>>> That’s all for now.
>>>> Any help will be greatly appreciated.
>>>>
>>>> thanks!
>>>>
>>>> Cristián Carranza
>>>> Brazil.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Yes user owns the directory and had right permissions, still i don't
understand what could be the issue.
ls -ltr ~/hadoop-1.0.4/logs/history
total 0
drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com> wrote:
> Does your user have permissions to read/write on the dfs directories you
> made?
>
> try changing the directory ownerships to the user which is running hadoop.
>
>
> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Hi Nitin,
>>
>> I tried latest stable Hadoop version on windows with cygwin, I see
>> following error in JobTracker logs. Do you have any advice?
>>
>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>> at
>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>> at
>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>> at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>> at java.security.AccessController.doPrivileged(Native Method)^M
>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>> Thanks
>> -Gangadhar
>>
>>
>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>> If you got a laptop with you then thats all you need to learn hadoop.
>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>> and you can use it with localhost all the time.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>> cristiancarranza_1@hotmail.com> wrote:
>>>
>>>> Hi all in this list!
>>>>
>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>> issues.
>>>> I’am requesting advice in order to plan my learning.
>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>> works and Commercial Support”
>>>> but after that, I am still with doubts.
>>>>
>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>
>>>> - I want to begin by learning how to find specified strings of text in
>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>>
>>>> That’s all for now.
>>>> Any help will be greatly appreciated.
>>>>
>>>> thanks!
>>>>
>>>> Cristián Carranza
>>>> Brazil.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Yes user owns the directory and had right permissions, still i don't
understand what could be the issue.
ls -ltr ~/hadoop-1.0.4/logs/history
total 0
drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com> wrote:
> Does your user have permissions to read/write on the dfs directories you
> made?
>
> try changing the directory ownerships to the user which is running hadoop.
>
>
> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Hi Nitin,
>>
>> I tried latest stable Hadoop version on windows with cygwin, I see
>> following error in JobTracker logs. Do you have any advice?
>>
>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>> at
>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>> at
>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>> at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>> at java.security.AccessController.doPrivileged(Native Method)^M
>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>> Thanks
>> -Gangadhar
>>
>>
>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>> If you got a laptop with you then thats all you need to learn hadoop.
>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>> and you can use it with localhost all the time.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>> cristiancarranza_1@hotmail.com> wrote:
>>>
>>>> Hi all in this list!
>>>>
>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>> issues.
>>>> I’am requesting advice in order to plan my learning.
>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>> works and Commercial Support”
>>>> but after that, I am still with doubts.
>>>>
>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>
>>>> - I want to begin by learning how to find specified strings of text in
>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>>
>>>> That’s all for now.
>>>> Any help will be greatly appreciated.
>>>>
>>>> thanks!
>>>>
>>>> Cristián Carranza
>>>> Brazil.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Yes user owns the directory and had right permissions, still i don't
understand what could be the issue.
ls -ltr ~/hadoop-1.0.4/logs/history
total 0
drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <ni...@gmail.com> wrote:
> Does your user have permissions to read/write on the dfs directories you
> made?
>
> try changing the directory ownerships to the user which is running hadoop.
>
>
> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
>
>> Hi Nitin,
>>
>> I tried latest stable Hadoop version on windows with cygwin, I see
>> following error in JobTracker logs. Do you have any advice?
>>
>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>> at
>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>> at
>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>> at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>> at
>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>> at java.security.AccessController.doPrivileged(Native Method)^M
>> at javax.security.auth.Subject.doAs(Subject.java:415)^M
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>> at
>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>> Thanks
>> -Gangadhar
>>
>>
>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>>
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>> If you got a laptop with you then thats all you need to learn hadoop.
>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>> and you can use it with localhost all the time.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>> cristiancarranza_1@hotmail.com> wrote:
>>>
>>>> Hi all in this list!
>>>>
>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>> issues.
>>>> I’am requesting advice in order to plan my learning.
>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>> works and Commercial Support”
>>>> but after that, I am still with doubts.
>>>>
>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>
>>>> - I want to begin by learning how to find specified strings of text in
>>>> a hiuge data set (csv, txt format, huge means 10 Gb.
>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>> really a problem for me when dealing with Infosphere, since I travel
>>>> frequently.
>>>>
>>>> That’s all for now.
>>>> Any help will be greatly appreciated.
>>>>
>>>> thanks!
>>>>
>>>> Cristián Carranza
>>>> Brazil.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
Does your user have permissions to read/write on the dfs directories you
made?
try changing the directory ownerships to the user which is running hadoop.
On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Hi Nitin,
>
> I tried latest stable Hadoop version on windows with cygwin, I see
> following error in JobTracker logs. Do you have any advice?
>
> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
> at java.security.AccessController.doPrivileged(Native Method)^M
> at javax.security.auth.Subject.doAs(Subject.java:415)^M
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
> Thanks
> -Gangadhar
>
>
> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> If you want a free O.S , ubuntu is good but if you are familiar with
>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>> If you got a laptop with you then thats all you need to learn hadoop.
>> Hadoop can be installed in a pseudo distributed mode on a single machine
>> and you can use it with localhost all the time.
>>
>>
>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>> cristiancarranza_1@hotmail.com> wrote:
>>
>>> Hi all in this list!
>>>
>>> My name is Cristián Carranza, a statistician and quality consultant that
>>> for the second time, intends to learn Hadoop and Big Data related issues.
>>> I’am requesting advice in order to plan my learning.
>>> I read the page “ Products that include Apache Hadoop or derivative
>>> works and Commercial Support”
>>> but after that, I am still with doubts.
>>>
>>> Please, as a newcomer, I want some advice about the following topics:
>>>
>>> - I want to begin by learning how to find specified strings of text in a
>>> hiuge data set (csv, txt format, huge means 10 Gb.
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>>
>>> That’s all for now.
>>> Any help will be greatly appreciated.
>>>
>>> thanks!
>>>
>>> Cristián Carranza
>>> Brazil.
>>>
>>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
Does your user have permissions to read/write on the dfs directories you
made?
try changing the directory ownerships to the user which is running hadoop.
On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Hi Nitin,
>
> I tried latest stable Hadoop version on windows with cygwin, I see
> following error in JobTracker logs. Do you have any advice?
>
> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
> at java.security.AccessController.doPrivileged(Native Method)^M
> at javax.security.auth.Subject.doAs(Subject.java:415)^M
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
> Thanks
> -Gangadhar
>
>
> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> If you want a free O.S , ubuntu is good but if you are familiar with
>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>> If you got a laptop with you then thats all you need to learn hadoop.
>> Hadoop can be installed in a pseudo distributed mode on a single machine
>> and you can use it with localhost all the time.
>>
>>
>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>> cristiancarranza_1@hotmail.com> wrote:
>>
>>> Hi all in this list!
>>>
>>> My name is Cristián Carranza, a statistician and quality consultant that
>>> for the second time, intends to learn Hadoop and Big Data related issues.
>>> I’am requesting advice in order to plan my learning.
>>> I read the page “ Products that include Apache Hadoop or derivative
>>> works and Commercial Support”
>>> but after that, I am still with doubts.
>>>
>>> Please, as a newcomer, I want some advice about the following topics:
>>>
>>> - I want to begin by learning how to find specified strings of text in a
>>> hiuge data set (csv, txt format, huge means 10 Gb.
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>>
>>> That’s all for now.
>>> Any help will be greatly appreciated.
>>>
>>> thanks!
>>>
>>> Cristián Carranza
>>> Brazil.
>>>
>>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
Does your user have permissions to read/write on the dfs directories you
made?
try changing the directory ownerships to the user which is running hadoop.
On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Hi Nitin,
>
> I tried latest stable Hadoop version on windows with cygwin, I see
> following error in JobTracker logs. Do you have any advice?
>
> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
> at java.security.AccessController.doPrivileged(Native Method)^M
> at javax.security.auth.Subject.doAs(Subject.java:415)^M
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
> Thanks
> -Gangadhar
>
>
> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> If you want a free O.S , ubuntu is good but if you are familiar with
>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>> If you got a laptop with you then thats all you need to learn hadoop.
>> Hadoop can be installed in a pseudo distributed mode on a single machine
>> and you can use it with localhost all the time.
>>
>>
>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>> cristiancarranza_1@hotmail.com> wrote:
>>
>>> Hi all in this list!
>>>
>>> My name is Cristián Carranza, a statistician and quality consultant that
>>> for the second time, intends to learn Hadoop and Big Data related issues.
>>> I’am requesting advice in order to plan my learning.
>>> I read the page “ Products that include Apache Hadoop or derivative
>>> works and Commercial Support”
>>> but after that, I am still with doubts.
>>>
>>> Please, as a newcomer, I want some advice about the following topics:
>>>
>>> - I want to begin by learning how to find specified strings of text in a
>>> hiuge data set (csv, txt format, huge means 10 Gb.
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>>
>>> That’s all for now.
>>> Any help will be greatly appreciated.
>>>
>>> thanks!
>>>
>>> Cristián Carranza
>>> Brazil.
>>>
>>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
Does your user have permissions to read/write on the dfs directories you
made?
try changing the directory ownerships to the user which is running hadoop.
On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <us...@gmail.com>wrote:
> Hi Nitin,
>
> I tried latest stable Hadoop version on windows with cygwin, I see
> following error in JobTracker logs. Do you have any advice?
>
> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
> at
> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
> at java.security.AccessController.doPrivileged(Native Method)^M
> at javax.security.auth.Subject.doAs(Subject.java:415)^M
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
> at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
> Thanks
> -Gangadhar
>
>
> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> If you want a free O.S , ubuntu is good but if you are familiar with
>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>> If you got a laptop with you then thats all you need to learn hadoop.
>> Hadoop can be installed in a pseudo distributed mode on a single machine
>> and you can use it with localhost all the time.
>>
>>
>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>> cristiancarranza_1@hotmail.com> wrote:
>>
>>> Hi all in this list!
>>>
>>> My name is Cristián Carranza, a statistician and quality consultant that
>>> for the second time, intends to learn Hadoop and Big Data related issues.
>>> I’am requesting advice in order to plan my learning.
>>> I read the page “ Products that include Apache Hadoop or derivative
>>> works and Commercial Support”
>>> but after that, I am still with doubts.
>>>
>>> Please, as a newcomer, I want some advice about the following topics:
>>>
>>> - I want to begin by learning how to find specified strings of text in a
>>> hiuge data set (csv, txt format, huge means 10 Gb.
>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>> - Is there a way to learn Hadoop without a static IP address? That was
>>> really a problem for me when dealing with Infosphere, since I travel
>>> frequently.
>>>
>>> That’s all for now.
>>> Any help will be greatly appreciated.
>>>
>>> thanks!
>>>
>>> Cristián Carranza
>>> Brazil.
>>>
>>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Hi Nitin,
I tried latest stable Hadoop version on windows with cygwin, I see
following error in JobTracker logs. Do you have any advice?
C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
at
org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
at java.security.AccessController.doPrivileged(Native Method)^M
at javax.security.auth.Subject.doAs(Subject.java:415)^M
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com> wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Michael Segel <mi...@hotmail.com>.
Uhm...
Well, you can talk to Microsoft and Hortonworks about Microsoft as a platform.
Depending on the power of your laptop, you could create a VM and run hadoop in a pseudo distributed mode there.
You could also get an Amazon Web Services account and build a small cluster via EMR...
In terms of OS, Centos is free and its a solid platform for Hadoop.
You could then download Cloudera's CHDx and run it in a pseudo distributed cluster on a single node.
Lots of options...
On Jan 4, 2013, at 1:27 PM, John Lilley <jo...@redpoint.net> wrote:
> I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
> Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
> John
>
> From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
> Sent: Friday, January 04, 2013 12:19 PM
> To: user@hadoop.apache.org
> Subject: RE: Hello and request some advice.
>
> Hi john,
> which would be a better option between Linux and windows from learning perspective of Hadoop?
>
> --- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
>
> John
>
Re: Hello and request some advice.
Posted by Michael Segel <mi...@hotmail.com>.
Uhm...
Well, you can talk to Microsoft and Hortonworks about Microsoft as a platform.
Depending on the power of your laptop, you could create a VM and run hadoop in a pseudo distributed mode there.
You could also get an Amazon Web Services account and build a small cluster via EMR...
In terms of OS, Centos is free and its a solid platform for Hadoop.
You could then download Cloudera's CHDx and run it in a pseudo distributed cluster on a single node.
Lots of options...
On Jan 4, 2013, at 1:27 PM, John Lilley <jo...@redpoint.net> wrote:
> I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
> Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
> John
>
> From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
> Sent: Friday, January 04, 2013 12:19 PM
> To: user@hadoop.apache.org
> Subject: RE: Hello and request some advice.
>
> Hi john,
> which would be a better option between Linux and windows from learning perspective of Hadoop?
>
> --- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
>
> John
>
Re: Hello and request some advice.
Posted by Michael Segel <mi...@hotmail.com>.
Uhm...
Well, you can talk to Microsoft and Hortonworks about Microsoft as a platform.
Depending on the power of your laptop, you could create a VM and run hadoop in a pseudo distributed mode there.
You could also get an Amazon Web Services account and build a small cluster via EMR...
In terms of OS, Centos is free and its a solid platform for Hadoop.
You could then download Cloudera's CHDx and run it in a pseudo distributed cluster on a single node.
Lots of options...
On Jan 4, 2013, at 1:27 PM, John Lilley <jo...@redpoint.net> wrote:
> I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
> Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
> John
>
> From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
> Sent: Friday, January 04, 2013 12:19 PM
> To: user@hadoop.apache.org
> Subject: RE: Hello and request some advice.
>
> Hi john,
> which would be a better option between Linux and windows from learning perspective of Hadoop?
>
> --- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
>
> John
>
Re: Hello and request some advice.
Posted by Michael Segel <mi...@hotmail.com>.
Uhm...
Well, you can talk to Microsoft and Hortonworks about Microsoft as a platform.
Depending on the power of your laptop, you could create a VM and run hadoop in a pseudo distributed mode there.
You could also get an Amazon Web Services account and build a small cluster via EMR...
In terms of OS, Centos is free and its a solid platform for Hadoop.
You could then download Cloudera's CHDx and run it in a pseudo distributed cluster on a single node.
Lots of options...
On Jan 4, 2013, at 1:27 PM, John Lilley <jo...@redpoint.net> wrote:
> I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
> Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
> John
>
> From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
> Sent: Friday, January 04, 2013 12:19 PM
> To: user@hadoop.apache.org
> Subject: RE: Hello and request some advice.
>
> Hi john,
> which would be a better option between Linux and windows from learning perspective of Hadoop?
>
> --- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
>
> John
>
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
John
From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
Sent: Friday, January 04, 2013 12:19 PM
To: user@hadoop.apache.org
Subject: RE: Hello and request some advice.
Hi john,
which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net>> wrote:
From: John Lilley <jo...@redpoint.net>>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
John
From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
Sent: Friday, January 04, 2013 12:19 PM
To: user@hadoop.apache.org
Subject: RE: Hello and request some advice.
Hi john,
which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net>> wrote:
From: John Lilley <jo...@redpoint.net>>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
John
From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
Sent: Friday, January 04, 2013 12:19 PM
To: user@hadoop.apache.org
Subject: RE: Hello and request some advice.
Hi john,
which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net>> wrote:
From: John Lilley <jo...@redpoint.net>>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development.
Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it.
John
From: Rajeev Yadav [mailto:rajeev_vnsi@yahoo.com]
Sent: Friday, January 04, 2013 12:19 PM
To: user@hadoop.apache.org
Subject: RE: Hello and request some advice.
Hi john,
which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net>> wrote:
From: John Lilley <jo...@redpoint.net>>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
Re: Hello and request some advice.
Posted by Glen Mazza <gm...@talend.com>.
I would say Linux, because in your job you're most likely going to use a
*nix-type system instead of Windows for hosting Hadoop, so it's good to
gain experience with whatever headaches come along. Further, you're
also learning Linux simultaneously, killing two birds with one stone.
Glen
On 01/04/2013 02:18 PM, Rajeev Yadav wrote:
> Hi john,
> which would be a better option between Linux and windows from
> learning perspective of Hadoop?
>
> --- On *Fri, 4/1/13, John Lilley /<jo...@redpoint.net>/*wrote:
>
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete
> clone of the RHEL distro.
>
> John
>
> *From:*Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Friday, January 04, 2013 10:46 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Hello and request some advice.
>
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn
> in the past using Red Hat & Infosphere Biginsights, but I need a
> free O.S.
>
> If you want a free O.S , ubuntu is good but if you are familiar
> with RedHat then you may want to have look at Scientific Linux
> (Its free as well)
>
--
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
Re: Hello and request some advice.
Posted by Glen Mazza <gm...@talend.com>.
I would say Linux, because in your job you're most likely going to use a
*nix-type system instead of Windows for hosting Hadoop, so it's good to
gain experience with whatever headaches come along. Further, you're
also learning Linux simultaneously, killing two birds with one stone.
Glen
On 01/04/2013 02:18 PM, Rajeev Yadav wrote:
> Hi john,
> which would be a better option between Linux and windows from
> learning perspective of Hadoop?
>
> --- On *Fri, 4/1/13, John Lilley /<jo...@redpoint.net>/*wrote:
>
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete
> clone of the RHEL distro.
>
> John
>
> *From:*Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Friday, January 04, 2013 10:46 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Hello and request some advice.
>
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn
> in the past using Red Hat & Infosphere Biginsights, but I need a
> free O.S.
>
> If you want a free O.S , ubuntu is good but if you are familiar
> with RedHat then you may want to have look at Scientific Linux
> (Its free as well)
>
--
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
Re: Hello and request some advice.
Posted by Glen Mazza <gm...@talend.com>.
I would say Linux, because in your job you're most likely going to use a
*nix-type system instead of Windows for hosting Hadoop, so it's good to
gain experience with whatever headaches come along. Further, you're
also learning Linux simultaneously, killing two birds with one stone.
Glen
On 01/04/2013 02:18 PM, Rajeev Yadav wrote:
> Hi john,
> which would be a better option between Linux and windows from
> learning perspective of Hadoop?
>
> --- On *Fri, 4/1/13, John Lilley /<jo...@redpoint.net>/*wrote:
>
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete
> clone of the RHEL distro.
>
> John
>
> *From:*Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Friday, January 04, 2013 10:46 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Hello and request some advice.
>
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn
> in the past using Red Hat & Infosphere Biginsights, but I need a
> free O.S.
>
> If you want a free O.S , ubuntu is good but if you are familiar
> with RedHat then you may want to have look at Scientific Linux
> (Its free as well)
>
--
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
Re: Hello and request some advice.
Posted by Glen Mazza <gm...@talend.com>.
I would say Linux, because in your job you're most likely going to use a
*nix-type system instead of Windows for hosting Hadoop, so it's good to
gain experience with whatever headaches come along. Further, you're
also learning Linux simultaneously, killing two birds with one stone.
Glen
On 01/04/2013 02:18 PM, Rajeev Yadav wrote:
> Hi john,
> which would be a better option between Linux and windows from
> learning perspective of Hadoop?
>
> --- On *Fri, 4/1/13, John Lilley /<jo...@redpoint.net>/*wrote:
>
>
> From: John Lilley <jo...@redpoint.net>
> Subject: RE: Hello and request some advice.
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Friday, 4 January, 2013, 6:12 PM
>
> If you like RedHat, consider Centos also; it is a nearly-complete
> clone of the RHEL distro.
>
> John
>
> *From:*Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Friday, January 04, 2013 10:46 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Hello and request some advice.
>
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn
> in the past using Red Hat & Infosphere Biginsights, but I need a
> free O.S.
>
> If you want a free O.S , ubuntu is good but if you are familiar
> with RedHat then you may want to have look at Scientific Linux
> (Its free as well)
>
--
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
RE: Hello and request some advice.
Posted by Rajeev Yadav <ra...@yahoo.com>.
Hi john,which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
From: John Lilley <jo...@redpoint.net>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
RE: Hello and request some advice.
Posted by Rajeev Yadav <ra...@yahoo.com>.
Hi john,which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
From: John Lilley <jo...@redpoint.net>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
RE: Hello and request some advice.
Posted by Rajeev Yadav <ra...@yahoo.com>.
Hi john,which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
From: John Lilley <jo...@redpoint.net>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
RE: Hello and request some advice.
Posted by Rajeev Yadav <ra...@yahoo.com>.
Hi john,which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <jo...@redpoint.net> wrote:
From: John Lilley <jo...@redpoint.net>
Subject: RE: Hello and request some advice.
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I've tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
Re: Hello and request some advice.
Posted by Jay Vyas <ja...@gmail.com>.
for the basics, all you need is a java IDE . Hadoop Map/Reduce can run in
local filesystem mode without any kind of HDFS backing.
On Fri, Jan 4, 2013 at 12:45 PM, Nitin Pawar <ni...@gmail.com>wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Hello and request some advice.
Posted by Jay Vyas <ja...@gmail.com>.
for the basics, all you need is a java IDE . Hadoop Map/Reduce can run in
local filesystem mode without any kind of HDFS backing.
On Fri, Jan 4, 2013 at 12:45 PM, Nitin Pawar <ni...@gmail.com>wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Hello and request some advice.
Posted by Jay Vyas <ja...@gmail.com>.
for the basics, all you need is a java IDE . Hadoop Map/Reduce can run in
local filesystem mode without any kind of HDFS backing.
On Fri, Jan 4, 2013 at 12:45 PM, Nitin Pawar <ni...@gmail.com>wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
--
Jay Vyas
http://jayunit100.blogspot.com
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I've tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Hi Nitin,
I tried latest stable Hadoop version on windows with cygwin, I see
following error in JobTracker logs. Do you have any advice?
C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
at
org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
at java.security.AccessController.doPrivileged(Native Method)^M
at javax.security.auth.Subject.doAs(Subject.java:415)^M
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com> wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I've tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
RE: Hello and request some advice.
Posted by John Lilley <jo...@redpoint.net>.
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Friday, January 04, 2013 10:46 AM
To: user@hadoop.apache.org
Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I've tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Hi Nitin,
I tried latest stable Hadoop version on windows with cygwin, I see
following error in JobTracker logs. Do you have any advice?
C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
at
org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
at java.security.AccessController.doPrivileged(Native Method)^M
at javax.security.auth.Subject.doAs(Subject.java:415)^M
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com> wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Gangadhar Ramini <us...@gmail.com>.
Hi Nitin,
I tried latest stable Hadoop version on windows with cygwin, I see
following error in JobTracker logs. Do you have any advice?
C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
at
org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
at java.security.AccessController.doPrivileged(Native Method)^M
at javax.security.auth.Subject.doAs(Subject.java:415)^M
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
at
org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <ni...@gmail.com> wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> If you want a free O.S , ubuntu is good but if you are familiar with
> RedHat then you may want to have look at Scientific Linux (Its free as well)
>
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
> If you got a laptop with you then thats all you need to learn hadoop.
> Hadoop can be installed in a pseudo distributed mode on a single machine
> and you can use it with localhost all the time.
>
>
> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
> cristiancarranza_1@hotmail.com> wrote:
>
>> Hi all in this list!
>>
>> My name is Cristián Carranza, a statistician and quality consultant that
>> for the second time, intends to learn Hadoop and Big Data related issues.
>> I’am requesting advice in order to plan my learning.
>> I read the page “ Products that include Apache Hadoop or derivative
>> works and Commercial Support”
>> but after that, I am still with doubts.
>>
>> Please, as a newcomer, I want some advice about the following topics:
>>
>> - I want to begin by learning how to find specified strings of text in a
>> hiuge data set (csv, txt format, huge means 10 Gb.
>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
>> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>> - Is there a way to learn Hadoop without a static IP address? That was
>> really a problem for me when dealing with Infosphere, since I travel
>> frequently.
>>
>> That’s all for now.
>> Any help will be greatly appreciated.
>>
>> thanks!
>>
>> Cristián Carranza
>> Brazil.
>>
>>
>
>
>
> --
> Nitin Pawar
>
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat
then you may want to have look at Scientific Linux (Its free as well)
- Is there a way to learn Hadoop without a static IP address? That was
really a problem for me when dealing with Infosphere, since I travel
frequently.
If you got a laptop with you then thats all you need to learn hadoop.
Hadoop can be installed in a pseudo distributed mode on a single machine
and you can use it with localhost all the time.
On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
cristiancarranza_1@hotmail.com> wrote:
> Hi all in this list!
>
> My name is Cristián Carranza, a statistician and quality consultant that
> for the second time, intends to learn Hadoop and Big Data related issues.
> I’am requesting advice in order to plan my learning.
> I read the page “ Products that include Apache Hadoop or derivative works
> and Commercial Support”
> but after that, I am still with doubts.
>
> Please, as a newcomer, I want some advice about the following topics:
>
> - I want to begin by learning how to find specified strings of text in a
> hiuge data set (csv, txt format, huge means 10 Gb.
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
>
> That’s all for now.
> Any help will be greatly appreciated.
>
> thanks!
>
> Cristián Carranza
> Brazil.
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat
then you may want to have look at Scientific Linux (Its free as well)
- Is there a way to learn Hadoop without a static IP address? That was
really a problem for me when dealing with Infosphere, since I travel
frequently.
If you got a laptop with you then thats all you need to learn hadoop.
Hadoop can be installed in a pseudo distributed mode on a single machine
and you can use it with localhost all the time.
On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
cristiancarranza_1@hotmail.com> wrote:
> Hi all in this list!
>
> My name is Cristián Carranza, a statistician and quality consultant that
> for the second time, intends to learn Hadoop and Big Data related issues.
> I’am requesting advice in order to plan my learning.
> I read the page “ Products that include Apache Hadoop or derivative works
> and Commercial Support”
> but after that, I am still with doubts.
>
> Please, as a newcomer, I want some advice about the following topics:
>
> - I want to begin by learning how to find specified strings of text in a
> hiuge data set (csv, txt format, huge means 10 Gb.
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
>
> That’s all for now.
> Any help will be greatly appreciated.
>
> thanks!
>
> Cristián Carranza
> Brazil.
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat
then you may want to have look at Scientific Linux (Its free as well)
- Is there a way to learn Hadoop without a static IP address? That was
really a problem for me when dealing with Infosphere, since I travel
frequently.
If you got a laptop with you then thats all you need to learn hadoop.
Hadoop can be installed in a pseudo distributed mode on a single machine
and you can use it with localhost all the time.
On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
cristiancarranza_1@hotmail.com> wrote:
> Hi all in this list!
>
> My name is Cristián Carranza, a statistician and quality consultant that
> for the second time, intends to learn Hadoop and Big Data related issues.
> I’am requesting advice in order to plan my learning.
> I read the page “ Products that include Apache Hadoop or derivative works
> and Commercial Support”
> but after that, I am still with doubts.
>
> Please, as a newcomer, I want some advice about the following topics:
>
> - I want to begin by learning how to find specified strings of text in a
> hiuge data set (csv, txt format, huge means 10 Gb.
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
>
> That’s all for now.
> Any help will be greatly appreciated.
>
> thanks!
>
> Cristián Carranza
> Brazil.
>
>
--
Nitin Pawar
Re: Hello and request some advice.
Posted by Nitin Pawar <ni...@gmail.com>.
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
past using Red Hat & Infosphere Biginsights, but I need a free O.S.
If you want a free O.S , ubuntu is good but if you are familiar with RedHat
then you may want to have look at Scientific Linux (Its free as well)
- Is there a way to learn Hadoop without a static IP address? That was
really a problem for me when dealing with Infosphere, since I travel
frequently.
If you got a laptop with you then thats all you need to learn hadoop.
Hadoop can be installed in a pseudo distributed mode on a single machine
and you can use it with localhost all the time.
On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
cristiancarranza_1@hotmail.com> wrote:
> Hi all in this list!
>
> My name is Cristián Carranza, a statistician and quality consultant that
> for the second time, intends to learn Hadoop and Big Data related issues.
> I’am requesting advice in order to plan my learning.
> I read the page “ Products that include Apache Hadoop or derivative works
> and Commercial Support”
> but after that, I am still with doubts.
>
> Please, as a newcomer, I want some advice about the following topics:
>
> - I want to begin by learning how to find specified strings of text in a
> hiuge data set (csv, txt format, huge means 10 Gb.
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the
> past using Red Hat & Infosphere Biginsights, but I need a free O.S.
> - Is there a way to learn Hadoop without a static IP address? That was
> really a problem for me when dealing with Infosphere, since I travel
> frequently.
>
> That’s all for now.
> Any help will be greatly appreciated.
>
> thanks!
>
> Cristián Carranza
> Brazil.
>
>
--
Nitin Pawar