You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by lei liu <li...@gmail.com> on 2012/11/04 09:06:26 UTC
same edits file is loaded more than once
I am using hadoop0.20.2, now I want to use HDFS HA function. I research
AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
StandbyNN do checkpoint, the same edits file is loaded again. Can same
edits file be loaded more than once in hadoop0.20.2?
if not, what is the harm?
Thanks,
LiuLei
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
Hi Coli,
Thank you very much for your reply.
I am researching the hadoop2.0 code, I find there are below code in
FSEditLogLoader.loadEditRecords method.
<code>
if (op.hasTransactionId()) {
if (op.getTransactionId() > expectedTxId) {
MetaRecoveryContext.editLogLoaderPrompt("There appears " +
"to be a gap in the edit log. We expected txid " +
expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery, "ignoring missing
" +
" transaction IDs");
} *else if (op.getTransactionId() < expectedTxId) {
MetaRecoveryContext.**editLogLoaderPrompt("There appears " +
"to be an out-of-order edit in the edit log. We " +
"expected txid " + expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery,
"skipping the out-of-order edit");
continue;*
}
}
</code>
The method use transaction id to **guarantee same transaction log is not
applied to namespace more than once.
I am using hadoop-0.20.2, that don't store the transaction id to edits log
file.
So I want to know if StandbyNN apply same edits log file many times to
namespace, that will lead to the namespace of StandbyNN is corrupt?
2012/11/8 Colin McCabe <cm...@alumni.cmu.edu>
> Hi,
>
> If you want to learn more about HA in HDFS, here are some slides from
> a talk that Aaron T. Meyers and Suresh Srinivas gave:
> http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
>
> branch-2 and later contain HDFS HA.
>
> cheers,
> Colin
>
>
> On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> > I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> > AvatarNode. I find if the StandbyNN do checkpoint fail, when next time
> the
> > StandbyNN do checkpoint, the same edits file is loaded again. Can same
> > edits file be loaded more than once in hadoop0.20.2?
> > if not, what is the harm?
> >
> > Thanks,
> >
> > LiuLei
> >
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
Hi Coli,
Thank you very much for your reply.
I am researching the hadoop2.0 code, I find there are below code in
FSEditLogLoader.loadEditRecords method.
<code>
if (op.hasTransactionId()) {
if (op.getTransactionId() > expectedTxId) {
MetaRecoveryContext.editLogLoaderPrompt("There appears " +
"to be a gap in the edit log. We expected txid " +
expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery, "ignoring missing
" +
" transaction IDs");
} *else if (op.getTransactionId() < expectedTxId) {
MetaRecoveryContext.**editLogLoaderPrompt("There appears " +
"to be an out-of-order edit in the edit log. We " +
"expected txid " + expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery,
"skipping the out-of-order edit");
continue;*
}
}
</code>
The method use transaction id to **guarantee same transaction log is not
applied to namespace more than once.
I am using hadoop-0.20.2, that don't store the transaction id to edits log
file.
So I want to know if StandbyNN apply same edits log file many times to
namespace, that will lead to the namespace of StandbyNN is corrupt?
2012/11/8 Colin McCabe <cm...@alumni.cmu.edu>
> Hi,
>
> If you want to learn more about HA in HDFS, here are some slides from
> a talk that Aaron T. Meyers and Suresh Srinivas gave:
> http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
>
> branch-2 and later contain HDFS HA.
>
> cheers,
> Colin
>
>
> On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> > I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> > AvatarNode. I find if the StandbyNN do checkpoint fail, when next time
> the
> > StandbyNN do checkpoint, the same edits file is loaded again. Can same
> > edits file be loaded more than once in hadoop0.20.2?
> > if not, what is the harm?
> >
> > Thanks,
> >
> > LiuLei
> >
>
Re: Ubuntu 12.04 - Which JDK? and some more
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
After spending time to research Hadoop and Hbase JDK requirements, here is my advice about using Ubuntu 12.04:
1) If you plan to use HBase on Hadoop HDFS, do note that HBase will run on Oracle's JDK only, so do NOT use OpenJDK or other JDKs for the setup.
2) When installing Ubuntu, should NOT use LVM (Linux Logical Volume Manager) for Hadoop data disks! (There will be performance issue between the filesystem and the device, LVM is the default for some Linux package, be careful not to select LVM)
regards
On 8 Nov 2012, at 6:12 PM, ac@hsk.hk wrote:
> Hi, thank you for your info and will head for it. Thanks.
> On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
>
>> Hi there,
>>
>> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>>
>> 1. Download the zipped file and extract it.
>>
>> 2. chmod +x jdk-6u37-linux-x64.bin
>>
>> 3. ./jdk-6u37-linux-x64.bin
>>
>> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>>
>> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>>
>> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>>
>> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>>
>> Then choose which java to use :
>>
>> sudo update-alternatives --config java
>>
>> choose the no for java6
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
>> Thanks Harsh,
>>
>> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>>
>> Thanks
>>
>>
>> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>>
>> > Hi Sanjeev,
>> >
>> > Unfortunately, official Ubuntu repositories no longer supports Oracle
>> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>> >
>> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
>> > <sa...@gmail.com> wrote:
>> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> >> from source? Get precompiled binaries and you will be ok.
>> >>
>> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> >> instructions, u will find plenty, like here -
>> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> >> These are for jdk 7, but you can follow the same to install jdk 6.
>> >>
>> >> Enjoy!
>> >>
>> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> I am planning to use Ubuntu 12.04, from
>> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>> >>>
>> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> >>> beyond, please use other JDKs."
>> >>>
>> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>> >>>
>> >>> Thanks
>> >>>
>> >>
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>>
>
Re: Ubuntu 12.04 - Which JDK? and some more
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
After spending time to research Hadoop and Hbase JDK requirements, here is my advice about using Ubuntu 12.04:
1) If you plan to use HBase on Hadoop HDFS, do note that HBase will run on Oracle's JDK only, so do NOT use OpenJDK or other JDKs for the setup.
2) When installing Ubuntu, should NOT use LVM (Linux Logical Volume Manager) for Hadoop data disks! (There will be performance issue between the filesystem and the device, LVM is the default for some Linux package, be careful not to select LVM)
regards
On 8 Nov 2012, at 6:12 PM, ac@hsk.hk wrote:
> Hi, thank you for your info and will head for it. Thanks.
> On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
>
>> Hi there,
>>
>> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>>
>> 1. Download the zipped file and extract it.
>>
>> 2. chmod +x jdk-6u37-linux-x64.bin
>>
>> 3. ./jdk-6u37-linux-x64.bin
>>
>> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>>
>> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>>
>> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>>
>> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>>
>> Then choose which java to use :
>>
>> sudo update-alternatives --config java
>>
>> choose the no for java6
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
>> Thanks Harsh,
>>
>> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>>
>> Thanks
>>
>>
>> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>>
>> > Hi Sanjeev,
>> >
>> > Unfortunately, official Ubuntu repositories no longer supports Oracle
>> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>> >
>> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
>> > <sa...@gmail.com> wrote:
>> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> >> from source? Get precompiled binaries and you will be ok.
>> >>
>> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> >> instructions, u will find plenty, like here -
>> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> >> These are for jdk 7, but you can follow the same to install jdk 6.
>> >>
>> >> Enjoy!
>> >>
>> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> I am planning to use Ubuntu 12.04, from
>> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>> >>>
>> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> >>> beyond, please use other JDKs."
>> >>>
>> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>> >>>
>> >>> Thanks
>> >>>
>> >>
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>>
>
Re: Ubuntu 12.04 - Which JDK? and some more
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
After spending time to research Hadoop and Hbase JDK requirements, here is my advice about using Ubuntu 12.04:
1) If you plan to use HBase on Hadoop HDFS, do note that HBase will run on Oracle's JDK only, so do NOT use OpenJDK or other JDKs for the setup.
2) When installing Ubuntu, should NOT use LVM (Linux Logical Volume Manager) for Hadoop data disks! (There will be performance issue between the filesystem and the device, LVM is the default for some Linux package, be careful not to select LVM)
regards
On 8 Nov 2012, at 6:12 PM, ac@hsk.hk wrote:
> Hi, thank you for your info and will head for it. Thanks.
> On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
>
>> Hi there,
>>
>> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>>
>> 1. Download the zipped file and extract it.
>>
>> 2. chmod +x jdk-6u37-linux-x64.bin
>>
>> 3. ./jdk-6u37-linux-x64.bin
>>
>> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>>
>> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>>
>> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>>
>> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>>
>> Then choose which java to use :
>>
>> sudo update-alternatives --config java
>>
>> choose the no for java6
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
>> Thanks Harsh,
>>
>> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>>
>> Thanks
>>
>>
>> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>>
>> > Hi Sanjeev,
>> >
>> > Unfortunately, official Ubuntu repositories no longer supports Oracle
>> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>> >
>> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
>> > <sa...@gmail.com> wrote:
>> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> >> from source? Get precompiled binaries and you will be ok.
>> >>
>> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> >> instructions, u will find plenty, like here -
>> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> >> These are for jdk 7, but you can follow the same to install jdk 6.
>> >>
>> >> Enjoy!
>> >>
>> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> I am planning to use Ubuntu 12.04, from
>> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>> >>>
>> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> >>> beyond, please use other JDKs."
>> >>>
>> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>> >>>
>> >>> Thanks
>> >>>
>> >>
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>>
>
Re: Ubuntu 12.04 - Which JDK? and some more
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
After spending time to research Hadoop and Hbase JDK requirements, here is my advice about using Ubuntu 12.04:
1) If you plan to use HBase on Hadoop HDFS, do note that HBase will run on Oracle's JDK only, so do NOT use OpenJDK or other JDKs for the setup.
2) When installing Ubuntu, should NOT use LVM (Linux Logical Volume Manager) for Hadoop data disks! (There will be performance issue between the filesystem and the device, LVM is the default for some Linux package, be careful not to select LVM)
regards
On 8 Nov 2012, at 6:12 PM, ac@hsk.hk wrote:
> Hi, thank you for your info and will head for it. Thanks.
> On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
>
>> Hi there,
>>
>> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>>
>> 1. Download the zipped file and extract it.
>>
>> 2. chmod +x jdk-6u37-linux-x64.bin
>>
>> 3. ./jdk-6u37-linux-x64.bin
>>
>> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>>
>> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>>
>> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>>
>> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>>
>> Then choose which java to use :
>>
>> sudo update-alternatives --config java
>>
>> choose the no for java6
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
>> Thanks Harsh,
>>
>> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>>
>> Thanks
>>
>>
>> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>>
>> > Hi Sanjeev,
>> >
>> > Unfortunately, official Ubuntu repositories no longer supports Oracle
>> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>> >
>> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
>> > <sa...@gmail.com> wrote:
>> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> >> from source? Get precompiled binaries and you will be ok.
>> >>
>> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> >> instructions, u will find plenty, like here -
>> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> >> These are for jdk 7, but you can follow the same to install jdk 6.
>> >>
>> >> Enjoy!
>> >>
>> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> I am planning to use Ubuntu 12.04, from
>> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>> >>>
>> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> >>> beyond, please use other JDKs."
>> >>>
>> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>> >>>
>> >>> Thanks
>> >>>
>> >>
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi, thank you for your info and will head for it. Thanks.
On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
> Hi there,
>
> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>
> 1. Download the zipped file and extract it.
>
> 2. chmod +x jdk-6u37-linux-x64.bin
>
> 3. ./jdk-6u37-linux-x64.bin
>
> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>
> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>
> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>
> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>
> Then choose which java to use :
>
> sudo update-alternatives --config java
>
> choose the no for java6
>
> Regards,
> Mohammad Tariq
>
>
>
> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi, thank you for your info and will head for it. Thanks.
On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
> Hi there,
>
> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>
> 1. Download the zipped file and extract it.
>
> 2. chmod +x jdk-6u37-linux-x64.bin
>
> 3. ./jdk-6u37-linux-x64.bin
>
> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>
> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>
> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>
> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>
> Then choose which java to use :
>
> sudo update-alternatives --config java
>
> choose the no for java6
>
> Regards,
> Mohammad Tariq
>
>
>
> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi, thank you for your info and will head for it. Thanks.
On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
> Hi there,
>
> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>
> 1. Download the zipped file and extract it.
>
> 2. chmod +x jdk-6u37-linux-x64.bin
>
> 3. ./jdk-6u37-linux-x64.bin
>
> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>
> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>
> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>
> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>
> Then choose which java to use :
>
> sudo update-alternatives --config java
>
> choose the no for java6
>
> Regards,
> Mohammad Tariq
>
>
>
> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi, thank you for your info and will head for it. Thanks.
On 8 Nov 2012, at 6:07 PM, Mohammad Tariq wrote:
> Hi there,
>
> As per my understanding, all the code has been built and tested against java6(sun). There are some changes between java7 and 6 and you may face issues while running your code, like using sort with collections. I faced the same thing when using List.sort in my code. So, it's better to go with sun's java6. If you want to install it you can follow these steps :
>
> 1. Download the zipped file and extract it.
>
> 2. chmod +x jdk-6u37-linux-x64.bin
>
> 3. ./jdk-6u37-linux-x64.bin
>
> 4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
>
> 5. sudo update-alternatives --install /usr/bin/javac javac /usr/lib/jvm/jdk1.6.0_37/bin/javac 1
>
> 6. sudo update-alternatives --install /usr/bin/java java /usr/lib/jvm/jdk1.6.0_37/bin/java 1
>
> 7. sudo update-alternatives --install /usr/bin/javaws javaws /usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
>
> Then choose which java to use :
>
> sudo update-alternatives --config java
>
> choose the no for java6
>
> Regards,
> Mohammad Tariq
>
>
>
> On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Mohammad Tariq <do...@gmail.com>.
Hi there,
As per my understanding, all the code has been built and tested against
java6(sun). There are some changes between java7 and 6 and you may face
issues while running your code, like using sort with collections. I faced
the same thing when using List.sort in my code. So, it's better to go with
sun's java6. If you want to install it you can follow these steps :
1. Download the zipped file and extract it.
2. chmod +x jdk-6u37-linux-x64.bin
3. ./jdk-6u37-linux-x64.bin
4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
5. sudo update-alternatives --install /usr/bin/javac javac
/usr/lib/jvm/jdk1.6.0_37/bin/javac 1
6. sudo update-alternatives --install /usr/bin/java java
/usr/lib/jvm/jdk1.6.0_37/bin/java 1
7. sudo update-alternatives --install /usr/bin/javaws javaws
/usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
Then choose which java to use :
sudo update-alternatives --config java
choose the no for java6
Regards,
Mohammad Tariq
On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04
> is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no
> longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander
> Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See
> https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build
> hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23
> and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Mohammad Tariq <do...@gmail.com>.
Hi there,
As per my understanding, all the code has been built and tested against
java6(sun). There are some changes between java7 and 6 and you may face
issues while running your code, like using sort with collections. I faced
the same thing when using List.sort in my code. So, it's better to go with
sun's java6. If you want to install it you can follow these steps :
1. Download the zipped file and extract it.
2. chmod +x jdk-6u37-linux-x64.bin
3. ./jdk-6u37-linux-x64.bin
4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
5. sudo update-alternatives --install /usr/bin/javac javac
/usr/lib/jvm/jdk1.6.0_37/bin/javac 1
6. sudo update-alternatives --install /usr/bin/java java
/usr/lib/jvm/jdk1.6.0_37/bin/java 1
7. sudo update-alternatives --install /usr/bin/javaws javaws
/usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
Then choose which java to use :
sudo update-alternatives --config java
choose the no for java6
Regards,
Mohammad Tariq
On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04
> is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no
> longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander
> Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See
> https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build
> hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23
> and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Mohammad Tariq <do...@gmail.com>.
Hi there,
As per my understanding, all the code has been built and tested against
java6(sun). There are some changes between java7 and 6 and you may face
issues while running your code, like using sort with collections. I faced
the same thing when using List.sort in my code. So, it's better to go with
sun's java6. If you want to install it you can follow these steps :
1. Download the zipped file and extract it.
2. chmod +x jdk-6u37-linux-x64.bin
3. ./jdk-6u37-linux-x64.bin
4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
5. sudo update-alternatives --install /usr/bin/javac javac
/usr/lib/jvm/jdk1.6.0_37/bin/javac 1
6. sudo update-alternatives --install /usr/bin/java java
/usr/lib/jvm/jdk1.6.0_37/bin/java 1
7. sudo update-alternatives --install /usr/bin/javaws javaws
/usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
Then choose which java to use :
sudo update-alternatives --config java
choose the no for java6
Regards,
Mohammad Tariq
On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04
> is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no
> longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander
> Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See
> https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build
> hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23
> and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Mohammad Tariq <do...@gmail.com>.
Hi there,
As per my understanding, all the code has been built and tested against
java6(sun). There are some changes between java7 and 6 and you may face
issues while running your code, like using sort with collections. I faced
the same thing when using List.sort in my code. So, it's better to go with
sun's java6. If you want to install it you can follow these steps :
1. Download the zipped file and extract it.
2. chmod +x jdk-6u37-linux-x64.bin
3. ./jdk-6u37-linux-x64.bin
4. sudo mv jdk1.6.0_37/ /usr/lib/jvm/
5. sudo update-alternatives --install /usr/bin/javac javac
/usr/lib/jvm/jdk1.6.0_37/bin/javac 1
6. sudo update-alternatives --install /usr/bin/java java
/usr/lib/jvm/jdk1.6.0_37/bin/java 1
7. sudo update-alternatives --install /usr/bin/javaws javaws
/usr/lib/jvm/jdk1.6.0_37/bin/javaws 1
Then choose which java to use :
sudo update-alternatives --config java
choose the no for java6
Regards,
Mohammad Tariq
On Thu, Nov 8, 2012 at 2:29 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Thanks Harsh,
>
> This is exactly what I am facing, I have used Ubuntu for long time, 12.04
> is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no
> longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander
> Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
>
> Thanks
>
>
> On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
>
> > Hi Sanjeev,
> >
> > Unfortunately, official Ubuntu repositories no longer supports Oracle
> > JDK/JRE 6. See
> https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
> >
> > On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> > <sa...@gmail.com> wrote:
> >> AFAIK, openjdk can be used to run hadoop. Why do you want to build
> hadoop
> >> from source? Get precompiled binaries and you will be ok.
> >>
> >> Also, you can install sun/oracle jdk on ubuntu. Just google for
> >> instructions, u will find plenty, like here -
> >> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> >> These are for jdk 7, but you can follow the same to install jdk 6.
> >>
> >> Enjoy!
> >>
> >> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I am planning to use Ubuntu 12.04, from
> >>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
> >>>
> >>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> >>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23
> and
> >>> beyond, please use other JDKs."
> >>>
> >>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
> >>>
> >>> Thanks
> >>>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Thanks Harsh,
This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
Thanks
On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
> Hi Sanjeev,
>
> Unfortunately, official Ubuntu repositories no longer supports Oracle
> JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>
> On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> <sa...@gmail.com> wrote:
>> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> from source? Get precompiled binaries and you will be ok.
>>
>> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> instructions, u will find plenty, like here -
>> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> These are for jdk 7, but you can follow the same to install jdk 6.
>>
>> Enjoy!
>>
>> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>>
>>> Hi,
>>>
>>> I am planning to use Ubuntu 12.04, from
>>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>>
>>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>>> beyond, please use other JDKs."
>>>
>>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>>
>>> Thanks
>>>
>>
>
>
>
> --
> Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Thanks Harsh,
This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
Thanks
On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
> Hi Sanjeev,
>
> Unfortunately, official Ubuntu repositories no longer supports Oracle
> JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>
> On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> <sa...@gmail.com> wrote:
>> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> from source? Get precompiled binaries and you will be ok.
>>
>> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> instructions, u will find plenty, like here -
>> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> These are for jdk 7, but you can follow the same to install jdk 6.
>>
>> Enjoy!
>>
>> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>>
>>> Hi,
>>>
>>> I am planning to use Ubuntu 12.04, from
>>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>>
>>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>>> beyond, please use other JDKs."
>>>
>>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>>
>>> Thanks
>>>
>>
>
>
>
> --
> Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Thanks Harsh,
This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
Thanks
On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
> Hi Sanjeev,
>
> Unfortunately, official Ubuntu repositories no longer supports Oracle
> JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>
> On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> <sa...@gmail.com> wrote:
>> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> from source? Get precompiled binaries and you will be ok.
>>
>> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> instructions, u will find plenty, like here -
>> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> These are for jdk 7, but you can follow the same to install jdk 6.
>>
>> Enjoy!
>>
>> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>>
>>> Hi,
>>>
>>> I am planning to use Ubuntu 12.04, from
>>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>>
>>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>>> beyond, please use other JDKs."
>>>
>>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>>
>>> Thanks
>>>
>>
>
>
>
> --
> Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Thanks Harsh,
This is exactly what I am facing, I have used Ubuntu for long time, 12.04 is the Long Term Support version (LTS), however Oracle JDK/JRE6 is no longer supported in it, "OpenJDK has sometimes a odd behavior - Alexander Lorenz'". Any Ubuntu 12.04 users here to share your selections/options?
Thanks
On 8 Nov 2012, at 4:37 PM, Harsh J wrote:
> Hi Sanjeev,
>
> Unfortunately, official Ubuntu repositories no longer supports Oracle
> JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
>
> On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
> <sa...@gmail.com> wrote:
>> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
>> from source? Get precompiled binaries and you will be ok.
>>
>> Also, you can install sun/oracle jdk on ubuntu. Just google for
>> instructions, u will find plenty, like here -
>> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
>> These are for jdk 7, but you can follow the same to install jdk 6.
>>
>> Enjoy!
>>
>> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>>
>>> Hi,
>>>
>>> I am planning to use Ubuntu 12.04, from
>>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>>
>>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>>> beyond, please use other JDKs."
>>>
>>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>>
>>> Thanks
>>>
>>
>
>
>
> --
> Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
Hi Sanjeev,
Unfortunately, official Ubuntu repositories no longer supports Oracle
JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
<sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
>
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Alexander Lorenz <wg...@gmail.com>.
Recommend JDK 1.6.3x, 1.7 has serval issues within NIO and I wouldn't use them in production, OpenJDK has sometimes a odd behavior and IBM's JDK - no.
cheers,
Alex
On Nov 8, 2012, at 7:17 AM, Sanjeev Verma <sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>>
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
Re: Ubuntu 12.04 - Which JDK?
Posted by Alexander Lorenz <wg...@gmail.com>.
Recommend JDK 1.6.3x, 1.7 has serval issues within NIO and I wouldn't use them in production, OpenJDK has sometimes a odd behavior and IBM's JDK - no.
cheers,
Alex
On Nov 8, 2012, at 7:17 AM, Sanjeev Verma <sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>>
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
Hi Sanjeev,
Unfortunately, official Ubuntu repositories no longer supports Oracle
JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
<sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
>
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
Hi Sanjeev,
Unfortunately, official Ubuntu repositories no longer supports Oracle
JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
<sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
>
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
Hi Sanjeev,
Unfortunately, official Ubuntu repositories no longer supports Oracle
JDK/JRE 6. See https://help.ubuntu.com/community/Java#Oracle_.28Sun.29_Java_6
On Thu, Nov 8, 2012 at 11:47 AM, Sanjeev Verma
<sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
>
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Alexander Lorenz <wg...@gmail.com>.
Recommend JDK 1.6.3x, 1.7 has serval issues within NIO and I wouldn't use them in production, OpenJDK has sometimes a odd behavior and IBM's JDK - no.
cheers,
Alex
On Nov 8, 2012, at 7:17 AM, Sanjeev Verma <sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>>
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
Re: Ubuntu 12.04 - Which JDK?
Posted by Alexander Lorenz <wg...@gmail.com>.
Recommend JDK 1.6.3x, 1.7 has serval issues within NIO and I wouldn't use them in production, OpenJDK has sometimes a odd behavior and IBM's JDK - no.
cheers,
Alex
On Nov 8, 2012, at 7:17 AM, Sanjeev Verma <sa...@gmail.com> wrote:
> AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
> from source? Get precompiled binaries and you will be ok.
>
> Also, you can install sun/oracle jdk on ubuntu. Just google for
> instructions, u will find plenty, like here -
> http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
> These are for jdk 7, but you can follow the same to install jdk 6.
>
> Enjoy!
> On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
>
>> Hi,
>>
>> I am planning to use Ubuntu 12.04, from
>> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>>
>> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
>> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
>> beyond, please use other JDKs."
>>
>> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>>
>> Thanks
>>
>>
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
Re: Ubuntu 12.04 - Which JDK?
Posted by Sanjeev Verma <sa...@gmail.com>.
AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
from source? Get precompiled binaries and you will be ok.
Also, you can install sun/oracle jdk on ubuntu. Just google for
instructions, u will find plenty, like here -
http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
These are for jdk 7, but you can follow the same to install jdk 6.
Enjoy!
On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> beyond, please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
I don't think OpenJDK 7 has been as extensively tested as OpenJDK 6
for Hadoop. I'd recommend staying on 1.6-based JVMs if you have a prod
goal for this cluster, but otherwise, you could give OpenJDK 7 a try
and let us know.
On Thu, Nov 8, 2012 at 11:30 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK
> cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond,
> please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
I don't think OpenJDK 7 has been as extensively tested as OpenJDK 6
for Hadoop. I'd recommend staying on 1.6-based JVMs if you have a prod
goal for this cluster, but otherwise, you could give OpenJDK 7 a try
and let us know.
On Thu, Nov 8, 2012 at 11:30 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK
> cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond,
> please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Sanjeev Verma <sa...@gmail.com>.
AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
from source? Get precompiled binaries and you will be ok.
Also, you can install sun/oracle jdk on ubuntu. Just google for
instructions, u will find plenty, like here -
http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
These are for jdk 7, but you can follow the same to install jdk 6.
Enjoy!
On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> beyond, please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Sanjeev Verma <sa...@gmail.com>.
AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
from source? Get precompiled binaries and you will be ok.
Also, you can install sun/oracle jdk on ubuntu. Just google for
instructions, u will find plenty, like here -
http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
These are for jdk 7, but you can follow the same to install jdk 6.
Enjoy!
On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> beyond, please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
>
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
I don't think OpenJDK 7 has been as extensively tested as OpenJDK 6
for Hadoop. I'd recommend staying on 1.6-based JVMs if you have a prod
goal for this cluster, but otherwise, you could give OpenJDK 7 a try
and let us know.
On Thu, Nov 8, 2012 at 11:30 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK
> cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond,
> please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Harsh J <ha...@cloudera.com>.
I don't think OpenJDK 7 has been as extensively tested as OpenJDK 6
for Hadoop. I'd recommend staying on 1.6-based JVMs if you have a prod
goal for this cluster, but otherwise, you could give OpenJDK 7 a try
and let us know.
On Thu, Nov 8, 2012 at 11:30 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK
> cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond,
> please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
--
Harsh J
Re: Ubuntu 12.04 - Which JDK?
Posted by Sanjeev Verma <sa...@gmail.com>.
AFAIK, openjdk can be used to run hadoop. Why do you want to build hadoop
from source? Get precompiled binaries and you will be ok.
Also, you can install sun/oracle jdk on ubuntu. Just google for
instructions, u will find plenty, like here -
http://www.ubuntututorials.com/install-oracle-java-jdk-7-ubuntu-12-04/.
These are for jdk 7, but you can follow the same to install jdk 6.
Enjoy!
On Nov 8, 2012 11:30 AM, "ac@hsk.hk" <ac...@hsk.hk> wrote:
> Hi,
>
> I am planning to use Ubuntu 12.04, from
> http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
>
> "Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so
> OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and
> beyond, please use other JDKs."
>
> Is it OK to use OpenJDK 7 in Ubuntu 12.04?
>
> Thanks
>
>
Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
I am planning to use Ubuntu 12.04, from http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
"Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond, please use other JDKs."
Is it OK to use OpenJDK 7 in Ubuntu 12.04?
Thanks
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
Hi Coli,
Thank you very much for your reply.
I am researching the hadoop2.0 code, I find there are below code in
FSEditLogLoader.loadEditRecords method.
<code>
if (op.hasTransactionId()) {
if (op.getTransactionId() > expectedTxId) {
MetaRecoveryContext.editLogLoaderPrompt("There appears " +
"to be a gap in the edit log. We expected txid " +
expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery, "ignoring missing
" +
" transaction IDs");
} *else if (op.getTransactionId() < expectedTxId) {
MetaRecoveryContext.**editLogLoaderPrompt("There appears " +
"to be an out-of-order edit in the edit log. We " +
"expected txid " + expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery,
"skipping the out-of-order edit");
continue;*
}
}
</code>
The method use transaction id to **guarantee same transaction log is not
applied to namespace more than once.
I am using hadoop-0.20.2, that don't store the transaction id to edits log
file.
So I want to know if StandbyNN apply same edits log file many times to
namespace, that will lead to the namespace of StandbyNN is corrupt?
2012/11/8 Colin McCabe <cm...@alumni.cmu.edu>
> Hi,
>
> If you want to learn more about HA in HDFS, here are some slides from
> a talk that Aaron T. Meyers and Suresh Srinivas gave:
> http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
>
> branch-2 and later contain HDFS HA.
>
> cheers,
> Colin
>
>
> On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> > I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> > AvatarNode. I find if the StandbyNN do checkpoint fail, when next time
> the
> > StandbyNN do checkpoint, the same edits file is loaded again. Can same
> > edits file be loaded more than once in hadoop0.20.2?
> > if not, what is the harm?
> >
> > Thanks,
> >
> > LiuLei
> >
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
Hi Coli,
Thank you very much for your reply.
I am researching the hadoop2.0 code, I find there are below code in
FSEditLogLoader.loadEditRecords method.
<code>
if (op.hasTransactionId()) {
if (op.getTransactionId() > expectedTxId) {
MetaRecoveryContext.editLogLoaderPrompt("There appears " +
"to be a gap in the edit log. We expected txid " +
expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery, "ignoring missing
" +
" transaction IDs");
} *else if (op.getTransactionId() < expectedTxId) {
MetaRecoveryContext.**editLogLoaderPrompt("There appears " +
"to be an out-of-order edit in the edit log. We " +
"expected txid " + expectedTxId + ", but got txid " +
op.getTransactionId() + ".", recovery,
"skipping the out-of-order edit");
continue;*
}
}
</code>
The method use transaction id to **guarantee same transaction log is not
applied to namespace more than once.
I am using hadoop-0.20.2, that don't store the transaction id to edits log
file.
So I want to know if StandbyNN apply same edits log file many times to
namespace, that will lead to the namespace of StandbyNN is corrupt?
2012/11/8 Colin McCabe <cm...@alumni.cmu.edu>
> Hi,
>
> If you want to learn more about HA in HDFS, here are some slides from
> a talk that Aaron T. Meyers and Suresh Srinivas gave:
> http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
>
> branch-2 and later contain HDFS HA.
>
> cheers,
> Colin
>
>
> On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> > I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> > AvatarNode. I find if the StandbyNN do checkpoint fail, when next time
> the
> > StandbyNN do checkpoint, the same edits file is loaded again. Can same
> > edits file be loaded more than once in hadoop0.20.2?
> > if not, what is the harm?
> >
> > Thanks,
> >
> > LiuLei
> >
>
Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
I am planning to use Ubuntu 12.04, from http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
"Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond, please use other JDKs."
Is it OK to use OpenJDK 7 in Ubuntu 12.04?
Thanks
Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
I am planning to use Ubuntu 12.04, from http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
"Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond, please use other JDKs."
Is it OK to use OpenJDK 7 in Ubuntu 12.04?
Thanks
Ubuntu 12.04 - Which JDK?
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
I am planning to use Ubuntu 12.04, from http://wiki.apache.org/hadoop/HadoopJavaVersions, about OpenJDK
"Note*: OpenJDK6 has some open bugs w.r.t handling of generics... so OpenJDK cannot be used to compile hadoop mapreduce code in branch-0.23 and beyond, please use other JDKs."
Is it OK to use OpenJDK 7 in Ubuntu 12.04?
Thanks
Re: same edits file is loaded more than once
Posted by Colin McCabe <cm...@alumni.cmu.edu>.
Hi,
If you want to learn more about HA in HDFS, here are some slides from
a talk that Aaron T. Meyers and Suresh Srinivas gave:
http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
branch-2 and later contain HDFS HA.
cheers,
Colin
On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
Re: same edits file is loaded more than once
Posted by Colin McCabe <cm...@alumni.cmu.edu>.
Hi,
If you want to learn more about HA in HDFS, here are some slides from
a talk that Aaron T. Meyers and Suresh Srinivas gave:
http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
branch-2 and later contain HDFS HA.
cheers,
Colin
On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
> I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
> opration first delete inode(call FSDirectory.unprotectedDelete method),
> then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
> read one OP_ADD transaction log and add one inode to namespace for the
> operation, when next time NN read the same transaction log form same edits
> file,NN first delete the inode , then add same inode to namespace again,
> So I think this is no harmful,even if the same transaction log is loaded
> more than once.
>
> If there are some thing wrong,please give me some advice.
>
> Thanks
> LiuLei
>
>
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
> I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
> opration first delete inode(call FSDirectory.unprotectedDelete method),
> then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
> read one OP_ADD transaction log and add one inode to namespace for the
> operation, when next time NN read the same transaction log form same edits
> file,NN first delete the inode , then add same inode to namespace again,
> So I think this is no harmful,even if the same transaction log is loaded
> more than once.
>
> If there are some thing wrong,please give me some advice.
>
> Thanks
> LiuLei
>
>
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
> I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
> opration first delete inode(call FSDirectory.unprotectedDelete method),
> then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
> read one OP_ADD transaction log and add one inode to namespace for the
> operation, when next time NN read the same transaction log form same edits
> file,NN first delete the inode , then add same inode to namespace again,
> So I think this is no harmful,even if the same transaction log is loaded
> more than once.
>
> If there are some thing wrong,please give me some advice.
>
> Thanks
> LiuLei
>
>
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
> I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
> opration first delete inode(call FSDirectory.unprotectedDelete method),
> then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
> read one OP_ADD transaction log and add one inode to namespace for the
> operation, when next time NN read the same transaction log form same edits
> file,NN first delete the inode , then add same inode to namespace again,
> So I think this is no harmful,even if the same transaction log is loaded
> more than once.
>
> If there are some thing wrong,please give me some advice.
>
> Thanks
> LiuLei
>
>
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
opration first delete inode(call FSDirectory.unprotectedDelete method),
then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
read one OP_ADD transaction log and add one inode to namespace for the
operation, when next time NN read the same transaction log form same edits
file,NN first delete the inode , then add same inode to namespace again,
So I think this is no harmful,even if the same transaction log is loaded
more than once.
If my understand is wrong, welcom everyone to point it out.
Thanks,
LiuLei
2012/11/4 lei liu <li...@gmail.com>
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
opration first delete inode(call FSDirectory.unprotectedDelete method),
then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
read one OP_ADD transaction log and add one inode to namespace for the
operation, when next time NN read the same transaction log form same edits
file,NN first delete the inode , then add same inode to namespace again,
So I think this is no harmful,even if the same transaction log is loaded
more than once.
If my understand is wrong, welcom everyone to point it out.
Thanks,
LiuLei
2012/11/4 lei liu <li...@gmail.com>
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
opration first delete inode(call FSDirectory.unprotectedDelete method),
then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
read one OP_ADD transaction log and add one inode to namespace for the
operation, when next time NN read the same transaction log form same edits
file,NN first delete the inode , then add same inode to namespace again,
So I think this is no harmful,even if the same transaction log is loaded
more than once.
If my understand is wrong, welcom everyone to point it out.
Thanks,
LiuLei
2012/11/4 lei liu <li...@gmail.com>
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
>
Re: same edits file is loaded more than once
Posted by lei liu <li...@gmail.com>.
I research FSEditLog.loadFSEdits method, I find OP_ADD and OP_CLOSE
opration first delete inode(call FSDirectory.unprotectedDelete method),
then re-add inode(call FSDirectory.unprotectedAddFile method), so if NN
read one OP_ADD transaction log and add one inode to namespace for the
operation, when next time NN read the same transaction log form same edits
file,NN first delete the inode , then add same inode to namespace again,
So I think this is no harmful,even if the same transaction log is loaded
more than once.
If my understand is wrong, welcom everyone to point it out.
Thanks,
LiuLei
2012/11/4 lei liu <li...@gmail.com>
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
>
Re: same edits file is loaded more than once
Posted by Colin McCabe <cm...@alumni.cmu.edu>.
Hi,
If you want to learn more about HA in HDFS, here are some slides from
a talk that Aaron T. Meyers and Suresh Srinivas gave:
http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
branch-2 and later contain HDFS HA.
cheers,
Colin
On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>
Re: same edits file is loaded more than once
Posted by Colin McCabe <cm...@alumni.cmu.edu>.
Hi,
If you want to learn more about HA in HDFS, here are some slides from
a talk that Aaron T. Meyers and Suresh Srinivas gave:
http://www.slideshare.net/hortonworks/nn-ha-hadoop-worldfinal-10173419
branch-2 and later contain HDFS HA.
cheers,
Colin
On Sun, Nov 4, 2012 at 1:06 AM, lei liu <li...@gmail.com> wrote:
> I am using hadoop0.20.2, now I want to use HDFS HA function. I research
> AvatarNode. I find if the StandbyNN do checkpoint fail, when next time the
> StandbyNN do checkpoint, the same edits file is loaded again. Can same
> edits file be loaded more than once in hadoop0.20.2?
> if not, what is the harm?
>
> Thanks,
>
> LiuLei
>