You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Serkan Taş <se...@likyateknoloji.com> on 2014/04/05 15:07:43 UTC
Code generation error due to locale settings to tr
Hi,
I am faced to a common problem of tr locale settings for java application while trying to build dev environment according to http://wiki.apache.org/hadoop/EclipseEnvironment.
Here is the error :
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-common: Compilation failure
[ERROR] /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244] unmappable character for encoding UTF-8
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-common: Compilation failure
/Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244] unmappable character for encoding UTF-8
I f i check the code i discovered the reason for error :
public static final org.apache.avro.Schema SCHEMA$ = new org.apache.avro.Schema.Parser().parse("{\"type\":\"record\",\"name\":\"AvroRecord\",\"namespace\":\"org.apache.hadoop.io.serializer.avro\",\"fields\":[{\"name\":\"intField\",\"type\":\"Ýnt\"}]}");
As you can see, locale dependent capitalization of letter "i" turns in to "Ý".
May i report a bug ?
Note : I may fix this by changing locale to EN but not prefer.
Serkan Taş
Likya Bilgi Teknolojileri
ve İletişim Hiz. Ltd. Şti.
www.likyateknoloji.com
Tel : + 90 216 471 81 55 - 117
Gsm : + 90 542 242 00 92
Faks: + 90 216 661 14 92
--------------------------------------
Bu elektronik posta ve onunla iletilen bütün dosyalar gizlidir. Sadece yukarıda isimleri belirtilen kişiler arasında özel haberleşme amacını taşımaktadır. Size yanlışlıkla ulaşmışsa bu elektonik postanın içeriğini açıklamanız, kopyalamanız, yönlendirmeniz ve kullanmanız kesinlikle yasaktır. Lütfen mesajı geri gönderiniz ve sisteminizden siliniz. Likya Bilgi Teknolojileri ve İletişim Hiz. Ltd. Şti. bu mesajın içeriği ile ilgili olarak hiç bir hukuksal sorumluluğu kabul etmez.
This electronic mail and any files transmitted with it are intended for the private use of the persons named above. If you received this message in error, forwarding, copying or use of any of the information is strictly prohibited. Please immediately notify the sender and delete it from your system. Likya Bilgi Teknolojileri ve İletişim Hiz. Ltd. Şti. does not accept legal responsibility for the contents of this message.
--------------------------------------
P
Bu e-postayı yazdırmadan önce, çevreye olan sorumluluğunuzu tekrar düşünün.
Please consider your environmental responsibility before printing this e-mail.
Re: Code generation error due to locale settings to tr
Posted by Serkan Taş <se...@hotmail.com>.
Steve,
0. I have found same problem in projects like OPENEJB-1071, OAK-260, IBATIS-218, and sent the question to the user list of AVRO.
2. I tested the latest avro, still has the same error.
I used
export MAVEN_OPTS="-Duser.country=EN -Duser.language=en -Xms256m -Xmx1024m"
option for maven as a workaround.
Thanks again.
5 Nis 2014 tarihinde 21:19 saatinde, Serkan Taş <se...@hotmail.com> şunları yazdı:
> I know that it is auto-generated code, but was not aware where to address.
>
> Thank you for the info.
>
> 0. i will check it in avro.
> 1. Yes, as svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/
> 2. will check it.
>
>
>
> 5 Nis 2014 tarihinde 21:04 saatinde, Steve Loughran <st...@hortonworks.com> şunları yazdı:
>
>> yes, this is a bug -not enough people know that .equalsIgnoreCase() doesn't
>> work in some locales, Turkey being a key one.
>>
>> But, if you look at the top of the file, you'll see something important
>>
>> /**
>> * Autogenerated by Avro
>> *
>> * DO NOT EDIT DIRECTLY
>> */
>>
>> this is code generated by Avro -if it's getting case wrong, it's a bug
>> there.
>>
>> Before worrying about it,
>> 0. Can find the problem mentioned on the web somewhere -especially apache
>> JIRa?
>> 1. Does the problem exist in hadoop trunk?
>> 2. If you edit the POMs to move up to any later Avro, does the problem
>> exist.
>>
>>
>>
>> On 5 April 2014 15:16, Serkan Taş <se...@hotmail.com> wrote:
>>
>>>
>>>
>>>> Hi,
>>>>
>>>> I am faced to a common problem of tr locale settings for java
>>> application while trying to build dev environment according to
>>> http://wiki.apache.org/hadoop/EclipseEnvironment.
>>>>
>>>> Here is the error :
>>>>
>>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
>>> (default-testCompile) on project hadoop-common: Compilation failure
>>>> [ERROR]
>>> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244]
>>> unmappable character for encoding UTF-8
>>>> [ERROR] -> [Help 1]
>>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>>> execute goal
>>> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
>>> (default-testCompile) on project hadoop-common: Compilation failure
>>>>
>>> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244]
>>> unmappable character for encoding UTF-8
>>>>
>>>>
>>>> I f i check the code i discovered the reason for error :
>>>>
>>>> public static final org.apache.avro.Schema SCHEMA$ = new
>>> org.apache.avro.Schema.Parser().parse("{\"type\":\"record\",\"name\":\"AvroRecord\",\"namespace\":\"org.apache.hadoop.io.serializer.avro\",\"fields\":[{\"name\":\"intField\",\"type\":\"Ýnt\"}]}");
>>>>
>>>> As you can see, locale dependent capitalization of letter "i" turns in
>>> to "Ý".
>>>>
>>>> May i report a bug ?
>>>>
>>>>
>>>> Note : I may fix this by changing locale to EN but not prefer.
>>>
>>>
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
Re: Code generation error due to locale settings to tr
Posted by Serkan Taş <se...@hotmail.com>.
I know that it is auto-generated code, but was not aware where to address.
Thank you for the info.
0. i will check it in avro.
1. Yes, as svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/
2. will check it.
5 Nis 2014 tarihinde 21:04 saatinde, Steve Loughran <st...@hortonworks.com> şunları yazdı:
> yes, this is a bug -not enough people know that .equalsIgnoreCase() doesn't
> work in some locales, Turkey being a key one.
>
> But, if you look at the top of the file, you'll see something important
>
> /**
> * Autogenerated by Avro
> *
> * DO NOT EDIT DIRECTLY
> */
>
> this is code generated by Avro -if it's getting case wrong, it's a bug
> there.
>
> Before worrying about it,
> 0. Can find the problem mentioned on the web somewhere -especially apache
> JIRa?
> 1. Does the problem exist in hadoop trunk?
> 2. If you edit the POMs to move up to any later Avro, does the problem
> exist.
>
>
>
> On 5 April 2014 15:16, Serkan Taş <se...@hotmail.com> wrote:
>
>>
>>
>>> Hi,
>>>
>>> I am faced to a common problem of tr locale settings for java
>> application while trying to build dev environment according to
>> http://wiki.apache.org/hadoop/EclipseEnvironment.
>>>
>>> Here is the error :
>>>
>>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
>> (default-testCompile) on project hadoop-common: Compilation failure
>>> [ERROR]
>> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244]
>> unmappable character for encoding UTF-8
>>> [ERROR] -> [Help 1]
>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>> execute goal
>> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
>> (default-testCompile) on project hadoop-common: Compilation failure
>>>
>> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244]
>> unmappable character for encoding UTF-8
>>>
>>>
>>> I f i check the code i discovered the reason for error :
>>>
>>> public static final org.apache.avro.Schema SCHEMA$ = new
>> org.apache.avro.Schema.Parser().parse("{\"type\":\"record\",\"name\":\"AvroRecord\",\"namespace\":\"org.apache.hadoop.io.serializer.avro\",\"fields\":[{\"name\":\"intField\",\"type\":\"Ýnt\"}]}");
>>>
>>> As you can see, locale dependent capitalization of letter "i" turns in
>> to "Ý".
>>>
>>> May i report a bug ?
>>>
>>>
>>> Note : I may fix this by changing locale to EN but not prefer.
>>
>>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Code generation error due to locale settings to tr
Posted by Steve Loughran <st...@hortonworks.com>.
yes, this is a bug -not enough people know that .equalsIgnoreCase() doesn't
work in some locales, Turkey being a key one.
But, if you look at the top of the file, you'll see something important
/**
* Autogenerated by Avro
*
* DO NOT EDIT DIRECTLY
*/
this is code generated by Avro -if it's getting case wrong, it's a bug
there.
Before worrying about it,
0. Can find the problem mentioned on the web somewhere -especially apache
JIRa?
1. Does the problem exist in hadoop trunk?
2. If you edit the POMs to move up to any later Avro, does the problem
exist.
On 5 April 2014 15:16, Serkan Taş <se...@hotmail.com> wrote:
>
>
> > Hi,
> >
> > I am faced to a common problem of tr locale settings for java
> application while trying to build dev environment according to
> http://wiki.apache.org/hadoop/EclipseEnvironment.
> >
> > Here is the error :
> >
> > [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
> (default-testCompile) on project hadoop-common: Compilation failure
> > [ERROR]
> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244]
> unmappable character for encoding UTF-8
> > [ERROR] -> [Help 1]
> > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
> (default-testCompile) on project hadoop-common: Compilation failure
> >
> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244]
> unmappable character for encoding UTF-8
> >
> >
> > I f i check the code i discovered the reason for error :
> >
> > public static final org.apache.avro.Schema SCHEMA$ = new
> org.apache.avro.Schema.Parser().parse("{\"type\":\"record\",\"name\":\"AvroRecord\",\"namespace\":\"org.apache.hadoop.io.serializer.avro\",\"fields\":[{\"name\":\"intField\",\"type\":\"Ýnt\"}]}");
> >
> > As you can see, locale dependent capitalization of letter "i" turns in
> to "Ý".
> >
> > May i report a bug ?
> >
> >
> > Note : I may fix this by changing locale to EN but not prefer.
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Code generation error due to locale settings to tr
Posted by Serkan Taş <se...@hotmail.com>.
> Hi,
>
> I am faced to a common problem of tr locale settings for java application while trying to build dev environment according to http://wiki.apache.org/hadoop/EclipseEnvironment.
>
> Here is the error :
>
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-common: Compilation failure
> [ERROR] /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244] unmappable character for encoding UTF-8
> [ERROR] -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-common: Compilation failure
> /Users/serkan/programlar/dev/hadooptest/hadoop-trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/io/serializer/avro/AvroRecord.java:[10,244] unmappable character for encoding UTF-8
>
>
> I f i check the code i discovered the reason for error :
>
> public static final org.apache.avro.Schema SCHEMA$ = new org.apache.avro.Schema.Parser().parse("{\"type\":\"record\",\"name\":\"AvroRecord\",\"namespace\":\"org.apache.hadoop.io.serializer.avro\",\"fields\":[{\"name\":\"intField\",\"type\":\"Ýnt\"}]}");
>
> As you can see, locale dependent capitalization of letter "i" turns in to "Ý".
>
> May i report a bug ?
>
>
> Note : I may fix this by changing locale to EN but not prefer.