You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Szehon Ho <sz...@cloudera.com> on 2015/01/21 08:23:51 UTC

Precommit test error with utf8

The builds have been hitting some strange error in trying to update the
source in svn due to the new test files added in hcatalog in different
locales.

I wasn't able to reproduce the issue manually and dont know the exact
cause, but just FYI that the builds are broken now.

Thanks
Szehon

++ svn status --no-ignore
svn: Error converting entry in directory
'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
svn: Can't convert string from native encoding to 'UTF-8':
svn: artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"
+ rm -rf
+ svn update
svn: Error converting entry in directory
'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
svn: Can't convert string from native encoding to 'UTF-8':
svn: artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"

Re: Precommit test error with utf8

Posted by Szehon Ho <sz...@cloudera.com>.
Not really sure.  Checked the build box's client-side locales and they are
pretty standard (en_US.UTF8).  I think if its a client side issue, it would
be saying "Error converting UTF-8 to native", but its the other way around,
saying "Error converting native to UTF8".  But I'm not an expert on this.

The build machine was able to apply the patch fine, but it cant check out
those files from svn, explaining why it passed pre-commit but not
afterwards.

On Wed, Jan 21, 2015 at 11:10 AM, Eugene Koifman <ek...@hortonworks.com>
wrote:

> this was added in https://issues.apache.org/jira/browse/HIVE-9272.  The
> build bot ran fine with the patch.  I also ran "mvn clean package install
> -Phadoop-2,dist -DskipTests".
>
> Does anyone have ideas on why this is an issue?
>
> On Wed, Jan 21, 2015 at 10:52 AM, Brock Noland <br...@cloudera.com> wrote:
>
> > Thank you Szehon! I also could not reproduce manually. I went and did
> >
> >    rm -rf $(svn status --no-ignore)
> >    svn status --no-ignore
> >
> > manually. I hope that fixes it.
> >
> > On Tue, Jan 20, 2015 at 11:23 PM, Szehon Ho <sz...@cloudera.com> wrote:
> > > The builds have been hitting some strange error in trying to update the
> > > source in svn due to the new test files added in hcatalog in different
> > > locales.
> > >
> > > I wasn't able to reproduce the issue manually and dont know the exact
> > > cause, but just FYI that the builds are broken now.
> > >
> > > Thanks
> > > Szehon
> > >
> > > ++ svn status --no-ignore
> > > svn: Error converting entry in directory
> > > 'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
> > > svn: Can't convert string from native encoding to 'UTF-8':
> > > svn:
> >
> artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"
> > > + rm -rf
> > > + svn update
> > > svn: Error converting entry in directory
> > > 'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
> > > svn: Can't convert string from native encoding to 'UTF-8':
> > > svn:
> >
> artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"
> >
>
>
>
> --
>
> Thanks,
> Eugene
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Re: Precommit test error with utf8

Posted by Eugene Koifman <ek...@hortonworks.com>.
this was added in https://issues.apache.org/jira/browse/HIVE-9272.  The
build bot ran fine with the patch.  I also ran "mvn clean package install
-Phadoop-2,dist -DskipTests".

Does anyone have ideas on why this is an issue?

On Wed, Jan 21, 2015 at 10:52 AM, Brock Noland <br...@cloudera.com> wrote:

> Thank you Szehon! I also could not reproduce manually. I went and did
>
>    rm -rf $(svn status --no-ignore)
>    svn status --no-ignore
>
> manually. I hope that fixes it.
>
> On Tue, Jan 20, 2015 at 11:23 PM, Szehon Ho <sz...@cloudera.com> wrote:
> > The builds have been hitting some strange error in trying to update the
> > source in svn due to the new test files added in hcatalog in different
> > locales.
> >
> > I wasn't able to reproduce the issue manually and dont know the exact
> > cause, but just FYI that the builds are broken now.
> >
> > Thanks
> > Szehon
> >
> > ++ svn status --no-ignore
> > svn: Error converting entry in directory
> > 'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
> > svn: Can't convert string from native encoding to 'UTF-8':
> > svn:
> artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"
> > + rm -rf
> > + svn update
> > svn: Error converting entry in directory
> > 'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
> > svn: Can't convert string from native encoding to 'UTF-8':
> > svn:
> artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"
>



-- 

Thanks,
Eugene

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Precommit test error with utf8

Posted by Brock Noland <br...@cloudera.com>.
Thank you Szehon! I also could not reproduce manually. I went and did

   rm -rf $(svn status --no-ignore)
   svn status --no-ignore

manually. I hope that fixes it.

On Tue, Jan 20, 2015 at 11:23 PM, Szehon Ho <sz...@cloudera.com> wrote:
> The builds have been hitting some strange error in trying to update the
> source in svn due to the new test files added in hcatalog in different
> locales.
>
> I wasn't able to reproduce the issue manually and dont know the exact
> cause, but just FYI that the builds are broken now.
>
> Thanks
> Szehon
>
> ++ svn status --no-ignore
> svn: Error converting entry in directory
> 'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
> svn: Can't convert string from native encoding to 'UTF-8':
> svn: artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"
> + rm -rf
> + svn update
> svn: Error converting entry in directory
> 'hcatalog/src/test/e2e/templeton/inpdir' to UTF-8
> svn: Can't convert string from native encoding to 'UTF-8':
> svn: artof?\228?\182?\180?\227?\132?\169?\233?\188?\190?\228?\184?\132?\231?\139?\156?\227?\128?\135war.txt"