You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by root <eb...@yahoo.com> on 2003/12/30 23:12:42 UTC
WARNING: error decoding UTF-8 for ?
Hi, this popped up when checking in a large number of
PDF files into a repository.
Is there some way to determine which file it was
having trouble with? Is this something to be
concerned about?
It seems to come from:
../subversion/clients/cmdline/notify.c
err = svn_cmdline_path_local_style_from_utf8
(&path_stdout, path, nb->pool);
if (err)
{
printf ("WARNING: error decoding UTF-8 for
?\n");
Regards,
Davis
__________________________________
Do you Yahoo!?
Find out what made the Top Yahoo! Searches of 2003
http://search.yahoo.com/top2003
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: WARNING: error decoding UTF-8 for ?
Posted by kf...@collab.net.
John Szakmeister <jo...@szakmeister.net> writes:
> I made a change in r8040 whereby ra_dav could compute the root of the
> repository wrong. This may stem from that, but without more information it
> would be difficult to tell.
To clarify: John's change *fixed* the problem whereby ra_dav could
miscompute the root, not caused it :-).
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: WARNING: error decoding UTF-8 for ?
Posted by root <eb...@yahoo.com>.
> Davis,
>
> We'll need a little more information, such as what
> server and client version
> you're using, and over which ra_layer (ra_local,
> ra_svn, or ra_dav). Also,
> can you narrow your commit down to see where this
> fails, or prints the
> warning? That could help identify the problem, as
> would having the exact
> command line you used to commit.
>
> I made a change in r8040 whereby ra_dav could
> compute the root of the
> repository wrong. This may stem from that, but
> without more information it
> would be difficult to tell.
>
> -John
Hi John,
The server is running the following, all of which I
built yesterday:
subversion-0.35.1
http-2.0.48
db-4.2.52
If you need other versions of relevant software
pieces, let me know, but those three I specifically
re-built yesterday.
The client is Win32 command line svn tools,
svn-win32-0.33.0.
Pardon my ignorance, but I believe I'm using
ra_svn...although I do have https access to said
repository through ra_dav, I use svn+ssh method to
checkin/out..so, I think this is ra_svn, right?
The sequence of steps:
On server:
# svnadmin create /svn/repos1
# chmod -R 770 /svn/repos1
# chown -R svn /svn/repos1
# chgrp -R svn /svn/repos1
On client:
C:\DirToCheckin>svn co
svn+ssh://192.168.1.10/svn/repos1 .
C:\DirToCheckin>svn add *
C:\DirToCheckin>svn ci -m"Initial Import"
Adding ..... <lots of stuff printed here>
...then finally:
Transmitting file data
................................................................................................................................
.......................................................................................................................................................
......................................WARNING: error
decoding UTF-8 for ?
.......................................................................................................................................................
.......................................................................................................................................................
.......................................................................................................................................................
.............................
Committed revision 1.
Please let me know if you need me to provide any other
information that would be useful.
Regards,
Davis
__________________________________
Do you Yahoo!?
Find out what made the Top Yahoo! Searches of 2003
http://search.yahoo.com/top2003
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: WARNING: error decoding UTF-8 for ?
Posted by John Szakmeister <jo...@szakmeister.net>.
On Tuesday 30 December 2003 18:54, root wrote:
> Hi Erik,
>
> I did not explicitly run cvs2svn.py, but it is
> possible that a filename in the repository has a
> non-ascii filename. Is there some way to quickly find
> the culprit - is there a log somewhere that would
> identify which file it is? If not, I'm sure I can
> track it down.
Davis,
We'll need a little more information, such as what server and client version
you're using, and over which ra_layer (ra_local, ra_svn, or ra_dav). Also,
can you narrow your commit down to see where this fails, or prints the
warning? That could help identify the problem, as would having the exact
command line you used to commit.
I made a change in r8040 whereby ra_dav could compute the root of the
repository wrong. This may stem from that, but without more information it
would be difficult to tell.
-John
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: WARNING: error decoding UTF-8 for ?
Posted by root <eb...@yahoo.com>.
Hi Erik,
I did not explicitly run cvs2svn.py, but it is
possible that a filename in the repository has a
non-ascii filename. Is there some way to quickly find
the culprit - is there a log somewhere that would
identify which file it is? If not, I'm sure I can
track it down.
Best regards,
Davis
--- Erik Huelsmann <e....@gmx.net> wrote:
> I think you used cvs2svn.py for conversion of your
> repository to Subversion.
> Your repository has non-ascii filenames in it.
> cvs2svn.py in 0.35.1 does not
> like that. Go to issue 1255 and apply the patch you
> find there. I just
> attached it. It should fix your problems with the
> conversion.
>
> bye,
>
> Erik.
>
> > Hi, this popped up when checking in a large number
> of
> > PDF files into a repository.
> >
> > Is there some way to determine which file it was
> > having trouble with? Is this something to be
> > concerned about?
> >
> > It seems to come from:
> >
> > ../subversion/clients/cmdline/notify.c
> >
> > err = svn_cmdline_path_local_style_from_utf8
> > (&path_stdout, path, nb->pool);
> > if (err)
> > {
> > printf ("WARNING: error decoding UTF-8 for
> > ?\n");
> >
> > Regards,
> > Davis
> >
> > __________________________________
> > Do you Yahoo!?
> > Find out what made the Top Yahoo! Searches of 2003
> > http://search.yahoo.com/top2003
> >
> >
>
---------------------------------------------------------------------
> > To unsubscribe, e-mail:
> users-unsubscribe@subversion.tigris.org
> > For additional commands, e-mail:
> users-help@subversion.tigris.org
> >
>
> --
> +++ GMX - die erste Adresse f�r Mail, Message, More
> +++
> Neu: Preissenkung f�r MMS und FreeMMS!
> http://www.gmx.net
>
>
>
>
---------------------------------------------------------------------
> To unsubscribe, e-mail:
> users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail:
> users-help@subversion.tigris.org
>
__________________________________
Do you Yahoo!?
Find out what made the Top Yahoo! Searches of 2003
http://search.yahoo.com/top2003
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: WARNING: error decoding UTF-8 for ?
Posted by Erik Huelsmann <e....@gmx.net>.
I think you used cvs2svn.py for conversion of your repository to Subversion.
Your repository has non-ascii filenames in it. cvs2svn.py in 0.35.1 does not
like that. Go to issue 1255 and apply the patch you find there. I just
attached it. It should fix your problems with the conversion.
bye,
Erik.
> Hi, this popped up when checking in a large number of
> PDF files into a repository.
>
> Is there some way to determine which file it was
> having trouble with? Is this something to be
> concerned about?
>
> It seems to come from:
>
> ../subversion/clients/cmdline/notify.c
>
> err = svn_cmdline_path_local_style_from_utf8
> (&path_stdout, path, nb->pool);
> if (err)
> {
> printf ("WARNING: error decoding UTF-8 for
> ?\n");
>
> Regards,
> Davis
>
> __________________________________
> Do you Yahoo!?
> Find out what made the Top Yahoo! Searches of 2003
> http://search.yahoo.com/top2003
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
--
+++ GMX - die erste Adresse für Mail, Message, More +++
Neu: Preissenkung für MMS und FreeMMS! http://www.gmx.net
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Performance
Posted by Patrick Dean Rusk <pa...@comcast.net>.
"Patrick Dean Rusk" wrote...
> That's the second time I've heard WCE mentioned. Could you point me to
> something that describes what it is and how to turn it on, and possible
> other good NTFS options, too?
D'OH!!! Silly me. That's "write cache enabled" isn't it? If so, never
mind.
Pat
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Performance
Posted by Patrick Dean Rusk <pa...@comcast.net>.
"Brandon Ehle" wrote...
> After enabling WCE and TXN_NOSYNC, I find that my server is
> completely CPU limited at this point (and this isn't likely to be fixed in
1.0).
That's the second time I've heard WCE mentioned. Could you point me to
something that describes what it is and how to turn it on, and possible
other good NTFS options, too?
Thanks.
Patrick Rusk
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Performance
Posted by Brandon Ehle <az...@yahoo.com>.
> A straight file transfer of this data, even given
> Gig-E still takes probably 10 minutes b/c of various
> OS overhead. However, it seems like more than an hour
> to check in a repository this big is a long time. Are
> there ways to monitor performance, and try tweaks?
>
You should see a huge speedup if you created the repository with
--bdb-txn-nosync.
You can see about how much speedup you should see from this chart
(NOSYNC vs regular):
http://subversion.kicks-ass.org/perf/elapsed.html
This will give you a huge performance boost during imports and commits.
It shouldn't affect any other operations much and is slightly unsafe
if your server isn't on a UPS (but no less secure than having write
cache enabled on your hard drives, which is also another huge
performance win).
After the repository has been created, you can turn this off by editing
your DB_CONFIG file and restarting your servers, but I wouldn't
recommend doing this unless you also disable write cache on your harddrives.
After enabling WCE and TXN_NOSYNC, I find that my server is completely
CPU limited at this point (and this isn't likely to be fixed in 1.0).
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Performance
Posted by root <eb...@yahoo.com>.
Hello,
One of my repositories is quite large, and I am
curious about the performance in checking it in. This
is via the method where I checkout a newly created
blank repos, then cd to my directory where I have
everything, do an svn add, then do a checkin.
Both client and server are identical machines and the
specs are:
Dual-Processor Pentium III 1.13 GHz, 2GB SDRAM, 10K
RPM Ultrawide SCSI storage, and Gigabit Ethernet
between them.
The characteristics of the repository are: 8.67GB,
3141 files, 1187 folders.
When I try to check in this large repository, it takes
well over an hour. My question is...does this seem
reasonable, given the hardware involved here?
A straight file transfer of this data, even given
Gig-E still takes probably 10 minutes b/c of various
OS overhead. However, it seems like more than an hour
to check in a repository this big is a long time. Are
there ways to monitor performance, and try tweaks?
I'd be willing to run such tests here and report
results if someone has some suggestions on what to
try.
Regards,
Davis
__________________________________
Do you Yahoo!?
Find out what made the Top Yahoo! Searches of 2003
http://search.yahoo.com/top2003
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org