Re: [NOTICE] people.apache.org web space is moving to home.apache.org

[sebb <se...@gmail.com>]

However, I have just discovered that although SFTP has a recursive put
command, it does not have a recursive delete.

Directories can only be removed when they are empty.

As you can imagine, that makes tidying up after staging a website very
tiresome (especially ones with Javadoc and source xref)

Is there a way to fix this?


On 26 November 2015 at 19:42, sebb <se...@gmail.com> wrote:
> I was able to use sftp to copy a small site:
>
> http://home.apache.org/~sebb/commons-build-plugin-1.5-RC1/
>
> I used the "put -r" interactive command to do so.
>
> It takes quite a while as each file is sent separately.
> I've not tried uploading a very large site, so I don't know if that is feasible.
>
>  It's not easy to automate as sftp is designed for interactive use only.
>
> AIUI scp uses the same underlying transport, but is designed for
> command-line use.
>
> It would make life simpler if scp were enabled as well.
>
> On 26 November 2015 at 19:16, Greg Stein <gs...@gmail.com> wrote:
>> A VCS cannot operate a test/staging web site. They'll need a VM.
>>
>> On Thu, Nov 26, 2015 at 1:10 PM, Tony Stevenson <to...@pc-tony.com> wrote:
>>>
>>>
>>>
>>> On Thu, 26 Nov 2015, at 07:00 PM, Ralph Goers wrote:
>>> > When performing releases we typically create a new web site for our
>>> > project on our local machine, zip it up and then unzip it on p.a.o for
>>> > reviewers to look at during voting on the release. The site is way too
>>> > big to try to do file by file with sftp. How will we be able to
>>> > accomplish this with the new plan?
>>>
>>> Ralph,
>>>
>>> There are two options here.
>>>
>>> 1) Stage the changes in VCS, and when they're ready it's a simple
>>> operation to push them live.  Or edits can be made easily too.
>>> 2) Request a project VM where you can throw your tarballs.
>>>
>>> Our preference would be that you use 1. It already exists, and going
>>> from dev->prod is a trivial act for you.
>>
>>

---------------------------------------------------------------------
To unsubscribe, e-mail: log4j-dev-unsubscribe@logging.apache.org
For additional commands, e-mail: log4j-dev-help@logging.apache.org

Re: [NOTICE] people.apache.org web space is moving to home.apache.org

[Mikael Ståldal <mi...@magine.com>]

How about SSHFS?

http://fuse.sourceforge.net/sshfs.html

On Sun, Dec 6, 2015 at 4:36 AM, Matt Sicker <bo...@gmail.com> wrote:

> Would definitely like rsync support.
>
> On 5 December 2015 at 21:21, sebb <se...@gmail.com> wrote:
>
>> On 6 December 2015 at 02:01, Roman Shaposhnik <ro...@shaposhnik.org>
>> wrote:
>> > On Sat, Dec 5, 2015 at 1:32 PM, sebb <se...@gmail.com> wrote:
>> >> However, I have just discovered that although SFTP has a recursive put
>> >> command, it does not have a recursive delete.
>> >>
>> >> Directories can only be removed when they are empty.
>> >>
>> >> As you can imagine, that makes tidying up after staging a website very
>> >> tiresome (especially ones with Javadoc and source xref)
>> >
>> > I was passively monitoring this thread and dusting off my expect(1) man
>> page,
>> > but this could be a deal breaker even with automation.
>>
>> It seems that sftp does not even support recursive listing, so one way
>> to automate the process would be to use ls -l to show the directories,
>> parse the response to find the subdirs, etc.
>> Possible, but pretty tedious, and generates a lot of unnecessary
>> network traffic.
>>
>> Another option is to use rm *;rm */*;rm */*/* etc to the maximum depth
>> expected.
>> That works for files.
>>
>> Unfortunately it seems that rmdir * is not supported, so the
>> directories have to be done individually
>> This will require listing parsing as above, but at least the listings
>> will be somewhat shorter.
>>
>> [Note that sftp supports batch input, so this can all be be done without
>> expect]
>>
>> Having rsync would make it somewhat easier.
>>
>> > Thanks,
>> > Roman.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: log4j-dev-unsubscribe@logging.apache.org
>> For additional commands, e-mail: log4j-dev-help@logging.apache.org
>>
>>
>
>
> --
> Matt Sicker <bo...@gmail.com>
>



-- 
[image: MagineTV]

*Mikael Ståldal*
Senior software developer

*Magine TV*
mikael.staldal@magine.com
Grev Turegatan 3  | 114 46 Stockholm, Sweden  |   www.magine.com

Privileged and/or Confidential Information may be contained in this
message. If you are not the addressee indicated in this message
(or responsible for delivery of the message to such a person), you may not
copy or deliver this message to anyone. In such case,
you should destroy this message and kindly notify the sender by reply
email.

Re: [NOTICE] people.apache.org web space is moving to home.apache.org

[Matt Sicker <bo...@gmail.com>]

Would definitely like rsync support.

On 5 December 2015 at 21:21, sebb <se...@gmail.com> wrote:

> On 6 December 2015 at 02:01, Roman Shaposhnik <ro...@shaposhnik.org>
> wrote:
> > On Sat, Dec 5, 2015 at 1:32 PM, sebb <se...@gmail.com> wrote:
> >> However, I have just discovered that although SFTP has a recursive put
> >> command, it does not have a recursive delete.
> >>
> >> Directories can only be removed when they are empty.
> >>
> >> As you can imagine, that makes tidying up after staging a website very
> >> tiresome (especially ones with Javadoc and source xref)
> >
> > I was passively monitoring this thread and dusting off my expect(1) man
> page,
> > but this could be a deal breaker even with automation.
>
> It seems that sftp does not even support recursive listing, so one way
> to automate the process would be to use ls -l to show the directories,
> parse the response to find the subdirs, etc.
> Possible, but pretty tedious, and generates a lot of unnecessary
> network traffic.
>
> Another option is to use rm *;rm */*;rm */*/* etc to the maximum depth
> expected.
> That works for files.
>
> Unfortunately it seems that rmdir * is not supported, so the
> directories have to be done individually
> This will require listing parsing as above, but at least the listings
> will be somewhat shorter.
>
> [Note that sftp supports batch input, so this can all be be done without
> expect]
>
> Having rsync would make it somewhat easier.
>
> > Thanks,
> > Roman.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: log4j-dev-unsubscribe@logging.apache.org
> For additional commands, e-mail: log4j-dev-help@logging.apache.org
>
>


-- 
Matt Sicker <bo...@gmail.com>

Re: [NOTICE] people.apache.org web space is moving to home.apache.org

[sebb <se...@gmail.com>]

On 6 December 2015 at 02:01, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
> On Sat, Dec 5, 2015 at 1:32 PM, sebb <se...@gmail.com> wrote:
>> However, I have just discovered that although SFTP has a recursive put
>> command, it does not have a recursive delete.
>>
>> Directories can only be removed when they are empty.
>>
>> As you can imagine, that makes tidying up after staging a website very
>> tiresome (especially ones with Javadoc and source xref)
>
> I was passively monitoring this thread and dusting off my expect(1) man page,
> but this could be a deal breaker even with automation.

It seems that sftp does not even support recursive listing, so one way
to automate the process would be to use ls -l to show the directories,
parse the response to find the subdirs, etc.
Possible, but pretty tedious, and generates a lot of unnecessary
network traffic.

Another option is to use rm *;rm */*;rm */*/* etc to the maximum depth expected.
That works for files.

Unfortunately it seems that rmdir * is not supported, so the
directories have to be done individually
This will require listing parsing as above, but at least the listings
will be somewhat shorter.

[Note that sftp supports batch input, so this can all be be done without expect]

Having rsync would make it somewhat easier.

> Thanks,
> Roman.

---------------------------------------------------------------------
To unsubscribe, e-mail: log4j-dev-unsubscribe@logging.apache.org
For additional commands, e-mail: log4j-dev-help@logging.apache.org

Re: [NOTICE] people.apache.org web space is moving to home.apache.org

[Roman Shaposhnik <ro...@shaposhnik.org>]

On Sat, Dec 5, 2015 at 1:32 PM, sebb <se...@gmail.com> wrote:
> However, I have just discovered that although SFTP has a recursive put
> command, it does not have a recursive delete.
>
> Directories can only be removed when they are empty.
>
> As you can imagine, that makes tidying up after staging a website very
> tiresome (especially ones with Javadoc and source xref)

I was passively monitoring this thread and dusting off my expect(1) man page,
but this could be a deal breaker even with automation.

Thanks,
Roman.

---------------------------------------------------------------------
To unsubscribe, e-mail: log4j-dev-unsubscribe@logging.apache.org
For additional commands, e-mail: log4j-dev-help@logging.apache.org