You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@guacamole.apache.org by Philippe MARASSE <ph...@ch-poitiers.fr.INVALID> on 2022/04/08 15:20:19 UTC

Re: stalled guacd processes

Hello,

Unfortunately, one week later I have a lot of stalled processes, started 
days ago :

guacd    1312043  0.0  0.4 1641792 9596 ?        Ssl  mars29   7:43 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1312046  0.0  0.2 668136  5388 ?        Sl   mars29 0:03  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1312620  0.0  0.2 733672  5728 ?        Sl   mars29 0:10  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1313947  0.0  0.2 733672  5776 ?        Sl   mars29 0:06  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1352763  0.0  0.3 1383560 6100 ?        Sl   mars30 0:13  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1393093  0.0  0.4 1305860 8556 ?        Sl   mars31 0:01  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1393211  0.0  0.4 1325248 8468 ?        Sl   mars31 0:01  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1419712  0.0  0.8 1331816 16564 ?       Sl   avril01 0:16  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1424529  0.0  0.8 1388236 16684 ?       Sl   avril01 0:10  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1428738  0.0  0.8 1357592 16616 ?       Sl   avril01 0:07  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1429107  0.0  0.8 1431356 16032 ?       Sl   avril01 0:02  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1429229  0.0  0.8 1423128 16528 ?       Sl   avril01 0:10  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1430554  0.0  0.7 1338528 14284 ?       Sl   avril01 0:05  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1430658  0.0  0.7 1423128 14524 ?       Sl   avril01 0:10  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1540060  0.0  0.9 1357592 19524 ?       Sl   avril04 0:11  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1540219  0.0  0.3  46004  6352 ?        S    avril04 0:30  |   
\_ gs -q -dNOPAUSE -dBATCH -dSAFER -dPARANOIDSAFER -sDEVICE=pdfwrite 
-sOutputFile=- -c .s
guacd    1614435  0.0  3.8 1357592 76540 ?       Sl   avril06 0:03  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1614647  0.0  2.1 1562492 42988 ?       Sl   avril06 0:00  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1620397  0.0  5.5 1342668 111788 ?      Sl   avril06 0:08  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1623907  0.0  5.4 1408204 109400 ?      Sl   avril06 0:10  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1625341  0.0  4.3 1357592 87620 ?       Sl   avril06 0:06  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1650641  0.0  4.3 1355552 86536 ?       Sl   avril07 0:12  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1653970  0.0  4.3 1355552 87140 ?       Sl   avril07 0:21  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1658340  0.0  5.0 1357592 101028 ?      Sl   avril07 0:06  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1663974  0.0  3.2 1338528 64892 ?       Sl   avril07 0:01  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1665246  0.0  4.2 1357592 83968 ?       Sl   avril07 0:02  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1689909  0.1  5.0 1355648 100416 ?      Sl   08:28 0:36  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1691232  0.0  4.9 1388264 99372 ?       Sl   09:18 0:06  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1692428  0.0  5.8 1409856 116580 ?      Sl   10:02 0:16  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1701532  0.0  5.2 1357680 105308 ?      Sl   15:36 0:05  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1701987  0.1  3.6 1355640 72836 ?       Sl   15:50 0:06  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f
guacd    1704157  0.2  2.8 1355584 56568 ?       Sl   17:07 0:01  \_ 
/opt/guacd-1.5.0-pre1/sbin/guacd -f

How can I troubleshoot why they are stalled ?

Regards.

Le 21/03/2022 à 17:52, Mike Jumper a écrit :
> Mind retesting with a build of guacamole-server from git master or 
> "staging/1.5.0"? Changes were recently merged that should address this.
>
> - Mike
>
>
> On Mon, Mar 21, 2022 at 1:17 AM Philippe MARASSE 
> <ph...@ch-poitiers.fr.invalid> wrote:
>
>     Hello,
>
>     Again, with usage of ghostscript, lots of stalled guacd processes :
>
>     root@guacd-dc:~# ps auxf | grep guacd
>     root      975526  0.0  0.0   6196   728 pts/0    S+ 09:15  
>     0:00          \_ grep guacd
>     guacd     239034  0.0  0.4 1305732 8428 ?        Ssl mars03  12:27
>     /opt/guacd-1.4.0/sbin/guacd -f
>     *guacd     773326  0.0  0.4 1318236 9736 ?        Sl mars16  
>     0:09  \_ /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     776152  0.0  0.4 1318236 9964 ? Sl   mars16   0:15  \_
>     /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     778194  0.0  0.4 1324056 9964 ? Sl   mars16   0:08  \_
>     /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     786275  0.0  0.4 1348344 9588 ? Sl   mars16   0:14  \_
>     /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     788503  0.0  0.1  47920  3836 ? S    mars16   0:08 
>     |   \_ gs -q -dNOPAUSE -dBATCH -dSAFER -dPARANOIDSAFER
>     -sDEVICE=pdfwrite -sOutputFile=- -c .setpdfwrite
>     -sstdout=/dev/null -f -**
>     **guacd     828165  0.0  0.4 1423284 9956 ? Sl   mars17   0:10  \_
>     /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     830466  0.0  0.2  46292  4152 ? S    mars17   0:05 
>     |   \_ gs -q -dNOPAUSE -dBATCH -dSAFER -dPARANOIDSAFER
>     -sDEVICE=pdfwrite -sOutputFile=- -c .setpdfwrite
>     -sstdout=/dev/null -f -**
>     **guacd     830678  0.0  0.4 1423316 9804 ? Sl   mars17   0:04  \_
>     /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     830695  0.0  0.1  46292  3992 ? S    mars17   0:05 
>     |   \_ gs -q -dNOPAUSE -dBATCH -dSAFER -dPARANOIDSAFER
>     -sDEVICE=pdfwrite -sOutputFile=- -c .setpdfwrite
>     -sstdout=/dev/null -f -**
>     **guacd     860958  0.0  0.5 1357748 10256 ? Sl   mars18   0:07 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     862243  0.0  3.8 1423284 76780 ? Sl   mars18   0:14 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     863245  0.0  0.7 1480688 14932 ? Sl   mars18   0:00 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     863329  0.0  4.6 1423284 92264 ? Sl   mars18   0:11 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     866151  0.0  1.8 1322788 37152 ? Sl   mars18   0:01 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>     **guacd     871034  0.0  4.5 1334216 89992 ? Sl   mars18   0:06 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f*
>     guacd     973738  0.1  4.0 1355708 81364 ?       Sl 08:09   0:06 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f
>     guacd     974720  0.6  5.5 1355652 110296 ?      Sl 08:46   0:10 
>     \_ /opt/guacd-1.4.0/sbin/guacd -f
>
>     I'm seeking directions to narrow the issue. Some usage of
>     ghostscript worked fine, other hangs.
>
>     Regards.
>
>
>     Le 10/03/2022 à 17:00, Philippe MARASSE a écrit :
>>     Hello,
>>
>>     It occurs more frequently since I've upgraded to guacd 1.4.0, I
>>     see stalled process used a few days ago :
>>
>>     # ps auxf | grep guacd
>>     root      548250  0.0  0.0   6196   716 pts/0    S+ 16:48  
>>     0:00          \_ grep guacd
>>     guacd     239034  0.0  0.6 1231968 13364 ?       Ssl mars03  
>>     6:07 /opt/guacd-1.4.0/sbin/guacd -f
>>     *guacd     450284  0.0  1.1 1323840 22476 ?       Sl mars08  
>>     0:11  \_ /opt/guacd-1.4.0/sbin/guacd -f**
>>     **guacd     459214  0.0  1.1 1319924 23760 ? Sl   mars08   0:01 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>>     **guacd     460026  0.0  4.5 1330532 90820 ? Sl   mars08   0:03 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>>     **guacd     462567  0.0  5.4 1357880 109208 ? Sl   mars08   0:04 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f**
>>     **guacd     488863  0.0  5.0 1332036 101260 ? Sl   mars09   0:18 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f*
>>     guacd     534541  0.1  5.7 1348296 114428 ?      Sl 08:14   0:34 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f
>>     guacd     544071  0.1  6.4 1423284 128796 ?      Sl 14:11   0:09 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f
>>     guacd     545739  0.2  5.9 1423680 118572 ?      Sl 15:15   0:15 
>>     \_ /opt/guacd-1.4.0/sbin/guacd -f
>>
>>     All of them looks like :
>>
>>     # grep 460026 /var/log/daemon.log
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: No security mode
>>     specified. Defaulting to security mode negotiation with server.
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011No security mode specified. Defaulting to security mode
>>     negotiation with server.
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Resize method: none
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011No clipboard line-ending normalization specified.
>>     Defaulting to preserving the format of all line endings.
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011User "@6c8b6aee-7840-4c64-b4a0-a72c40501d86" joined
>>     connection "$afe8dfaf-77fc-4c6b-8271-680b3a06ce1a" (1 users now
>>     present)
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: Resize method: none
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: No clipboard line-ending
>>     normalization specified. Defaulting to preserving the format of
>>     all line endings.
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: User
>>     "@6c8b6aee-7840-4c64-b4a0-a72c40501d86" joined connection
>>     "$afe8dfaf-77fc-4c6b-8271-680b3a06ce1a" (1 users now present)
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: Recording of session will
>>     be saved to "/xxx.sr <http://xxx.sr>".
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Recording of session will be saved to "/xxx.sr
>>     <http://xxx.sr>".
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: Loading keymap "base"
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Loading keymap "base"
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: Loading keymap "fr-fr-azerty"
>>     Mar  8 14:08:22 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Loading keymap "fr-fr-azerty"
>>     Mar  8 14:08:30 guacd-dc guacd[460026]: Connected to RDPDR 1.12
>>     as client 0x0038
>>     Mar  8 14:08:30 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Connected to RDPDR 1.12 as client 0x0038
>>     Mar  8 14:08:30 guacd-dc guacd[460026]: RDPDR user logged on
>>     Mar  8 14:08:30 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011RDPDR user logged on
>>     Mar  8 14:19:37 guacd-dc guacd[460026]: Print job created
>>     Mar  8 14:19:37 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Print job created
>>     Mar  8 14:19:37 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Created PDF filter process PID=460369
>>     Mar  8 14:19:37 guacd-dc guacd[460026]: Created PDF filter
>>     process PID=460369
>>     Mar  8 14:19:37 guacd-dc guacd[460026]: Print job closed
>>     Mar  8 14:19:37 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Print job closed
>>     Mar  8 14:19:49 guacd-dc guacd[460026]: Print job created
>>     Mar  8 14:19:49 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Print job created
>>     Mar  8 14:19:49 guacd-dc guacd[460026]: Created PDF filter
>>     process PID=460375
>>     Mar  8 14:19:49 guacd-dc guacd[460026]: guacd[460026]:
>>     INFO:#011Created PDF filter process PID=460375
>>
>>     Print jobs are never closed at end, I think a normal job looks like :
>>
>>     Print job created
>>     INFO:#011Print job created
>>     INFO:#011Created PDF filter process PID=460369
>>     Created PDF filter process PID=460369
>>     Print job closed
>>     INFO:#011Print job closed
>>
>>     And the stalled processes last log line is :
>>
>>     INFO:#011Created PDF filter process PID=460375
>>
>>     Maybe an issue with ghostscript ? It looks like two log lines are
>>     inverted :
>>
>>     INFO:#011Created PDF filter process PID=460369
>>     Created PDF filter process PID=460369
>>
>>     When it works, and once stalled :
>>
>>     Created PDF filter process PID=460375
>>     INFO:#011Created PDF filter process PID=460375
>>
>>     As a workaround, I can kill processes individually, it does not
>>     seem to affect guacd behavior but it's a bit strange.
>>
>>     Regards.
>>     -- 
>>     Philippe MARASSE
>>
>>     Responsable pôle Infrastructures - DSIO
>>     Centre Hospitalier Henri Laborit
>>     CS 10587 - 370 avenue Jacques Cœur
>>     86021 Poitiers Cedex
>>     Tel : 05.49.44.57.19
>
>     -- 
>     Philippe MARASSE
>
>     Responsable pôle Infrastructures
>     Direction de l'Informatique, Support à la Communication et à l'Organisation (DISCO)
>     Centre Hospitalier Henri Laborit
>     CS 10587 - 370 avenue Jacques Cœur
>     86021 Poitiers Cedex
>     Tel : 05.49.44.57.19
>

-- 
Philippe MARASSE

Responsable pôle Infrastructures
Direction de l'Informatique, Support à la Communication et à l'Organisation (DISCO)
Centre Hospitalier Henri Laborit
CS 10587 - 370 avenue Jacques Cœur
86021 Poitiers Cedex
Tel : 05.49.44.57.19

Re: stalled guacd processes

Posted by Philippe MARASSE <ph...@ch-poitiers.fr.INVALID>.
git log shows :

commit a175a3d902faf76d4b85817887866e388787ab5f (HEAD -> master, 
origin/master, origin/HEAD)
Merge: c716a07a 9cbd7682
Author: Virtually Nick <ne...@users.noreply.github.com>
Date:   Wed Mar 23 09:58:58 2022 -0400

     GUACAMOLE-1312: Merge add Canadian French RDP keymap

commit 9cbd768210a7b2330b16012748d980cb987ea728
Author: Kaven Rousseau <kr...@macif.fr>
Date:   Thu Feb 20 17:44:16 2020 -0500

     GUACAMOLE-1312: Added fr_ca keymap

commit c716a07abca0d3d44760f0207fd26c22930f29ea
Merge: 75a11b05 c880f02f
Author: Virtually Nick <vn...@apache.org>
Date:   Thu Mar 17 15:24:48 2022 -0400

     Merge 1.5.0 changes back to master.

commit c880f02fe88f83ccabbbb5d057a64d4de3dc4219 (origin/staging/1.5.0)
Merge: 75a11b05 ce88fa4d
Author: Virtually Nick <ne...@users.noreply.github.com>
Date:   Thu Mar 17 15:20:51 2022 -0400

     GUACAMOLE-1115: Merge ensure RDP print process does not block 
itself from completing.

commit ce88fa4d4a45f2d640148231e06413eb8223fd4d
Author: Michael Jumper <mj...@apache.org>
Date:   Thu Mar 17 18:27:05 2022 +0000

     GUACAMOLE-1115: Forcibly kill any outstanding PDF filter job when 
cleaning up resources.
...

So I should have the fix I think.

Regards.

Le 08/04/2022 à 17:59, Michael Jumper a écrit :
> On Fri, Apr 8, 2022, 08:20 Philippe MARASSE 
> <ph...@ch-poitiers.fr.invalid> wrote:
>
>     Hello,
>
>     Unfortunately, one week later I have a lot of stalled processes,
>     started days ago :
>
>     ...
>
>
> In the source tree that you built, what does git show as the current 
> commit?
>
> - Mike
>

-- 
Philippe MARASSE

Responsable pôle Infrastructures
Direction de l'Informatique, Support à la Communication et à l'Organisation (DISCO)
Centre Hospitalier Henri Laborit
CS 10587 - 370 avenue Jacques Cœur
86021 Poitiers Cedex
Tel : 05.49.44.57.19

Re: stalled guacd processes

Posted by Michael Jumper <mj...@apache.org>.
On Fri, Apr 8, 2022, 08:20 Philippe MARASSE
<ph...@ch-poitiers.fr.invalid> wrote:

> Hello,
>
> Unfortunately, one week later I have a lot of stalled processes, started
> days ago :
>
> ...
>

In the source tree that you built, what does git show as the current commit?

- Mike