You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Shyam Rai (JIRA)" <ji...@apache.org> on 2017/06/19 18:03:00 UTC

[jira] [Commented] (HAWQ-738) Allocate query resource twice in function call through jdbc

    [ https://issues.apache.org/jira/browse/HAWQ-738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054486#comment-16054486 ] 

Shyam Rai commented on HAWQ-738:
--------------------------------

Can someone please state the exact version in which this was fixed ?

> Allocate query resource twice in function call through jdbc
> -----------------------------------------------------------
>
>                 Key: HAWQ-738
>                 URL: https://issues.apache.org/jira/browse/HAWQ-738
>             Project: Apache HAWQ
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0.0-incubating
>            Reporter: Ruilong Huo
>            Assignee: Ruilong Huo
>             Fix For: 2.0.0.0-incubating
>
>
> It allocates query resource twice in function call through jdbc, one in parse, and the other in bind. Though the same thing works with psql.
> Use runme.sh in attached bug.zip to reproduce the issue. It may raise below error on host with limited resource (i.e., low memory, etc).
> {noformat}
> [gpadmin@localhost debug]$ ./runme.sh 
> java -classpath /home/gpadmin/debug/Bug.jar:/home/gpadmin/debug/gpdb.jar Bug localhost 5432 gpadmin gpadmin changeme
> gpServer: hdp23
> gpPort: 5432
> gpDatabase: gpadmin
> gpUserName: gpadmin
> gpPassword: changeme
> DriverManager.getConnection("jdbc:postgresql://hdp23:5432/gpadmin")
>     trying sun.jdbc.odbc.JdbcOdbcDriver
> *Driver.connect (jdbc:postgresql://hdp23:5432/gpadmin)
>     trying org.postgresql.Driver
> getConnection returning org.postgresql.Driver
> strSQL: DROP TABLE IF EXISTS public.debug;
> CREATE TABLE public.debug
> (id int, foo_bar text)
> DISTRIBUTED RANDOMLY;
> strSQL: INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;
> strSQL: CREATE OR REPLACE FUNCTION public.fn_debug() RETURNS text AS
> $$
> DECLARE
> 	v_return text;
> BEGIN
> 	SELECT foo_bar
> 	INTO v_return
> 	FROM public.debug
> 	WHERE id = 1;
> 	RETURN v_return;
> END;
> $$
> LANGUAGE plpgsql;
> strSQL: SELECT public.fn_debug()
> org.postgresql.util.PSQLException: ERROR: failed to acquire resource from resource manager, session 32 deadlock is detected (pquery.c:804)
> 	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)
> 	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)
> 	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> 	at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)
> 	at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:374)
> 	at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:254)
> 	at Bug.getFunctionResults(Bug.java:144)
> 	at Bug.main(Bug.java:41)
> SQLException: SQLState(XX000)
> ERROR: failed to acquire resource from resource manager, session 32 deadlock is detected (pquery.c:804)
> Exception in thread "main" java.sql.SQLException: ERROR: failed to acquire resource from resource manager, session 32 deadlock is detected (pquery.c:804)
> 	at Bug.main(Bug.java:49)
> {noformat}
> while the expected result is as below:
> {noformat}
> [gpadmin@localhost hawq_bug]$ ./runme.sh
> java -classpath /home/gpadmin/huor/hawq_bug/Bug.jar:/home/gpadmin/huor/hawq_bug/gpdb.jar Bug localhost 5432 gptest gpadmin changeme
> gpServer: localhost
> gpPort: 5432
> gpDatabase: gptest
> gpUserName: gpadmin
> gpPassword: changeme
> DriverManager.getConnection("jdbc:postgresql://localhost:5432/gptest")
>     trying sun.jdbc.odbc.JdbcOdbcDriver
> *Driver.connect (jdbc:postgresql://localhost:5432/gptest)
>     trying org.postgresql.Driver
> getConnection returning org.postgresql.Driver
> strSQL: DROP TABLE IF EXISTS public.debug;
> CREATE TABLE public.debug
> (id int, foo_bar text)
> DISTRIBUTED RANDOMLY;
> SQLWarning:
> strSQL: INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;
> strSQL: CREATE OR REPLACE FUNCTION public.fn_debug() RETURNS text AS
> $$
> DECLARE
>     v_return text;
> BEGIN
>     SELECT foo_bar
>     INTO v_return
>     FROM public.debug
>     WHERE id = 1;
>     RETURN v_return;
> END;
> $$
> LANGUAGE plpgsql;
> strSQL: SELECT public.fn_debug()
> output: foo_1
> {noformat}
> If you look into the pg_log on master, you can see it allocate query resource twice for the function call:
> {noformat}
> rhuo-mbp:jdbc rhuo$ cat hawq-2016-05-14_000000.csv
> 2016-05-16 13:50:50.255504 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:51:20.275204 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:51:50.291712 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:52:20.300825 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:52:50.313270 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:52:54.579579 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,0,con521,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:521 tmpdir:/data/master_tmp",,,,,,,0,,"postinit.c",465,
> 2016-05-16 13:52:54.693462 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103517,con521,cmd7,seg-10000,,,x103517,sx1,"LOG","00000","ConnID 507. Registered in HAWQ resource manager (By OID)",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;",0,,"rmcomm_QD2RM.c",609,
> 2016-05-16 13:52:54.693695 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 507. Expect query resource (256 MB, 0.250000 CORE) x 1 ( MIN 1 ) resource after adjusting based on queue NVSEG limits.",,,,,,,0,,"resqueuemanager.c",1913,
> 2016-05-16 13:52:54.693711 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Latency of getting resource allocated is 73us",,,,,,,0,,"resqueuemanager.c",4375,
> 2016-05-16 13:52:54.693719 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource water mark changes from (0 MB, 0.000000 CORE) to (256 MB, 0.250000 CORE)",,,,,,,0,,"resqueuemanager.c",2550,
> 2016-05-16 13:52:54.693769 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103517,con521,cmd7,seg-10000,,,x103517,sx1,"LOG","00000","ConnID 507. Acquired resource from resource manager, (256 MB, 0.250000 CORE) x 1.",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;",0,,"rmcomm_QD2RM.c",868,
> 2016-05-16 13:52:54.694119 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103517,con521,cmd7,seg-10000,,,x103517,sx1,"LOG","00000","data locality ratio: 0.000; virtual segment number: 1; different host number: 1; virtual segment number per host(avg/min/max): (1/1/1); segment size(avg/min/max): (0.000 B/0 B/0 B); segment size with penalty(avg/min/max): (0.000 B/0 B/0 B); continuity(avg/min/max): (0.000/0.000/0.000).",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;",0,,"cdbdatalocality.c",3396,
> 2016-05-16 13:52:54.811026 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 507. Returned resource.",,,,,,,0,,"requesthandler.c",562,
> 2016-05-16 13:52:54.811146 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103517,con521,cmd8,seg-1,,,x103517,sx1,"LOG","00000","ConnID 507. Returned resource to resource manager.",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;",0,,"rmcomm_QD2RM.c",951,
> 2016-05-16 13:52:54.811247 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"WARNING","01000","Resource manager finds possible not handled resource request from ConnID 507.",,,,,,,0,,"requesthandler.c",282,
> 2016-05-16 13:52:54.811272 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 507. Connection is unregistered.",,,,,,,0,,"requesthandler.c",300,
> 2016-05-16 13:52:54.811634 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103517,con521,cmd8,seg-1,,,x103517,sx1,"LOG","00000","ConnID 507. Unregistered from HAWQ resource manager.",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i;",0,,"rmcomm_QD2RM.c",661,
> 2016-05-16 13:52:54.820168 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103521,con521,cmd10,seg-1,,,x103521,sx1,"LOG","00000","ConnID 508. Registered in HAWQ resource manager (By OID)",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",609,
> 2016-05-16 13:52:54.820419 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 508. Expect query resource (256 MB, 0.250000 CORE) x 6 ( MIN 6 ) resource after adjusting based on queue NVSEG limits.",,,,,,,0,,"resqueuemanager.c",1913,
> 2016-05-16 13:52:54.820437 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Latency of getting resource allocated is 73us",,,,,,,0,,"resqueuemanager.c",4375,
> 2016-05-16 13:52:54.820446 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource water mark changes from (256 MB, 0.250000 CORE) to (1536 MB, 1.500000 CORE)",,,,,,,0,,"resqueuemanager.c",2550,
> 2016-05-16 13:52:54.820495 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103521,con521,cmd10,seg-1,,,x103521,sx1,"LOG","00000","ConnID 508. Acquired resource from resource manager, (256 MB, 0.250000 CORE) x 6.",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",868,
> 2016-05-16 13:52:54.823416 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103521,con521,cmd11,seg-1,,,x103521,sx1,"LOG","00000","data locality ratio: 1.000; virtual segment number: 6; different host number: 1; virtual segment number per host(avg/min/max): (6/6/6); segment size(avg/min/max): (424.000 B/0 B/2544 B); segment size with penalty(avg/min/max): (424.000 B/0 B/2544 B); continuity(avg/min/max): (0.167/0.000/1.000).",,,,,"SQL statement ""SELECT foo_bar FROM public.debug WHERE id = 1""
> PL/pgSQL function ""fn_debug"" line 4 at SQL statement","SELECT public.fn_debug()",0,,"cdbdatalocality.c",3396,
> 2016-05-16 13:52:54.898230 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 508. Returned resource.",,,,,,,0,,"requesthandler.c",562,
> 2016-05-16 13:52:54.898336 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103521,con521,cmd12,seg-1,,,x103521,sx1,"LOG","00000","ConnID 508. Returned resource to resource manager.",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",951,
> 2016-05-16 13:52:54.898428 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"WARNING","01000","Resource manager finds possible not handled resource request from ConnID 508.",,,,,,,0,,"requesthandler.c",282,
> 2016-05-16 13:52:54.898441 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 508. Connection is unregistered.",,,,,,,0,,"requesthandler.c",300,
> 2016-05-16 13:52:54.898598 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,103521,con521,cmd12,seg-1,,,x103521,sx1,"LOG","00000","ConnID 508. Unregistered from HAWQ resource manager.",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",661,
> 2016-05-16 13:52:54.906284 EDT,"gpadmin","gpadmin",p29743,th424065152,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,0,con521,cmd12,seg-1,,,,,"LOG","00000","Clean up communication to resource manager now.",,,,,,,0,,"rmcomm_QD2RM.c",460,
> 2016-05-16 13:52:54.993569 EDT,"gpadmin","gpadmin",p29743,th-248940800,"192.168.175.129","26084",2016-05-16 13:52:54 EDT,0,con521,cmd12,seg-1,,,,,"LOG","00000","generateResourceRefreshHeartBeat exits.",,,,,,,0,,,,
> 2016-05-16 13:53:02.031115 EDT,"gpadmin","gpadmin",p29774,th424065152,"[local]",,2016-05-16 13:53:02 EDT,0,con523,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:523 tmpdir:/data/master_tmp",,,,,,,0,,"postinit.c",465,
> 2016-05-16 13:53:20.332840 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:53:39.463663 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,0,con524,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:524 tmpdir:/data/master_tmp",,,,,,,0,,"postinit.c",465,
> 2016-05-16 13:53:39.545968 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103526,con524,cmd2,seg-10000,,,x103526,sx1,"LOG","00000","ConnID 509. Registered in HAWQ resource manager (By OID)",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i",0,,"rmcomm_QD2RM.c",609,
> 2016-05-16 13:53:39.546149 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 509. Expect query resource (256 MB, 0.250000 CORE) x 1 ( MIN 1 ) resource after adjusting based on queue NVSEG limits.",,,,,,,0,,"resqueuemanager.c",1913,
> 2016-05-16 13:53:39.546165 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Latency of getting resource allocated is 50us",,,,,,,0,,"resqueuemanager.c",4375,
> 2016-05-16 13:53:39.546218 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103526,con524,cmd2,seg-10000,,,x103526,sx1,"LOG","00000","ConnID 509. Acquired resource from resource manager, (256 MB, 0.250000 CORE) x 1.",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i",0,,"rmcomm_QD2RM.c",868,
> 2016-05-16 13:53:39.546502 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103526,con524,cmd2,seg-10000,,,x103526,sx1,"LOG","00000","data locality ratio: 0.000; virtual segment number: 1; different host number: 1; virtual segment number per host(avg/min/max): (1/1/1); segment size(avg/min/max): (0.000 B/0 B/0 B); segment size with penalty(avg/min/max): (0.000 B/0 B/0 B); continuity(avg/min/max): (0.000/0.000/0.000).",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i",0,,"cdbdatalocality.c",3396,
> 2016-05-16 13:53:39.661720 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 509. Returned resource.",,,,,,,0,,"requesthandler.c",562,
> 2016-05-16 13:53:39.661832 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103526,con524,cmd3,seg-1,,,x103526,sx1,"LOG","00000","ConnID 509. Returned resource to resource manager.",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i",0,,"rmcomm_QD2RM.c",951,
> 2016-05-16 13:53:39.661935 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"WARNING","01000","Resource manager finds possible not handled resource request from ConnID 509.",,,,,,,0,,"requesthandler.c",282,
> 2016-05-16 13:53:39.661950 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 509. Connection is unregistered.",,,,,,,0,,"requesthandler.c",300,
> 2016-05-16 13:53:39.662270 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103526,con524,cmd3,seg-1,,,x103526,sx1,"LOG","00000","ConnID 509. Unregistered from HAWQ resource manager.",,,,,,"INSERT INTO public.debug
> SELECT i, 'foo_' || i from generate_series(1,100) AS i",0,,"rmcomm_QD2RM.c",661,
> -----------------------------------------------------------------------------------------------------------------------------------
> First time query resource allocate for function call "SELECT public.fn_debug()": successful
> -----------------------------------------------------------------------------------------------------------------------------------
> 2016-05-16 13:53:39.667859 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103530,con524,cmd4,seg-1,,,x103530,sx1,"LOG","00000","ConnID 510. Registered in HAWQ resource manager (By OID)",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",609,
> 2016-05-16 13:53:39.668054 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 510. Expect query resource (256 MB, 0.250000 CORE) x 6 ( MIN 6 ) resource after adjusting based on queue NVSEG limits.",,,,,,,0,,"resqueuemanager.c",1913,
> 2016-05-16 13:53:39.668081 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Latency of getting resource allocated is 57us",,,,,,,0,,"resqueuemanager.c",4375,
> 2016-05-16 13:53:39.668131 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103530,con524,cmd4,seg-1,,,x103530,sx1,"LOG","00000","ConnID 510. Acquired resource from resource manager, (256 MB, 0.250000 CORE) x 6.",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",868,
> -----------------------------------------------------------------------------------------------------------------------------------
> Second time query resource allocate for function call "SELECT public.fn_debug()": failed
> -----------------------------------------------------------------------------------------------------------------------------------
> 2016-05-16 13:53:39.668333 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103530,con524,cmd4,seg-1,,,x103530,sx1,"LOG","00000","ConnID 511. Registered in HAWQ resource manager (By OID)",,,,,,"SELECT public.fn_debug()",0,,"rmcomm_QD2RM.c",609,
> 2016-05-16 13:53:39.668501 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 511. Expect query resource (256 MB, 0.250000 CORE) x 6 ( MIN 6 ) resource after adjusting based on queue NVSEG limits.",,,,,,,0,,"resqueuemanager.c",1913,
> 2016-05-16 13:53:39.668516 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Locking resource and stop forced GRM container breathe out.",,,,,,,0,,"resqueuemanager.c",3532,
> 2016-05-16 13:53:39.712340 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,103530,con524,cmd4,seg-1,,,x103530,sx1,"ERROR","XX000","failed to acquire resource from resource manager, session 524 deadlock is detected (pquery.c:804)",,,,,,"SELECT public.fn_debug()",0,,"pquery.c",804,"Stack trace:
> 1    0x87463a postgres errstart (elog.c:497)
> 2    0x7b47e9 postgres AllocateResource (pquery.c:804)
> 3    0x727888 postgres planner (planner.c:550)
> 4    0x7add1e postgres pg_plan_query (postgres.c:845)
> 5    0x7ae437 postgres <symbol not found> (postgres.c:917)
> 6    0x7b1682 postgres PostgresMain (postgres.c:5014)
> 7    0x763f23 postgres <symbol not found> (postmaster.c:5889)
> 8    0x76467d postgres <symbol not found> (postmaster.c:2169)
> 9    0x7664ae postgres PostmasterMain (postmaster.c:6519)
> 10   0x6c072a postgres main (main.c:226)
> 11   0x7f1915021d5d libc.so.6 __libc_start_main (??:0)
> 12   0x4a14e9 postgres <symbol not found> (??:0)
> "
> 2016-05-16 13:53:39.712775 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 510. Returned resource.",,,,,,,0,,"requesthandler.c",562,
> 2016-05-16 13:53:39.713056 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,0,con524,cmd4,seg-1,,,,,"LOG","00000","ConnID 510. Returned resource to resource manager.",,,,,,,0,,"rmcomm_QD2RM.c",951,
> 2016-05-16 13:53:39.713253 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"WARNING","01000","Resource manager finds possible not handled resource request from ConnID 510.",,,,,,,0,,"requesthandler.c",282,
> 2016-05-16 13:53:39.713269 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 510. Connection is unregistered.",,,,,,,0,,"requesthandler.c",300,
> 2016-05-16 13:53:39.713352 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,0,con524,cmd4,seg-1,,,,,"LOG","00000","ConnID 510. Unregistered from HAWQ resource manager.",,,,,,,0,,"rmcomm_QD2RM.c",661,
> 2016-05-16 13:53:39.714932 EDT,"gpadmin","gpadmin",p30112,th424065152,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,0,con524,cmd4,seg-1,,,,,"LOG","00000","Clean up communication to resource manager now.",,,,,,,0,,"rmcomm_QD2RM.c",460,
> 2016-05-16 13:53:39.745897 EDT,"gpadmin","gpadmin",p30112,th-248940800,"192.168.175.129","26129",2016-05-16 13:53:39 EDT,0,con524,cmd4,seg-1,,,,,"LOG","00000","generateResourceRefreshHeartBeat exits.",,,,,,,0,,,,
> 2016-05-16 13:53:50.339646 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:54:20.375091 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:54:50.390263 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:55:20.406517 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:55:50.411268 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:56:20.440662 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:56:50.476459 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:57:20.524175 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:57:50.540684 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:58:20.557625 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:58:40.018311 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource water mark changes from (1536 MB, 1.500000 CORE) to (0 MB, 0.000000 CORE)",,,,,,,0,,"resqueuemanager.c",2550,
> 2016-05-16 13:58:50.580164 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> 2016-05-16 13:59:20.635568 EDT,,,p4522,th424065152,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager adjusts segment hdp23.localdomain original resource capacity from (2048 MB, 48 CORE) to (2048 MB, 2 CORE)",,,,,,,0,,"resourcepool.c",4688,
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)