You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hawq.apache.org by xi...@iluvatar.ai on 2018/11/13 13:10:01 UTC
segment fail after cluster init
Hi!
After init cluster, a slave segment fail, i only find below issue in master pg_log:
2018-11-13 20:38:47.384398 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","database system was shut down at 2018-11-13 20:38:46 CST",,,,,,,0,,"xlog.c",6207,
2018-11-13 20:38:47.385965 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","checkpoint record is at 0/855870",,,,,,,0,,"xlog.c",6306,
2018-11-13 20:38:47.385988 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","redo record is at 0/855870; undo record is at 0/0; shutdown TRUE",,,,,,,0,,"xlog.c",6340,
2018-11-13 20:38:47.385996 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","next transaction ID: 0/963; next OID: 10896",,,,,,,0,,"xlog.c",6344,
2018-11-13 20:38:47.386006 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","next MultiXactId: 1; next MultiXactOffset: 0",,,,,,,0,,"xlog.c",6347,
2018-11-13 20:38:47.386013 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","end of transaction log location is 0/8558C0",,,,,,,0,,"xlog.c",6584,
2018-11-13 20:38:47.386788 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","Oldest active transaction from prepared transactions 963",,,,,,,0,,"xlog.c",5998,
2018-11-13 20:38:47.397500 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","database system is ready",,,,,,,0,,"xlog.c",6024,
2018-11-13 20:38:47.397531 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ 2.2.0.0-incubating build dev) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-11) compiled on Jun 23 2017 05:39:25",,,,,,,0,,"xlog.c",6034,
2018-11-13 20:38:47.402521 CST,,,p28191,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","Finished normal startup for clean shutdown case",,,,,,,0,,"xlog.c",6812,
2018-11-13 20:38:47.413971 CST,,,p28192,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","Finished startup integrity checking",,,,,,,0,,"xlog.c",7161,
2018-11-13 20:38:47.429410 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager starts accepting resource request. Listening normal socket port 5437. Total listened 1 FDs.",,,,,,,0,,"resourcemanager.c",2497,
2018-11-13 20:38:47.429603 CST,,,p28189,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","Wait for HAWQ RM -1",,,,,,,0,,"resourcemanager.c",428,
2018-11-13 20:38:47.429623 CST,,,p28189,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","HAWQ :: Received signal notification that HAWQ RM works now.",,,,,,,0,,"resourcemanager.c",436,
2018-11-13 20:38:47.429632 CST,,,p28189,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ 2.2.0.0-incubating build dev) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-11) compiled on Jun 23 2017 05:39:03",,,,,,,0,,"postmaster.c",3694,
2018-11-13 20:38:47.429643 CST,,,p28189,th-1393014272,,,,0,,,seg-10000,,,,,"LOG","00000","database system is ready to accept connections","PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ 2.2.0.0-incubating build dev) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-11) compiled on Jun 23 2017 05:39:03",,,,,,0,,"postmaster.c",3701,
2018-11-13 20:38:47.433221 CST,"gpadmin","template1",p28200,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.442357 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Cleanup segment configuration catalog table successfully!",,,,,,,0,,"resourcepool.c",465,
2018-11-13 20:38:47.446240 CST,"gpadmin","template1",p28201,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.452497 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Cleanup segment configuration history catalog table successfully, keep period: recent 365 days.",,,,,,,0,,"resourcepool.c",535,
2018-11-13 20:38:47.455618 CST,"gpadmin","template1",p28202,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.464156 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Add a new row into segment configuration catalog table,registration order:0, role:m, status:u, port:1809, hostname:test-computing.novalocal, address:test-computing.novalocal, description:",,,,,,,0,,"resourcepool.c",910,
2018-11-13 20:38:47.466730 CST,"gpadmin","template1",p28203,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.472091 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager successfully loaded role specifications.",,,,,,,0,,"resourcemanager.c",1277,
2018-11-13 20:38:47.474823 CST,"gpadmin","template1",p28204,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.480492 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manger successfully loaded resource queue specifications",,,,,,,0,,"resourcemanager.c",1587,
2018-11-13 20:38:47.480636 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager created resource queue instance :
RESQUEUE:ID=9800,Name=pg_root,PARENT=0,LIMIT(MEM=100.000000%,CORE=100.000000%),RATIO=0 MBPCORE,INUSE(0 MB, 0.000000 CORE),CONN=0,INQUEUE=0.",,,,,,,0,,"resourcemanager.c",1976,
2018-11-13 20:38:47.480666 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager created resource queue instance :
RESQUEUE:ID=6055,Name=pg_default,PARENT=9800,LIMIT(MEM=50.000000%,CORE=50.000000%),RATIO=0 MBPCORE,INUSE(0 MB, 0.000000 CORE),CONN=0,INQUEUE=0.",,,,,,,0,,"resourcemanager.c",1976,
2018-11-13 20:38:47.480687 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager created user. USER:ID=gpadmin,QUEUEID=6055,ISSUPERUSER=YES",,,,,,,0,,"resourcemanager.c",2019,
2018-11-13 20:38:47.480778 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager refreshed slaves host size from 0 to 2.",,,,,,,0,,"resourcepool.c",4434,
2018-11-13 20:38:47.480797 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","HAWQ RM process works now.",,,,,,,0,,"resourcemanager.c",517,
2018-11-13 20:38:47.670391 CST,"gpadmin","template1",p28205,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.681890 CST,"gpadmin","template1",p28207,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.681995 CST,"gpadmin","template1",p28207,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,con11,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:11 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:47.685861 CST,"gpadmin","template1",p28207,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,974,con11,,seg-10000,,,x974,sx1,"LOG","00000","no master mirroring standby configuration found",,,,,,,0,,"cdblink.c",159,
2018-11-13 20:38:47.712073 CST,"gpadmin","template1",p28211,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.712162 CST,"gpadmin","template1",p28211,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,con12,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:12 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:47.748073 CST,"gpadmin","template1",p28215,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.765933 CST,"gpadmin","template1",p28217,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:47.766079 CST,"gpadmin","template1",p28217,th-1393014272,"[local]",,2018-11-13 20:38:47 CST,0,con14,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:14 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:48.644486 CST,"gpadmin","template1",p28220,th-1393014272,"[local]",,2018-11-13 20:38:48 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:48.660665 CST,"gpadmin","template1",p28222,th-1393014272,"[local]",,2018-11-13 20:38:48 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:48.660793 CST,"gpadmin","template1",p28222,th-1393014272,"[local]",,2018-11-13 20:38:48 CST,0,con16,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:16 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:49.550571 CST,"gpadmin","template1",p28225,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:49.568186 CST,"gpadmin","template1",p28227,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:49.693602 CST,"gpadmin","template1",p28250,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:49.693735 CST,"gpadmin","template1",p28250,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,con19,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:19 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:49.709839 CST,"gpadmin","template1",p28255,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:49.709929 CST,"gpadmin","template1",p28255,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,con20,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:20 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:49.775855 CST,"gpadmin","postgres",p28258,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:49.776017 CST,"gpadmin","postgres",p28258,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,con21,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:21 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:49.845990 CST,"gpadmin","template1",p28262,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:38:49.846106 CST,"gpadmin","template1",p28262,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,con22,,seg-10000,,,,,"LOG","00000","getLocalTmpDirFromMasterConfig session_id:22 tmpdir:/SkyDiscovery/data/hawq/tmp",,,,,,,0,,"postinit.c",470,
2018-11-13 20:38:49.851224 CST,"gpadmin","template1",p28262,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,999,con22,cmd1,seg-10000,,,x999,sx1,"LOG","00000","ConnID 0. Registered in HAWQ resource manager (By OID)",,,,,,"alter user ""gpadmin"" password 'gparray';",0,,"rmcomm_QD2RM.c",609,
2018-11-13 20:38:49.852117 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","resource manager finds possible not handled resource request from ConnID 0.",,,,,,,0,,"requesthandler.c",282,
2018-11-13 20:38:49.852148 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","ConnID 0. Connection is unregistered.",,,,,,,0,,"requesthandler.c",300,
2018-11-13 20:38:49.852209 CST,"gpadmin","template1",p28262,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,999,con22,cmd1,seg-10000,,,x999,sx1,"LOG","00000","ConnID 0. Unregistered from HAWQ resource manager.",,,,,,"alter user ""gpadmin"" password 'gparray';",0,,"rmcomm_QD2RM.c",661,
2018-11-13 20:38:49.858141 CST,"gpadmin","template1",p28262,th-1393014272,"[local]",,2018-11-13 20:38:49 CST,0,con22,cmd1,seg-10000,,,,,"LOG","00000","clean up communication to resource manager now.",,,,,,,0,,"rmcomm_QD2RM.c",460,
2018-11-13 20:38:49.950674 CST,"gpadmin","template1",p28262,th-2106398976,"[local]",,2018-11-13 20:38:49 CST,0,con22,cmd1,seg-10000,,,,,"LOG","00000","generateResourceRefreshHeartBeat exits.",,,,,,,0,,,,
2018-11-13 20:39:05.669582 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager tracked ip address '192.168.60.27' for host 'test-computing.novalocal'",,,,,,,0,,"resourcepool.c",1026,
2018-11-13 20:39:05.669686 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager tracked ip address '127.0.0.1' for host 'test-computing.novalocal'",,,,,,,0,,"resourcepool.c",1026,
2018-11-13 20:39:05.669698 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","Resource manager ignored ip address '192.168.60.27' for host 'test-computing.novalocal'",,,,,,,0,,"resourcepool.c",1032,
2018-11-13 20:39:05.669707 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager tracked ip address '172.17.0.1' for host 'test-computing.novalocal'",,,,,,,0,,"resourcepool.c",1026,
2018-11-13 20:39:05.669720 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager tracked ip address '198.173.225.0' for host 'test-computing.novalocal'",,,,,,,0,,"resourcepool.c",1026,
2018-11-13 20:39:05.669729 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager tracked segment 0 of host test-computing.novalocal ip address ,192.168.60.27,127.0.0.1,172.17.0.1,198.173.225.0.",,,,,,,0,,"resourcepool.c",1039,
2018-11-13 20:39:05.669739 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Host test-computing.novalocal is set availability 1. Cluster currently has 1 available nodes.",,,,,,,0,,"resourcepool.c",1841,
2018-11-13 20:39:05.674559 CST,"gpadmin","template1",p28534,th-1393014272,"[local]",,2018-11-13 20:39:05 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:39:05.684251 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Add a new row into segment configuration catalog table,registration order:1, role:p, status:u, port:40000, hostname:test-computing.novalocal, address:192.168.60.27, description:",,,,,,,0,,"resourcepool.c",910,
2018-11-13 20:39:05.687795 CST,"gpadmin","template1",p28535,th-1393014272,"[local]",,2018-11-13 20:39:05 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:39:05.694534 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Add a new row into segment configuration history catalog table,time: 2018-11-13 20:39:05.691733+08, registration order:1, hostname:test-computing.novalocal, description:segment is up",,,,,,,0,,"resourcepool.c",798,
2018-11-13 20:39:05.694565 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager chooses ratio 4096 MB per core as cluster level memory to core ratio, there are 0 MB memory 0 CORE resource unable to be utilized.",,,,,,,0,,"resourcepool.c",4641,
2018-11-13 20:39:05.694802 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","NONE mode resource broker allocated containers (4096 MB, 1 CORE) x 16. Expected 16 containers.",,,,,,,0,,"resourcebroker_NONE.c",140,
2018-11-13 20:39:05.694843 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Resource manager increase host test-computing.novalocal memory quota 65536 MB, Expected total memory quota after increasing is 65536 MB. Include 0 MB old in-use memory quota.",,,,,,,0,,"rmcomm_RM2RMSEG.c",315,
2018-11-13 20:39:05.695955 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","Host test-computing.novalocal successfully increased memory quota.",,,,,,,0,,"rmcomm_RM2RMSEG.c",403,
2018-11-13 20:39:05.696000 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (61440 MB, 15.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696032 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (57344 MB, 14.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696062 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (53248 MB, 13.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696091 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (49152 MB, 12.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696120 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (45056 MB, 11.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696165 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (40960 MB, 10.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696194 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (36864 MB, 9.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696223 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (32768 MB, 8.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696251 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (28672 MB, 7.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696280 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (24576 MB, 6.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696309 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (20480 MB, 5.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696388 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (16384 MB, 4.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696418 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (12288 MB, 3.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696447 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (8192 MB, 2.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696478 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (4096 MB, 1.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:05.696509 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"LOG","00000","removed pending GRM request from root resource queue by (4096 MB, 1.000000 CORE) to (0 MB, 0.000000 CORE)",,,,,,,0,,"resqueuemanager.c",3980,
2018-11-13 20:39:07.129585 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:39:37.114137 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:40:09.231869 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:40:37.222162 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:41:07.286666 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:41:37.327382 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:42:07.381317 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:42:37.434788 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:43:07.484406 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:43:37.538508 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:44:07.591120 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:44:37.643247 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:45:07.696310 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:45:37.749636 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:46:07.808540 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:46:37.863072 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:47:07.918827 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:47:37.977290 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:48:08.034990 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:48:38.090501 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:49:08.147480 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:49:38.202642 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:50:08.257421 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:50:38.313705 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:51:08.367424 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:51:38.423997 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:52:08.479951 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:52:38.536755 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:53:08.592080 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:53:38.647002 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:54:08.701253 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:54:38.755809 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:55:08.856898 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:55:38.867196 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:56:08.966510 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:56:38.981219 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:57:09.038014 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:57:39.145853 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:57:54.109677 CST,"gpadmin","template1",p30750,th-1393014272,"192.168.60.27","61234",2018-11-13 20:57:54 CST,0,,,seg-10000,,,,,"LOG","00000","acl check type is standalone, the acl type value is 0.",,,,,,,0,,"postgres.c",4424,
2018-11-13 20:58:11.174492 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:58:39.218630 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:59:09.314602 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 20:59:39.330249 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:00:09.387457 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:00:39.487458 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:01:09.512590 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:01:39.559091 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:02:09.614487 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:02:39.670587 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:03:09.727139 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:03:39.786817 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:04:09.843349 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
2018-11-13 21:04:39.901326 CST,,,p28199,th-1393014272,,,,0,con4,,seg-10000,,,,,"WARNING","01000","failed to reverse DNS lookup for ip 192.168.60.18.",,,,,,,0,,"requesthandler.c",632,
But i can ssh/ping slave as normal.
Could you help me?