You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2015/05/21 08:20:59 UTC
[jira] [Created] (LENS-569) Too many "set param key" on session
restoration upon restart
Amareshwari Sriramadasu created LENS-569:
--------------------------------------------
Summary: Too many "set param key" on session restoration upon restart
Key: LENS-569
URL: https://issues.apache.org/jira/browse/LENS-569
Project: Apache Lens
Issue Type: Bug
Reporter: Amareshwari Sriramadasu
We are seeing too may "set param key :" logs on session restoration upon restrat. And each set param is involving IO with disk, which in turn increases restart time.
Here is a log snippet :
{noformat}
21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:lens.query.output.enable.compression value:true
21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.client.socket.timeout value:600
21 May 2015 06:05:50,806 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:hive.metastore.client.socket.timeout value:600
21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.connect.retries value:5
21 May 2015 06:05:50,806 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:hive.metastore.connect.retries value:5
21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:lens.query.enable.mail.notify value:true
21 May 2015 06:05:50,806 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
21 May 2015 06:05:50,807 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:lens.query.enable.mail.notify value:true
21 May 2015 06:05:50,807 [main] INFO org.apache.lens.server.session.HiveSessionService - Restored session 26064577-7a38-4279-ad73-0daa4a32a767
21 May 2015 06:05:50,807 [main] INFO org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at this point. hive.execution.engine=mr.
21 May 2015 06:05:50,808 [main] INFO org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at this point. hive.execution.engine=mr.
21 May 2015 06:05:50,808 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.failure.retries value:3
21 May 2015 06:05:50,810 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
21 May 2015 06:05:50,810 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:hive.metastore.failure.retries value:3
21 May 2015 06:05:50,810 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.client.connect.retry.delay value:1
21 May 2015 06:05:50,811 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)