You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Rajat Khandelwal (JIRA)" <ji...@apache.org> on 2015/06/16 11:13:00 UTC
[jira] [Commented] (LENS-569) Too many "set param key" on session
restoration upon restart
[ https://issues.apache.org/jira/browse/LENS-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587726#comment-14587726 ]
Rajat Khandelwal commented on LENS-569:
---------------------------------------
Created https://reviews.apache.org/r/35499/
> Too many "set param key" on session restoration upon restart
> ------------------------------------------------------------
>
> Key: LENS-569
> URL: https://issues.apache.org/jira/browse/LENS-569
> Project: Apache Lens
> Issue Type: Bug
> Reporter: Amareshwari Sriramadasu
>
> We are seeing too may "set param key :" logs on session restoration upon restrat. And each set param is involving IO with disk, which in turn increases restart time.
> Here is a log snippet :
> {noformat}
> 21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:lens.query.output.enable.compression value:true
> 21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.client.socket.timeout value:600
> 21 May 2015 06:05:50,806 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
> 21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:hive.metastore.client.socket.timeout value:600
> 21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.connect.retries value:5
> 21 May 2015 06:05:50,806 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
> 21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:hive.metastore.connect.retries value:5
> 21 May 2015 06:05:50,806 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:lens.query.enable.mail.notify value:true
> 21 May 2015 06:05:50,806 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
> 21 May 2015 06:05:50,807 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:lens.query.enable.mail.notify value:true
> 21 May 2015 06:05:50,807 [main] INFO org.apache.lens.server.session.HiveSessionService - Restored session 26064577-7a38-4279-ad73-0daa4a32a767
> 21 May 2015 06:05:50,807 [main] INFO org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at this point. hive.execution.engine=mr.
> 21 May 2015 06:05:50,808 [main] INFO org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at this point. hive.execution.engine=mr.
> 21 May 2015 06:05:50,808 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.failure.retries value:3
> 21 May 2015 06:05:50,810 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
> 21 May 2015 06:05:50,810 [main] INFO org.apache.lens.server.session.HiveSessionService - Set param key:hive.metastore.failure.retries value:3
> 21 May 2015 06:05:50,810 [main] INFO org.apache.lens.server.session.HiveSessionService - Request to Set param key:hive.metastore.client.connect.retry.delay value:1
> 21 May 2015 06:05:50,811 [main] INFO org.apache.hive.service.cli.operation.Operation - Putting temp output to file /tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)