You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2015/01/29 16:52:34 UTC

[jira] [Commented] (LENS-240) Explain for Hive query is taking time

    [ https://issues.apache.org/jira/browse/LENS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297044#comment-14297044 ] 

Amareshwari Sriramadasu commented on LENS-240:
----------------------------------------------

We saw explain was taking more time on production, because server was getting permgen space errors. When we increased through LENS_SERVER_OPTS="-XX:PermSize=512m -XX:MaxPermSize=512m", we are seeing explain time has come down.

[~arshadmatin20], Can you update the new time taken for explain here? 

> Explain for Hive query is taking time
> -------------------------------------
>
>                 Key: LENS-240
>                 URL: https://issues.apache.org/jira/browse/LENS-240
>             Project: Apache Lens
>          Issue Type: Bug
>            Reporter: Arshad Matin
>            Assignee: Rajat Khandelwal
>             Fix For: 2.1
>
>
> Query Fired from RestApi call
> {noformat}
> 27 Jan 2015 11:22:52,981 [lens-server-snapshotter] INFO  org.apache.lens.server.LensServices  - SnapShot of Lens Services created
> 27 Jan 2015 11:24:03,445 [Grizzly-worker(30)] INFO  org.apache.lens.server.AuthenticationFilter  - Request from user: null, path=/queryapi/queries
> 27 Jan 2015 11:24:03,451 [Grizzly-worker(30)] INFO  org.apache.lens.server.query.QueryExecutionServiceImpl  - Explain: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><lensSessionHandle><publicId>94ed-a660e111111a</publicId><secretId>4a8f-a47d-11111afda</secretId></lensSessionHandle> query:cube select field1 from cube where time_range_in(request_time, '2014-12-01-01', '2014-12-04-01')
> {noformat}
> Lens Server answered and closed the explain in 7 secs
> {noformat}
> 27 Jan 2015 11:24:11,502 [Grizzly-worker(30)] INFO  org.apache.lens.driver.hive.HiveDriver  - No more results closing the query
> 27 Jan 2015 11:24:11,503 [Grizzly-worker(30)] INFO  org.apache.lens.driver.hive.HiveDriver  - CloseQuery: 6e3e8512-a3d4-4c66-97d3-f43d10639b9d
> {noformat}
> Since Explain is syn call.. client waited for 7 mins
> {noformat}
> Minutes diff : 7
> Seconds diff : 427
> Millis diff : 427719
> {noformat}
> Seems like formatting of query plan is taking time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)