You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Puneet Gupta (JIRA)" <ji...@apache.org> on 2016/03/18 06:51:33 UTC
[jira] [Commented] (LENS-990) Seeing fecthresult failing with '
Expected state FINISHED, but found ERROR' for failed hive queries
[ https://issues.apache.org/jira/browse/LENS-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201038#comment-15201038 ]
Puneet Gupta commented on LENS-990:
-----------------------------------
Once a Query is candidate for Purge , we create an instance of FinishedQuery to persist in DB .
While doing that following code is executed
if (ctx.isResultAvailableInDriver()) {
try
{ driverRS = ctx.getSelectedDriver().fetchResultSet(getCtx()); }
While creating Hive Result set, seeing "HiveSQLException: Expected state FINISHED, but found ERROR"
-------
public boolean isResultAvailableInDriver()
{ return isDriverPersistent() || driverStatus.isResultSetAvailable(); }
This may be the problem. isDriverPersistent() is true even if query fails.
> Seeing fecthresult failing with ' Expected state FINISHED, but found ERROR' for failed hive queries
> ---------------------------------------------------------------------------------------------------
>
> Key: LENS-990
> URL: https://issues.apache.org/jira/browse/LENS-990
> Project: Apache Lens
> Issue Type: Bug
> Reporter: Puneet Gupta
>
> {noformat}
> 12 Mar 2016 23:30:45 [cd437361-0c14-424d-a6c1-4c276697a977] [StatusPoller] INFO org.apache.lens.server.api.query.QueryContext - Updating status of cd437361-0c14-424d-a6c1-4c276697a977 from Progress: 0.20000000298023224
> Status: RUNNING
> Status Message: Query is running in HiveServer!
> Is Result Set Available: false
> Progress Message: [{"taskId":"Stage-14","type":"MAPREDLOCAL","externalHandle":"Stage-14","taskState":"FINISHED_STATE"},{"taskId":"Stage-12","type":"MAPRED","externalHandle":"job_1456299518471_825588","taskState":"RUNNING_STATE"},{"taskId":"Stage-13","type":"MAPREDLOCAL","externalHandle":"Stage-13","taskState":"UNKNOWN_STATE"},{"taskId":"Stage-3","type":"MAPRED","externalHandle":null,"taskState":"UNKNOWN_STATE"},{"taskId":"Stage-0","type":"MOVE","externalHandle":"Stage-0","taskState":"UNKNOWN_STATE"}]
> to Progress: 0.20000000298023224
> Status: FAILED
> Status Message: Query execution failed!
> Is Result Set Available: false
> Progress Message: [{"taskId":"Stage-14","type":"MAPREDLOCAL","externalHandle":"Stage-14","taskState":"FINISHED_STATE"},{"taskId":"Stage-12","type":"MAPRED","externalHandle":"job_1456299518471_825588","taskState":"FAILED_STATE"},{"taskId":"Stage-13","type":"MAPREDLOCAL","externalHandle":"Stage-13","taskState":"UNKNOWN_STATE"},{"taskId":"Stage-3","type":"MAPRED","externalHandle":null,"taskState":"UNKNOWN_STATE"},{"taskId":"Stage-0","type":"MOVE","externalHandle":"Stage-0","taskState":"UNKNOWN_STATE"}]
> Error Message: Stage-12(MAPRED):job_1456299518471_825588: has failed!
> 12 Mar 2016 23:30:45 [cd437361-0c14-424d-a6c1-4c276697a977] [StatusPoller] INFO org.apache.lens.server.api.driver.AbstractLensDriver - FetchResultSet: cd437361-0c14-424d-a6c1-4c276697a977
> 12 Mar 2016 23:30:45 [cd437361-0c14-424d-a6c1-4c276697a977] [StatusPoller] INFO org.apache.lens.driver.hive.HiveDriver - Creating result set for hiveHandle:OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=97052772-28d1-41e0-a000-d365a7a36d57]
> 12 Mar 2016 23:30:45 [cd437361-0c14-424d-a6c1-4c276697a977] [StatusPoller] ERROR org.apache.lens.server.query.QueryExecutionServiceImpl - Error while getting result ser form driver hive/prod. Driver result set based purging logic will be ignored
> org.apache.lens.server.api.error.LensException: Error creating result set
> at org.apache.lens.driver.hive.HiveDriver.createResultSet(HiveDriver.java:892) ~[lens-driver-hive-2.6.0-inm.jar:2.6.0-inm]
> at org.apache.lens.driver.hive.HiveDriver.createResultSet(HiveDriver.java:867) ~[lens-driver-hive-2.6.0-inm.jar:2.6.0-inm]
> at org.apache.lens.server.api.driver.AbstractLensDriver.fetchResultSet(AbstractLensDriver.java:68) ~[lens-server-api-2.6.0-inm.jar:2.6.0-inm]
> at org.apache.lens.server.query.QueryExecutionServiceImpl$FinishedQuery.<init>(QueryExecutionServiceImpl.java:540) ~[classes/:na]
> at org.apache.lens.server.query.QueryExecutionServiceImpl.updateFinishedQuery(QueryExecutionServiceImpl.java:861) [classes/:na]
> at org.apache.lens.server.query.QueryExecutionServiceImpl.updateStatus(QueryExecutionServiceImpl.java:903) [classes/:na]
> at org.apache.lens.server.query.QueryExecutionServiceImpl.access$1600(QueryExecutionServiceImpl.java:98) [classes/:na]
> at org.apache.lens.server.query.QueryExecutionServiceImpl$StatusPoller.run(QueryExecutionServiceImpl.java:789) [classes/:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> Caused by: org.apache.hive.service.cli.HiveSQLException: Expected state FINISHED, but found ERROR
> at org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.checkStatus(ThriftCLIServiceClient.java:52) ~[hive-service-0.13.4-inm.jar:0.13.4-inm]
> at org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.getResultSetMetadata(ThriftCLIServiceClient.java:371) ~[hive-service-0.13.4-inm.jar:0.13.4-inm]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_72]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_72]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_72]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_72]
> at org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient.invokeInternal(RetryingThriftCLIServiceClient.java:301) ~[hive-service-0.13.4-inm.jar:0.13.4-inm]
> at org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient.invoke(RetryingThriftCLIServiceClient.java:329) ~[hive-service-0.13.4-inm.jar:0.13.4-inm]
> at com.sun.proxy.$Proxy44.getResultSetMetadata(Unknown Source) ~[na:na]
> at org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient$CLIServiceClientWrapper.getResultSetMetadata(RetryingThriftCLIServiceClient.java:177) ~[hive-service-0.13.4-inm.jar:0.13.4-inm]
> at org.apache.lens.driver.hive.HivePersistentResultSet.<init>(HivePersistentResultSet.java:53) ~[lens-driver-hive-2.6.0-inm.jar:2.6.0-inm]
> at org.apache.lens.driver.hive.HiveDriver.createResultSet(HiveDriver.java:883) ~[lens-driver-hive-2.6.0-inm.jar:2.6.0-inm]
> ... 8 common frames omitted
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)