You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Gardella Juan Pablo (JIRA)" <ji...@apache.org> on 2018/04/10 19:58:00 UTC

[jira] [Comment Edited] (NIFI-5049) Fixhandling of Phonenix datetime columns in QueryDatabaseTable and GenerateTableFetch

    [ https://issues.apache.org/jira/browse/NIFI-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432868#comment-16432868 ] 

Gardella Juan Pablo edited comment on NIFI-5049 at 4/10/18 7:57 PM:
--------------------------------------------------------------------

Patch complete, but there is an issue with QueryDatabaseTable processor (not related with the change). The issue is:
 org.apache.nifi.processor.exception.ProcessException: Error during database query or conversion of records to Avro.
                 at org.apache.nifi.processors.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:328)
                 at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2571)
                 at com.point72.nifi.processors.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:322)
                 at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1122)
                 at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
                 at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
                 at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
                 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
                 at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
                 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
                 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
                 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
                 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
                 at java.lang.Thread.run(Thread.java:748)
 Caused by: java.sql.SQLException: ERROR 1101 (XCL01): ResultSet is closed.
                 at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:442)
                 at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
                 at org.apache.phoenix.jdbc.PhoenixResultSet.checkOpen(PhoenixResultSet.java:215)
                 at org.apache.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:772)
                 at org.apache.commons.dbcp.DelegatingResultSet.next(DelegatingResultSet.java:207)
                 at org.apache.commons.dbcp.DelegatingResultSet.next(DelegatingResultSet.java:207)
                 at org.apache.nifi.nifi.processors.JdbcCommon.convertToAvroStream(JdbcCommon.java:292)
                 at org.apache.nifi.nifi.processors.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:326)
                 ... 13 common frames omitted
  
 [~mattyb149] Do you agree on file another issue to track below issue?


was (Author: gardellajuanpablo):
Patch complete, but there is an issue with QueryDatabaseTable processor (not related with the change). The issue is:
org.apache.nifi.processor.exception.ProcessException: Error during database query or conversion of records to Avro.
                at com.point72.nifi.processors.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:328)
                at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2571)
                at com.point72.nifi.processors.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:322)
                at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1122)
                at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
                at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
                at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
                at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
                at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
                at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
                at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLException: ERROR 1101 (XCL01): ResultSet is closed.
                at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:442)
                at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
                at org.apache.phoenix.jdbc.PhoenixResultSet.checkOpen(PhoenixResultSet.java:215)
                at org.apache.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:772)
                at org.apache.commons.dbcp.DelegatingResultSet.next(DelegatingResultSet.java:207)
                at org.apache.commons.dbcp.DelegatingResultSet.next(DelegatingResultSet.java:207)
                at com.point72.nifi.processors.JdbcCommon.convertToAvroStream(JdbcCommon.java:292)
                at com.point72.nifi.processors.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:326)
                ... 13 common frames omitted
 
[~mattyb149] Do you agree on file another issue to track below issue?

> Fixhandling of Phonenix datetime columns in QueryDatabaseTable and GenerateTableFetch
> -------------------------------------------------------------------------------------
>
>                 Key: NIFI-5049
>                 URL: https://issues.apache.org/jira/browse/NIFI-5049
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.5.0
>            Reporter: Gardella Juan Pablo
>            Assignee: Matt Burgess
>            Priority: Major
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> QueryDatabaseAdapter does not work against Phoenix DB if it should convert TIMESTAMP. The error is described below:
> [https://stackoverflow.com/questions/45989678/convert-varchar-to-timestamp-in-hbase]
> Basically, it's required to use TO_TIMESTAMP(MAX_COLUMN) to make it work. 
> See [https://lists.apache.org/thread.html/%3CCA+kiFscJE8AY+UxT_D_vSt4QgZF4jxWoVBOYnJgztt4dSbSXWQ@mail.gmail.com%3E]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)