You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "macdoor615 (Jira)" <ji...@apache.org> on 2021/02/18 17:04:00 UTC

[jira] [Updated] (NIFI-8237) PutDatabaseRecord can not insert into mysql table with TEXT column

     [ https://issues.apache.org/jira/browse/NIFI-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

macdoor615 updated NIFI-8237:
-----------------------------
    Description: 
1. create table on mysql server

CREATE TABLE tmp_text (
 ver varchar(10) NULL,
 richtext text NULL
 ) ;

2. insert data into table with PutDatabaseRecord processor , raise error

{{2021-02-19 00:43:04,424 ERROR [Timer-Driven Process Thread-3] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=b54f68de-0177-1000-917a-119d1bd6f5bf] Failed to put Records to database for StandardFlowFileRecord[uuid=3ad1b100-5661-4988-a21b-795b24cc5222,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1613666502360-8, container=default, section=8], offset=87073, length=17],offset=0,name=3ad1b100-5661-4988-a21b-795b24cc5222,size=17]. Routing to failure.: java.lang.NullPointerException}}

{{java.lang.NullPointerException: null}}

{{at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:181)}}

{{at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:152)}}

{{at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:148)}}

{{at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:707)}}

{{at org.apache.nifi.processors.standard.PutDatabaseRecord.putToDatabase(PutDatabaseRecord.java:838)}}

{{at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:487)}}

{{at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)}}

{{at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1173)}}

{{at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)}}

{{at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)}}

{{at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)}}

{{at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)}}

{{at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)}}

{{at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)}}

{{at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)}}

{{at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)}}

{{at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)}}

{{at java.lang.Thread.run(Thread.java:748)}}

3. downgrade to Nifi 1.12.1, no error, data inserted into table

4. change TEXT column to VARCHAR, no error

 

  was:
1. create table on mysql server

CREATE TABLE tmp_text (
ver varchar(10) NULL,
richtext text NULL
) ;

2. insert data into table with PutDatabaseRecord processor , raise error

2021-02-19 00:43:04,424 ERROR [Timer-Driven Process Thread-3] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=b54f68de-0177-1000-917a-119d1bd6f5bf] Failed to put Records to database for StandardFlowFileRecord[uuid=3ad1b100-5661-4988-a21b-795b24cc5222,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1613666502360-8, container=default, section=8], offset=87073, length=17],offset=0,name=3ad1b100-5661-4988-a21b-795b24cc5222,size=17]. Routing to failure.: java.lang.NullPointerException

java.lang.NullPointerException: null

at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:181)

at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:152)

at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:148)

at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:707)

at org.apache.nifi.processors.standard.PutDatabaseRecord.putToDatabase(PutDatabaseRecord.java:838)

at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:487)

at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)

at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1173)

at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)

at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)

at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)



3. downgrade to Nifi 1.12.1, no error, data inserted into table

4. change TEXT column to VARCHAR, no error

 


> PutDatabaseRecord can not insert into mysql table with TEXT column
> ------------------------------------------------------------------
>
>                 Key: NIFI-8237
>                 URL: https://issues.apache.org/jira/browse/NIFI-8237
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.13.0
>         Environment: Linux hb3-prod-gem-svc1-001 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
> openjdk version "1.8.0_282"
> OpenJDK Runtime Environment (build 1.8.0_282-b08)
> OpenJDK 64-Bit Server VM (build 25.282-b08, mixed mode)
>            Reporter: macdoor615
>            Priority: Blocker
>
> 1. create table on mysql server
> CREATE TABLE tmp_text (
>  ver varchar(10) NULL,
>  richtext text NULL
>  ) ;
> 2. insert data into table with PutDatabaseRecord processor , raise error
> {{2021-02-19 00:43:04,424 ERROR [Timer-Driven Process Thread-3] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=b54f68de-0177-1000-917a-119d1bd6f5bf] Failed to put Records to database for StandardFlowFileRecord[uuid=3ad1b100-5661-4988-a21b-795b24cc5222,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1613666502360-8, container=default, section=8], offset=87073, length=17],offset=0,name=3ad1b100-5661-4988-a21b-795b24cc5222,size=17]. Routing to failure.: java.lang.NullPointerException}}
> {{java.lang.NullPointerException: null}}
> {{at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:181)}}
> {{at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:152)}}
> {{at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:148)}}
> {{at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:707)}}
> {{at org.apache.nifi.processors.standard.PutDatabaseRecord.putToDatabase(PutDatabaseRecord.java:838)}}
> {{at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:487)}}
> {{at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)}}
> {{at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1173)}}
> {{at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)}}
> {{at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)}}
> {{at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)}}
> {{at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)}}
> {{at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)}}
> {{at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)}}
> {{at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)}}
> {{at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)}}
> {{at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)}}
> {{at java.lang.Thread.run(Thread.java:748)}}
> 3. downgrade to Nifi 1.12.1, no error, data inserted into table
> 4. change TEXT column to VARCHAR, no error
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)