You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/05/04 19:59:00 UTC
[jira] [Commented] (NIFI-6061) PutDatabaseRecord does not properly
handle BLOB/CLOB fields
[ https://issues.apache.org/jira/browse/NIFI-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339273#comment-17339273 ]
ASF subversion and git services commented on NIFI-6061:
-------------------------------------------------------
Commit 30fc26647e06a9a38b95ac050722bf752bb392b0 in nifi's branch refs/heads/main from Matt Burgess
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=30fc266 ]
NIFI-6061: Fix CLOB/BLOB handling in PutDatabaseRecord
NIFI-6061: Force getBytes() in BLOB handling to use UTF-8 charset
NIFI-6061: Use setClob(), added unit tests, incorporated review comments
This closes #5049
Co-authored-by: zhangcheng <zh...@foxmail.com>
Signed-off-by: David Handermann <ex...@apache.org>
> PutDatabaseRecord does not properly handle BLOB/CLOB fields
> -----------------------------------------------------------
>
> Key: NIFI-6061
> URL: https://issues.apache.org/jira/browse/NIFI-6061
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.11.4
> Reporter: Matt Burgess
> Assignee: ZhangCheng
> Priority: Major
> Time Spent: 3h
> Remaining Estimate: 0h
>
> BLOB/CLOB fields in NiFi's Record API are returned from the record as Object[Byte], but when PutDatabaseRecord tries to insert Object[] via setObject(), the following error occurs:
> 2019-02-20 15:11:16,216 WARN [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=0c84b9de-0169-1000-0164-3fbad7a17664] Failed to process StandardFlowFileRecord[uuid=d739f432-0871-41bb-a0c9-d6ceeac68a6d,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1550690599998-1, container=default, section=1], offset=1728, length=251],offset=0,name=d739f432-0871-41bb-a0c9-d6ceeac68a6d,size=251] due to org.postgresql.util.PSQLException: Can't infer the SQL type to use for an instance of [Ljava.lang.Object;. Use setObject() with an explicit Types value to specify the type to use.:
> Somewhere in the value conversion/representation, PutDatabaseRecord would likely need to create a java.sql.Blob object and transfer the bytes into it. One issue I see is that the record field type has been converted to Array[Byte], so the information that the field is a BLOB is lost by that point. If this requires DB-specific code, we'd likely need to add a Database Adapter property and delegate out to the various DB adapters.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)