You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Peter Turcsanyi (Jira)" <ji...@apache.org> on 2021/08/04 08:00:00 UTC
[jira] [Updated] (NIFI-8996) PutHive*QL processors do not close
JDBC statements
[ https://issues.apache.org/jira/browse/NIFI-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Turcsanyi updated NIFI-8996:
----------------------------------
Affects Version/s: 1.11.4
1.12.1
1.14.0
1.13.2
> PutHive*QL processors do not close JDBC statements
> --------------------------------------------------
>
> Key: NIFI-8996
> URL: https://issues.apache.org/jira/browse/NIFI-8996
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.11.4, 1.12.1, 1.14.0, 1.13.2
> Reporter: Peter Turcsanyi
> Assignee: Peter Turcsanyi
> Priority: Major
>
> When multiple HiveQL statements arrive in a FlowFile, PutHive*QL processors create and execute the statements in a loop but do not close them. It may lead to data loss.
> Example scenario:
> * create a source table with 100 Mio records (single int column with random numbers)
> * create 10 target tables with the same structure
> * feed PutHive3QL with a single FF containing the following script:
> {code:java}
> truncate table target0;
> insert into target0 select * from source;
> truncate table target1;
> insert into target1 select * from source;
> ...{code}
> * result: some target tables are empty instead of having the 100 Mio records
--
This message was sent by Atlassian Jira
(v8.3.4#803005)