You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ChuaSweeChin (Jira)" <ji...@apache.org> on 2021/06/24 02:51:00 UTC

[jira] [Created] (NIFI-8733) PutSQL fragmented transaction issue

ChuaSweeChin created NIFI-8733:
----------------------------------

             Summary: PutSQL fragmented transaction issue
                 Key: NIFI-8733
                 URL: https://issues.apache.org/jira/browse/NIFI-8733
             Project: Apache NiFi
          Issue Type: Bug
          Components: NiFi Stateless
    Affects Versions: 1.12.1
         Environment: 3 Node Cluster
            Reporter: ChuaSweeChin
         Attachments: Screenshot 2021-06-22 at 1.40.37 AM.png, Screenshot 2021-06-22 at 1.48.13 AM.png

I am hitting an issue with PutSQL processor which is pretty weird. 

What happen is, I have a 987 flow files sharing the same attributes [fragment.identifier], [fragment.count] and their respective [fragment.index] all stuck in upstream of PutSQL.

In PutSQL, I have configured [{{Support Fragmented Transactions]}} to TRUE. If I understand correctly, when [{{Support Fragmented Transactions]}} is TRUE, PutSQL will wait till all the fragments arrive before executing the transaction, in which in my case, the fragment all arrived however the sql execution did not.

Only when I restart PutSQL, then all the 987 flow files will get processed successfully right away.

If I reconfigure [{{Transaction Timeout]}} to 5000ms, then the 987 flow files will flow to failure relationship after 5000ms. This I assume PutSQL is unable to detect that all the fragments has arrived upstream and push it to failure.

The other thing I tried is that if I reconfigure [{{Support Fragmented Transactions]}} to FALSE, then the flow files will all get processed successfully right away.

I am not entirely sure why PutSQL is behaving this way for fragmented transaction I was hoping someone could help me out on this. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)