You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "joewitt (via GitHub)" <gi...@apache.org> on 2026/09/22 19:31:23 UTC
[PR] NIFI-16379 Restore GenerateFlowFile non-unique generation and batch write behavior [nifi]
joewitt opened a new pull request, #11711:
URL: https://github.com/apache/nifi/pull/11711
# Summary
[NIFI-16379](https://issues.apache.org/jira/browse/NIFI-16379) restores the `GenerateFlowFile` behavior changed by NIFI-16322:
- Non-unique generated content is created once when the Processor is scheduled and retained for reuse, avoiding repeated random generation on every trigger.
- Every FlowFile requested by Batch Size is independently written to the Content Repository instead of cloning the first FlowFile.
- Non-unique mode again documents its higher-throughput behavior.
- The `Integer.MAX_VALUE` File Size bound from NIFI-16322 is retained.
The retained payload is an intentional memory-for-throughput tradeoff for this load-testing Processor. A `MEMORY` `SystemResourceConsideration` and an inline comment now document that behavior so the allocation is not mistaken for an accidental optimization opportunity in the future.
# Tracking
### Issue Tracking
- [x] Apache NiFi Jira issue created
### Pull Request Tracking
- [x] Pull Request title starts with Apache NiFi Jira issue number
- [x] Pull Request commit message starts with Apache NiFi Jira issue number
- [x] Pull request contains commits signed with a registered key indicating `Verified` status
### Pull Request Formatting
- [x] Pull Request based on current revision of the `main` branch
- [x] Pull Request refers to a feature branch with one commit containing changes
# Verification
### Build
- [ ] Build completed using `./mvnw clean install -P contrib-check`
- [ ] JDK 21
- [ ] JDK 25
- [x] `./mvnw -pl :nifi-standard-processors -am test -Dtest=TestGenerateFlowFile -Dsurefire.failIfNoSpecifiedTests=false`
- 10 tests passed
- [x] `./mvnw -pl :nifi-standard-processors test`
- 2,100 tests passed; 2 skipped; 0 failures or errors
- [x] `./mvnw -pl :nifi-standard-processors -P contrib-check verify -DskipTests`
- Checkstyle, RAT, and PMD passed
The new batch regression test was also run against unmodified `main` and failed as expected: Batch Size 3 produced only one CREATE provenance event. It passes with this change, confirming that independent batch writes are restored.
### Licensing
No new dependencies.
### Documentation
Processor metadata now documents the intentional memory usage.
Made with [Cursor](https://cursor.com)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@nifi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] NIFI-16379 Restore GenerateFlowFile non-unique generation and batch write behavior [nifi]
Posted by "pvillard31 (via GitHub)" <gi...@apache.org>.
pvillard31 merged PR #11711:
URL: https://github.com/apache/nifi/pull/11711
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@nifi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org