You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by ma...@apache.org on 2021/02/23 16:00:33 UTC
[nifi] branch main updated (200c04c -> 528fce2)
This is an automated email from the ASF dual-hosted git repository.
mattyb149 pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git.
from 200c04c NIFI-8237: This closes #4835. Added missing SQL types to getDataTypeFromSQLTypeValue(), added defensive code
add 528fce2 NIFI-7646, NIFI-8222: Instead of having StandardProcessSession call ContentRepository.read(ContentClaim), introduced a new ContentRepository.read(ResourceClaim) and hold open the InputStream to the ResourceClaim. This can't be supported by EncryptedContentRepository, so introduced a method to allow using this or not. The benefit here is that when we have many FlowFiles read within a session, such as when using MergeContent/MergeRecord or a processor configured with a Run [...]
No new revisions were added by this update.
Summary of changes:
.../apache/nifi/stream/io/LimitingInputStream.java | 7 +
.../controller/repository/ContentRepository.java | 18 ++
.../repository/StandardProcessSession.java | 47 +++--
.../repository/io/ContentClaimInputStream.java | 10 +-
.../repository/FileSystemRepository.java | 16 ++
.../repository/VolatileContentRepository.java | 5 +
.../crypto/EncryptedFileSystemRepository.java | 26 ++-
.../EncryptedFileSystemRepositoryTest.groovy | 2 +-
.../repository/StandardProcessSessionIT.java | 21 ++
.../repository/ByteArrayContentRepository.java | 14 ++
.../provenance/EncryptedSchemaRecordWriter.java | 133 ++----------
.../EncryptedWriteAheadProvenanceRepository.java | 12 +-
.../provenance/EventIdFirstSchemaRecordWriter.java | 232 ++++++++-------------
.../provenance/WriteAheadProvenanceRepository.java | 2 +
.../serialization/CompressableRecordWriter.java | 19 +-
.../provenance/serialization/RecordReaders.java | 23 +-
.../provenance/serialization/RecordWriter.java | 19 +-
.../provenance/store/WriteAheadStorePartition.java | 10 +-
.../provenance/util/ByteArrayDataOutputStream.java | 39 ----
.../util/ByteArrayDataOutputStreamCache.java | 52 -----
.../EncryptedSchemaRecordReaderWriterTest.groovy | 6 +-
.../provenance/AbstractTestRecordReaderWriter.java | 44 ++--
.../TestEventIdFirstSchemaRecordReaderWriter.java | 48 ++---
23 files changed, 344 insertions(+), 461 deletions(-)
delete mode 100644 nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/util/ByteArrayDataOutputStream.java
delete mode 100644 nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/util/ByteArrayDataOutputStreamCache.java