You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by fg...@apache.org on 2023/01/24 10:49:47 UTC

[nifi-minifi-cpp] branch MINIFICPP-2019_Fix-autogeneration-of-processors-md updated (1ce018827 -> 0daace643)

This is an automated email from the ASF dual-hosted git repository.

fgerlits pushed a change to branch MINIFICPP-2019_Fix-autogeneration-of-processors-md
in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git


    omit 1ce018827 add a missing include guard
    omit ccd6c0299 fix a typo
    omit 333f62313 update PROCESSORS.md and unify Description strings with descriptions in PROCESSORS.md
    omit 57a9ed822 MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md
     add 30fdfb7ee MINIFICPP-1948 Add the UUID to the end of Processor and Controller Service log lines
     add 63c4eb9e9 MINIFICPP-2025 Eliminate cmake CMP0135 warnings
     add 00d145e08 MINIFICPP-1972 - Refactor State Manager code
     add 6c57decc7 MINIFICPP-1991 - Remove unused ControllerServiceProvider methods
     add 8d18ef1ff MINIFICPP-2026 Make isRunning member functions const
     add e6d827187 MINIFICPP-1973 Refactor ResourceQueue
     add 2173e13e1 MINIFICPP-1987 Configuring processor metrics with regular expressions
     add 78a5c85b8 MINIFICPP-1965 Add CMAKE flags to select malloc implementation
     add 572e7e928 MINIFICPP-2032 Add support for new AWS regions
     add 06d1d1610 MINIFICPP-2004 Remove default property values from kubernetes examples
     add 0c64a6791 MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md
     add aa91a80c5 update PROCESSORS.md and unify Description strings with descriptions in PROCESSORS.md
     add 8a9355280 fix a typo
     add 4342fbea0 add a missing include guard
     add 0daace643 rebase fix

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (1ce018827)
            \
             N -- N -- N   refs/heads/MINIFICPP-2019_Fix-autogeneration-of-processors-md (0daace643)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 C2.md                                              |   4 +
 CMakeLists.txt                                     |  32 ++-
 METRICS.md                                         |  16 +-
 PROCESSORS.md                                      | 163 +++++++--------
 bootstrap.sh                                       |  16 +-
 centos.sh                                          |   1 +
 cmake/BundledAwsSdkCpp.cmake                       |  15 +-
 cmake/BundledLibXml2.cmake                         |   4 +
 cmake/{Abseil.cmake => Crc32c.cmake}               |  16 +-
 cmake/FindLibGPS.cmake                             |  12 +-
 cmake/GoogleCloudCpp.cmake                         |  13 +-
 cmake/{ExpectedLite.cmake => MiMalloc.cmake}       |  13 +-
 cmake/MiNiFiOptions.cmake                          |   9 +
 cmake/{Abseil.cmake => RpMalloc.cmake}             |  18 +-
 conf/minifi-log.properties                         |   3 +
 docker/conf/minifi-log.properties                  |   3 +
 docker/requirements.txt                            |   2 +-
 .../integration/MiNiFi_integration_test_driver.py  |  14 +-
 .../features/core_functionality.feature            |  10 +
 .../integration/minifi/core/DockerTestCluster.py   |  29 ++-
 docker/test/integration/minifi/core/ImageStore.py  |   2 +-
 docker/test/integration/minifi/core/utils.py       |  24 +++
 docker/test/integration/steps/steps.py             |  64 +++---
 .../daemon-set-log-collection.yml                  |   6 -
 .../sidecar-log-collection.yml                     |   6 -
 .../aws/controllerservices/AWSCredentialsService.h |   2 +-
 extensions/aws/processors/DeleteS3Object.h         |   4 +-
 extensions/aws/processors/FetchS3Object.h          |   4 +-
 extensions/aws/processors/ListS3.h                 |   4 +-
 extensions/aws/processors/PutS3Object.h            |   4 +-
 extensions/aws/processors/S3Processor.cpp          |   5 +-
 extensions/aws/processors/S3Processor.h            |   7 +-
 .../processors/S3ProcessorStaticDefinitions.cpp    |   7 +-
 extensions/aws/s3/S3ClientRequestSender.cpp        |  28 +--
 extensions/aws/s3/S3ClientRequestSender.h          |  14 +-
 extensions/aws/s3/S3Wrapper.h                      |   6 +-
 .../AzureStorageCredentialsService.h               |   4 +-
 .../processors/AzureBlobStorageProcessorBase.h     |   4 -
 .../AzureBlobStorageSingleBlobProcessorBase.h      |   4 -
 .../azure/processors/DeleteAzureDataLakeStorage.h  |   2 +-
 .../azure/processors/FetchAzureDataLakeStorage.h   |   2 +-
 extensions/azure/processors/ListAzureBlobStorage.h |   2 +-
 .../azure/processors/ListAzureDataLakeStorage.h    |   4 +-
 extensions/bustache/ApplyTemplate.h                |   2 +-
 extensions/bustache/CMakeLists.txt                 |   1 -
 extensions/civetweb/processors/ListenHTTP.h        |   7 +-
 extensions/coap/controllerservice/CoapConnector.h  |   2 +-
 extensions/coap/server/CoapServer.h                |   6 +-
 .../ElasticsearchCredentialsControllerService.h    |   4 +-
 extensions/elasticsearch/PostElasticsearch.h       |   2 +-
 .../GCPCredentialsControllerService.h              |   4 +-
 extensions/gcp/processors/DeleteGCSObject.h        |   2 +-
 extensions/gcp/processors/FetchGCSObject.h         |   2 +-
 extensions/gcp/processors/ListGCSBucket.h          |   2 +-
 extensions/gcp/processors/PutGCSObject.h           |   2 +-
 extensions/gps/GetGPS.h                            |   2 +-
 extensions/http-curl/client/HTTPClient.h           |   2 +-
 extensions/http-curl/processors/InvokeHTTP.cpp     |  15 +-
 extensions/http-curl/processors/InvokeHTTP.h       |   2 +-
 .../http-curl/tests/C2DescribeMetricsTest.cpp      |  30 ++-
 extensions/http-curl/tests/C2MetricsTest.cpp       |   2 +-
 .../tests/ControllerServiceIntegrationTests.cpp    |  43 ++--
 extensions/jni/ExecuteJavaControllerService.h      |   6 +-
 extensions/jni/jvm/JavaControllerService.h         |   4 +-
 .../KubernetesControllerService.cpp                |   2 +-
 .../processors/CollectKubernetesPodMetrics.h       |   2 +-
 extensions/libarchive/BinFiles.h                   |  15 +-
 extensions/libarchive/CompressContent.h            |  14 +-
 extensions/libarchive/FocusArchiveEntry.h          |   3 +-
 extensions/libarchive/ManipulateArchive.h          |   2 +-
 extensions/libarchive/MergeContent.cpp             |   4 +-
 extensions/libarchive/MergeContent.h               |  16 +-
 extensions/libarchive/UnfocusArchiveEntry.h        |   2 +-
 extensions/librdkafka/ConsumeKafka.h               |  11 +-
 extensions/librdkafka/PublishKafka.h               |   2 +-
 extensions/mqtt/processors/AbstractMQTTProcessor.h |   2 +-
 extensions/mqtt/processors/ConsumeMQTT.h           |   2 +-
 extensions/mqtt/processors/PublishMQTT.h           |   2 +-
 extensions/opc/include/fetchopc.h                  |  16 +-
 extensions/opc/include/putopc.h                    |   4 +-
 extensions/opencv/CaptureRTSPFrame.h               |   2 +-
 extensions/opencv/MotionDetector.h                 |   2 +-
 .../SourceInitiatedSubscriptionListener.h          |   2 +-
 extensions/pcap/CapturePacket.h                    |   2 +-
 extensions/procfs/processors/ProcFsMonitor.h       |   3 +-
 .../rocksdb-repos/DatabaseContentRepository.h      |   2 +-
 ...lueStoreService.cpp => RocksDbStateStorage.cpp} |  74 ++++---
 ...eyValueStoreService.h => RocksDbStateStorage.h} |  36 ++--
 extensions/script/ExecuteScript.cpp                |  10 +-
 extensions/script/ExecuteScript.h                  |   2 +-
 extensions/script/python/ExecutePythonProcessor.h  |   2 +-
 extensions/sftp/processors/FetchSFTP.cpp           |   6 +-
 extensions/sftp/processors/FetchSFTP.h             |   4 +-
 extensions/sftp/processors/ListSFTP.cpp            |  21 +-
 extensions/sftp/processors/ListSFTP.h              |  30 +--
 extensions/sftp/processors/PutSFTP.cpp             |  15 +-
 extensions/splunk/PutSplunkHTTP.cpp                |  48 ++---
 extensions/splunk/PutSplunkHTTP.h                  |   2 +-
 extensions/sql/processors/ExecuteSQL.cpp           |  10 +-
 extensions/sql/processors/PutSQL.cpp               |   4 +-
 extensions/sql/processors/QueryDatabaseTable.cpp   |   8 +-
 extensions/sql/processors/QueryDatabaseTable.h     |   3 +-
 extensions/sql/services/DatabaseService.h          |   8 +-
 extensions/sql/services/ODBCConnector.h            |   6 +-
 .../controllers/InMemoryKeyValueStorage.cpp        |  77 +++++++
 .../controllers/InMemoryKeyValueStorage.h          |  30 +--
 ...reService.cpp => PersistentMapStateStorage.cpp} | 120 ++++++-----
 ...eStoreService.h => PersistentMapStateStorage.h} |  47 ++---
 .../UnorderedMapKeyValueStoreService.cpp           | 108 ----------
 .../controllers/VolatileMapStateStorage.cpp        |  75 +++++++
 ...lueStoreService.h => VolatileMapStateStorage.h} |  26 ++-
 .../processors/AppendHostInfo.h                    |  12 +-
 .../processors/AttributesToJSON.h                  |   2 +-
 .../processors/DefragmentText.h                    |   2 +-
 .../processors/ExecuteProcess.h                    |  10 +-
 .../standard-processors/processors/ExtractText.h   |   2 +-
 .../standard-processors/processors/FetchFile.h     |   2 +-
 .../processors/GenerateFlowFile.h                  |   3 +-
 .../standard-processors/processors/GetFile.h       |   2 +-
 extensions/standard-processors/processors/GetTCP.h |  27 +--
 .../standard-processors/processors/HashContent.h   |   8 +-
 .../standard-processors/processors/ListFile.h      |   2 +-
 .../standard-processors/processors/ListenSyslog.h  |   2 +-
 .../standard-processors/processors/ListenTCP.h     |   2 +-
 .../standard-processors/processors/ListenUDP.h     |   2 +-
 .../standard-processors/processors/LogAttribute.h  |  19 +-
 .../standard-processors/processors/PutFile.h       |   6 +-
 extensions/standard-processors/processors/PutTCP.h |   2 +-
 .../standard-processors/processors/PutUDP.cpp      |   2 +-
 .../standard-processors/processors/ReplaceText.cpp |   2 +-
 .../standard-processors/processors/RetryFlowFile.h |   2 +-
 .../processors/RouteOnAttribute.h                  |   7 +-
 .../standard-processors/processors/RouteText.cpp   |   6 +-
 .../standard-processors/processors/TailFile.h      |   4 +-
 .../processors/UpdateAttribute.h                   |   7 +-
 extensions/systemd/ConsumeJournald.h               |   6 +-
 extensions/tensorflow/TFApplyGraph.h               |   2 +-
 extensions/tensorflow/TFConvertImageToTensor.h     |   2 +-
 extensions/tensorflow/TFExtractTopLabels.h         |   2 +-
 extensions/test-processors/KamikazeProcessor.h     |   2 +-
 .../test-processors/LogOnDestructionProcessor.h    |   2 +-
 extensions/usb-camera/GetUSBCamera.h               |   8 +-
 extensions/windows-event-log/Bookmark.cpp          |   2 +-
 extensions/windows-event-log/Bookmark.h            |   4 +-
 .../CollectorInitiatedSubscription.cpp             |   2 +-
 .../windows-event-log/ConsumeWindowsEventLog.cpp   |   2 +-
 .../windows-event-log/ConsumeWindowsEventLog.h     |   2 +-
 .../windows-event-log/tests/BookmarkTests.cpp      |  22 +-
 libminifi/CMakeLists.txt                           |   3 +
 libminifi/include/Connection.h                     |   2 +-
 libminifi/include/FlowController.h                 |  39 +---
 libminifi/include/Funnel.h                         |   2 +-
 libminifi/include/Port.h                           |   2 +-
 libminifi/include/RemoteProcessorGroupPort.h       |   2 +-
 libminifi/include/SchedulingAgent.h                |  17 +-
 libminifi/include/c2/C2Protocol.h                  |   6 +-
 libminifi/include/c2/HeartbeatReporter.h           |   2 +-
 libminifi/include/c2/triggers/FileUpdateTrigger.h  |   2 +-
 .../include/controllers/AttributeProviderService.h |   2 +-
 .../controllers/LinuxPowerManagementService.h      |   4 +-
 .../controllers/NetworkPrioritizerService.h        |   4 +-
 libminifi/include/controllers/SSLContextService.h  |   7 +-
 .../include/controllers/ThreadManagementService.h  |  10 +-
 .../controllers/UpdatePolicyControllerService.h    |   2 +-
 .../AbstractCoreComponentStateManagerProvider.h    |  87 --------
 ...stingKeyValueStoreService.h => AutoPersistor.h} |  45 ++---
 .../KeyValueStateManager.h}                        |  41 +++-
 ...yValueStoreService.h => KeyValueStateStorage.h} |  55 +++--
 .../keyvalue/PersistableKeyValueStoreService.h     |  49 -----
 libminifi/include/core/Connectable.h               |   2 +-
 libminifi/include/core/CoreComponentState.h        |  82 --------
 libminifi/include/core/ProcessContext.h            | 110 +++++-----
 libminifi/include/core/ProcessGroup.h              |  14 +-
 libminifi/include/core/ProcessSession.h            |   2 +-
 libminifi/include/core/Processor.h                 |   3 +-
 libminifi/include/core/ProcessorNode.h             |   2 +-
 libminifi/include/core/SerializableComponent.h     |   2 +-
 .../{json/JsonConfiguration.h => StateManager.h}   |  54 +++--
 .../{ConfigurationFactory.h => StateStorage.h}     |  31 +--
 libminifi/include/core/ThreadedRepository.h        |   2 +-
 .../include/core/controller/ControllerService.h    |   4 +-
 .../core/controller/ControllerServiceProvider.h    |  88 +-------
 .../ForwardingControllerServiceProvider.h          |  62 +-----
 .../controller/StandardControllerServiceProvider.h | 131 ++----------
 libminifi/include/core/logging/Logger.h            |  57 +++---
 .../include/core/logging/LoggerConfiguration.h     |  27 ++-
 libminifi/include/core/logging/LoggerFactory.h     |   9 +-
 libminifi/include/core/state/ProcessorController.h |   6 +-
 libminifi/include/core/state/UpdateController.h    |   2 +-
 libminifi/include/core/state/nodes/MetricsBase.h   |   2 +-
 .../include/core/state/nodes/ResponseNodeLoader.h  |  21 +-
 libminifi/include/properties/Configuration.h       |  15 +-
 libminifi/include/properties/Configure.h           |  17 +-
 libminifi/include/sitetosite/SiteToSiteClient.h    |   2 +-
 libminifi/include/utils/ListingStateManager.h      |   6 +-
 libminifi/include/utils/ResourceQueue.h            |  32 ++-
 libminifi/include/utils/ThreadPool.h               |  23 +--
 libminifi/src/Configuration.cpp                    |  15 +-
 libminifi/src/Configure.cpp                        |  18 +-
 libminifi/src/FlowController.cpp                   |  29 ++-
 libminifi/src/SchedulingAgent.cpp                  |  41 ----
 libminifi/src/c2/C2Agent.cpp                       |  18 +-
 libminifi/src/c2/C2Client.cpp                      |   2 +-
 .../controllers/LinuxPowerManagementService.cpp    |   2 +-
 .../src/controllers/NetworkPrioritizerService.cpp  |   2 +-
 .../controllers/UpdatePolicyControllerService.cpp  |   2 +-
 .../AbstractCoreComponentStateManagerProvider.cpp  | 222 ---------------------
 ...gKeyValueStoreService.cpp => AutoPersistor.cpp} |  59 ++----
 .../controllers/keyvalue/KeyValueStateManager.cpp  | 145 ++++++++++++++
 .../controllers/keyvalue/KeyValueStateStorage.cpp  | 104 ++++++++++
 .../controllers/keyvalue/KeyValueStoreService.cpp  |  39 ----
 .../keyvalue/PersistableKeyValueStoreService.cpp   |  63 ------
 libminifi/src/core/Connectable.cpp                 |   4 +-
 libminifi/src/core/FlowConfiguration.cpp           |   4 +-
 libminifi/src/core/ProcessGroup.cpp                |  28 +--
 libminifi/src/core/Processor.cpp                   |   6 +-
 libminifi/src/core/ProcessorNode.cpp               |   2 +-
 libminifi/src/core/logging/LoggerConfiguration.cpp |  30 ++-
 libminifi/src/core/logging/LoggerFactory.cpp       |   4 +-
 libminifi/src/core/state/ProcessorController.cpp   |   6 +-
 .../src/core/state/nodes/ResponseNodeLoader.cpp    |  40 +++-
 libminifi/src/utils/ThreadPool.cpp                 |  41 +++-
 libminifi/test/ReadFromFlowFileTestProcessor.h     |   3 +-
 libminifi/test/StatefulProcessor.h                 |   6 +-
 libminifi/test/TestBase.cpp                        |  16 +-
 libminifi/test/TestBase.h                          |  12 +-
 libminifi/test/WriteToFlowFileTestProcessor.h      |   3 +-
 libminifi/test/aws-tests/PutS3ObjectTests.cpp      |   4 +-
 libminifi/test/flow-tests/CycleTest.cpp            |   4 +-
 libminifi/test/flow-tests/FlowControllerTests.cpp  |   4 +-
 libminifi/test/flow-tests/LoopTest.cpp             |   4 +-
 libminifi/test/flow-tests/MultiLoopTest.cpp        |   4 +-
 libminifi/test/integration/IntegrationBase.h       |   8 +-
 .../integration/StateTransactionalityTests.cpp     | 118 +++++------
 libminifi/test/keyvalue-tests/CMakeLists.txt       |   6 +-
 ...viceTest.cpp => PersistentStateStorageTest.cpp} |  34 ++--
 ...iceTest.cpp => VolatileMapStateStorageTest.cpp} |  33 ++-
 ...rviceTest.yml => PersistentMapStateStorage.yml} |   2 +-
 ...toreServiceTest.yml => RocksDbStateStorage.yml} |   2 +-
 ...ServiceTest.yml => VolatileMapStateStorage.yml} |   2 +-
 libminifi/test/sql-tests/mocks/MockODBCService.h   |   2 +-
 libminifi/test/unit/ComponentManifestTests.cpp     |   2 +-
 libminifi/test/unit/ControllerTests.cpp            |   4 +-
 libminifi/test/unit/LoggerTests.cpp                |  35 ++++
 libminifi/test/unit/MockClasses.h                  |   2 +-
 libminifi/test/unit/ProvenanceTestHelper.h         |   2 +-
 libminifi/test/unit/ResourceQueueTests.cpp         |  77 ++++---
 libminifi/test/unit/ResponseNodeLoaderTests.cpp    | 134 +++++++++++++
 libminifi/test/unit/SchedulingAgentTests.cpp       |   2 +-
 minifi_main/CMakeLists.txt                         |   8 +-
 nanofi/include/cxx/CallbackProcessor.h             |   7 +-
 thirdparty/aws-sdk-cpp/bundle-openssl.patch        |  46 +++++
 .../aws-sdk-cpp/c++20-compilation-fixes.patch      |  27 +--
 thirdparty/aws-sdk-cpp/dll-export-injection.patch  |  34 ++--
 thirdparty/aws-sdk-cpp/shutdown-fix.patch          |   9 +-
 255 files changed, 2219 insertions(+), 2375 deletions(-)
 copy cmake/{Abseil.cmake => Crc32c.cmake} (62%)
 copy cmake/{ExpectedLite.cmake => MiMalloc.cmake} (75%)
 copy cmake/{Abseil.cmake => RpMalloc.cmake} (61%)
 rename extensions/rocksdb-repos/controllers/{RocksDbPersistableKeyValueStoreService.cpp => RocksDbStateStorage.cpp} (68%)
 rename extensions/rocksdb-repos/controllers/{RocksDbPersistableKeyValueStoreService.h => RocksDbStateStorage.h} (74%)
 create mode 100644 extensions/standard-processors/controllers/InMemoryKeyValueStorage.cpp
 copy libminifi/include/controllers/AttributeProviderService.h => extensions/standard-processors/controllers/InMemoryKeyValueStorage.h (52%)
 rename extensions/standard-processors/controllers/{UnorderedMapPersistableKeyValueStoreService.cpp => PersistentMapStateStorage.cpp} (59%)
 rename extensions/standard-processors/controllers/{UnorderedMapPersistableKeyValueStoreService.h => PersistentMapStateStorage.h} (63%)
 delete mode 100644 extensions/standard-processors/controllers/UnorderedMapKeyValueStoreService.cpp
 create mode 100644 extensions/standard-processors/controllers/VolatileMapStateStorage.cpp
 rename extensions/standard-processors/controllers/{UnorderedMapKeyValueStoreService.h => VolatileMapStateStorage.h} (75%)
 delete mode 100644 libminifi/include/controllers/keyvalue/AbstractCoreComponentStateManagerProvider.h
 rename libminifi/include/controllers/keyvalue/{AbstractAutoPersistingKeyValueStoreService.h => AutoPersistor.h} (61%)
 copy libminifi/include/controllers/{AttributeProviderService.h => keyvalue/KeyValueStateManager.h} (52%)
 rename libminifi/include/controllers/keyvalue/{KeyValueStoreService.h => KeyValueStateStorage.h} (53%)
 delete mode 100644 libminifi/include/controllers/keyvalue/PersistableKeyValueStoreService.h
 delete mode 100644 libminifi/include/core/CoreComponentState.h
 copy libminifi/include/core/{json/JsonConfiguration.h => StateManager.h} (51%)
 copy libminifi/include/core/{ConfigurationFactory.h => StateStorage.h} (62%)
 delete mode 100644 libminifi/src/controllers/keyvalue/AbstractCoreComponentStateManagerProvider.cpp
 rename libminifi/src/controllers/keyvalue/{AbstractAutoPersistingKeyValueStoreService.cpp => AutoPersistor.cpp} (52%)
 create mode 100644 libminifi/src/controllers/keyvalue/KeyValueStateManager.cpp
 create mode 100644 libminifi/src/controllers/keyvalue/KeyValueStateStorage.cpp
 delete mode 100644 libminifi/src/controllers/keyvalue/KeyValueStoreService.cpp
 delete mode 100644 libminifi/src/controllers/keyvalue/PersistableKeyValueStoreService.cpp
 rename libminifi/test/keyvalue-tests/{PersistableKeyValueStoreServiceTest.cpp => PersistentStateStorageTest.cpp} (80%)
 rename libminifi/test/keyvalue-tests/{UnorderedMapKeyValueStoreServiceTest.cpp => VolatileMapStateStorageTest.cpp} (78%)
 rename libminifi/test/resources/{UnorderedMapPersistableKeyValueStoreServiceTest.yml => PersistentMapStateStorage.yml} (95%)
 rename libminifi/test/resources/{RocksDbPersistableKeyValueStoreServiceTest.yml => RocksDbStateStorage.yml} (95%)
 rename libminifi/test/resources/{UnorderedMapKeyValueStoreServiceTest.yml => VolatileMapStateStorage.yml} (95%)
 create mode 100644 libminifi/test/unit/ResponseNodeLoaderTests.cpp
 create mode 100644 thirdparty/aws-sdk-cpp/bundle-openssl.patch