You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by fg...@apache.org on 2023/02/10 11:56:17 UTC
[nifi-minifi-cpp] branch MINIFICPP-2019_Fix-autogeneration-of-processors-md updated (0daace643 -> 5331a2377)
This is an automated email from the ASF dual-hosted git repository.
fgerlits pushed a change to branch MINIFICPP-2019_Fix-autogeneration-of-processors-md
in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git
omit 0daace643 rebase fix
omit 4342fbea0 add a missing include guard
omit 8a9355280 fix a typo
omit aa91a80c5 update PROCESSORS.md and unify Description strings with descriptions in PROCESSORS.md
omit 0c64a6791 MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md
add 2dc589158 MINIFICPP-1983 Mount files in minifi test containers
add 417756064 MINIFICPP-1983 Modify correct minifi.properties file for test containers
add 9f2040abc MINIFICPP-2008 Differentiate successful onTriggers from throwing onTriggers in ScheduleAgents
add 169cd6822 MINIFICPP-2036 Upgrade gcc to version 11
add c172824f1 MINIFICPP-2036 Handle different ccache directory locations
add a1099c556 MINIFICPP-1994 - Adding failure relationship to SQL processors
add 1181498b8 MINIFICPP-2016 Add session commit time metrics
add 71f5f8bfb MINIFICPP-2020 Improve error messages when MiNiFi is not able to start
add e9ca206f9 MINIFICPP-1840 - Add support for MQTT 5 Closes #1432
add f2f561ce2 MINIFICPP-1979 Use Coroutines with asio
add d25cd5d89 MINIFICPP-1975 Volatile and persistent combination of repositories should be avoided
add 3c44ebaff MINIFICPP-2009 CWEL should add resolved attributes with json output as well
add 650f7c28b MINIFICPP-2043 Reset flowfile repo checkpoint during initialization
add afcf304d7 MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md
add e33e5ff50 update PROCESSORS.md and unify Description strings with descriptions in PROCESSORS.md
add 96e8583cc fix a typo
add d27a9cecd add a missing include guard
add 12427fbd5 rebase fix
add e256beadd merge fixes
add b617491a4 rename: find_widths() -> findWidths()
add 4a69170c4 add unit tests for TableFormatter
add 5331a2377 fix a typo in the Description of PutS3Object
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0daace643)
\
N -- N -- N refs/heads/MINIFICPP-2019_Fix-autogeneration-of-processors-md (5331a2377)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci.yml | 6 +-
CMakeLists.txt | 5 +
METRICS.md | 18 +-
PROCESSORS.md | 116 +++--
README.md | 2 +-
centos.sh | 4 +-
cmake/BuildTests.cmake | 1 +
run_shellcheck.sh => cmake/Coroutines.cmake | 10 +-
controller/Controller.h | 15 +-
docker/DockerBuild.sh | 2 +-
docker/Dockerfile | 10 +-
docker/centos/Dockerfile | 6 +-
.../integration/MiNiFi_integration_test_driver.py | 146 +++----
.../ContainerStore.py} | 134 +++---
.../test/integration/cluster/DockerCommunicator.py | 69 +++
.../test/integration/cluster/DockerTestCluster.py | 267 ++++++++++++
.../DockerTestDirectoryBindings.py | 5 +-
.../{minifi/core => cluster}/ImageStore.py | 65 +--
.../{minifi/core => cluster}/KubernetesProxy.py | 0
.../{minifi/core => cluster}/LogSource.py | 0
docker/test/integration/{ => cluster}/__init__.py | 0
.../integration/cluster/checkers/AwsChecker.py | 49 +++
.../integration/cluster/checkers/AzureChecker.py | 59 +++
.../cluster/checkers/ElasticSearchChecker.py | 46 ++
.../checkers/GcsChecker.py} | 28 +-
.../checkers/PostgresChecker.py} | 19 +-
.../core => cluster/checkers}/PrometheusChecker.py | 33 +-
.../integration/cluster/checkers/SplunkChecker.py | 80 ++++
.../integration/{ => cluster/checkers}/__init__.py | 0
.../containers}/AzureStorageServerContainer.py | 0
.../core => cluster/containers}/Container.py | 20 +-
.../containers}/ElasticsearchContainer.py | 0
.../containers/FakeGcsServerContainer.py} | 19 +-
.../core => cluster/containers}/FlowContainer.py | 0
.../containers}/HttpProxyContainer.py | 0
.../containers}/KafkaBrokerContainer.py | 0
.../containers}/MinifiAsPodInKubernetesCluster.py | 19 +-
.../containers}/MinifiC2ServerContainer.py | 0
.../cluster/containers/MinifiContainer.py | 126 ++++++
.../containers}/MqttBrokerContainer.py | 0
.../core => cluster/containers}/NifiContainer.py | 2 +-
.../containers}/OPCUAServerContainer.py | 0
.../containers}/OpensearchContainer.py | 0
.../containers}/PostgreSQLServerContainer.py | 0
.../containers}/PrometheusContainer.py | 0
.../containers}/S3ServerContainer.py | 0
.../core => cluster/containers}/SplunkContainer.py | 0
.../containers/SyslogTcpClientContainer.py} | 15 +-
.../containers/SyslogUdpClientContainer.py} | 15 +-
.../containers/TcpClientContainer.py} | 11 +-
.../containers}/ZookeeperContainer.py | 0
.../{ => cluster/containers}/__init__.py | 0
docker/test/integration/environment.py | 6 +-
.../features/attributes_to_json.feature | 15 +
.../integration/features/azure_storage.feature | 15 +
.../features/core_functionality.feature | 21 +-
.../features/defragtextflowfiles.feature | 15 +
.../features/google_cloud_storage.feature | 15 +
.../test/integration/features/hashcontent.feature | 15 +
docker/test/integration/features/http.feature | 15 +
docker/test/integration/features/https.feature | 15 +
docker/test/integration/features/kafka.feature | 15 +
.../integration/features/minifi_c2_server.feature | 16 +
docker/test/integration/features/mqtt.feature | 253 ++++++++++-
.../integration/features/network_listener.feature | 15 +
.../test/integration/features/prometheus.feature | 17 +
.../integration/features/syslog_listener.feature | 15 +
.../FileSystemObserver.py | 0
.../OutputEventHandler.py | 2 +-
.../{ => filesystem_validation}/__init__.py | 0
.../controllers/ElasticsearchCredentialsService.py | 14 +
.../controllers/GCPCredentialsControllerService.py | 14 +
docker/test/integration/minifi/core/Cluster.py | 53 ---
.../integration/minifi/core/DockerTestCluster.py | 347 ---------------
.../minifi/core/FakeGcsServerContainer.py | 27 --
.../integration/minifi/core/MinifiContainer.py | 74 ----
.../minifi/core/MinifiWithHttpsC2Config.py | 21 -
.../core/MinifiWithProvenanceRepoContainer.py | 21 -
.../minifi/core/SyslogTcpClientContainer.py | 23 -
.../minifi/core/SyslogUdpClientContainer.py | 23 -
.../integration/minifi/core/TcpClientContainer.py | 23 -
.../minifi/core/TransientMinifiContainer.py | 24 -
.../minifi/processors/DeleteGCSObject.py | 14 +
.../minifi/processors/FetchGCSObject.py | 14 +
.../minifi/processors/ListAzureBlobStorage.py | 14 +
.../integration/minifi/processors/ListGCSBucket.py | 14 +
.../integration/minifi/processors/ListenSyslog.py | 14 +
.../integration/minifi/processors/ListenTCP.py | 14 +
.../minifi/processors/LogOnDestructionProcessor.py | 14 +
.../integration/minifi/processors/PutGCSObject.py | 14 +
.../minifi/validators/FileOutputValidator.py | 2 +-
.../minifi/validators/MultiFileOutputValidator.py | 2 +-
.../validators/SingleJSONFileOutputValidator.py | 2 +-
.../kubernetes/pods-etc/minifi.test-pod.yml | 2 +-
.../resources/minifi-c2-server-ssl/config.yml | 8 +-
.../resources/minifi/minifi-log.properties | 4 +
.../integration/resources/minifi/minifi.properties | 17 +
.../minifi.properties | 29 --
.../{minifi/core => ssl_utils}/SSL_cert_utils.py | 0
.../test/integration/{ => ssl_utils}/__init__.py | 0
docker/test/integration/steps/steps.py | 41 +-
docker/test/integration/{minifi/core => }/utils.py | 12 +
extensions/aws/processors/PutS3Object.h | 2 +-
.../mqtt/processors/AbstractMQTTProcessor.cpp | 394 ++++++++++++++---
extensions/mqtt/processors/AbstractMQTTProcessor.h | 249 ++++++-----
.../AbstractMQTTProcessorStaticDefinitions.cpp | 66 ++-
extensions/mqtt/processors/ConsumeMQTT.cpp | 356 ++++++++++++---
extensions/mqtt/processors/ConsumeMQTT.h | 145 ++++--
extensions/mqtt/processors/PublishMQTT.cpp | 287 +++++++++---
extensions/mqtt/processors/PublishMQTT.h | 149 ++++---
extensions/mqtt/tests/ConsumeMQTTTests.cpp | 106 ++++-
extensions/mqtt/tests/PublishMQTTTests.cpp | 29 +-
extensions/rocksdb-repos/FlowFileRepository.cpp | 1 +
extensions/sql/data/DatabaseConnectors.h | 25 +-
extensions/sql/data/SociConnectors.cpp | 39 +-
extensions/sql/data/SociConnectors.h | 20 +-
extensions/sql/processors/ExecuteSQL.cpp | 14 +-
extensions/sql/processors/ExecuteSQL.h | 4 +-
extensions/sql/processors/PutSQL.cpp | 19 +-
extensions/sql/processors/PutSQL.h | 4 +-
extensions/sql/processors/SQLProcessor.cpp | 29 +-
.../processors/SQLProcessorStaticDefinitions.cpp | 4 +-
extensions/standard-processors/CMakeLists.txt | 3 +
.../processors/ListenSyslog.cpp | 5 +-
.../standard-processors/processors/ListenTCP.cpp | 5 +-
.../processors/NetworkListenerProcessor.cpp | 8 +-
.../processors/NetworkListenerProcessor.h | 7 +-
.../standard-processors/processors/PutTCP.cpp | 484 +++++++--------------
extensions/standard-processors/processors/PutTCP.h | 32 +-
.../standard-processors/processors/PutUDP.cpp | 2 +-
.../processors/RouteOnAttribute.h | 5 +-
.../standard-processors/tests/CMakeLists.txt | 2 +
.../tests/unit/ListenSyslogTests.cpp | 204 +++++----
.../tests/unit/ListenTcpTests.cpp | 187 +++++---
.../tests/unit/ListenUDPTests.cpp | 53 +--
.../standard-processors/tests/unit/PutTCPTests.cpp | 162 +++----
.../standard-processors/tests/unit/PutUDPTests.cpp | 13 +-
.../windows-event-log/ConsumeWindowsEventLog.cpp | 54 ++-
.../windows-event-log/ConsumeWindowsEventLog.h | 9 +-
.../tests/ConsumeWindowsEventLogTests.cpp | 12 +
libminifi/include/CronDrivenSchedulingAgent.h | 2 -
libminifi/include/EventDrivenSchedulingAgent.h | 25 +-
libminifi/include/SchedulingAgent.h | 18 +-
libminifi/include/ThreadedSchedulingAgent.h | 26 +-
libminifi/include/TimerDrivenSchedulingAgent.h | 27 +-
libminifi/include/controllers/SSLContextService.h | 13 +-
libminifi/include/core/ConfigurableComponent.h | 17 +-
libminifi/include/core/ProcessSessionFactory.h | 4 +-
libminifi/include/core/ProcessorMetrics.h | 5 +
libminifi/include/utils/Enum.h | 5 +-
libminifi/include/utils/net/AsioCoro.h | 75 ++++
libminifi/include/utils/net/Server.h | 15 +-
.../include/utils/net/SessionHandlingServer.h | 67 ---
libminifi/include/utils/net/Ssl.h | 16 +
libminifi/include/utils/net/SslServer.h | 65 ---
libminifi/include/utils/net/TcpServer.h | 38 +-
libminifi/include/utils/net/UdpServer.h | 12 +-
libminifi/src/CronDrivenSchedulingAgent.cpp | 17 +-
libminifi/src/EventDrivenSchedulingAgent.cpp | 16 +-
libminifi/src/SchedulingAgent.cpp | 28 +-
libminifi/src/TimerDrivenSchedulingAgent.cpp | 23 +-
libminifi/src/controllers/SSLContextService.cpp | 10 +-
libminifi/src/core/ConfigurableComponent.cpp | 25 +-
libminifi/src/core/Processor.cpp | 8 +-
libminifi/src/core/ProcessorMetrics.cpp | 20 +-
libminifi/src/core/RepositoryFactory.cpp | 32 +-
libminifi/src/utils/net/SslServer.cpp | 90 ----
libminifi/src/utils/net/TcpServer.cpp | 90 ++--
libminifi/src/utils/net/UdpServer.cpp | 41 +-
libminifi/test/Catch.h | 46 +-
libminifi/test/TestBase.cpp | 53 ++-
libminifi/test/TestBase.h | 2 +-
libminifi/test/Utils.h | 75 ++--
libminifi/test/sql-tests/ExecuteSQLTests.cpp | 41 +-
libminifi/test/sql-tests/PutSQLTests.cpp | 89 +++-
libminifi/test/sql-tests/SQLTestPlan.h | 2 +-
libminifi/test/sql-tests/mocks/MockConnectors.cpp | 14 +-
libminifi/test/unit/MetricsTests.cpp | 41 +-
minifi_main/MiNiFiMain.cpp | 24 +-
minifi_main/MiNiFiWindowsService.cpp | 17 +-
minifi_main/MiNiFiWindowsService.h | 8 +-
minifi_main/TableFormatter.cpp | 4 +-
minifi_main/TableFormatter.h | 2 +-
.../systemd => minifi_main}/tests/CMakeLists.txt | 24 +-
minifi_main/tests/TableFormatterTests.cpp | 53 +++
185 files changed, 4509 insertions(+), 2787 deletions(-)
copy run_shellcheck.sh => cmake/Coroutines.cmake (77%)
mode change 100755 => 100644
rename docker/test/integration/{minifi/core/SingleNodeDockerCluster.py => cluster/ContainerStore.py} (65%)
create mode 100644 docker/test/integration/cluster/DockerCommunicator.py
create mode 100644 docker/test/integration/cluster/DockerTestCluster.py
rename docker/test/integration/{minifi/core => cluster}/DockerTestDirectoryBindings.py (94%)
rename docker/test/integration/{minifi/core => cluster}/ImageStore.py (71%)
rename docker/test/integration/{minifi/core => cluster}/KubernetesProxy.py (100%)
rename docker/test/integration/{minifi/core => cluster}/LogSource.py (100%)
copy docker/test/integration/{ => cluster}/__init__.py (100%)
create mode 100644 docker/test/integration/cluster/checkers/AwsChecker.py
create mode 100644 docker/test/integration/cluster/checkers/AzureChecker.py
create mode 100644 docker/test/integration/cluster/checkers/ElasticSearchChecker.py
copy docker/test/integration/{minifi/core/FlowContainer.py => cluster/checkers/GcsChecker.py} (55%)
copy docker/test/integration/{minifi/controllers/KubernetesControllerService.py => cluster/checkers/PostgresChecker.py} (53%)
rename docker/test/integration/{minifi/core => cluster/checkers}/PrometheusChecker.py (80%)
create mode 100644 docker/test/integration/cluster/checkers/SplunkChecker.py
copy docker/test/integration/{ => cluster/checkers}/__init__.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/AzureStorageServerContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/Container.py (73%)
rename docker/test/integration/{minifi/core => cluster/containers}/ElasticsearchContainer.py (100%)
copy docker/test/integration/{minifi/core/HttpProxyContainer.py => cluster/containers/FakeGcsServerContainer.py} (69%)
rename docker/test/integration/{minifi/core => cluster/containers}/FlowContainer.py (100%)
copy docker/test/integration/{minifi/core => cluster/containers}/HttpProxyContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/KafkaBrokerContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/MinifiAsPodInKubernetesCluster.py (83%)
rename docker/test/integration/{minifi/core => cluster/containers}/MinifiC2ServerContainer.py (100%)
create mode 100644 docker/test/integration/cluster/containers/MinifiContainer.py
rename docker/test/integration/{minifi/core => cluster/containers}/MqttBrokerContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/NifiContainer.py (96%)
rename docker/test/integration/{minifi/core => cluster/containers}/OPCUAServerContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/OpensearchContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/PostgreSQLServerContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/PrometheusContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/S3ServerContainer.py (100%)
rename docker/test/integration/{minifi/core => cluster/containers}/SplunkContainer.py (100%)
copy docker/test/integration/{minifi/core/HttpProxyContainer.py => cluster/containers/SyslogTcpClientContainer.py} (73%)
copy docker/test/integration/{minifi/core/HttpProxyContainer.py => cluster/containers/SyslogUdpClientContainer.py} (73%)
rename docker/test/integration/{minifi/core/HttpProxyContainer.py => cluster/containers/TcpClientContainer.py} (83%)
rename docker/test/integration/{minifi/core => cluster/containers}/ZookeeperContainer.py (100%)
copy docker/test/integration/{ => cluster/containers}/__init__.py (100%)
rename docker/test/integration/{minifi/core => filesystem_validation}/FileSystemObserver.py (100%)
rename docker/test/integration/{minifi/core => filesystem_validation}/OutputEventHandler.py (98%)
copy docker/test/integration/{ => filesystem_validation}/__init__.py (100%)
delete mode 100644 docker/test/integration/minifi/core/Cluster.py
delete mode 100644 docker/test/integration/minifi/core/DockerTestCluster.py
delete mode 100644 docker/test/integration/minifi/core/FakeGcsServerContainer.py
delete mode 100644 docker/test/integration/minifi/core/MinifiContainer.py
delete mode 100644 docker/test/integration/minifi/core/MinifiWithHttpsC2Config.py
delete mode 100644 docker/test/integration/minifi/core/MinifiWithProvenanceRepoContainer.py
delete mode 100644 docker/test/integration/minifi/core/SyslogTcpClientContainer.py
delete mode 100644 docker/test/integration/minifi/core/SyslogUdpClientContainer.py
delete mode 100644 docker/test/integration/minifi/core/TcpClientContainer.py
delete mode 100644 docker/test/integration/minifi/core/TransientMinifiContainer.py
create mode 100644 docker/test/integration/resources/minifi/minifi-log.properties
create mode 100644 docker/test/integration/resources/minifi/minifi.properties
delete mode 100644 docker/test/integration/resources/minifi_cpp_with_provenance_repo/minifi.properties
rename docker/test/integration/{minifi/core => ssl_utils}/SSL_cert_utils.py (100%)
copy docker/test/integration/{ => ssl_utils}/__init__.py (100%)
rename docker/test/integration/{minifi/core => }/utils.py (88%)
create mode 100644 libminifi/include/utils/net/AsioCoro.h
delete mode 100644 libminifi/include/utils/net/SessionHandlingServer.h
delete mode 100644 libminifi/include/utils/net/SslServer.h
delete mode 100644 libminifi/src/utils/net/SslServer.cpp
copy {extensions/systemd => minifi_main}/tests/CMakeLists.txt (56%)
create mode 100644 minifi_main/tests/TableFormatterTests.cpp