You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by ac...@apache.org on 2019/12/05 09:29:23 UTC
[camel-kafka-connector] branch master updated (ab4a86a -> c96b35a)
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git.
from ab4a86a Revert "Added readme.md"
new 190bc36 Initial commit
new 57969f4 Project scaffolding
new 1b89992 Merged relevant parts from https://github.com/scholzj/kafka-connect-camel-connector
new 5fa98c3 Initial spike to have a working POC.
new bc4e723 Bump to Camel 2.23.2
new 51dbf4e Added support for headers in source connector
new b52186e Moved to camel 3 fix #12
new ab3fab3 chore(sink headers): Support headers in Sink connector too
new 1df49dc Indentation
new 3c3f40f chore(headers properties support): Support headers and properties
new 39a5cc0 test(source): First attempt of test for Souce
new 7c2781a Fixed polling to consume more than one message per poll() call, see CamelSourceTaskTestIT test.
new b8863a5 test(sink): Added tests for Camel Sink Task
new 4aafdf6 test(sink): Properties and headers mixed tests
new fe12987 chore(source): add a getter for Camel context
new ed781af Fixed typo
new f09a14f Added support for configuring component properties. Refined unit tests and README.adoc Added Jms source/sink examples Fix #1 and #2
new ec1a640 fix #9 : Add option to configure pollingConsumerQueueSize, pollingConsumerBlockWhenFull and pollingConsumerBlockTimeout
new f0bd0ed Added an AWS SQS Sink connector example
new 68dbdce Added an example for AWS S3 Source Connector
new a5f1e27 Fixed README for S3 example
new 1dafcb9 Added an example for AWS SQS Source connector
new b0d373e Added an AWS SNS Sink connector example
new 5d1d9e8 Typo in SNS example config
new 7aa284b Added AWS Kinesis source connector example
new c176378 Fixes #31 Upgrade to Camel 3.0.0-M4
new fc0b3e0 Ensured Property whose value starts with #class, are first in order no matter where they are in the properties file.
new 2ce0921 Updated know limitations and small cosmetic changes.
new 4184346 Fix formatting in the README file (#36)
new 21b88c6 Add strimzi guide - Closes #3
new 08c632b Fix links, we are asciidoc not markdown
new 6c4b96e One more link to fix
new 10eb344 Increase the timeout in testSourcePolling to 2100ms - Closes #40
new 6222b6e Minor documentation fixes: typos
new 95396c5 Introduces an integration test infrastructure to allow verifying the integrated functionality between Camel and Kafka.
new 6e03afa Adds retry to camel source task test to work-around timeout issues
new 378b21d Adds integration tests for the Camel JMS sink and source
new 0a2c3c7 Fix a typo in the package name in the integration-test module
new 50e416f Improve handling of exceptions raised during CamelContext startup - Closes #38
new 2fcebdb Update to Camel 3.0.0-RC1 fix #42
new 00a721e Refactored CamelMainSupport strtup exception catching/logging.
new f2366ba Added support for dataformat, fix #35
new 012894e Convert the Apache Artemis image to Centos 8 as noted on issue #53
new 52b38c3 Adds a small note about how to run the integration tests
new 7d0c610 This patch introductes integration testing for a Camel Kafka Connect sink using AWS SQS
new c2b463f Specified requirements to run integration tests.
new e121a8c Bumped to camel 3.0.0-RC2 and re-enabled tests fix #50
new 8e59b2d Added http Sink example
new 0ed6f94 Bump Maven compiler to version 3.8.1
new 079ced5 Re-enable the AWS SQS test since Camel 3 RC2 is released with the fix required for the test execution
new 95d1ea8 Adds the source check profile from Camel to ensure consistency of the codebase
new fa07a00 Fix multiple source check violations
new d8d40be Removes a System.out.println left out during a debug session
new c8aeca0 This patch introduces integration testing for a Camel Kafka Connect source using AWS SQS
new de3f507 Refactor duplicated AWS Configuration code to simplify reusing it for other TCs
new c086a4d Prevent NPE if the Kafka connect runner was not properly initialized
new 90e10fb Introduces tests for AWS SNS Sink
new dc8c3bf Remove parent from root pom.xml so we can do a mvn versions:set on this project
new aaf541c Adjust the code to make it work on Camel 3 RC3
new 19d7ee2 Fix issue #67: warnings displayed on test startup
new 55dd7fe Adds integration tests for AWS Kinesis source
new f6fe6fc Adds integration tests for AWS S3
new ea72f16 Marks the test as ignored
new b632f58 Ensure all tests run within a reasonable time or fail otherwise
new c295abe Increase timeout for the AWS S3 Source test case
new 444d0ed Do fail the test if the startup does not finish within the specified time
new 5ca48e1 Fix code style compliance issues on the testing code
new daa5e2a Version bump to Camel 3
new 20058ba Basic implementation of the HTTP tests
new 680cccc Re-enable the AWS S3 tests
new a09b050 Fix one minor formatting issue pointed by source check
new d81d230 Add Apache RAT plugin
new a24a5f4 add ASF license to pom
new 97f9682 use apache managed plugins
new 1fd1219 add license to another pom
new 89dd789 Fix issue #87: missing copyright headers causing Apache RAT Plugin check to fail
new c96b35a Adds an integration test for the camel-file component
The 77 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 32 ++
.mvn/wrapper/MavenWrapperDownloader.java | 117 ++++++
.mvn/wrapper/maven-wrapper.properties | 2 +
LICENSE | 201 ++++++++++
README.adoc | 42 ++
config/CamelSinkConnector.properties | 25 ++
config/CamelSourceConnector.properties | 26 ++
core/pom.xml | 175 +++++++++
core/src/main/assembly/package.xml | 59 +++
.../camel/kafkaconnector/CamelSinkConnector.java | 68 ++++
.../kafkaconnector/CamelSinkConnectorConfig.java | 48 +++
.../apache/camel/kafkaconnector/CamelSinkTask.java | 154 ++++++++
.../camel/kafkaconnector/CamelSourceConnector.java | 69 ++++
.../kafkaconnector/CamelSourceConnectorConfig.java | 79 ++++
.../camel/kafkaconnector/CamelSourceTask.java | 198 ++++++++++
.../apache/camel/kafkaconnector/VersionUtil.java | 31 ++
.../converters/S3ObjectConverter.java | 43 +++
.../converters/S3ObjectSerializer.java | 55 +++
.../kafkaconnector/utils/CamelMainSupport.java | 232 +++++++++++
.../camel/kafkaconnector/CamelSinkTaskTest.java | 204 ++++++++++
.../camel/kafkaconnector/CamelSourceTaskTest.java | 129 +++++++
.../camel/kafkaconnector/DataFormatTest.java | 109 ++++++
.../camel/kafkaconnector/PropertiesOrderTest.java | 51 +++
.../test/TestBlockingQueueFactory.java | 45 +++
core/src/test/resources/log4j.xml | 56 +++
core/src/test/resources/log4j2.properties | 28 ++
docs/try-it-out-locally.adoc | 171 +++++++++
docs/try-it-out-on-openshift-with-strimzi.adoc | 122 ++++++
examples/CamelAWSKinesisSourceConnector.properties | 27 ++
examples/CamelAWSS3SourceConnector.properties | 31 ++
examples/CamelAWSSNSSinkConnector.properties | 30 ++
examples/CamelAWSSQSSinkConnector.properties | 30 ++
examples/CamelAWSSQSSourceConnector.properties | 30 ++
examples/CamelFileSinkConnector.properties | 27 ++
examples/CamelHttpSinkConnector.properties | 27 ++
examples/CamelJmsSinkConnector.properties | 28 ++
examples/CamelJmsSourceConnector.properties | 29 ++
examples/CamelTelegramSourceConnector.properties | 26 ++
mvnw | 310 +++++++++++++++
mvnw.cmd | 182 +++++++++
parent/pom.xml | 423 +++++++++++++++++++++
pom.xml | 151 ++++++++
tests/pom.xml | 120 ++++++
.../apache/camel/kafkaconnector/AWSConfigs.java | 30 ++
.../camel/kafkaconnector/ArtemisContainer.java | 136 +++++++
.../kafkaconnector/ConnectorPropertyFactory.java | 35 ++
.../apache/camel/kafkaconnector/ContainerUtil.java | 110 ++++++
.../DefaultKafkaConnectPropertyFactory.java | 54 +++
.../camel/kafkaconnector/HTTPEchoService.java | 71 ++++
.../KafkaConnectPropertyFactory.java | 35 ++
.../camel/kafkaconnector/KafkaConnectRunner.java | 223 +++++++++++
.../apache/camel/kafkaconnector/TestCommon.java | 72 ++++
.../clients/aws/sqs/AWSSQSClient.java | 95 +++++
.../kafkaconnector/clients/jms/JMSClient.java | 202 ++++++++++
.../clients/kafka/ConsumerPropertyFactory.java | 35 ++
.../kafka/DefaultConsumerPropertyFactory.java | 57 +++
.../kafka/DefaultProducerPropertyFactory.java | 50 +++
.../kafkaconnector/clients/kafka/KafkaClient.java | 102 +++++
.../clients/kafka/ProducerPropertyFactory.java | 35 ++
.../sink/aws/sns/CamelAWSSNSPropertyFactory.java | 73 ++++
.../sink/aws/sns/CamelSinkAWSSNSITCase.java | 160 ++++++++
.../sink/aws/sns/TestSNSConfiguration.java | 100 +++++
.../sink/aws/sqs/CamelAWSSQSPropertyFactory.java | 68 ++++
.../sink/aws/sqs/CamelSinkAWSSQSITCase.java | 148 +++++++
.../sink/file/CamelFilePropertyFactory.java | 51 +++
.../sink/file/CamelSinkFileITCase.java | 173 +++++++++
.../sink/http/CamelHTTPPropertyFactory.java | 51 +++
.../sink/http/CamelSinkHTTPITCase.java | 131 +++++++
.../sink/http/HTTPTestValidationHandler.java | 83 ++++
.../sink/jms/CamelJMSPropertyFactory.java | 59 +++
.../sink/jms/CamelSinkJMSITCase.java | 156 ++++++++
.../kinesis/CamelAWSKinesisPropertyFactory.java | 72 ++++
.../aws/kinesis/CamelSourceAWSKinesisITCase.java | 183 +++++++++
.../aws/kinesis/TestKinesisConfiguration.java | 88 +++++
.../source/aws/s3/CamelAWSS3PropertyFactory.java | 71 ++++
.../source/aws/s3/CamelSourceAWSS3ITCase.java | 133 +++++++
.../source/aws/s3/TestS3Configuration.java | 89 +++++
.../source/aws/sqs/CamelAWSSQSPropertyFactory.java | 69 ++++
.../source/aws/sqs/CamelSourceAWSSQSITCase.java | 116 ++++++
.../source/jms/CamelJMSPropertyFactory.java | 58 +++
.../source/jms/CamelSourceJMSITCase.java | 114 ++++++
.../source/timer/CamelSourceTimerITCase.java | 87 +++++
.../source/timer/CamelTimerPropertyFactory.java | 49 +++
tests/src/test/resources/log4j2.properties | 37 ++
.../org/apache/camel/kafkaconnector/Dockerfile | 33 ++
.../camel/kafkaconnector/source/aws/s3/file0.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file1.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file2.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file3.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file4.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file5.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file6.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file7.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file8.test | 14 +
.../camel/kafkaconnector/source/aws/s3/file9.test | 14 +
95 files changed, 7976 insertions(+)
create mode 100644 .gitignore
create mode 100644 .mvn/wrapper/MavenWrapperDownloader.java
create mode 100644 .mvn/wrapper/maven-wrapper.properties
create mode 100644 LICENSE
create mode 100644 README.adoc
create mode 100644 config/CamelSinkConnector.properties
create mode 100644 config/CamelSourceConnector.properties
create mode 100644 core/pom.xml
create mode 100644 core/src/main/assembly/package.xml
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/CamelSinkConnector.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/CamelSinkConnectorConfig.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/CamelSinkTask.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/CamelSourceConnector.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/CamelSourceConnectorConfig.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/CamelSourceTask.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/VersionUtil.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/converters/S3ObjectConverter.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/converters/S3ObjectSerializer.java
create mode 100644 core/src/main/java/org/apache/camel/kafkaconnector/utils/CamelMainSupport.java
create mode 100644 core/src/test/java/org/apache/camel/kafkaconnector/CamelSinkTaskTest.java
create mode 100644 core/src/test/java/org/apache/camel/kafkaconnector/CamelSourceTaskTest.java
create mode 100644 core/src/test/java/org/apache/camel/kafkaconnector/DataFormatTest.java
create mode 100644 core/src/test/java/org/apache/camel/kafkaconnector/PropertiesOrderTest.java
create mode 100644 core/src/test/java/org/apache/camel/kafkaconnector/test/TestBlockingQueueFactory.java
create mode 100644 core/src/test/resources/log4j.xml
create mode 100644 core/src/test/resources/log4j2.properties
create mode 100644 docs/try-it-out-locally.adoc
create mode 100644 docs/try-it-out-on-openshift-with-strimzi.adoc
create mode 100644 examples/CamelAWSKinesisSourceConnector.properties
create mode 100644 examples/CamelAWSS3SourceConnector.properties
create mode 100644 examples/CamelAWSSNSSinkConnector.properties
create mode 100644 examples/CamelAWSSQSSinkConnector.properties
create mode 100644 examples/CamelAWSSQSSourceConnector.properties
create mode 100644 examples/CamelFileSinkConnector.properties
create mode 100644 examples/CamelHttpSinkConnector.properties
create mode 100644 examples/CamelJmsSinkConnector.properties
create mode 100644 examples/CamelJmsSourceConnector.properties
create mode 100644 examples/CamelTelegramSourceConnector.properties
create mode 100755 mvnw
create mode 100644 mvnw.cmd
create mode 100644 parent/pom.xml
create mode 100644 pom.xml
create mode 100644 tests/pom.xml
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/AWSConfigs.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/ArtemisContainer.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/ConnectorPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/ContainerUtil.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/DefaultKafkaConnectPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/HTTPEchoService.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/KafkaConnectPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/KafkaConnectRunner.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/TestCommon.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/aws/sqs/AWSSQSClient.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/jms/JMSClient.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/kafka/ConsumerPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/kafka/DefaultConsumerPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/kafka/DefaultProducerPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/kafka/KafkaClient.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/clients/kafka/ProducerPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/aws/sns/CamelAWSSNSPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/aws/sns/CamelSinkAWSSNSITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/aws/sns/TestSNSConfiguration.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/aws/sqs/CamelAWSSQSPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/aws/sqs/CamelSinkAWSSQSITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/file/CamelFilePropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/file/CamelSinkFileITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/http/CamelHTTPPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/http/CamelSinkHTTPITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/http/HTTPTestValidationHandler.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/jms/CamelJMSPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/sink/jms/CamelSinkJMSITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/kinesis/CamelAWSKinesisPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/kinesis/CamelSourceAWSKinesisITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/kinesis/TestKinesisConfiguration.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/s3/CamelAWSS3PropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/s3/CamelSourceAWSS3ITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/s3/TestS3Configuration.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/sqs/CamelAWSSQSPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/aws/sqs/CamelSourceAWSSQSITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/jms/CamelJMSPropertyFactory.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/jms/CamelSourceJMSITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/timer/CamelSourceTimerITCase.java
create mode 100644 tests/src/test/java/org/apache/camel/kafkaconnector/source/timer/CamelTimerPropertyFactory.java
create mode 100644 tests/src/test/resources/log4j2.properties
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/Dockerfile
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file0.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file1.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file2.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file3.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file4.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file5.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file6.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file7.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file8.test
create mode 100644 tests/src/test/resources/org/apache/camel/kafkaconnector/source/aws/s3/file9.test