You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ilya Shishkov (Jira)" <ji...@apache.org> on 2022/12/02 10:37:00 UTC
[jira] [Commented] (IGNITE-18179) KafkaPoducer and KafkaConsumer classes missed in ignite-cdc-ext build
[ https://issues.apache.org/jira/browse/IGNITE-18179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17642429#comment-17642429 ]
Ilya Shishkov commented on IGNITE-18179:
----------------------------------------
TC Build of CDC: https://ci2.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6943758?buildTab=overview&hideProblemsFromDependencies=false&hideTestsFromDependencies=false&expandBuildChangesSection=true&expandBuildTestsSection=true
> KafkaPoducer and KafkaConsumer classes missed in ignite-cdc-ext build
> ---------------------------------------------------------------------
>
> Key: IGNITE-18179
> URL: https://issues.apache.org/jira/browse/IGNITE-18179
> Project: Ignite
> Issue Type: Bug
> Components: extensions
> Reporter: Ilya Shishkov
> Assignee: Ilya Shishkov
> Priority: Major
> Labels: IEP-59, ise
> Attachments: cdc-ext-build-patch.patch, ignite-cdc-ext-current.txt, ignite-cdc-ext-old.txt, ignite-cdc-ext-patch.txt
>
>
> CDC though Kafka uses {{KafkaConsumer}} and {{KafkaProducer}}, which are parts of {{kafka-clients}} module.
> But when you build ignite-cdc-ext with a below command:
> {code}
> mvn clean package -f modules/cdc-ext/ -P checkstyle,extension-release -DskipTests
> {code}
> you will obtain zip file with a structure [^ignite-cdc-ext-current.txt], where {{kafka-clients}} dependency _*is missing*_.
> So, when you try to start {{KafkaToIgniteCdcStreamer}} or {{IgniteToKafkaCdcStreamer}} you will obtain missing classes error.
> Building of module changed after IGNITE-16847, IGNITE-16815. Structure was: [^ignite-cdc-ext-old.txt]. As you can see, there was many jar libraries included, but i'm not sure whether all of them needed to run CDC.
> I have prepared a patch [^cdc-ext-build-patch.patch], which replaces _kafka_2.12-2.7.0.jar_ by _kafka-clients-2.7.0.jar_ and tested it locally: problems with missed classes eliminated and it seems, that simple active-active replication cases works fine. But, patch does not fix other dependencies from old build assembly structure (I'm not sure, that all dependencies satisfied).
> Structure after patch: [^ignite-cdc-ext-patch.txt]
> Also, proposed patch affects other modules, which uses {{/assembly/bin-component-shared.xml}} in build process.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)