You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ilya Shishkov (Jira)" <ji...@apache.org> on 2022/12/02 10:37:00 UTC

[jira] [Commented] (IGNITE-18179) KafkaPoducer and KafkaConsumer classes missed in ignite-cdc-ext build

    [ https://issues.apache.org/jira/browse/IGNITE-18179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17642429#comment-17642429 ] 

Ilya Shishkov commented on IGNITE-18179:
----------------------------------------

TC Build of CDC: https://ci2.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6943758?buildTab=overview&hideProblemsFromDependencies=false&hideTestsFromDependencies=false&expandBuildChangesSection=true&expandBuildTestsSection=true

> KafkaPoducer and KafkaConsumer classes missed in ignite-cdc-ext build
> ---------------------------------------------------------------------
>
>                 Key: IGNITE-18179
>                 URL: https://issues.apache.org/jira/browse/IGNITE-18179
>             Project: Ignite
>          Issue Type: Bug
>          Components: extensions
>            Reporter: Ilya Shishkov
>            Assignee: Ilya Shishkov
>            Priority: Major
>              Labels: IEP-59, ise
>         Attachments: cdc-ext-build-patch.patch, ignite-cdc-ext-current.txt, ignite-cdc-ext-old.txt, ignite-cdc-ext-patch.txt
>
>
> CDC though Kafka uses {{KafkaConsumer}} and {{KafkaProducer}}, which are parts of  {{kafka-clients}} module. 
> But when you build ignite-cdc-ext with a below command:
> {code}
> mvn clean package -f modules/cdc-ext/ -P checkstyle,extension-release -DskipTests
> {code}
> you will obtain zip file with a structure  [^ignite-cdc-ext-current.txt], where {{kafka-clients}} dependency _*is missing*_.
> So, when you try to start {{KafkaToIgniteCdcStreamer}} or {{IgniteToKafkaCdcStreamer}} you will obtain missing classes error.
> Building of module changed after IGNITE-16847, IGNITE-16815. Structure was:  [^ignite-cdc-ext-old.txt]. As you can see, there was many jar libraries included, but i'm not sure whether all of them needed to run CDC.
> I have prepared a patch [^cdc-ext-build-patch.patch], which replaces _kafka_2.12-2.7.0.jar_ by _kafka-clients-2.7.0.jar_ and tested it locally: problems with missed classes eliminated and it seems, that simple active-active replication cases works fine. But, patch does not fix other dependencies from old build assembly structure (I'm not sure, that all dependencies satisfied). 
> Structure after patch:   [^ignite-cdc-ext-patch.txt] 
> Also, proposed patch affects other modules, which uses {{/assembly/bin-component-shared.xml}} in build process.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)