You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ilya Shishkov (Jira)" <ji...@apache.org> on 2023/04/26 08:49:00 UTC

[jira] [Created] (IGNITE-19368) Fix ignite-cdc-ext assembly

Ilya Shishkov created IGNITE-19368:
--------------------------------------

             Summary: Fix ignite-cdc-ext assembly
                 Key: IGNITE-19368
                 URL: https://issues.apache.org/jira/browse/IGNITE-19368
             Project: Ignite
          Issue Type: Bug
          Components: extensions
            Reporter: Ilya Shishkov
            Assignee: Ilya Shishkov


CDC though Kafka uses {{KafkaConsumer}} and {{KafkaProducer}}, which are parts of  {{kafka-clients}} module. 

But when you build ignite-cdc-ext with a below command:
{code}
mvn clean package -f modules/cdc-ext/ -P checkstyle,extension-release -DskipTests
{code}
you will obtain zip file with a structure  [^ignite-cdc-ext-current.txt], where {{kafka-clients}} dependency _*is missing*_.
So, when you try to start {{KafkaToIgniteCdcStreamer}} or {{IgniteToKafkaCdcStreamer}} you will obtain missing classes error.

Building of module changed after IGNITE-16847, IGNITE-16815. Structure was:  [^ignite-cdc-ext-old.txt]. As you can see, there was many jar libraries included, but i'm not sure whether all of them needed to run CDC.

I have prepared a patch [^cdc-ext-build-patch.patch], which replaces _kafka_2.12-2.7.0.jar_ by _kafka-clients-2.7.0.jar_ and tested it locally: problems with missed classes eliminated and it seems, that simple active-active replication cases works fine. But, patch does not fix other dependencies from old build assembly structure (I'm not sure, that all dependencies satisfied). 
Structure after patch:   [^ignite-cdc-ext-patch.txt] 

Also, proposed patch affects other modules, which uses {{/assembly/bin-component-shared.xml}} in build process.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)