You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ilya Shishkov (Jira)" <ji...@apache.org> on 2023/04/26 08:53:00 UTC

[jira] [Updated] (IGNITE-19368) Fix ignite-cdc-ext assembly

     [ https://issues.apache.org/jira/browse/IGNITE-19368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ilya Shishkov updated IGNITE-19368:
-----------------------------------
    Description: Currently, _kafka-clients_ and _slf4j-api_ libraries are missing in the assembled zip file.  (was: CDC though Kafka uses {{KafkaConsumer}} and {{KafkaProducer}}, which are parts of  {{kafka-clients}} module. 

But when you build ignite-cdc-ext with a below command:
{code}
mvn clean package -f modules/cdc-ext/ -P checkstyle,extension-release -DskipTests
{code}
you will obtain zip file with a structure  [^ignite-cdc-ext-current.txt], where {{kafka-clients}} dependency _*is missing*_.
So, when you try to start {{KafkaToIgniteCdcStreamer}} or {{IgniteToKafkaCdcStreamer}} you will obtain missing classes error.

Building of module changed after IGNITE-16847, IGNITE-16815. Structure was:  [^ignite-cdc-ext-old.txt]. As you can see, there was many jar libraries included, but i'm not sure whether all of them needed to run CDC.

I have prepared a patch [^cdc-ext-build-patch.patch], which replaces _kafka_2.12-2.7.0.jar_ by _kafka-clients-2.7.0.jar_ and tested it locally: problems with missed classes eliminated and it seems, that simple active-active replication cases works fine. But, patch does not fix other dependencies from old build assembly structure (I'm not sure, that all dependencies satisfied). 
Structure after patch:   [^ignite-cdc-ext-patch.txt] 

Also, proposed patch affects other modules, which uses {{/assembly/bin-component-shared.xml}} in build process.)

> Fix ignite-cdc-ext assembly
> ---------------------------
>
>                 Key: IGNITE-19368
>                 URL: https://issues.apache.org/jira/browse/IGNITE-19368
>             Project: Ignite
>          Issue Type: Bug
>          Components: extensions
>            Reporter: Ilya Shishkov
>            Assignee: Ilya Shishkov
>            Priority: Major
>              Labels: IEP-59, ise
>
> Currently, _kafka-clients_ and _slf4j-api_ libraries are missing in the assembled zip file.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)