You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ilya Shishkov (Jira)" <ji...@apache.org> on 2023/04/26 08:53:00 UTC
[jira] [Updated] (IGNITE-19368) Fix ignite-cdc-ext assembly
[ https://issues.apache.org/jira/browse/IGNITE-19368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ilya Shishkov updated IGNITE-19368:
-----------------------------------
Description: Currently, _kafka-clients_ and _slf4j-api_ libraries are missing in the assembled zip file. (was: CDC though Kafka uses {{KafkaConsumer}} and {{KafkaProducer}}, which are parts of {{kafka-clients}} module.
But when you build ignite-cdc-ext with a below command:
{code}
mvn clean package -f modules/cdc-ext/ -P checkstyle,extension-release -DskipTests
{code}
you will obtain zip file with a structure [^ignite-cdc-ext-current.txt], where {{kafka-clients}} dependency _*is missing*_.
So, when you try to start {{KafkaToIgniteCdcStreamer}} or {{IgniteToKafkaCdcStreamer}} you will obtain missing classes error.
Building of module changed after IGNITE-16847, IGNITE-16815. Structure was: [^ignite-cdc-ext-old.txt]. As you can see, there was many jar libraries included, but i'm not sure whether all of them needed to run CDC.
I have prepared a patch [^cdc-ext-build-patch.patch], which replaces _kafka_2.12-2.7.0.jar_ by _kafka-clients-2.7.0.jar_ and tested it locally: problems with missed classes eliminated and it seems, that simple active-active replication cases works fine. But, patch does not fix other dependencies from old build assembly structure (I'm not sure, that all dependencies satisfied).
Structure after patch: [^ignite-cdc-ext-patch.txt]
Also, proposed patch affects other modules, which uses {{/assembly/bin-component-shared.xml}} in build process.)
> Fix ignite-cdc-ext assembly
> ---------------------------
>
> Key: IGNITE-19368
> URL: https://issues.apache.org/jira/browse/IGNITE-19368
> Project: Ignite
> Issue Type: Bug
> Components: extensions
> Reporter: Ilya Shishkov
> Assignee: Ilya Shishkov
> Priority: Major
> Labels: IEP-59, ise
>
> Currently, _kafka-clients_ and _slf4j-api_ libraries are missing in the assembled zip file.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)