You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Peter Palaga (Jira)" <ji...@apache.org> on 2023/06/28 10:13:00 UTC
[jira] [Updated] (CAMEL-19558) Manage protobuf to build and test with a single deterministic version
[ https://issues.apache.org/jira/browse/CAMEL-19558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Palaga updated CAMEL-19558:
---------------------------------
Description:
There are various protobuf related version properties in camel-parent but they are not used everywhere throughout the source tree and therefore several versions are pulled during the build:
{code}
$ mvn org.l2x6.cq:cq-prod-maven-plugin:4.4.0:find-dependency -N '-Dcq.gavPattern=com.google.protobuf'
...
[WARNING] Found org.apache.camel:camel-test-infra-hdfs:4.0.0-SNAPSHOT:jar
-> org.apache.hadoop:hadoop-minicluster:3.3.5:jar
-> org.apache.hadoop:hadoop-common:3.3.5:jar:tests
-> com.google.protobuf:protobuf-java:2.5.0:jar
[WARNING] Found org.apache.camel:camel-debezium-postgres:4.0.0-SNAPSHOT:jar
-> io.debezium:debezium-connector-postgres:2.3.0.Final:jar
-> com.google.protobuf:protobuf-java:3.19.6:jar
[WARNING] Found org.apache.camel:camel-etcd3:4.0.0-SNAPSHOT:jar
-> io.etcd:jetcd-core:0.7.5:jar
-> io.etcd:jetcd-grpc:0.7.5:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-etcd3:4.0.0-SNAPSHOT:jar
-> io.etcd:jetcd-core:0.7.5:jar
-> io.etcd:jetcd-grpc:0.7.5:jar
-> io.grpc:grpc-grpclb:1.56.0:jar
-> com.google.protobuf:protobuf-java-util:3.22.3:jar
[WARNING] Found org.apache.camel:camel-google-bigquery:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-bigquery:2.19.1:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-bigquery:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-bigquery:2.19.1:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-functions:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-functions:2.2.0:jar
-> com.google.protobuf:protobuf-java:3.17.3:jar
[WARNING] Found org.apache.camel:camel-google-functions:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-functions:2.2.0:jar
-> com.google.protobuf:protobuf-java-util:3.17.3:jar
[WARNING] Found org.apache.camel:camel-google-pubsub:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-pubsub:1.121.0:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-pubsub:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-pubsub:1.121.0:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-secret-manager:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-secretmanager:2.2.0:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-secret-manager:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-secretmanager:2.2.0:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-storage:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-storage:2.15.1:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-storage:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-storage:2.15.1:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-grpc:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-hdfs:4.0.0-SNAPSHOT:jar
-> org.apache.hadoop:hadoop-common:3.3.5:jar
-> com.google.protobuf:protobuf-java:2.5.0:jar
[WARNING] Found org.apache.camel:camel-protobuf:4.0.0-SNAPSHOT:jar
-> com.google.protobuf:protobuf-java:3.19.6:jar
[WARNING] Found org.apache.camel:camel-protobuf:4.0.0-SNAPSHOT:jar
-> com.google.protobuf:protobuf-java-util:3.19.6:jar
[WARNING] Found org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-salesforce-codegen:4.0.0-SNAPSHOT:jar
-> org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel.maven:camel-salesforce-maven-plugin:4.0.0-SNAPSHOT:jar
-> org.apache.camel:camel-salesforce-codegen:4.0.0-SNAPSHOT:jar
-> org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-zeebe:4.0.0-SNAPSHOT:jar
-> io.camunda:zeebe-client-java:8.1.9:jar
-> com.google.protobuf:protobuf-java:3.21.12:jar
{code}
We should try to manage a single version so that upgrades and testing get more deterministic.
The same holds for com.google.protobuf:protoc and com.google.api.grpc:proto-google-common-protos
was:
There are various protobuf related version properties in camel-parent but they are not used everywhere throughout the source tree and therefore several versions are pulled during the build:
{code}
$ mvn org.l2x6.cq:cq-prod-maven-plugin:4.4.0:find-dependency -N '-Dcq.gavPattern=com.google.protobuf'
...
[WARNING] Found org.apache.camel:camel-test-infra-hdfs:4.0.0-SNAPSHOT:jar
-> org.apache.hadoop:hadoop-minicluster:3.3.5:jar
-> org.apache.hadoop:hadoop-common:3.3.5:jar:tests
-> com.google.protobuf:protobuf-java:2.5.0:jar
[WARNING] Found org.apache.camel:camel-debezium-postgres:4.0.0-SNAPSHOT:jar
-> io.debezium:debezium-connector-postgres:2.3.0.Final:jar
-> com.google.protobuf:protobuf-java:3.19.6:jar
[WARNING] Found org.apache.camel:camel-etcd3:4.0.0-SNAPSHOT:jar
-> io.etcd:jetcd-core:0.7.5:jar
-> io.etcd:jetcd-grpc:0.7.5:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-etcd3:4.0.0-SNAPSHOT:jar
-> io.etcd:jetcd-core:0.7.5:jar
-> io.etcd:jetcd-grpc:0.7.5:jar
-> io.grpc:grpc-grpclb:1.56.0:jar
-> com.google.protobuf:protobuf-java-util:3.22.3:jar
[WARNING] Found org.apache.camel:camel-google-bigquery:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-bigquery:2.19.1:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-bigquery:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-bigquery:2.19.1:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-functions:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-functions:2.2.0:jar
-> com.google.protobuf:protobuf-java:3.17.3:jar
[WARNING] Found org.apache.camel:camel-google-functions:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-functions:2.2.0:jar
-> com.google.protobuf:protobuf-java-util:3.17.3:jar
[WARNING] Found org.apache.camel:camel-google-pubsub:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-pubsub:1.121.0:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-pubsub:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-pubsub:1.121.0:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-secret-manager:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-secretmanager:2.2.0:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-secret-manager:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-secretmanager:2.2.0:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-storage:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-storage:2.15.1:jar
-> com.google.protobuf:protobuf-java:3.21.10:jar
[WARNING] Found org.apache.camel:camel-google-storage:4.0.0-SNAPSHOT:jar
-> com.google.cloud:google-cloud-storage:2.15.1:jar
-> com.google.protobuf:protobuf-java-util:3.21.10:jar
[WARNING] Found org.apache.camel:camel-grpc:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-hdfs:4.0.0-SNAPSHOT:jar
-> org.apache.hadoop:hadoop-common:3.3.5:jar
-> com.google.protobuf:protobuf-java:2.5.0:jar
[WARNING] Found org.apache.camel:camel-protobuf:4.0.0-SNAPSHOT:jar
-> com.google.protobuf:protobuf-java:3.19.6:jar
[WARNING] Found org.apache.camel:camel-protobuf:4.0.0-SNAPSHOT:jar
-> com.google.protobuf:protobuf-java-util:3.19.6:jar
[WARNING] Found org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-salesforce-codegen:4.0.0-SNAPSHOT:jar
-> org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel.maven:camel-salesforce-maven-plugin:4.0.0-SNAPSHOT:jar
-> org.apache.camel:camel-salesforce-codegen:4.0.0-SNAPSHOT:jar
-> org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
-> io.grpc:grpc-protobuf:1.56.0:jar
-> com.google.protobuf:protobuf-java:3.22.3:jar
[WARNING] Found org.apache.camel:camel-zeebe:4.0.0-SNAPSHOT:jar
-> io.camunda:zeebe-client-java:8.1.9:jar
-> com.google.protobuf:protobuf-java:3.21.12:jar
{code}
We should try to manage a single version so that upgrades and testing get more deterministic.
> Manage protobuf to build and test with a single deterministic version
> ---------------------------------------------------------------------
>
> Key: CAMEL-19558
> URL: https://issues.apache.org/jira/browse/CAMEL-19558
> Project: Camel
> Issue Type: Improvement
> Reporter: Peter Palaga
> Priority: Major
>
> There are various protobuf related version properties in camel-parent but they are not used everywhere throughout the source tree and therefore several versions are pulled during the build:
> {code}
> $ mvn org.l2x6.cq:cq-prod-maven-plugin:4.4.0:find-dependency -N '-Dcq.gavPattern=com.google.protobuf'
> ...
> [WARNING] Found org.apache.camel:camel-test-infra-hdfs:4.0.0-SNAPSHOT:jar
> -> org.apache.hadoop:hadoop-minicluster:3.3.5:jar
> -> org.apache.hadoop:hadoop-common:3.3.5:jar:tests
> -> com.google.protobuf:protobuf-java:2.5.0:jar
> [WARNING] Found org.apache.camel:camel-debezium-postgres:4.0.0-SNAPSHOT:jar
> -> io.debezium:debezium-connector-postgres:2.3.0.Final:jar
> -> com.google.protobuf:protobuf-java:3.19.6:jar
> [WARNING] Found org.apache.camel:camel-etcd3:4.0.0-SNAPSHOT:jar
> -> io.etcd:jetcd-core:0.7.5:jar
> -> io.etcd:jetcd-grpc:0.7.5:jar
> -> io.grpc:grpc-protobuf:1.56.0:jar
> -> com.google.protobuf:protobuf-java:3.22.3:jar
> [WARNING] Found org.apache.camel:camel-etcd3:4.0.0-SNAPSHOT:jar
> -> io.etcd:jetcd-core:0.7.5:jar
> -> io.etcd:jetcd-grpc:0.7.5:jar
> -> io.grpc:grpc-grpclb:1.56.0:jar
> -> com.google.protobuf:protobuf-java-util:3.22.3:jar
> [WARNING] Found org.apache.camel:camel-google-bigquery:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-bigquery:2.19.1:jar
> -> com.google.protobuf:protobuf-java-util:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-bigquery:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-bigquery:2.19.1:jar
> -> com.google.protobuf:protobuf-java:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-functions:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-functions:2.2.0:jar
> -> com.google.protobuf:protobuf-java:3.17.3:jar
> [WARNING] Found org.apache.camel:camel-google-functions:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-functions:2.2.0:jar
> -> com.google.protobuf:protobuf-java-util:3.17.3:jar
> [WARNING] Found org.apache.camel:camel-google-pubsub:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-pubsub:1.121.0:jar
> -> com.google.protobuf:protobuf-java:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-pubsub:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-pubsub:1.121.0:jar
> -> com.google.protobuf:protobuf-java-util:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-secret-manager:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-secretmanager:2.2.0:jar
> -> com.google.protobuf:protobuf-java:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-secret-manager:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-secretmanager:2.2.0:jar
> -> com.google.protobuf:protobuf-java-util:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-storage:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-storage:2.15.1:jar
> -> com.google.protobuf:protobuf-java:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-google-storage:4.0.0-SNAPSHOT:jar
> -> com.google.cloud:google-cloud-storage:2.15.1:jar
> -> com.google.protobuf:protobuf-java-util:3.21.10:jar
> [WARNING] Found org.apache.camel:camel-grpc:4.0.0-SNAPSHOT:jar
> -> io.grpc:grpc-protobuf:1.56.0:jar
> -> com.google.protobuf:protobuf-java:3.22.3:jar
> [WARNING] Found org.apache.camel:camel-hdfs:4.0.0-SNAPSHOT:jar
> -> org.apache.hadoop:hadoop-common:3.3.5:jar
> -> com.google.protobuf:protobuf-java:2.5.0:jar
> [WARNING] Found org.apache.camel:camel-protobuf:4.0.0-SNAPSHOT:jar
> -> com.google.protobuf:protobuf-java:3.19.6:jar
> [WARNING] Found org.apache.camel:camel-protobuf:4.0.0-SNAPSHOT:jar
> -> com.google.protobuf:protobuf-java-util:3.19.6:jar
> [WARNING] Found org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
> -> io.grpc:grpc-protobuf:1.56.0:jar
> -> com.google.protobuf:protobuf-java:3.22.3:jar
> [WARNING] Found org.apache.camel:camel-salesforce-codegen:4.0.0-SNAPSHOT:jar
> -> org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
> -> io.grpc:grpc-protobuf:1.56.0:jar
> -> com.google.protobuf:protobuf-java:3.22.3:jar
> [WARNING] Found org.apache.camel.maven:camel-salesforce-maven-plugin:4.0.0-SNAPSHOT:jar
> -> org.apache.camel:camel-salesforce-codegen:4.0.0-SNAPSHOT:jar
> -> org.apache.camel:camel-salesforce:4.0.0-SNAPSHOT:jar
> -> io.grpc:grpc-protobuf:1.56.0:jar
> -> com.google.protobuf:protobuf-java:3.22.3:jar
> [WARNING] Found org.apache.camel:camel-zeebe:4.0.0-SNAPSHOT:jar
> -> io.camunda:zeebe-client-java:8.1.9:jar
> -> com.google.protobuf:protobuf-java:3.21.12:jar
> {code}
> We should try to manage a single version so that upgrades and testing get more deterministic.
> The same holds for com.google.protobuf:protoc and com.google.api.grpc:proto-google-common-protos
--
This message was sent by Atlassian Jira
(v8.20.10#820010)