(beam) branch release-2.58.0 updated: Dedup Lineage and getTableToExtract call in BigQuerySourceBase (#31960) (#31972)

[jr...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a commit to branch release-2.58.0
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/release-2.58.0 by this push:
     new 3ec56433f49 Dedup Lineage and getTableToExtract call in BigQuerySourceBase (#31960) (#31972)
3ec56433f49 is described below

commit 3ec56433f497ce2a9e217343de46e2bb99b252d9
Author: Yi Hu <ya...@google.com>
AuthorDate: Thu Jul 25 10:37:08 2024 -0400

    Dedup Lineage and getTableToExtract call in BigQuerySourceBase (#31960) (#31972)
---
 .../java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySourceBase.java   | 3 ---
 1 file changed, 3 deletions(-)

diff --git a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySourceBase.java b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySourceBase.java
index 38c0c8e43b2..998c82ab8d8 100644
--- a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySourceBase.java
+++ b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySourceBase.java
@@ -157,9 +157,6 @@ abstract class BigQuerySourceBase<T> extends BoundedSource<T> {
       LOG.info("Extract job produced {} files", res.extractedFiles.size());
       if (res.extractedFiles.size() > 0) {
         BigQueryOptions bqOptions = options.as(BigQueryOptions.class);
-        // emit this table ID as a lineage source
-        Lineage.getSources()
-            .add(BigQueryHelpers.dataCatalogName(getTableToExtract(bqOptions), bqOptions));
         final String extractDestinationDir =
             resolveTempLocation(bqOptions.getTempLocation(), "BigQueryExtractTemp", stepUuid);
         // Match all files in the destination directory to stat them in bulk.