You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2022/04/28 17:46:00 UTC
[jira] [Commented] (BEAM-14182) Bigquery import/export should transfer dataflow labels to load job
[ https://issues.apache.org/jira/browse/BEAM-14182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529554#comment-17529554 ]
Chamikara Madhusanka Jayalath commented on BEAM-14182:
------------------------------------------------------
Yeah, this is possible. We already use such labels elsewhere: https://github.com/apache/beam/pull/17130
> Bigquery import/export should transfer dataflow labels to load job
> ------------------------------------------------------------------
>
> Key: BEAM-14182
> URL: https://issues.apache.org/jira/browse/BEAM-14182
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Reporter: Lara Schmidt
> Priority: P2
>
> We add labels to the load / export job but right now it's just a beam-related label and no others. If the user has labels with the dataflow job it would be good to forward these to the load job so that the resources can be looked up properly.
> I noticed this in java. I imagine it's an issue in python/go but would be good to check.
> Relevant code links:
> [1] [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java#L59|https://www.google.com/url?q=https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java%23L59&sa=D&source=buganizer&usg=AOvVaw3UgctcBiabSj5dS2_2mX3D]
> [2] [https://github.com/apache/beam/blob/11aad9160d3a12e19d593d5819bca9505ded9a3b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java#L232|https://www.google.com/url?q=https://github.com/apache/beam/blob/11aad9160d3a12e19d593d5819bca9505ded9a3b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java%23L232&sa=D&source=buganizer&usg=AOvVaw1sgWpvheNmbXax8m2wkVgf]
--
This message was sent by Atlassian Jira
(v8.20.7#820007)