[jira] [Created] (BEAM-11029) A dataflow job created the second time from the same template is unable to read BigQuery.

["Andrei (Jira)" <ji...@apache.org>]

Andrei created BEAM-11029:
-----------------------------

             Summary: A dataflow job created the second time from the same template is unable to read BigQuery.
                 Key: BEAM-11029
                 URL: https://issues.apache.org/jira/browse/BEAM-11029
             Project: Beam
          Issue Type: Bug
          Components: io-java-gcp
    Affects Versions: 2.24.0
         Environment: GCP Dataflow
            Reporter: Andrei


h1. A dataflow job created the second time from the same template.

Seems being unable to read BigQuery.
h2. Error

The first job created from a custom template reads from BigQuery successfully. When the first job is done, the second job created from the same template fails with an error:

 

{{}}
{noformat}
2020-10-06 14:48:02.002 PDTError message from worker: java.io.IOException: Cannot start an export job since table retailsearchproject-lowes:temp_dataset_beam_bq_job_QUERY_bigquerypipelinealitvinov100621394839e5f68a_eba5287932a74fb88787362144bd56f2.temp_table_beam_bq_job_QUERY_bigquerypipelinealitvinov100621394839e5f68a_eba5287932a74fb88787362144bd56f2 does not exist org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase.extractFiles(BigQuerySourceBase.java:115) org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase.split(BigQuerySourceBase.java:148) org.apache.beam.runners.dataflow.worker.WorkerCustomSources.splitAndValidate(WorkerCustomSources.java:290) org.apache.beam.runners.dataflow.worker.WorkerCustomSources.performSplitTyped(WorkerCustomSources.java:212) org.apache.beam.runners.dataflow.worker.WorkerCustomSources.performSplitWithApiLimit(WorkerCustomSources.java:196) org.apache.beam.runners.dataflow.worker.WorkerCustomSources.performSplit(WorkerCustomSources.java:175) org.apache.beam.runners.dataflow.worker.WorkerCustomSourceOperationExecutor.execute(WorkerCustomSourceOperationExecutor.java:78) org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:417) org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:386) org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:311) org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140) org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120) org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) {noformat}
{{}}
h2. Library version

{{org.apache.beam:beam-runners-google-cloud-dataflow-java:2.24.0}}
h2. Reproducing

 
 * Clone the  repository with an example java project.

{code:java}
https://github.com/alitvinov-gd/dataflow-bigquery-run-job-twice.git{code}

 * Create a BigQuery table {{repeating_job_input}} and populate a row:

{{}}
{code:java}
insert into andrei_L.repeating_job_input (id, group_id, dummy) values('100', '10000', 'DUMMY1');
{code}
{{}}

{{}}
 * Create a template

{{}}
{code:java}
mvn clean compile exec:java -Dexec.mainClass=org.litvinov.andrei.beam.bquery.example.BigqueryPipeline -Dexec.args="--runner=DataflowRunner --region=us-central1 --project=<your project> --stagingLocation=gs://<your bucket>/staging/ --inputTable=andrei_L.repeating_job_input --outputFile=gs://<your bucket>/temp/repeating_job_output --tempLocation=gs://<your bucket>/temp/ --templateLocation=gs://<your bucket>/templates/example_template --workerMachineType=n1-standard-8" {code}
{{}}
 * Create a job the first time

{{}}
{code:java}
gcloud dataflow jobs run first_job --project=<your project> --region=us-central1 --gcs-location=gs://<your bucket>/templates/example_template
{code}
 * After the job finishes successfully, check the output file

{{}}
{code:java}
gsutil cat gs://<your bucket/temp/repeating_job_output-00000-of-00001

{code}
expecting to see:

{{}}
{code:java}
1000
{code}
{{}}

{{}}

{{}}
 * Clean the output file

{{}}
{code:java}
gsutil rm gs://<your bucket/temp/repeating_job_output-00000-of-00001{code}
{{}}

{{}}
 * Create the second job

{{}}
{code:java}
gcloud dataflow jobs run second_job --project=<your project> --region=us-central1 --gcs-location=gs://<your bucket>/templates/example_template
{code}
 * Expect the second job to fail
 * Expect no output file created

{{}}
{code:java}
gsutil ls gs://<your bucket/temp/repeating_job_output-00000-of-00001 CommandException: One or more URLs matched no objects{code}
{{}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)