[GitHub] [nifi] chihhanyu commented on pull request #5135: NIFI-8611: GCP BigQuery processors support using designate project resource for ingestion

[GitBox <gi...@apache.org>]

chihhanyu commented on pull request #5135:
URL: https://github.com/apache/nifi/pull/5135#issuecomment-856639421


   > I'm not sure to fully understand the difference between project ID and designate project ID. Can you give me an example to understand the difference on how resources will be used on the two projects?
   
   Hi @pvillard31, thanks for your reply, the major purpose is that, when creating a job to load data of a project into BigQuery, this job will use the resources of the project. In most cases, a project can have data in BigQuery dataset and its limited resources for loading job. But in our cases, we split GCP projects into two layers for security control, data project and resource project: 
   * Data project can only store data and provide data access, it doesn't have any resources to create any jobs. 
   * Resource project is used to create jobs, users can only create job by resource projects instead of data project. 
   
   That's the reason why we needs to config two project ID for BigQuery processors, the designate project ID is used to specify the target project to store data, and the other project ID is to specify the resource project. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org