[jira] [Comment Edited] (AIRFLOW-1506) Improve DataprocClusterCreateOperator

["Daryl Erwin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141894#comment-16141894 ] 

Daryl Erwin edited comment on AIRFLOW-1506 at 8/25/17 6:53 PM:
---------------------------------------------------------------

This appears to be needed to be able to enable the sql-admin scope to allow access to the sql-cloud-proxy from the dataproc cluster.

I hardcoded in what I needed for now..


{code:java}
cluster_data = {
            'projectId': self.project_id,
            'clusterName': self.cluster_name,
            'config': {
                'gceClusterConfig': {
                    'zoneUri': zone_uri,
>>> This line                    'serviceAccountScopes': ['https://www.googleapis.com/auth/sqlservice.admin'],
                },
{code}



was (Author: derwin):
This appears to be needed to be able to enable the sql-admin scope to allow access to the sql-cloud-proxy from the dataproc cluster.

> Improve DataprocClusterCreateOperator
> -------------------------------------
>
>                 Key: AIRFLOW-1506
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1506
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib, operators
>            Reporter: Yu Ishikawa
>
> h2. Goals
> {{DataprocClusterCreateOperator}} should support {{$. gceClusterConfig.serviceAccountScopes}} to specify scopes for a Dataproc cluster.
> For example, I guess some users would like to store the result to Google Datastore and like this. In such a case, we have to put additional scopes to access to the produces from the Dataproc cluster.
> https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.clusters#gceclusterconfig



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)