You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Yu Ishikawa (JIRA)" <ji...@apache.org> on 2017/06/09 22:01:18 UTC

[jira] [Created] (AIRFLOW-1299) Google Dataproc cluster creation operator should support imageVersion feature

Yu Ishikawa created AIRFLOW-1299:
------------------------------------

             Summary: Google Dataproc cluster creation operator should support imageVersion feature
                 Key: AIRFLOW-1299
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1299
             Project: Apache Airflow
          Issue Type: Improvement
          Components: gcp, operators
    Affects Versions: Airflow 2.0
            Reporter: Yu Ishikawa
            Assignee: Yu Ishikawa


Google Dataproc has {{imageVersion}} field in {{softwareConfig}}. It is one of the most important field to create Dataproc clusters, because we would like to specify the versions of Spark and so on.

1. https://cloud.google.com/dataproc/docs/concepts/dataproc-versions
2. https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.clusters#softwareconfig



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)