You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Jarosław Śmietanka (JIRA)" <ji...@apache.org> on 2018/07/24 20:09:00 UTC
[jira] [Updated] (AIRFLOW-2789) Add ability to create single node
cluster to DataprocClusterCreateOperator
[ https://issues.apache.org/jira/browse/AIRFLOW-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarosław Śmietanka updated AIRFLOW-2789:
----------------------------------------
Affects Version/s: (was: 1.10.1)
1.10
> Add ability to create single node cluster to DataprocClusterCreateOperator
> --------------------------------------------------------------------------
>
> Key: AIRFLOW-2789
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2789
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, gcp, operators
> Affects Versions: 2.0.0, 1.10
> Reporter: Jarosław Śmietanka
> Assignee: Jarosław Śmietanka
> Priority: Minor
>
> In GCP, it is possible to set up [Single node clusters|https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/single-node-clusters]
> Since the minimal size of the cluster (without this modification) is 3 (one master + two workers). It may be very helpful while doing, for example, small-scale non-critical data processing or building proof-of-concept.
> Since I already have a code which does that, I volunteer to bring it to the community :)
> This improvement won't change many components and should not require groundbreaking changes to DataprocClusterCreateOperator.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)