You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Jeremiah Lowin (JIRA)" <ji...@apache.org> on 2016/05/10 03:12:12 UTC

[jira] [Commented] (AIRFLOW-22) Google cloud code needs tests

    [ https://issues.apache.org/jira/browse/AIRFLOW-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277534#comment-15277534 ] 

Jeremiah Lowin commented on AIRFLOW-22:
---------------------------------------

Can public buckets/BQ datasets (thinking about GDELT) be used without a project?

> Google cloud code needs tests
> -----------------------------
>
>                 Key: AIRFLOW-22
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-22
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>            Reporter: Chris Riccomini
>              Labels: gcp
>
> The Google cloud contrib hooks and operators need tests to verify that they work. This is somewhat tricky since they're hard to mock, and most of the value comes from integration tests, not unit tests.
> I spoke with [~alexvanboxel], and he suggested just writing a script that can be run manually, and exercises the hooks/operators to verify that they work as expected. I think this is about the best we can do without spending a ton of time on it, since most of the integration tests require a real Google cloud project, with real buckets/BQ datasets/DBs, etc. Running it locally means we can run the tests against whatever projects we have access to.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)