You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/06/23 19:15:27 UTC

[GitHub] [airflow] mik-laj edited a comment on issue #9418: Deprecated AI Platform Operators and Runtimes in Example DAG

mik-laj edited a comment on issue #9418:
URL: https://github.com/apache/airflow/issues/9418#issuecomment-648364194


   Unfortunately, the community has not developed procedures for storing files necessary for testing. We don't run these tests automatically on CI yet. Each team that works on integrations must provide these files on their own. This should not be difficult based on official guides for this service.
   https://cloud.google.com/ai-platform/training/docs/
   
   I have the following environment variables configured to run these tests. 
   ```
   GCP_PROJECT_ID=polidea-airflow
   
   GCP_MLENGINE_BUCKET_NAME_EPHEMERAL=polidea-airflow-tests-38
   GCP_MLENGINE_BUCKET_NAME_PERSISTENT=test-airflow-mlengine-persistent
   
   GCP_MLENGINE_MODEL_NAME=airflow_test_ci_model_name_19837
   
   GCP_MLENGINE_PREDICTION_INPUT=gs://test-airflow-mlengine-persistent/prediction_input.json
   GCP_MLENGINE_TRAINER_URI=gs://test-airflow-mlengine-persistent/trainer-0.0.0.tar.gz
   
   GCP_MLENGINE_DATAFLOW_STAGING=gs://polidea-airflow-tests-38/staging/
   GCP_MLENGINE_DATAFLOW_TMP=gs://polidea-airflow-tests-38/tmp/
   GCP_MLENGINE_JOB_DIR=gs://polidea-airflow-tests-38/job-dir
   GCP_MLENGINE_PREDICTION_OUTPUT=gs://polidea-airflow-tests-38/prediction_output/
   GCP_MLENGINE_SAVED_MODEL_PATH=gs://polidea-airflow-tests-38/job-dir/keras_export/
   ```
   I prepared copies of the necessary files for you and made them available in a public bucket. Please make a copy of this bucket if you want to work on this integration, because this bucket can be deleted at any time. 
   ```
   gs://airflow-polidea-googl-system-tests-resources-public
   ```
   I hope this information will help you.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org