You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2019/01/08 22:32:00 UTC
[jira] [Updated] (BEAM-6384) Google Dataflow unsupported SDK
version 0.5.5 error 400
[ https://issues.apache.org/jira/browse/BEAM-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-6384:
----------------------------------
Component/s: (was: beam-model)
sdk-py-core
> Google Dataflow unsupported SDK version 0.5.5 error 400
> -------------------------------------------------------
>
> Key: BEAM-6384
> URL: https://issues.apache.org/jira/browse/BEAM-6384
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: DCD1688
> Assignee: Kenneth Knowles
> Priority: Major
>
> While doing the Google Cloud Transfer learning flowers examples using my own data images, I have issues with launching the Dataflow with the correct version and getting an unsupported SDK error. It seems like the program somehow still download the old verison of Dataflow SDK instead of new ones. However, I have tried following upgrades before executing code :
> *sudo pip install --upgrade -r requirements.txt
> sudo pip install pip==9.0.3 ( to fix other error)
> Code I am trying to use is Google cloud pre-processing using dataflow :
> [https://github.com/GoogleCloudPlatform/cloudml-samples] (source)
> code :
> |python -E preprocess.py \|
> | |--input_path=PATH_TO_INPUT_CSV_FILE \|
> | |--input_dict=PATH_TO_INPUT_DIC_TXT_FILE \|
> | |--output_path=YOUR_OUTPUT_PATH \|
> | |--cloud|
> Error log:
> Collecting google-cloud-dataflow==0.5.5 Using cached https://files.pythonhosted.org/packages/18/18/e7d7a32f917d47bbcc7e3d5c9b60138a7d51adf04d155e0d400108915e79/google-cloud-dataflow-0.5.5.tar.gz Saved /tmp/tmp17oW97/google-cloud-dataflow-0.5.5.tar.gzSuccessfully downloaded google-cloud-dataflow
> File "/home/zeyihe/.local/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 604, in __ProcessHttpResponse http_response, method_config=method_config, request=request)apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/nexgenai-224306/jobs?alt=json>: response: <\{'status': '400', 'content-length': '342', 'x-xss-protection': '1; mode=block', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'vary': 'Origin, X-Origin, Referer', 'server': 'ESF', '-content-encoding': 'gzip', 'cache-control': 'private', 'date': 'Sun, 06 Jan 2019 13:11:24 GMT', 'x-frame-options': 'SAMEORIGIN', 'content-type': 'application/json; charset=UTF-8'}>, content <\{ "error": { "code": 400, "message": "(717cdaa221ed221e): The workflow was automatically rejected by the service because it uses an unsupported SDK version 0.5.5. For a list of supported SDK versions, see: \nhttps://cloud.google.com/dataflow/support#support-status-for-dataflow-sdk-releases", "status": "INVALID_ARGUMENT" }}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)