You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/05/23 14:51:41 UTC

Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #299

See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/299/display/redirect?page=changes>

Changes:

[github] [BEAM-10051] Move closed reader check after sentinel. (#11768)

[github] [BEAM-10056] Fix validation for struct CoGBKs (#11782)


------------------------------------------
[...truncated 81.58 KB...]
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_month"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_miles"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "3152 - 97284 Crystal Abernathy"
  value: "4615 - Tyrone Henderson"
  value: "4623 - Jay Kim"
  value: "4787 - Reny Cab Co"
  value: "Blue Ribbon Taxi Association Inc."
  value: "C & D Cab Co Inc"
  value: "Chicago Elite Cab Corp. (Chicago Carriag"
  value: "Choice Taxi Association"
  value: "Dispatch Taxi Affiliation"
  value: "KOAM Taxi Association"
  value: "Northwest Management LLC"
  value: "Taxi Affiliation Services"
  value: "Top Cab Affiliation"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "No Charge"
  value: "Pcard"
  value: "Prcard"
  value: "Unknown"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:118: FutureWarning: ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-05-23 14:41:04.303251: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-05-23 14:41:04.314060: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-05-23 14:41:04.315598: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8a8e4c0 executing computations on platform Host. Devices:
2020-05-23 14:41:04.315640: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-05-23 14:41:04.330765: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 228, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 213, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 133, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1656, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020052-05230741-egyq-harness-2xxh. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 201

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 25m 15s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/rh6e6cvddltea

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_Chicago_Taxi_Dataflow #305

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/305/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #304

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/304/display/redirect?page=changes>

Changes:

[kcweaver] Update Beam website to release 2.21.0.

[kcweaver] Add blog post announcing the Beam 2.21.0 release.

[rohde.samuel] Add to/from_runner_api_parameters to WriteToBigQuery

[heejong] [BEAM-10064] Fix google3 import error for BEAM-9383

[heejong] [BEAM-10077] using filename + hash instead of UUID for staging name

[darshanjani100] [BEAM-10074] | implement hashing functions

[kamil.wasilewski] [BEAM-9936] Reduce the code duplication across python/container/py*

[kamil.wasilewski] [BEAM-9936] Create SDK harness containers with Python3.8

[kamil.wasilewski] [BEAM-9810] Tox suites for Python 3.8

[kamil.wasilewski] [BEAM-9810] Fix 'dictionary keys changed during iteration' error

[kamil.wasilewski] [BEAM-9810] Disable all failing tests until Dataflow runner supports

[iemejia] [BEAM-7770] Make ReplicaInfo part of Read on SolrIO

[iemejia] [BEAM-7770] Add ReadAll transform for SolrIO

[piotr.szuberski] [BEAM-10102] Fix query in pubsub read grafana dashoard

[kcweaver] [BEAM-10108] Update Flink versions in publish_docker_images.sh.

[github] Add release date.

[github] Add release date.

[github] Add release date.

[github] Remove HTML comment (causes formatting issues)

[github] Add a flag to tune the size of the grouping tables used by the dataflow

[github] Add Pub/Sub Lite to in progress IOs

[kcweaver] Move 2.20 download addresses to archive.

[pabloem] [BEAM-10098] Enabling javadoc export for RabbitMqIO and KuduIO

[github] Merge pull request #11796 from [BEAM-10003] Use local code for building

[github] [BEAM-9971] Do not use context classloader. (#11784)

[github] [BEAM-9363] Support TUMBLE aggregation (#11807)


------------------------------------------
[...truncated 89.52 KB...]
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "dropoff_community_area"
    value_count {
      min: 1
      max: 1
    }
    type: BYTES
    int_domain {
    }
    presence {
      min_count: 1
    }
  }
  feature {
    name: "pickup_community_area"
    value_count {
      min: 1
      max: 1
    }
    type: BYTES
    int_domain {
    }
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "payment_type"
    value_count {
      min: 1
      max: 1
    }
    type: BYTES
    domain: "payment_type"
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "trip_seconds"
    value_count {
      min: 1
      max: 1
    }
    type: INT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "trip_start_day"
    value_count {
      min: 1
      max: 1
    }
    type: INT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "tips"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "pickup_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "dropoff_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  string_domain {
    name: "company"
    value: "Yellow Cab"
  }
  string_domain {
    name: "payment_type"
    value: "Cash"
    value: "Credit Card"
  }
}
anomaly_info {
  key: "trip_seconds"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "trip_seconds"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:151: FutureWarning: ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1730: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-05-28 14:48:47.207398: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-05-28 14:48:47.219994: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-05-28 14:48:47.221949: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8894f20 executing computations on platform Host. Devices:
2020-05-28 14:48:47.221986: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-05-28 14:48:47.245205: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200528-142832/chicago_taxi_output/tft_output/tftransform_tmp/f0c1d3ad731c41ac85ed8e4b7b0c1628/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200528-142832/chicago_taxi_output/tft_output/tftransform_tmp/f0c1d3ad731c41ac85ed8e4b7b0c1628/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200528-142832/chicago_taxi_output/tft_output/tftransform_tmp/80866f22e36a4cc0a8a24e2e236c6ebe/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200528-142832/chicago_taxi_output/tft_output/tftransform_tmp/80866f22e36a4cc0a8a24e2e236c6ebe/saved_model.pb
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "preprocess.py", line 255, in <module>
    main()
  File "preprocess.py", line 251, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 184, in transform_data
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1656, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020052-05280749-s8sh-harness-tbgv. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 201

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 31m 5s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/iqck433itb5um

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #303

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/303/display/redirect?page=changes>

Changes:

[zyichi] [BEAM-9603] Add timer family support to FnApiDoFnRunner

[zyichi] Address comments and add tests

[zyichi] comments

[bhulette] add def args

[github] Fix typo Portabillity -> Portability

[aramaswamis] Fix typo copyLicenseScrips -> copyLicenseScripts

[aramaswamis] add io-matrix

[aramaswamis] add descriptions, links to guides

[aramaswamis] fix typo

[aramaswamis] format

[aramaswamis] update CHANGES.md

[rarokni] [BEAM-9770] BigQueryIO Patterns. Add Document update to snippit update.

[github] [BEAM-10065] Fix beam release guide template (#11797)

[github] Fix typo in doc "and and" -> "and" (#11810)

[github] [BEAM-2939, BEAM-10057] Ensure that we can process an

[github] [BEAM-7370] Upgrade sphinx to 3.0.3 (#11798)

[zyichi] Clear redundant debug statements in pr-11756

[github] [BEAM-10076] Fix dataflow worker status page rendering (#11812)

[lcwik] [BEAM-10016, BEAM-10094] Disable single test to get portable validates


------------------------------------------
[...truncated 49.01 KB...]
  Downloading Keras_Applications-1.0.8.tar.gz (289 kB)
Processing /home/jenkins/.cache/pip/wheels/5b/d8/8e/81a83cb5321b940a954996f5b57fddc8976e712b3ac3a1a54b/wrapt-1.12.1-cp27-cp27mu-linux_x86_64.whl
Requirement already satisfied: protobuf>=3.6.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (3.12.1)
Collecting google-pasta>=0.1.6
  Downloading google_pasta-0.2.0-py2-none-any.whl (57 kB)
Collecting keras-preprocessing>=1.0.5
  Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Requirement already satisfied: mock>=2.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (2.0.0)
Requirement already satisfied: numpy<2.0,>=1.14.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.16.6)
Requirement already satisfied: six>=1.10.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.15.0)
Requirement already satisfied: wheel in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (0.34.2)
Collecting astor>=0.6.0
  Downloading astor-0.8.1-py2.py3-none-any.whl (27 kB)
Requirement already satisfied: enum34>=1.1.6 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.1.10)
Collecting termcolor>=1.1.0
  Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Collecting gast>=0.2.0
  Downloading gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting scikit-learn<1,>=0.18
  Downloading scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl (5.5 MB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.23.0.dev0)
Collecting joblib<1,>=0.12
  Downloading joblib-0.14.1-py2.py3-none-any.whl (294 kB)
Collecting IPython>=5.0
  Downloading ipython-5.10.0-py2-none-any.whl (760 kB)
Requirement already satisfied: pandas<1,>=0.18 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.24.2)
Requirement already satisfied: googleapis-common-protos in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-metadata<0.14,>=0.13.0->-r requirements.txt (line 21)) (1.51.0)
Collecting scipy==1.1.0
  Downloading scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8 MB)
Processing /home/jenkins/.cache/pip/wheels/6a/a5/14/25541ebcdeaf97a37b6d05c7ff15f5bd20f5e91b99d313e5b4/pydot-1.2.4-cp27-none-any.whl
Collecting qtpy
  Downloading QtPy-1.9.0-py2.py3-none-any.whl (54 kB)
Collecting pygments
  Downloading Pygments-2.5.2-py2.py3-none-any.whl (896 kB)
Collecting widgetsnbextension~=3.5.0
  Downloading widgetsnbextension-3.5.1-py2.py3-none-any.whl (2.2 MB)
Collecting prompt-toolkit<2.0.0,>=1.0.0
  Downloading prompt_toolkit-1.0.18-py2-none-any.whl (245 kB)
Collecting mistune<2,>=0.8.1
  Downloading mistune-0.8.4-py2.py3-none-any.whl (16 kB)
Collecting defusedxml
  Downloading defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Collecting entrypoints>=0.2.2
  Downloading entrypoints-0.3-py2.py3-none-any.whl (11 kB)
Collecting bleach
  Downloading bleach-3.1.5-py2.py3-none-any.whl (151 kB)
Collecting pandocfilters>=1.4.1
  Downloading pandocfilters-1.4.2.tar.gz (14 kB)
Collecting testpath
  Downloading testpath-0.4.4-py2.py3-none-any.whl (163 kB)
Collecting jsonschema!=2.5.0,>=2.4
  Downloading jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Collecting decorator
  Using cached decorator-4.4.2-py2.py3-none-any.whl (9.2 kB)
Collecting MarkupSafe>=0.23
  Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Requirement already satisfied: python-dateutil>=2.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jupyter-client>=5.2.0->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (2.8.1)
Requirement already satisfied: futures in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.3.0)
Requirement already satisfied: singledispatch in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.4.0.3)
Collecting backports_abc>=0.4
  Downloading backports_abc-0.5-py2.py3-none-any.whl (5.2 kB)
Collecting ptyprocess; os_name != "nt"
  Using cached ptyprocess-0.6.0-py2.py3-none-any.whl (39 kB)
Collecting markdown>=2.6.8
  Downloading Markdown-3.1.1-py2.py3-none-any.whl (87 kB)
Requirement already satisfied: setuptools>=41.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (44.1.0)
Collecting werkzeug>=0.11.15
  Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting h5py
  Downloading h5py-2.10.0-cp27-cp27mu-manylinux1_x86_64.whl (2.8 MB)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (5.4.5)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (1.0.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.5.8)
Requirement already satisfied: avro<1.10.0,>=1.8.1; python_version < "3.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.9.2)
Requirement already satisfied: httplib2<0.18.0,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.17.4)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.0)
Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.18.2)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.2)
Requirement already satisfied: typing<3.8.0,>=3.7.0; python_version < "3.5.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.1)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.10.1)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2020.1)
Requirement already satisfied: pyarrow<0.18.0,>=0.15.1; python_version >= "3.0" or platform_system != "Windows" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.16.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.3.1.1)
Requirement already satisfied: fastavro<0.24,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.23.4)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8; python_version < "3.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.8)
Requirement already satisfied: cachetools<4,>=3.1.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.1.1)
Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.13.0)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.31)
Requirement already satisfied: google-cloud-core<2,>=0.28.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.2)
Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.2)
Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0)
Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.42.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0)
Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.0)
Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.24.0)
Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7.4)
Collecting backports.shutil-get-terminal-size; python_version == "2.7"
  Downloading backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl (6.5 kB)
Requirement already satisfied: pathlib2; python_version == "2.7" or python_version == "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.3.5)
Collecting pexpect; sys_platform != "win32"
  Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
Collecting simplegeneric>0.8
  Downloading simplegeneric-0.8.1.zip (12 kB)
Collecting pickleshare
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->tensorflow-transform<0.14,>=0.13.0->-r requirements.txt (line 24)) (2.4.7)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from prompt-toolkit<2.0.0,>=1.0.0->jupyter-console->jupyter<2,>=1.0->-r requirements.txt (line 17)) (0.1.9)
Requirement already satisfied: configparser>=3.5; python_version == "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from entrypoints>=0.2.2->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (4.0.2)
Collecting webencodings
  Downloading webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from bleach->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (20.4)
Processing /home/jenkins/.cache/pip/wheels/c2/ea/a3/25af52265fad6418a74df0b8d9ca8b89e0b3735dbd4d0d3794/functools32-3.2.3.post2-py2-none-any.whl
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (19.3.0)
Collecting pyrsistent>=0.14.0
  Downloading pyrsistent-0.16.0.tar.gz (108 kB)
Requirement already satisfied: importlib-metadata; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.6.0)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.23.0)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (4.0)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.8)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.14.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.17.0)
Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-apitools<0.5.32,>=0.5.31; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.15)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.12.3)
Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.15.0)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.0)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pathlib2; python_version == "2.7" or python_version == "3.3"->IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.10.0)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.2.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2020.4.5.1)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.25.9)
Requirement already satisfied: monotonic>=0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from fasteners>=0.14->google-apitools<0.5.32,>=0.5.31; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.5)
Building wheels for collected packages: tensorflow-transform, Send2Trash, tornado, keras-applications, termcolor, pandocfilters, simplegeneric, pyrsistent
  Building wheel for tensorflow-transform (setup.py): started
  Building wheel for tensorflow-transform (setup.py): finished with status 'done'
  Created wheel for tensorflow-transform: filename=tensorflow_transform-0.13.0-py2-none-any.whl size=233598 sha256=ad2255d0b03ee2c886b935340d3d1bef3d9b125c4a6cf819eb3c3ca91f699d11
  Stored in directory: /home/jenkins/.cache/pip/wheels/d8/ff/c6/37a8eab1936e7b8c72da7824ebf22158aafce340d1693c161a
  Building wheel for Send2Trash (setup.py): started
  Building wheel for Send2Trash (setup.py): finished with status 'done'
  Created wheel for Send2Trash: filename=Send2Trash-1.5.0-py2-none-any.whl size=10734 sha256=17dbe71a469080038664d26c31f7d5c69444641898ad61a67f6dc9489ef3a092
  Stored in directory: /home/jenkins/.cache/pip/wheels/a2/d8/14/0457f16488d8cbc2cf18bccb5f1ceb59675787a80c649251bc
  Building wheel for tornado (setup.py): started
  Building wheel for tornado (setup.py): finished with status 'done'
  Created wheel for tornado: filename=tornado-5.1.1-cp27-cp27mu-linux_x86_64.whl size=457493 sha256=68050ec05977d39d1ab8d83fc68073709e9c4d18854c715a3fd2c2ef880a54de
  Stored in directory: /home/jenkins/.cache/pip/wheels/d8/83/af/e0dc6afbf3a2c51af8d6e3f9fbe790d0c581c2de05bc5d50f5
  Building wheel for keras-applications (setup.py): started
  Building wheel for keras-applications (setup.py): finished with status 'done'
  Created wheel for keras-applications: filename=Keras_Applications-1.0.8-py2-none-any.whl size=50702 sha256=52c978306cce29a33c6ba4ae55cdfed820e5c77b078c86b298a0b68ff29b2aef
  Stored in directory: /home/jenkins/.cache/pip/wheels/71/a0/64/e2e0c93740e0460f4b7f036141b7c73b5e44ff38f690ddff9f
  Building wheel for termcolor (setup.py): started
  Building wheel for termcolor (setup.py): finished with status 'done'
  Created wheel for termcolor: filename=termcolor-1.1.0-py2-none-any.whl size=4831 sha256=d447caa51f76ef77ab505e647ee1f77dddd4338e8510376474932069386815ba
  Stored in directory: /home/jenkins/.cache/pip/wheels/48/54/87/2f4d1a48c87e43906477a3c93d9663c49ca092046d5a4b00b4
  Building wheel for pandocfilters (setup.py): started
  Building wheel for pandocfilters (setup.py): finished with status 'done'
  Created wheel for pandocfilters: filename=pandocfilters-1.4.2-py2-none-any.whl size=7855 sha256=ceb147a9a66dc96a83e4a22b3fd11a4293eb59449461141f39aedaeb84b9494d
  Stored in directory: /home/jenkins/.cache/pip/wheels/49/82/c2/20339405e38b5650a69542cbbcb85082f6840c488ecd22d02e
  Building wheel for simplegeneric (setup.py): started
  Building wheel for simplegeneric (setup.py): finished with status 'done'
  Created wheel for simplegeneric: filename=simplegeneric-0.8.1-py2-none-any.whl size=5075 sha256=6479fc5bc23de2722c14390cf5bdb88840bb04f06f1ccf91b96727e76da2f16c
  Stored in directory: /home/jenkins/.cache/pip/wheels/1b/83/23/9d866729c0090bfc62d03a5bd43080fb07a5f4fad10a09399a
  Building wheel for pyrsistent (setup.py): started
  Building wheel for pyrsistent (setup.py): finished with status 'done'
  Created wheel for pyrsistent: filename=pyrsistent-0.16.0-cp27-cp27mu-linux_x86_64.whl size=93319 sha256=dc71b7157425389a60f63a400897ccf7df43abfe5be0b7a2a281a435a403b20b
  Stored in directory: /home/jenkins/.cache/pip/wheels/1f/d0/6d/4eb101c505cdc5e2be006684c0b93f3095a8ac5e0cf9abb35c
Successfully built tensorflow-transform Send2Trash tornado keras-applications termcolor pandocfilters simplegeneric pyrsistent
Installing collected packages: decorator, ipython-genutils, traitlets, backports.shutil-get-terminal-size, ptyprocess, pexpect, pygments, prompt-toolkit, simplegeneric, pickleshare, IPython, backports-abc, tornado, pyzmq, jupyter-core, jupyter-client, ipykernel, qtpy, qtconsole, mistune, defusedxml, entrypoints, MarkupSafe, jinja2, webencodings, bleach, pandocfilters, functools32, pyrsistent, jsonschema, nbformat, testpath, nbconvert, ipaddress, Send2Trash, terminado, prometheus-client, notebook, widgetsnbextension, ipywidgets, jupyter-console, jupyter, absl-py, backports.weakref, tensorflow-estimator, markdown, werkzeug, tensorboard, h5py, keras-applications, wrapt, google-pasta, keras-preprocessing, astor, termcolor, gast, tensorflow, scipy, scikit-learn, tensorflow-metadata, joblib, pydot, tensorflow-transform, tensorflow-data-validation, tensorflow-model-analysis, tensorflow-serving-api
  Attempting uninstall: pydot
    Found existing installation: pydot 1.4.1
    Uninstalling pydot-1.4.1:
      Successfully uninstalled pydot-1.4.1
Successfully installed IPython-5.10.0 MarkupSafe-1.1.1 Send2Trash-1.5.0 absl-py-0.9.0 astor-0.8.1 backports-abc-0.5 backports.shutil-get-terminal-size-1.0.0 backports.weakref-1.0.post1 bleach-3.1.5 decorator-4.4.2 defusedxml-0.6.0 entrypoints-0.3 functools32-3.2.3.post2 gast-0.3.3 google-pasta-0.2.0 h5py-2.10.0 ipaddress-1.0.23 ipykernel-4.10.1 ipython-genutils-0.2.0 ipywidgets-7.5.1 jinja2-2.11.2 joblib-0.14.1 jsonschema-3.2.0 jupyter-1.0.0 jupyter-client-5.3.4 jupyter-console-5.2.0 jupyter-core-4.6.3 keras-applications-1.0.8 keras-preprocessing-1.1.2 markdown-3.1.1 mistune-0.8.4 nbconvert-5.6.1 nbformat-4.4.0 notebook-5.7.9 pandocfilters-1.4.2 pexpect-4.8.0 pickleshare-0.7.5 prometheus-client-0.8.0 prompt-toolkit-1.0.18 ptyprocess-0.6.0 pydot-1.2.4 pygments-2.5.2 pyrsistent-0.16.0 pyzmq-19.0.1 qtconsole-4.7.4 qtpy-1.9.0 scikit-learn-0.20.4 scipy-1.1.0 simplegeneric-0.8.1 tensorboard-1.14.0 tensorflow-1.14.0 tensorflow-data-validation-0.13.1 tensorflow-estimator-1.14.0 tensorflow-metadata-0.13.0 tensorflow-model-analysis-0.13.2 tensorflow-serving-api-1.13.1 tensorflow-transform-0.13.0 termcolor-1.1.0 terminado-0.8.3 testpath-0.4.4 tornado-5.1.1 traitlets-4.3.3 webencodings-0.5.1 werkzeug-1.0.1 widgetsnbextension-3.5.1 wrapt-1.12.1

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample
Using GCP project: apache-beam-testing
Job output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200527-142838/chicago_taxi_output
TFDV output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200527-142838/chicago_taxi_output/tfdv_output
Starting distributed TFDV stats computation and schema generation...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:118: FutureWarning: ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-05-27 14:28:44.525732: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-05-27 14:28:44.537430: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-05-27 14:28:44.539002: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7d13ce0 executing computations on platform Host. Devices:
2020-05-27 14:28:44.539041: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-05-27 14:28:44.555087: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 228, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 213, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 133, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1656, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020052-05270728-s064-harness-zd62. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 201

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 18s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/aiujmlbkleedi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #302

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/302/display/redirect?page=changes>

Changes:

[github] [BEAM-10073] Add pubsub performance tests results to the grafana


------------------------------------------
[...truncated 92.87 KB...]
    }
  }
  feature {
    name: "pickup_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "dropoff_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  string_domain {
    name: "company"
    value: "0118 - 42111 Godfrey S.Awir"
    value: "0118 - Godfrey S.Awir"
    value: "0694 - 59280 Chinesco Trans Inc"
    value: "1085 - 72312 N and W Cab Co"
    value: "1085 - N and W Cab Co"
    value: "1408 - 89599 Donald Barnes"
    value: "2092 - 61288 Sbeih company"
    value: "2192 - 73487 Zeymane Corp"
    value: "2192 - Zeymane Corp"
    value: "2241 - 44667 Manuel Alonso"
    value: "2241 - Manuel Alonso"
    value: "2733 - Benny Jona"
    value: "2823 - 73307 Seung Lee"
    value: "3011 - 66308 JBL Cab Inc."
    value: "3094 - 24059 G.L.B. Cab Co"
    value: "3141 - Zip Cab"
    value: "3152 - 97284 Crystal Abernathy"
    value: "3152 - Crystal Abernathy"
    value: "3201 - C&D Cab Co Inc"
    value: "3253 - 91138 Gaither Cab Co."
    value: "3385 -  Eman Cab"
    value: "3385 - 23210  Eman Cab"
    value: "3385 - 23210 Eman Cab"
    value: "3556 - 36214 RC Andrews Cab"
    value: "3620 - 52292 David K. Cab Corp."
    value: "3620 - David K. Cab Corp."
    value: "3623 - 72222 Arrington Enterprises"
    value: "3623-Arrington Enterprises"
    value: "3897 - 57856 Ilie Malec"
    value: "3897 - Ilie Malec"
    value: "4053 - 40193 Adwar H. Nikola"
    value: "4053 - Adwar H. Nikola"
    value: "4197 - 41842 Royal Star"
    value: "4615 - 83503 Tyrone Henderson"
    value: "4615 - Tyrone Henderson"
    value: "4623 - 27290 Jay Kim"
    value: "4787 - Reny Cab Co"
    value: "5006 - 39261 Salifu Bawa"
    value: "5062 - 34841 Sam Mestas"
    value: "5074 - 54002 Ahzmi Inc"
    value: "5129 - 98755 Mengisti Taxi"
    value: "5129 - Mengisti Taxi"
    value: "5724 - 72965 KYVI Cab Inc"
    value: "585 - 88805 Valley Cab Co"
    value: "5864 - 73614 Thomas Owusu"
    value: "5874 - 73628 Sergey Cab Corp."
    value: "5874 - Sergey Cab Corp."
    value: "5997 - AW Services Inc."
    value: "6057 - 24657 Richard Addo"
    value: "6488 - 83287 Zuha Taxi"
    value: "6743 - 78771 Luhak Corp"
    value: "6743 - Luhak Corp"
    value: "Blue Ribbon Taxi Association Inc."
    value: "C & D Cab Co Inc"
    value: "Chicago Elite Cab Corp. (Chicago Carriag"
    value: "Chicago Medallion Management"
    value: "Choice Taxi Association"
    value: "Dispatch Taxi Affiliation"
    value: "Flash Cab"
    value: "KOAM Taxi Association"
    value: "Norshore Cab"
    value: "Northwest Management LLC"
    value: "Taxi Affiliation Services"
    value: "Top Cab Affiliation"
    value: "Yellow Cab"
  }
  string_domain {
    name: "payment_type"
    value: "Cash"
    value: "Credit Card"
    value: "Dispute"
    value: "No Charge"
    value: "Unknown"
  }
}
anomaly_info {
  key: "company"
  value {
    description: "Examples contain values missing from the schema: 0694 - Chinesco Trans Inc (<1%), 1247 - 72807 Daniel Ayertey (<1%), 1408 - Donald Barnes (<1%), 2092 - Sbeih company (<1%), 2733 - 74600 Benny Jona (<1%), 2809 - 95474 C & D Cab Co Inc. (<1%), 2823 - Seung Lee (<1%), 3011 - JBL Cab Inc. (<1%), 3094 - G.L.B. Cab Co (<1%), 3141 - 87803 Zip Cab (<1%), 3253 - Gaither Cab Co. (<1%), 3385 - Eman Cab (<1%), 3591- 63480 Chuk\\\'s Cab (<1%), 3591- Chuk\\\'s Cab (<1%), 3669 - 85800 Jordan Taxi Inc (<1%), 4197 - Royal Star (<1%), 4623 - Jay Kim (<1%), 4787 - 56058 Reny Cab Co (<1%), 5006 - Salifu Bawa (<1%), 5062 - Sam Mestas (<1%), 5074 - Ahzmi Inc (<1%), 5129 - 87128 (<1%), 5724 - 75306 KYVI Cab Inc (<1%), 5724 - KYVI Cab Inc (<1%), 585 - Valley Cab Co (<1%), 5864 - Thomas Owusu (<1%), 5997 - 65283 AW Services Inc. (<1%), 6488 - Zuha Taxi (<1%), 6574 - Babylon Express Inc. (<1%), 6742 - 83735 Tasha ride inc (<1%), 6747 - Mueen Abdalla (<1%), Chicago Medallion Leasing INC (<1%), Suburban Dispatch LLC (<1%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: 0694 - Chinesco Trans Inc (<1%), 1247 - 72807 Daniel Ayertey (<1%), 1408 - Donald Barnes (<1%), 2092 - Sbeih company (<1%), 2733 - 74600 Benny Jona (<1%), 2809 - 95474 C & D Cab Co Inc. (<1%), 2823 - Seung Lee (<1%), 3011 - JBL Cab Inc. (<1%), 3094 - G.L.B. Cab Co (<1%), 3141 - 87803 Zip Cab (<1%), 3253 - Gaither Cab Co. (<1%), 3385 - Eman Cab (<1%), 3591- 63480 Chuk\\\'s Cab (<1%), 3591- Chuk\\\'s Cab (<1%), 3669 - 85800 Jordan Taxi Inc (<1%), 4197 - Royal Star (<1%), 4623 - Jay Kim (<1%), 4787 - 56058 Reny Cab Co (<1%), 5006 - Salifu Bawa (<1%), 5062 - Sam Mestas (<1%), 5074 - Ahzmi Inc (<1%), 5129 - 87128 (<1%), 5724 - 75306 KYVI Cab Inc (<1%), 5724 - KYVI Cab Inc (<1%), 585 - Valley Cab Co (<1%), 5864 - Thomas Owusu (<1%), 5997 - 65283 AW Services Inc. (<1%), 6488 - Zuha Taxi (<1%), 6574 - Babylon Express Inc. (<1%), 6742 - 83735 Tasha ride inc (<1%), 6747 - Mueen Abdalla (<1%), Chicago Medallion Leasing INC (<1%), Suburban Dispatch LLC (<1%). "
    }
    path {
      step: "company"
    }
  }
}
anomaly_info {
  key: "pickup_community_area"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "pickup_community_area"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:151: FutureWarning: ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-05-26 14:48:42.313615: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-05-26 14:48:42.324416: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-05-26 14:48:42.325889: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8255430 executing computations on platform Host. Devices:
2020-05-26 14:48:42.325938: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-05-26 14:48:42.343452: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200526-142825/chicago_taxi_output/tft_output/tftransform_tmp/571ce4606e7441a3a70610b662dade57/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200526-142825/chicago_taxi_output/tft_output/tftransform_tmp/571ce4606e7441a3a70610b662dade57/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200526-142825/chicago_taxi_output/tft_output/tftransform_tmp/7178a37494994176b9c126194ec648e1/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200526-142825/chicago_taxi_output/tft_output/tftransform_tmp/7178a37494994176b9c126194ec648e1/saved_model.pb
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "preprocess.py", line 255, in <module>
    main()
  File "preprocess.py", line 251, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 184, in transform_data
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1656, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020052-05260749-r21m-harness-nt5z. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 201

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 31m 12s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/q2aersnfdv2pu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #301

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/301/display/redirect?page=changes>

Changes:

[kamil.wasilewski] [BEAM-10058] Provide less strict assertion to make the test more

[github] [BEAM-10050] Change labels checked in VideoIntelligenceIT (#11775)

[github] [BEAM-9930] Update blog post for new Beam Summit Digital dates (#11772)


------------------------------------------
[...truncated 90.77 KB...]
    value_count {
      min: 1
      max: 1
    }
    type: INT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "tips"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_count: 1
    }
  }
  feature {
    name: "pickup_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "dropoff_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  string_domain {
    name: "company"
    value: "3152 - 97284 Crystal Abernathy"
    value: "4615 - Tyrone Henderson"
    value: "4623 - Jay Kim"
    value: "4787 - Reny Cab Co"
    value: "Blue Ribbon Taxi Association Inc."
    value: "C & D Cab Co Inc"
    value: "Chicago Elite Cab Corp. (Chicago Carriag"
    value: "Choice Taxi Association"
    value: "Dispatch Taxi Affiliation"
    value: "KOAM Taxi Association"
    value: "Northwest Management LLC"
    value: "Taxi Affiliation Services"
    value: "Top Cab Affiliation"
  }
  string_domain {
    name: "payment_type"
    value: "Cash"
    value: "Credit Card"
    value: "No Charge"
    value: "Pcard"
    value: "Prcard"
    value: "Unknown"
  }
}
anomaly_info {
  key: "company"
  value {
    description: "Examples contain values missing from the schema: 1085 - 72312 N and W Cab Co (<1%), 1085 - N and W Cab Co (<1%), 1247 - 72807 Daniel Ayertey (<1%), 1469 - 64126 Omar Jada (<1%), 2092 - 61288 Sbeih company (<1%), 2192 - Zeymane Corp (<1%), 24 Seven Taxi (<1%), 2733 - 74600 Benny Jona (<1%), 2733 - Benny Jona (<1%), 3011 - 66308 JBL Cab Inc. (<1%), 3094 - 24059 G.L.B. Cab Co (<1%), 312 Medallion Management Corp (<1%), 3201 - C & D Cab Co Inc (<1%), 3201 - CID Cab Co Inc (<1%), 3556 - 36214 RC Andrews Cab (<1%), 3591 - 63480 Chuks Cab (<1%), 3620 - 52292 David K. Cab Corp. (<1%), 3623 - 72222 Arrington Enterprises (<1%), 3623-Arrington Enterprises (<1%), 3669 - 85800 Jordan Taxi Inc (<1%), 3721 - Santamaria Express, Alvaro Santamaria (<1%), 3897 - Ilie Malec (<1%), 4053 - 40193 Adwar H. Nikola (<1%), 4053 - Adwar H. Nikola (<1%), 4615 - 83503 Tyrone Henderson (<1%), 4623 - 27290 Jay Kim (<1%), 5 Star Taxi (<1%), 5006 - 39261 Salifu Bawa (<1%), 5062 - 34841 Sam Mestas (<1%), 5074 - 54002 Ahzmi Inc (<1%), 5437 - Great American Cab Co (<1%), 5776 - Mekonen Cab Company (<1%), 5874 - 73628 Sergey Cab Corp. (<1%), 5997 - AW Services Inc. (<1%), 6574 - Babylon Express Inc. (<1%), 6742 - 83735 Tasha ride inc (<1%), 6743 - 78771 Luhak Corp (<1%), American United Taxi Affiliation (<1%), Blue Diamond (<1%), Checker Taxi Affiliation (<1%), Chicago Carriage Cab Corp (~2%), Chicago Independents (<1%), Chicago Medallion Management (~2%), Chicago Taxicab (<1%), City Service (~1%), Flash Cab (~3%), Leonard Cab Co (<1%), Medallion Leasin (~1%), Metro Jet Taxi A (<1%), Nova Taxi Affiliation Llc (<1%), Patriot Taxi Dba Peace Taxi Associat (<1%), Petani Cab Corp (<1%), Setare Inc (<1%), Star North Management LLC (~13%), Sun Taxi (~1%), Taxi Affiliation Service Yellow (<1%), Taxicab Insurance Agency, LLC (~1%), U Taxicab (<1%), Yellow Cab (<1%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: 1085 - 72312 N and W Cab Co (<1%), 1085 - N and W Cab Co (<1%), 1247 - 72807 Daniel Ayertey (<1%), 1469 - 64126 Omar Jada (<1%), 2092 - 61288 Sbeih company (<1%), 2192 - Zeymane Corp (<1%), 24 Seven Taxi (<1%), 2733 - 74600 Benny Jona (<1%), 2733 - Benny Jona (<1%), 3011 - 66308 JBL Cab Inc. (<1%), 3094 - 24059 G.L.B. Cab Co (<1%), 312 Medallion Management Corp (<1%), 3201 - C & D Cab Co Inc (<1%), 3201 - CID Cab Co Inc (<1%), 3556 - 36214 RC Andrews Cab (<1%), 3591 - 63480 Chuks Cab (<1%), 3620 - 52292 David K. Cab Corp. (<1%), 3623 - 72222 Arrington Enterprises (<1%), 3623-Arrington Enterprises (<1%), 3669 - 85800 Jordan Taxi Inc (<1%), 3721 - Santamaria Express, Alvaro Santamaria (<1%), 3897 - Ilie Malec (<1%), 4053 - 40193 Adwar H. Nikola (<1%), 4053 - Adwar H. Nikola (<1%), 4615 - 83503 Tyrone Henderson (<1%), 4623 - 27290 Jay Kim (<1%), 5 Star Taxi (<1%), 5006 - 39261 Salifu Bawa (<1%), 5062 - 34841 Sam Mestas (<1%), 5074 - 54002 Ahzmi Inc (<1%), 5437 - Great American Cab Co (<1%), 5776 - Mekonen Cab Company (<1%), 5874 - 73628 Sergey Cab Corp. (<1%), 5997 - AW Services Inc. (<1%), 6574 - Babylon Express Inc. (<1%), 6742 - 83735 Tasha ride inc (<1%), 6743 - 78771 Luhak Corp (<1%), American United Taxi Affiliation (<1%), Blue Diamond (<1%), Checker Taxi Affiliation (<1%), Chicago Carriage Cab Corp (~2%), Chicago Independents (<1%), Chicago Medallion Management (~2%), Chicago Taxicab (<1%), City Service (~1%), Flash Cab (~3%), Leonard Cab Co (<1%), Medallion Leasin (~1%), Metro Jet Taxi A (<1%), Nova Taxi Affiliation Llc (<1%), Patriot Taxi Dba Peace Taxi Associat (<1%), Petani Cab Corp (<1%), Setare Inc (<1%), Star North Management LLC (~13%), Sun Taxi (~1%), Taxi Affiliation Service Yellow (<1%), Taxicab Insurance Agency, LLC (~1%), U Taxicab (<1%), Yellow Cab (<1%). "
    }
    path {
      step: "company"
    }
  }
}
anomaly_info {
  key: "payment_type"
  value {
    description: "Examples contain values missing from the schema: Dispute (<1%), Mobile (<1%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: Dispute (<1%), Mobile (<1%). "
    }
    path {
      step: "payment_type"
    }
  }
}
anomaly_info {
  key: "pickup_community_area"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "pickup_community_area"
    }
  }
}
anomaly_info {
  key: "trip_miles"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "trip_miles"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:151: FutureWarning: ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-05-25 14:48:40.009604: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-05-25 14:48:40.021463: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-05-25 14:48:40.023221: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8a87340 executing computations on platform Host. Devices:
2020-05-25 14:48:40.023262: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-05-25 14:48:40.042378: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200525-142823/chicago_taxi_output/tft_output/tftransform_tmp/3f54b76164e54179adfe0e4982dc12a6/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200525-142823/chicago_taxi_output/tft_output/tftransform_tmp/3f54b76164e54179adfe0e4982dc12a6/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200525-142823/chicago_taxi_output/tft_output/tftransform_tmp/bb931bf783224cfe819c4c918b5ec26a/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200525-142823/chicago_taxi_output/tft_output/tftransform_tmp/bb931bf783224cfe819c4c918b5ec26a/saved_model.pb
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "preprocess.py", line 255, in <module>
    main()
  File "preprocess.py", line 251, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 184, in transform_data
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1656, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020052-05250749-oi3w-harness-jdvf. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 201

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 30m 39s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/ipxxwl4d7wbss

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #300

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/300/display/redirect>

Changes:


------------------------------------------
[...truncated 81.42 KB...]
  name: "company"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "company"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_timestamp"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_month"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_miles"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "Yellow Cab"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:118: FutureWarning: ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-05-24 14:37:59.162202: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-05-24 14:37:59.173069: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-05-24 14:37:59.174477: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x6dfc430 executing computations on platform Host. Devices:
2020-05-24 14:37:59.174514: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-05-24 14:37:59.188153: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 228, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 213, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 133, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1656, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020052-05240738-wcop-harness-6gz0. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 201

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 20m 31s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/eonatenjflp66

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org