You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/03/31 14:46:17 UTC

Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #71

See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/71/display/redirect?page=changes>

Changes:

[kcweaver] [BEAM-9446] Retain unknown arguments when using uber jar job server.

[kcweaver] Enable '--option=value' and '-option' syntax.

[rohde.samuel] Address leftover styling comments from PR/10892

[rohde.samuel] address comments

[robertwb] Side input signals for legacy worker.

[lostluck] accept generated metrics

[github] Use split instead of rsplit

[lostluck] Remove mType and move type urns to urnToType

[lostluck] add missing pcollection payload

[github] Update documentation

[apilloud] [BEAM-9512] Map anonymous structs to schema

[kawaigin] [BEAM-7923] Fix datatable on notebook reloading

[robinyqiu] Clean up code in ZetaSQLDialectSpecTest


------------------------------------------
[...truncated 154.49 KB...]
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_month"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_miles"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "dropoff_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "1085 - N and W Cab Co"
  value: "2192 - Zeymane Corp"
  value: "2241 - Manuel Alonso"
  value: "2733 - Benny Jona"
  value: "3201 - CID Cab Co Inc"
  value: "3319 - C&D Cab Company"
  value: "3620 - David K. Cab Corp."
  value: "3897 - Ilie Malec"
  value: "4053 - Adwar H. Nikola"
  value: "4615 - Tyrone Henderson"
  value: "4787 - Reny Cab Co"
  value: "5437 - Great American Cab Co"
  value: "5776 - Mekonen Cab Company"
  value: "5874 - Sergey Cab Corp."
  value: "6743 - Luhak Corp"
  value: "Blue Ribbon Taxi Association Inc."
  value: "Chicago Elite Cab Corp."
  value: "Chicago Elite Cab Corp. (Chicago Carriag"
  value: "Chicago Medallion Management"
  value: "Choice Taxi Association"
  value: "Dispatch Taxi Affiliation"
  value: "KOAM Taxi Association"
  value: "Northwest Management LLC"
  value: "Taxi Affiliation Services"
  value: "Top Cab Affiliation"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "Dispute"
  value: "No Charge"
  value: "Unknown"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-03-31 14:45:31.882384: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-03-31 14:45:31.893275: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-03-31 14:45:31.894818: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7891120 executing computations on platform Host. Devices:
2020-03-31 14:45:31.894861: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-03-31 14:45:31.908134: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 132, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200331-143827-eval_cd19d130-ee6f-4c11-8824-b6d8cdd4b0c2 failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 33s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/yvutbcx6i2lrg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_Chicago_Taxi_Flink #80

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/80/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #79

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/79/display/redirect?page=changes>

Changes:

[ehudm] [BEAM-5422] Document DynamicDestinations.getTable uniqueness requirement

[github] Merge pull request #11226: [BEAM-9557] Fix timer window boundary

[github] Merge pull request #11244 from [BEAM-3097] _ReadFromBigQuery supports

[pabloem] [BEAM-9691] Ensuring BQSource is avoided on FnApi

[pabloem] [BEAM-9715] Ensuring annotations_test passes in all

[github] Name the pipeline_v1 proto import

[github] Update materialize_test.go

[ankurgoenka] [BEAM-9707] Hardcode Unified harness image for fixing dataflow VR 2

[rohde.samuel] Fix flaky interactive_runner_test

[github] Merge pull request #11205 [BEAM-9578] Defer expensive artifact

[robertwb] Update go protos.

[github] Fix some Go SDK linter/vet warnings. (#11330)

[robertwb] [BEAM-9577] Plumb resources through Python job service and runner.

[robertwb] [BEAM-9618] Pull bundle descriptors for Go.

[github] [BEAM-9529] Remove datastore.v1, googledatastore (#11175)

[github] [BEAM-9147] Add a VideoIntelligence transform to Java SDK (#11261)


------------------------------------------
[...truncated 153.63 KB...]
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_month"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_miles"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "dropoff_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "1085 - N and W Cab Co"
  value: "2192 - Zeymane Corp"
  value: "2241 - Manuel Alonso"
  value: "2733 - Benny Jona"
  value: "3201 - CID Cab Co Inc"
  value: "3319 - C&D Cab Company"
  value: "3620 - David K. Cab Corp."
  value: "3897 - Ilie Malec"
  value: "4053 - Adwar H. Nikola"
  value: "4615 - Tyrone Henderson"
  value: "4787 - Reny Cab Co"
  value: "5437 - Great American Cab Co"
  value: "5776 - Mekonen Cab Company"
  value: "5874 - Sergey Cab Corp."
  value: "6743 - Luhak Corp"
  value: "Blue Ribbon Taxi Association Inc."
  value: "Chicago Elite Cab Corp."
  value: "Chicago Elite Cab Corp. (Chicago Carriag"
  value: "Chicago Medallion Management"
  value: "Choice Taxi Association"
  value: "Dispatch Taxi Affiliation"
  value: "KOAM Taxi Association"
  value: "Northwest Management LLC"
  value: "Taxi Affiliation Services"
  value: "Top Cab Affiliation"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "Dispute"
  value: "No Charge"
  value: "Unknown"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1632: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-04-08 15:00:19.020263: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-08 15:00:19.030629: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-04-08 15:00:19.032151: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7350720 executing computations on platform Host. Devices:
2020-04-08 15:00:19.032187: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-08 15:00:19.045202: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 132, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200408-145302-eval_4feb555a-4efa-4d39-aefa-27e59f1474c7 failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 14s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/t4qz5wyaubpig

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #78

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/78/display/redirect?page=changes>

Changes:

[echauchot] [BEAM-5980] Change load-tests build to include spark-sql for spark

[echauchot] [BEAM-9436] avoid one flatmap step and a KV creation per element by

[kcweaver] [BEAM-9199] Require Dataflow --region in Python SDK.

[kcweaver] Add --region to tests where needed.

[kcweaver] [BEAM-9199] Require --region option for Dataflow in Java SDK.

[kcweaver] Add --region to Java GCP tests.

[kcweaver] Fix DataflowRunnerTest.

[kcweaver] Fix more Java unit tests missing --region.

[kcweaver] Add --region to DF streaming example tests.

[kcweaver] Add unit tests for get_default_gcp_region

[kcweaver] Add --region to Dataflow runner webpage.

[kcweaver] lint

[kcweaver] Add --region to more Java tests and examples.

[kcweaver] Add --region to more Python tests and examples.

[kcweaver] format

[valentyn] Fixes platform-dependent assumptions in subprocess_server_test.py.

[valentyn] Switches a test helper to a Py3-version thereof.

[alex] Add Beam Schema Options to changelog

[alex] [BEAM-9704] Deprecate FieldType metadata

[eekkaaadrian] [BEAM-9705] Go sdk add value length validation checking on write to

[kcweaver] Remove unrecognized --region option from non-DF tests.

[robertwb] [BEAM-9618] Add protocol for requesting process bundle descriptors.

[robertwb] [BEAM-9618] Update Python to support process bundle descriptor fetching.

[robertwb] [BEAM-9618] Java FnApiClient support for process bundle descriptor

[github] [BEAM-8019] Python SDK support for cross-langauge pipelines in Dataflow.

[robertwb] Typo fix.

[github] remove nose (#11307)

[lcwik] [BEAM-4374, BEAM-6189] Delete and remove deprecated Metrics proto

[ecapoccia] [BEAM-9434] Improve Spark runner reshuffle translation to maximize

[github] [BEAM-9685] remove Go SDK container from release process (#11308)


------------------------------------------
[...truncated 166.13 KB...]
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  string_domain {
    name: "company"
    value: "0118 - 42111 Godfrey S.Awir"
    value: "0694 - 59280 Chinesco Trans Inc"
    value: "1085 - 72312 N and W Cab Co"
    value: "1247 - 72807 Daniel Ayertey"
    value: "1408 - 89599 Donald Barnes"
    value: "2092 - 61288 Sbeih company"
    value: "2192 - 73487 Zeymane Corp"
    value: "2241 - 44667 Manuel Alonso"
    value: "24 Seven Taxi"
    value: "2733 - 74600 Benny Jona"
    value: "2823 - 73307 Seung Lee"
    value: "3011 - 66308 JBL Cab Inc."
    value: "3094 - 24059 G.L.B. Cab Co"
    value: "3141 - 87803 Zip Cab"
    value: "3141 - Zip Cab"
    value: "3152 - 97284 Crystal Abernathy"
    value: "3201 - C&D Cab Co Inc"
    value: "3201 - CD Cab Co Inc"
    value: "3253 - 91138 Gaither Cab Co."
    value: "3385 -  Eman Cab"
    value: "3385 - 23210  Eman Cab"
    value: "3385 - 23210 Eman Cab"
    value: "3556 - 36214 RC Andrews Cab"
    value: "3591- 63480 Chuk\'s Cab"
    value: "3620 - 52292 David K. Cab Corp."
    value: "3623 - 72222 Arrington Enterprises"
    value: "3669 - 85800 Jordan Taxi Inc"
    value: "3897 - 57856 Ilie Malec"
    value: "4053 - 40193 Adwar H. Nikola"
    value: "4197 - 41842 Royal Star"
    value: "4615 - 83503 Tyrone Henderson"
    value: "4623 - 27290 Jay Kim"
    value: "5006 - 39261 Salifu Bawa"
    value: "5062 - 34841 Sam Mestas"
    value: "5074 - 54002 Ahzmi Inc"
    value: "5129 - 87128"
    value: "5129 - 98755 Mengisti Taxi"
    value: "5724 - 72965 KYVI Cab Inc"
    value: "5724 - 75306 KYVI Cab Inc"
    value: "585 - 88805 Valley Cab Co"
    value: "5864 - 73614 Thomas Owusu"
    value: "5874 - 73628 Sergey Cab Corp."
    value: "5997 - 65283 AW Services Inc."
    value: "6057 - 24657 Richard Addo"
    value: "6488 - 83287 Zuha Taxi"
    value: "6574 - Babylon Express Inc."
    value: "6742 - 83735 Tasha ride inc"
    value: "6743 - 78771 Luhak Corp"
    value: "6747 - Mueen Abdalla"
    value: "Blue Ribbon Taxi Association Inc."
    value: "Chicago Carriage Cab Corp"
    value: "Chicago Elite Cab Corp. (Chicago Carriag"
    value: "Chicago Independents"
    value: "Chicago Medallion Leasing INC"
    value: "Chicago Medallion Management"
    value: "Choice Taxi Association"
    value: "City Service"
    value: "Dispatch Taxi Affiliation"
    value: "Flash Cab"
    value: "KOAM Taxi Association"
    value: "Medallion Leasin"
    value: "Northwest Management LLC"
    value: "Suburban Dispatch LLC"
    value: "Sun Taxi"
    value: "Taxi Affiliation Services"
    value: "Taxicab Insurance Agency, LLC"
    value: "Top Cab Affiliation"
  }
  string_domain {
    name: "payment_type"
    value: "Cash"
    value: "Credit Card"
    value: "Dispute"
    value: "No Charge"
    value: "Unknown"
  }
}
anomaly_info {
  key: "company"
  value {
    description: "Examples contain values missing from the schema: 2809 - 95474 C & D Cab Co Inc. (<1%), Nova Taxi Affiliation Llc (<1%), Star North Management LLC (<1%), Taxi Affiliation Service Yellow (<1%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: 2809 - 95474 C & D Cab Co Inc. (<1%), Nova Taxi Affiliation Llc (<1%), Star North Management LLC (<1%), Taxi Affiliation Service Yellow (<1%). "
    }
    path {
      step: "company"
    }
  }
}
anomaly_info {
  key: "payment_type"
  value {
    description: "Examples contain values missing from the schema: Prcard (<1%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: Prcard (<1%). "
    }
    path {
      step: "payment_type"
    }
  }
}
anomaly_info {
  key: "pickup_community_area"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "pickup_community_area"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:150: FutureWarning: _ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-04-07 14:51:12.002344: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-07 14:51:12.012010: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-07 14:51:12.013248: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x71b99b0 executing computations on platform Host. Devices:
2020-04-07 14:51:12.013282: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-07 14:51:12.028304: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200407-143724/chicago_taxi_output/tft_output/tftransform_tmp/02a1dbaf13154fe38defd3536c39d4b8/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200407-143724/chicago_taxi_output/tft_output/tftransform_tmp/02a1dbaf13154fe38defd3536c39d4b8/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200407-143724/chicago_taxi_output/tft_output/tftransform_tmp/9ec954969cfb4b769b7902298346c188/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200407-143724/chicago_taxi_output/tft_output/tftransform_tmp/9ec954969cfb4b769b7902298346c188/saved_model.pb
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "preprocess.py", line 254, in <module>
    main()
  File "preprocess.py", line 250, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 183, in transform_data
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200407-143724_ac4e31de-9614-4cf5-9481-1ee312f993ad failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 45s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/m66noe4vpsfxq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #77

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/77/display/redirect?page=changes>

Changes:

[kcweaver] [BEAM-9509] Improve error message for bad job server URL.

[mxm] [BEAM-8201] Cleanup FnServices from DockerEnvironmentFactory and

[iemejia] [website] Update information about Beam's LTS policy


------------------------------------------
[...truncated 155.48 KB...]
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "0118 - 42111 Godfrey S.Awir"
  value: "0694 - 59280 Chinesco Trans Inc"
  value: "1085 - 72312 N and W Cab Co"
  value: "1247 - 72807 Daniel Ayertey"
  value: "1408 - 89599 Donald Barnes"
  value: "2092 - 61288 Sbeih company"
  value: "2192 - 73487 Zeymane Corp"
  value: "2241 - 44667 Manuel Alonso"
  value: "24 Seven Taxi"
  value: "2733 - 74600 Benny Jona"
  value: "2823 - 73307 Seung Lee"
  value: "3011 - 66308 JBL Cab Inc."
  value: "3094 - 24059 G.L.B. Cab Co"
  value: "3141 - 87803 Zip Cab"
  value: "3141 - Zip Cab"
  value: "3152 - 97284 Crystal Abernathy"
  value: "3201 - C&D Cab Co Inc"
  value: "3201 - CD Cab Co Inc"
  value: "3253 - 91138 Gaither Cab Co."
  value: "3385 -  Eman Cab"
  value: "3385 - 23210  Eman Cab"
  value: "3385 - 23210 Eman Cab"
  value: "3556 - 36214 RC Andrews Cab"
  value: "3591- 63480 Chuk\'s Cab"
  value: "3620 - 52292 David K. Cab Corp."
  value: "3623 - 72222 Arrington Enterprises"
  value: "3669 - 85800 Jordan Taxi Inc"
  value: "3897 - 57856 Ilie Malec"
  value: "4053 - 40193 Adwar H. Nikola"
  value: "4197 - 41842 Royal Star"
  value: "4615 - 83503 Tyrone Henderson"
  value: "4623 - 27290 Jay Kim"
  value: "5006 - 39261 Salifu Bawa"
  value: "5062 - 34841 Sam Mestas"
  value: "5074 - 54002 Ahzmi Inc"
  value: "5129 - 87128"
  value: "5129 - 98755 Mengisti Taxi"
  value: "5724 - 72965 KYVI Cab Inc"
  value: "5724 - 75306 KYVI Cab Inc"
  value: "585 - 88805 Valley Cab Co"
  value: "5864 - 73614 Thomas Owusu"
  value: "5874 - 73628 Sergey Cab Corp."
  value: "5997 - 65283 AW Services Inc."
  value: "6057 - 24657 Richard Addo"
  value: "6488 - 83287 Zuha Taxi"
  value: "6574 - Babylon Express Inc."
  value: "6742 - 83735 Tasha ride inc"
  value: "6743 - 78771 Luhak Corp"
  value: "6747 - Mueen Abdalla"
  value: "Blue Ribbon Taxi Association Inc."
  value: "Chicago Carriage Cab Corp"
  value: "Chicago Elite Cab Corp. (Chicago Carriag"
  value: "Chicago Independents"
  value: "Chicago Medallion Leasing INC"
  value: "Chicago Medallion Management"
  value: "Choice Taxi Association"
  value: "City Service"
  value: "Dispatch Taxi Affiliation"
  value: "Flash Cab"
  value: "KOAM Taxi Association"
  value: "Medallion Leasin"
  value: "Northwest Management LLC"
  value: "Suburban Dispatch LLC"
  value: "Sun Taxi"
  value: "Taxi Affiliation Services"
  value: "Taxicab Insurance Agency, LLC"
  value: "Top Cab Affiliation"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "Dispute"
  value: "No Charge"
  value: "Unknown"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-04-06 14:42:57.592050: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-06 14:42:57.602120: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-06 14:42:57.603679: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8201f20 executing computations on platform Host. Devices:
2020-04-06 14:42:57.603711: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-06 14:42:57.616740: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 132, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200406-143539-eval_39f717f1-bd9f-4b7b-be03-65797847eb72 failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 34s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/iplnpidjit5s2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #76

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/76/display/redirect?page=changes>

Changes:

[robertwb] ResolveArtifact -> ResolveArtifacts

[robertwb] Regenerate protos.

[github] Merge pull request #11259: Use attachValues in SQL


------------------------------------------
[...truncated 171.40 KB...]
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: Prcard (<1%). "
    }
    path {
      step: "payment_type"
    }
  }
}
anomaly_info {
  key: "pickup_community_area"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "pickup_community_area"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:150: FutureWarning: _ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-04-05 20:17:43.391097: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-05 20:17:43.400826: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-05 20:17:43.402261: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x84cc720 executing computations on platform Host. Devices:
2020-04-05 20:17:43.402296: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-05 20:17:43.417635: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200405-200341/chicago_taxi_output/tft_output/tftransform_tmp/4906f06119754799a7c1595ad2b59f68/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200405-200341/chicago_taxi_output/tft_output/tftransform_tmp/4906f06119754799a7c1595ad2b59f68/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200405-200341/chicago_taxi_output/tft_output/tftransform_tmp/4d2ea15075ec4bdfa0ccad620ff2375b/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200405-200341/chicago_taxi_output/tft_output/tftransform_tmp/4d2ea15075ec4bdfa0ccad620ff2375b/saved_model.pb
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.RuntimeException: Error received from SDK harness for instruction 98: Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in _execute
    response = task()
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 296, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 465, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 500, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in process_bundle
    input_op_by_transform_id[data.transform_id].process_encoded(data.data)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 217, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 331, in apache_beam.runners.worker.operations.Operation.output
    def output(self, windowed_value, output_index=0):
  File "apache_beam/runners/worker/operations.py", line 333, in apache_beam.runners.worker.operations.Operation.output
    cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 196, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
    self.consumer.process(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 688, in apache_beam.runners.worker.operations.DoOperation.process
    with self.scoped_process_state:
  File "apache_beam/runners/worker/operations.py", line 689, in apache_beam.runners.worker.operations.DoOperation.process
    delayed_application = self.dofn_runner.process(o)
  File "apache_beam/runners/common.py", line 956, in apache_beam.runners.common.DoFnRunner.process
    self._reraise_augmented(exn)
  File "apache_beam/runners/common.py", line 1037, in apache_beam.runners.common.DoFnRunner._reraise_augmented
    raise_with_traceback(new_exn)
  File "apache_beam/runners/common.py", line 954, in apache_beam.runners.common.DoFnRunner.process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "apache_beam/runners/common.py", line 724, in apache_beam.runners.common.PerWindowInvoker.invoke_process
    self._invoke_process_per_window(
  File "apache_beam/runners/common.py", line 751, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
    [si[global_window] for si in self.side_inputs]))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 374, in __getitem__
    self._cache[target_window] = self._side_input_data.view_fn(raw_view)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/pvalue.py",> line 394, in <lambda>
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/pvalue.py",> line 506, in _from_runtime_iterable
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 974, in _lazy_iterator
    self._underlying.get_raw(state_key, continuation_token))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 809, in get_raw
    continuation_token=continuation_token)))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 844, in _blocking_request
    raise_(t, v, tb)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 782, in pull_responses
    for response in responses:
  File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 391, in next
    return self._next()
  File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 382, in _next
    raise self
RuntimeError: _Rendezvous: <_Rendezvous of RPC that terminated with:
	status = StatusCode.UNKNOWN
	details = ""
	debug_error_string = "{"created":"@1586118086.689559770","description":"Error received from peer ipv6:[::1]:41439","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"","grpc_status":2}"
> [while running 'Transform/Transform']

Traceback (most recent call last):
  File "preprocess.py", line 254, in <module>
    main()
  File "preprocess.py", line 250, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 183, in transform_data
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200405-200341_ca9615d9-f21a-42ef-96d4-ab2042f6dfc0 failed in state FAILED: java.lang.RuntimeException: Error received from SDK harness for instruction 98: Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in _execute
    response = task()
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 296, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 465, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 500, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in process_bundle
    input_op_by_transform_id[data.transform_id].process_encoded(data.data)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 217, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 331, in apache_beam.runners.worker.operations.Operation.output
    def output(self, windowed_value, output_index=0):
  File "apache_beam/runners/worker/operations.py", line 333, in apache_beam.runners.worker.operations.Operation.output
    cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 196, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
    self.consumer.process(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 688, in apache_beam.runners.worker.operations.DoOperation.process
    with self.scoped_process_state:
  File "apache_beam/runners/worker/operations.py", line 689, in apache_beam.runners.worker.operations.DoOperation.process
    delayed_application = self.dofn_runner.process(o)
  File "apache_beam/runners/common.py", line 956, in apache_beam.runners.common.DoFnRunner.process
    self._reraise_augmented(exn)
  File "apache_beam/runners/common.py", line 1037, in apache_beam.runners.common.DoFnRunner._reraise_augmented
    raise_with_traceback(new_exn)
  File "apache_beam/runners/common.py", line 954, in apache_beam.runners.common.DoFnRunner.process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "apache_beam/runners/common.py", line 724, in apache_beam.runners.common.PerWindowInvoker.invoke_process
    self._invoke_process_per_window(
  File "apache_beam/runners/common.py", line 751, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
    [si[global_window] for si in self.side_inputs]))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 374, in __getitem__
    self._cache[target_window] = self._side_input_data.view_fn(raw_view)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/pvalue.py",> line 394, in <lambda>
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/pvalue.py",> line 506, in _from_runtime_iterable
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 974, in _lazy_iterator
    self._underlying.get_raw(state_key, continuation_token))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 809, in get_raw
    continuation_token=continuation_token)))
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 844, in _blocking_request
    raise_(t, v, tb)
  File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 782, in pull_responses
    for response in responses:
  File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 391, in next
    return self._next()
  File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 382, in _next
    raise self
RuntimeError: _Rendezvous: <_Rendezvous of RPC that terminated with:
	status = StatusCode.UNKNOWN
	details = ""
	debug_error_string = "{"created":"@1586118086.689559770","description":"Error received from peer ipv6:[::1]:41439","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"","grpc_status":2}"
> [while running 'Transform/Transform']


> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19m 29s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/yn62enttv5txe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #75

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/75/display/redirect?page=changes>

Changes:

[iemejia] [BEAM-9686] Get default TmpCheckpointDir value from PipelineOptions

[spoorti] [BEAM-9660]: Add an explicit check for integer overflow.

[boyuanz] Populate source data from SDF

[boyuanz] Update Timer encoding

[robertwb] [BEAM-9577] Update container boot code to stage from dependencies, if

[rohde.samuel] Change delimeter to a dash as it is a reserved symbol in Windows

[github] Apply suggestions from code review

[robertwb] Use pointer recievers.

[aldaircr] Change: Fixing typos on javadoc


------------------------------------------
[...truncated 155.28 KB...]
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "0118 - 42111 Godfrey S.Awir"
  value: "0694 - 59280 Chinesco Trans Inc"
  value: "1085 - 72312 N and W Cab Co"
  value: "1247 - 72807 Daniel Ayertey"
  value: "1408 - 89599 Donald Barnes"
  value: "2092 - 61288 Sbeih company"
  value: "2192 - 73487 Zeymane Corp"
  value: "2241 - 44667 Manuel Alonso"
  value: "24 Seven Taxi"
  value: "2733 - 74600 Benny Jona"
  value: "2823 - 73307 Seung Lee"
  value: "3011 - 66308 JBL Cab Inc."
  value: "3094 - 24059 G.L.B. Cab Co"
  value: "3141 - 87803 Zip Cab"
  value: "3141 - Zip Cab"
  value: "3152 - 97284 Crystal Abernathy"
  value: "3201 - C&D Cab Co Inc"
  value: "3201 - CD Cab Co Inc"
  value: "3253 - 91138 Gaither Cab Co."
  value: "3385 -  Eman Cab"
  value: "3385 - 23210  Eman Cab"
  value: "3385 - 23210 Eman Cab"
  value: "3556 - 36214 RC Andrews Cab"
  value: "3591- 63480 Chuk\'s Cab"
  value: "3620 - 52292 David K. Cab Corp."
  value: "3623 - 72222 Arrington Enterprises"
  value: "3669 - 85800 Jordan Taxi Inc"
  value: "3897 - 57856 Ilie Malec"
  value: "4053 - 40193 Adwar H. Nikola"
  value: "4197 - 41842 Royal Star"
  value: "4615 - 83503 Tyrone Henderson"
  value: "4623 - 27290 Jay Kim"
  value: "5006 - 39261 Salifu Bawa"
  value: "5062 - 34841 Sam Mestas"
  value: "5074 - 54002 Ahzmi Inc"
  value: "5129 - 87128"
  value: "5129 - 98755 Mengisti Taxi"
  value: "5724 - 72965 KYVI Cab Inc"
  value: "5724 - 75306 KYVI Cab Inc"
  value: "585 - 88805 Valley Cab Co"
  value: "5864 - 73614 Thomas Owusu"
  value: "5874 - 73628 Sergey Cab Corp."
  value: "5997 - 65283 AW Services Inc."
  value: "6057 - 24657 Richard Addo"
  value: "6488 - 83287 Zuha Taxi"
  value: "6574 - Babylon Express Inc."
  value: "6742 - 83735 Tasha ride inc"
  value: "6743 - 78771 Luhak Corp"
  value: "6747 - Mueen Abdalla"
  value: "Blue Ribbon Taxi Association Inc."
  value: "Chicago Carriage Cab Corp"
  value: "Chicago Elite Cab Corp. (Chicago Carriag"
  value: "Chicago Independents"
  value: "Chicago Medallion Leasing INC"
  value: "Chicago Medallion Management"
  value: "Choice Taxi Association"
  value: "City Service"
  value: "Dispatch Taxi Affiliation"
  value: "Flash Cab"
  value: "KOAM Taxi Association"
  value: "Medallion Leasin"
  value: "Northwest Management LLC"
  value: "Suburban Dispatch LLC"
  value: "Sun Taxi"
  value: "Taxi Affiliation Services"
  value: "Taxicab Insurance Agency, LLC"
  value: "Top Cab Affiliation"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "Dispute"
  value: "No Charge"
  value: "Unknown"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-04-04 14:42:05.381897: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-04 14:42:05.392156: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-04 14:42:05.393749: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x83f8920 executing computations on platform Host. Devices:
2020-04-04 14:42:05.393781: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-04 14:42:05.406198: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 132, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200404-143502-eval_60081e7f-6620-47a3-8e2b-49a141d5a2f8 failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 55s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/lqjwxu4rmhky4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #74

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/74/display/redirect?page=changes>

Changes:

[valentyn] Fix a Py2/3 incompatibility in profiler.

[ameihm] [BEAM-9476] KinesisIO retry LimitExceededException

[github] [BEAM-7923] An indicator of progress in notebooks (#11276)

[robertwb] [BEAM-9577] Add dependency information to provision info.

[robertwb] Update go protos.

[lcwik] [BEAM-9677] Fix path -> url typo in ArtifactUrlPayload

[lcwik] [BEAM-9562] Update missed TimerSpec conversion in Go SDK

[github] [BEAM-9667] Allow metrics in DoFn Setup (#11287)

[github] [BEAM-9624] Adds Convert to Accumulators operator for use in combiner

[github] Fix minor typo

[github] Fix minor typo

[github] Merge pull request #11290: [BEAM-9670] Fix nullability widening in

[github] [BEAM-4374] Short IDs for the Python SDK (#11286)

[github] [BEAM-9136]Add licenses for dependencies for Python (#11067)

[mxm] [BEAM-9645] Fix premature removal of Docker container and logs

[alex] [BEAM-9044] Protobuf options to Schema options


------------------------------------------
[...truncated 158.71 KB...]
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "company"
  value: "0694 - 59280 Chinesco Trans Inc"
  value: "1085 - 72312 N and W Cab Co"
  value: "1247 - 72807 Daniel Ayertey"
  value: "2092 - 61288 Sbeih company"
  value: "2192 - 73487 Zeymane Corp"
  value: "24 Seven Taxi"
  value: "2733 - 74600 Benny Jona"
  value: "3011 - 66308 JBL Cab Inc."
  value: "3094 - 24059 G.L.B. Cab Co"
  value: "312 Medallion Management Corp"
  value: "3141 - 87803 Zip Cab"
  value: "3152 - 97284 Crystal Abernathy"
  value: "3201 - C&D Cab Co Inc"
  value: "3201 - CD Cab Co Inc"
  value: "3623 - 72222 Arrington Enterprises"
  value: "3669 - 85800 Jordan Taxi Inc"
  value: "4197 - 41842 Royal Star"
  value: "4615 - 83503 Tyrone Henderson"
  value: "4623 - 27290 Jay Kim"
  value: "5 Star Taxi"
  value: "5006 - 39261 Salifu Bawa"
  value: "5062 - 34841 Sam Mestas"
  value: "5074 - 54002 Ahzmi Inc"
  value: "5129 - 87128"
  value: "5724 - 75306 KYVI Cab Inc"
  value: "585 - 88805 Valley Cab Co"
  value: "5997 - 65283 AW Services Inc."
  value: "6574 - Babylon Express Inc."
  value: "6742 - 83735 Tasha ride inc"
  value: "6743 - 78771 Luhak Corp"
  value: "6747 - Mueen Abdalla"
  value: "American United"
  value: "American United Taxi Affiliation"
  value: "Blue Diamond"
  value: "Blue Ribbon Taxi Association Inc."
  value: "Checker Taxi"
  value: "Checker Taxi Affiliation"
  value: "Chicago Carriage Cab Corp"
  value: "Chicago Elite Cab Corp. (Chicago Carriag"
  value: "Chicago Independents"
  value: "Chicago Medallion Leasing INC"
  value: "Chicago Medallion Management"
  value: "Chicago Star Taxicab"
  value: "Chicago Taxicab"
  value: "Choice Taxi Association"
  value: "City Service"
  value: "Dispatch Taxi Affiliation"
  value: "Flash Cab"
  value: "Globe Taxi"
  value: "Gold Coast Taxi"
  value: "KOAM Taxi Association"
  value: "Leonard Cab Co"
  value: "Medallion Leasin"
  value: "Metro Jet Taxi A"
  value: "Norshore Cab"
  value: "Northwest Management LLC"
  value: "Nova Taxi Affiliation Llc"
  value: "Patriot Taxi Dba Peace Taxi Associat"
  value: "Peace Taxi Assoc"
  value: "Service Taxi Association"
  value: "Setare Inc"
  value: "Star North Management LLC"
  value: "Suburban Dispatch LLC"
  value: "Sun Taxi"
  value: "Taxi Affiliation Service Yellow"
  value: "Taxi Affiliation Services"
  value: "Taxicab Insurance Agency, LLC"
  value: "Top Cab Affiliation"
  value: "Yellow Cab"
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "Dispute"
  value: "Mobile"
  value: "No Charge"
  value: "Pcard"
  value: "Prcard"
  value: "Unknown"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-04-03 14:43:27.304063: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-03 14:43:27.314287: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-03 14:43:27.315628: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x79e5380 executing computations on platform Host. Devices:
2020-04-03 14:43:27.315660: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-03 14:43:27.327856: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 132, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200403-143615-eval_7ff42a81-e44b-474a-a3cc-f6171cdddb2b failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 11s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/hyguiiqnnxygm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #73

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/73/display/redirect?page=changes>

Changes:

[zyichi] Update BigQuery source in bigquery_tornadoes example

[rohde.samuel] Add dependency comment in streaming cache

[ehudm] [BEAM-1894] Remove obsolete EagerRunner test

[robertwb] [BEAM-9340] Populate requirement for timer families.

[pabloem] Revert "Merge pull request #11104 from y1chi/update_tornado_test"

[daniel.o.programmer] [BEAM-9642] Create runtime invokers for SDF methods.

[lcwik] [BEAM-9668] Disable tests till Dataflow containers are updated.

[github] [BEAM-9652] Ensure that the multipartition write sets the correct coder

[github] [BEAM-8889]add experiment flag use_grpc_for_gcs (#11183)


------------------------------------------
[...truncated 158.42 KB...]
    min_count: 1
  }
}
feature {
  name: "dropoff_census_tract"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "trip_start_timestamp"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "pickup_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_start_month"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_miles"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_longitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_community_area"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  int_domain {
  }
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "payment_type"
  value_count {
    min: 1
    max: 1
  }
  type: BYTES
  domain: "payment_type"
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "trip_seconds"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_count: 1
  }
}
feature {
  name: "trip_start_day"
  value_count {
    min: 1
    max: 1
  }
  type: INT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "tips"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_count: 1
  }
}
feature {
  name: "pickup_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
feature {
  name: "dropoff_latitude"
  value_count {
    min: 1
    max: 1
  }
  type: FLOAT
  presence {
    min_fraction: 1.0
    min_count: 1
  }
}
string_domain {
  name: "payment_type"
  value: "Cash"
  value: "Credit Card"
  value: "Pcard"
  value: "Prcard"
}

Writing schema to output path.
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-04-02 14:43:33.818510: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-02 14:43:33.829061: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-02 14:43:33.830791: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x89e1d90 executing computations on platform Host. Devices:
2020-04-02 14:43:33.830825: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-02 14:43:33.844861: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

ERROR:root:java.lang.OutOfMemoryError: Metaspace
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 132, in compute_stats
    result.wait_until_finish()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 550, in wait_until_finish
    (self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline chicago-taxi-tfdv-20200402-143630-eval_9314220a-c479-4096-9a63-0e4b99b55f7c failed in state FAILED: java.lang.OutOfMemoryError: Metaspace

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 24s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/rmkiu7fylicam

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Flink #72

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/72/display/redirect?page=changes>

Changes:

[zyichi] [BEAM-9263] Bump up python sdk dataflow environment major versions

[jozsi] Update Jet version to 4.0

[kyoungha] [BEAM-9325] Added Proper Write Method in UnownedOutputStream

[kyoungha] fix format warning

[kcweaver] [BEAM-9638] Strengthen worker region & zone options tests.

[samuelw] [BEAM-9399] Change the redirection of System.err to be a custom

[kyoungha] [BEAM-9325] reflect comment : inline testing methods

[boyuanz] [BEAM-9454] Add Deduplication PTransform

[robertwb] [BEAM-9577] Rename the Artifact{Staging,Retrieval}Service.

[robertwb] [BEAM-9577] Define the new Artifact{Staging,Retrieval}Service.

[robertwb] [BEAM-9577] Regenerate protos.

[jozsi] Update Jet Runner web page with info about 4.0

[jozsi] Add Beam-Jet compatibility table

[robertwb] [BEAM-9577] Implement the new Artifact{Staging,Retrieval}Services in

[samuelw] Fix missing test import

[kyoungha] [BEAM-9325] reflect comment : Fix JAXBCoder + change test

[chamikara] Refactors X-Lang test pipelines.

[pabloem] [BEAM-9608] Increase reliance on Context Managers for FnApiRunner


------------------------------------------
[...truncated 120.81 KB...]
  Using cached terminado-0.8.3-py2.py3-none-any.whl (33 kB)
Collecting ipython-genutils
  Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB)
Processing /home/jenkins/.cache/pip/wheels/8e/28/49/fad4e7f0b9a1227708cbbee4487ac8558a7334849cb81c813d/absl_py-0.9.0-cp27-none-any.whl
Collecting backports.weakref>=1.0rc1
  Using cached backports.weakref-1.0.post1-py2.py3-none-any.whl (5.2 kB)
Collecting tensorflow-estimator<1.15.0rc0,>=1.14.0rc0
  Using cached tensorflow_estimator-1.14.0-py2.py3-none-any.whl (488 kB)
Requirement already satisfied: grpcio>=1.8.6 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.27.2)
Collecting tensorboard<1.15.0,>=1.14.0
  Using cached tensorboard-1.14.0-py2-none-any.whl (3.1 MB)
Processing /home/jenkins/.cache/pip/wheels/dd/f2/5d/2689b5547f32c4e258c3b7ccbe7f1d0f2afbb84fb01e830792/Keras_Applications-1.0.8-cp27-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/5b/d8/8e/81a83cb5321b940a954996f5b57fddc8976e712b3ac3a1a54b/wrapt-1.12.1-cp27-cp27mu-linux_x86_64.whl
Requirement already satisfied: protobuf>=3.6.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (3.11.3)
Collecting google-pasta>=0.1.6
  Using cached google_pasta-0.2.0-py2-none-any.whl (57 kB)
Collecting keras-preprocessing>=1.0.5
  Using cached Keras_Preprocessing-1.1.0-py2.py3-none-any.whl (41 kB)
Requirement already satisfied: mock>=2.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (2.0.0)
Requirement already satisfied: numpy<2.0,>=1.14.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.16.6)
Requirement already satisfied: six>=1.10.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.14.0)
Requirement already satisfied: wheel in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (0.34.2)
Collecting astor>=0.6.0
  Using cached astor-0.8.1-py2.py3-none-any.whl (27 kB)
Requirement already satisfied: enum34>=1.1.6 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.1.10)
Processing /home/jenkins/.cache/pip/wheels/7c/06/54/bc84598ba1daf8f970247f550b175aaaee85f68b4b0c5ab2c6/termcolor-1.1.0-cp27-none-any.whl
Collecting gast>=0.2.0
  Using cached gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting scikit-learn<1,>=0.18
  Using cached scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl (5.5 MB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.21.0.dev0)
Collecting joblib<1,>=0.12
  Using cached joblib-0.14.1-py2.py3-none-any.whl (294 kB)
Collecting IPython>=5.0
  Using cached ipython-5.9.0-py2-none-any.whl (760 kB)
Requirement already satisfied: pandas<1,>=0.18 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.24.2)
Requirement already satisfied: googleapis-common-protos in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorflow-metadata<0.14,>=0.13.0->-r requirements.txt (line 21)) (1.51.0)
Collecting scipy==1.1.0
  Using cached scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8 MB)
Processing /home/jenkins/.cache/pip/wheels/6a/a5/14/25541ebcdeaf97a37b6d05c7ff15f5bd20f5e91b99d313e5b4/pydot-1.2.4-cp27-none-any.whl
Collecting qtpy
  Using cached QtPy-1.9.0-py2.py3-none-any.whl (54 kB)
Collecting pygments
  Using cached Pygments-2.5.2-py2.py3-none-any.whl (896 kB)
Collecting widgetsnbextension~=3.5.0
  Using cached widgetsnbextension-3.5.1-py2.py3-none-any.whl (2.2 MB)
Collecting prompt-toolkit<2.0.0,>=1.0.0
  Using cached prompt_toolkit-1.0.18-py2-none-any.whl (245 kB)
Collecting mistune<2,>=0.8.1
  Using cached mistune-0.8.4-py2.py3-none-any.whl (16 kB)
Collecting defusedxml
  Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Collecting entrypoints>=0.2.2
  Using cached entrypoints-0.3-py2.py3-none-any.whl (11 kB)
Collecting bleach
  Downloading bleach-3.1.4-py2.py3-none-any.whl (151 kB)
Processing /home/jenkins/.cache/pip/wheels/39/01/56/f1b08a6275acc59e846fa4c1e1b65dbc1919f20157d9e66c20/pandocfilters-1.4.2-cp27-none-any.whl
Collecting testpath
  Using cached testpath-0.4.4-py2.py3-none-any.whl (163 kB)
Collecting jsonschema!=2.5.0,>=2.4
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Collecting decorator
  Using cached decorator-4.4.2-py2.py3-none-any.whl (9.2 kB)
Collecting MarkupSafe>=0.23
  Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Requirement already satisfied: python-dateutil>=2.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from jupyter-client>=5.2.0->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (2.8.1)
Collecting backports-abc>=0.4
  Using cached backports_abc-0.5-py2.py3-none-any.whl (5.2 kB)
Requirement already satisfied: singledispatch in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.4.0.3)
Requirement already satisfied: futures in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.3.0)
Collecting ptyprocess; os_name != "nt"
  Using cached ptyprocess-0.6.0-py2.py3-none-any.whl (39 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.1.1-py2.py3-none-any.whl (87 kB)
Requirement already satisfied: setuptools>=41.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (44.1.0)
Collecting werkzeug>=0.11.15
  Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting h5py
  Using cached h5py-2.10.0-cp27-cp27mu-manylinux1_x86_64.whl (2.8 MB)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (5.4.4)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (1.0.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.5.8)
Requirement already satisfied: avro<1.10.0,>=1.8.1; python_version < "3.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.9.2)
Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.12.0)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.0)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.1)
Requirement already satisfied: typing<3.8.0,>=3.7.0; python_version < "3.5.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.1)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.21.24)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.10.1)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.16.0)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2019.3)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.3.1.1)
Requirement already satisfied: pyarrow<0.17.0,>=0.15.1; python_version >= "3.0" or platform_system != "Windows" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.16.0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8; python_version < "3.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.8)
Requirement already satisfied: cachetools<4,>=3.1.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.1.1)
Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.13.0)
Requirement already satisfied: google-cloud-core<2,>=0.28.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.2)
Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.2)
Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0; python_version < "3.0" and extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.90.4)
Requirement already satisfied: googledatastore<7.1,>=7.0.1; python_version < "3.0" and extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (7.0.2)
Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0)
Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.0)
Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.42.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.24.0)
Requirement already satisfied: google-apitools<0.5.29,>=0.5.28; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.28)
Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7.4)
Collecting backports.shutil-get-terminal-size; python_version == "2.7"
  Using cached backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl (6.5 kB)
Requirement already satisfied: pathlib2; python_version == "2.7" or python_version == "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.3.5)
Collecting pexpect; sys_platform != "win32"
  Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
Processing /home/jenkins/.cache/pip/wheels/a9/28/53/f24776b4c5bcbe91aaf1f1e247bd6fadd17191aa12fac63902/simplegeneric-0.8.1-cp27-none-any.whl
Collecting pickleshare
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->tensorflow-transform<0.14,>=0.13.0->-r requirements.txt (line 24)) (2.4.6)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from prompt-toolkit<2.0.0,>=1.0.0->jupyter-console->jupyter<2,>=1.0->-r requirements.txt (line 17)) (0.1.9)
Requirement already satisfied: configparser>=3.5; python_version == "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from entrypoints>=0.2.2->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (4.0.2)
Collecting webencodings
  Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/b5/18/32/77a1030457155606ba5e3ec3a8a57132b1a04b1c4f765177b2/functools32-3.2.3.post2-cp27-none-any.whl
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (19.3.0)
Collecting pyrsistent>=0.14.0
  Downloading pyrsistent-0.16.0.tar.gz (108 kB)
Requirement already satisfied: importlib-metadata; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.6.0)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.23.0)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (4.0)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.8)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.14.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.16.0)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.12.3)
Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.12.0)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.0)
Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from google-apitools<0.5.29,>=0.5.28; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.15)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pathlib2; python_version == "2.7" or python_version == "3.3"->IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.10.0)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.2.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2019.11.28)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.25.8)
Requirement already satisfied: monotonic>=0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from fasteners>=0.14->google-apitools<0.5.29,>=0.5.28; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.5)
Building wheels for collected packages: pyrsistent
  Building wheel for pyrsistent (setup.py): started
  Building wheel for pyrsistent (setup.py): finished with status 'done'
  Created wheel for pyrsistent: filename=pyrsistent-0.16.0-cp27-cp27mu-linux_x86_64.whl size=93321 sha256=01ea995076176de10a146c3fcae00f5ae2a2cb155b1704ff599416a1913b5f30
  Stored in directory: /home/jenkins/.cache/pip/wheels/1f/d0/6d/4eb101c505cdc5e2be006684c0b93f3095a8ac5e0cf9abb35c
Successfully built pyrsistent
Installing collected packages: decorator, ipython-genutils, traitlets, backports.shutil-get-terminal-size, ptyprocess, pexpect, prompt-toolkit, simplegeneric, pickleshare, pygments, IPython, backports-abc, tornado, pyzmq, jupyter-core, jupyter-client, ipykernel, qtpy, qtconsole, mistune, defusedxml, entrypoints, MarkupSafe, jinja2, webencodings, bleach, pandocfilters, functools32, pyrsistent, jsonschema, nbformat, testpath, nbconvert, prometheus-client, ipaddress, Send2Trash, terminado, notebook, widgetsnbextension, ipywidgets, jupyter-console, jupyter, absl-py, backports.weakref, tensorflow-estimator, markdown, werkzeug, tensorboard, h5py, keras-applications, wrapt, google-pasta, keras-preprocessing, astor, termcolor, gast, tensorflow, scipy, scikit-learn, tensorflow-metadata, joblib, pydot, tensorflow-transform, tensorflow-data-validation, tensorflow-model-analysis, tensorflow-serving-api
  Attempting uninstall: pydot
    Found existing installation: pydot 1.4.1
    Uninstalling pydot-1.4.1:
      Successfully uninstalled pydot-1.4.1
Successfully installed IPython-5.9.0 MarkupSafe-1.1.1 Send2Trash-1.5.0 absl-py-0.9.0 astor-0.8.1 backports-abc-0.5 backports.shutil-get-terminal-size-1.0.0 backports.weakref-1.0.post1 bleach-3.1.4 decorator-4.4.2 defusedxml-0.6.0 entrypoints-0.3 functools32-3.2.3.post2 gast-0.3.3 google-pasta-0.2.0 h5py-2.10.0 ipaddress-1.0.23 ipykernel-4.10.1 ipython-genutils-0.2.0 ipywidgets-7.5.1 jinja2-2.11.1 joblib-0.14.1 jsonschema-3.2.0 jupyter-1.0.0 jupyter-client-5.3.4 jupyter-console-5.2.0 jupyter-core-4.6.3 keras-applications-1.0.8 keras-preprocessing-1.1.0 markdown-3.1.1 mistune-0.8.4 nbconvert-5.6.1 nbformat-4.4.0 notebook-5.7.8 pandocfilters-1.4.2 pexpect-4.8.0 pickleshare-0.7.5 prometheus-client-0.7.1 prompt-toolkit-1.0.18 ptyprocess-0.6.0 pydot-1.2.4 pygments-2.5.2 pyrsistent-0.16.0 pyzmq-19.0.0 qtconsole-4.7.2 qtpy-1.9.0 scikit-learn-0.20.4 scipy-1.1.0 simplegeneric-0.8.1 tensorboard-1.14.0 tensorflow-1.14.0 tensorflow-data-validation-0.13.1 tensorflow-estimator-1.14.0 tensorflow-metadata-0.13.0 tensorflow-model-analysis-0.13.2 tensorflow-serving-api-1.13.1 tensorflow-transform-0.13.0 termcolor-1.1.0 terminado-0.8.3 testpath-0.4.4 tornado-5.1.1 traitlets-4.3.3 webencodings-0.5.1 werkzeug-1.0.1 widgetsnbextension-3.5.1 wrapt-1.12.1

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample
Using GCP project: apache-beam-testing
Job output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200401-143636/chicago_taxi_output
TFDV output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200401-143636/chicago_taxi_output/tfdv_output
Starting distributed TFDV stats computation and schema generation...
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
tfdv_analyze_and_validate.py:117: FutureWarning: _ReadFromBigQuery is experimental.
  | 'ConvertToTFDVInput' >> beam.Map(
<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1618: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:948: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-04-01 14:36:42.131269: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-04-01 14:36:42.141900: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300000000 Hz
2020-04-01 14:36:42.143448: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8859ea0 executing computations on platform Host. Devices:
2020-04-01 14:36:42.143481: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-04-01 14:36:42.157356: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py>:994: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 227, in <module>
    main()
  File "tfdv_analyze_and_validate.py", line 212, in main
    project=known_args.metric_reporting_project)
  File "tfdv_analyze_and_validate.py", line 131, in compute_stats
    result = pipeline.run()
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/pipeline.py",> line 498, in run
    self._options).run(False)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/pipeline.py",> line 511, in run
    return self.runner.run_pipeline(self, self._options)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 406, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 107, in submit
    prepare_response.staging_session_token)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py",> line 204, in stage
    stager.stage_job_resources(resources, staging_location='')
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/stager.py",> line 305, in stage_job_resources
    file_path, FileSystems.join(staging_location, staged_path))
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_stager.py",> line 98, in stage_artifact
    self._artifact_staging_stub.PutArtifact(artifact_request_generator())
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py",> line 1011, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py",> line 729, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNIMPLEMENTED
	details = "Method not found: org.apache.beam.model.job_management.v1.LegacyArtifactStagingService/PutArtifact"
	debug_error_string = "{"created":"@1585751807.391901784","description":"Error received from peer ipv4:127.0.0.1:8098","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.LegacyArtifactStagingService/PutArtifact","grpc_status":12}"
>

> Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 0s
6 actionable tasks: 5 executed, 1 up-to-date

Publishing build scan...
https://gradle.com/s/a2gdlpsl54g4y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org