You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/06/10 21:51:29 UTC

Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #2

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/2/display/redirect>

Changes:


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-1 (beam) in workspace /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Chicago_Taxi_Dataflow
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
 > git init /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Chicago_Taxi_Dataflow/src # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision d5dd47b47cbdf0739ac1a28cb8fbd06becbdbae7 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d5dd47b47cbdf0739ac1a28cb8fbd06becbdbae7 # timeout=10
Commit message: "[BEAM-9679] Add CombinePerKey to Core Transforms Go Katas (#11936)"
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Chicago_Taxi_Dataflow/src/gradlew -PgcsRoot=gs://temp-storage-for-perf-tests/chicago-taxi :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample
Starting a Gradle Daemon (subsequent builds will be faster)
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy
> Task :buildSrc:spotlessGroovyCheck
> Task :buildSrc:spotlessGroovyGradle
> Task :buildSrc:spotlessGroovyGradleCheck
> Task :buildSrc:spotlessCheck
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties
> Task :buildSrc:check
> Task :buildSrc:build
Configuration on demand is an incubating feature.

> Task :sdks:python:setupVirtualenv
New python executable in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Chicago_Taxi_Dataflow/src/build/gradleenv/1922375555/bin/python2.7
Also creating executable in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Chicago_Taxi_Dataflow/src/build/gradleenv/1922375555/bin/python
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting tox==3.11.1
  Using cached tox-3.11.1-py2.py3-none-any.whl (76 kB)
Collecting grpcio-tools<=1.14.2,>=1.3.5
  Downloading grpcio_tools-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl (22.2 MB)
Collecting future==0.18.2
  Downloading future-0.18.2.tar.gz (829 kB)
Collecting mypy-protobuf==1.18
  Downloading mypy-protobuf-1.18.tar.gz (6.4 kB)
Collecting six<2,>=1.0.0
  Downloading six-1.15.0-py2.py3-none-any.whl (10 kB)
Processing /home/jenkins/.cache/pip/wheels/66/13/60/ef107438d90e4aad6320e3424e50cfce5e16d1e9aad6d38294/filelock-3.0.12-cp27-none-any.whl
Collecting virtualenv>=14.0.0
  Downloading virtualenv-20.0.21-py2.py3-none-any.whl (4.7 MB)
Collecting pluggy<1,>=0.3.0
  Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting py<2,>=1.4.17
  Downloading py-1.8.1-py2.py3-none-any.whl (83 kB)
Collecting toml>=0.9.4
  Downloading toml-0.10.1-py2.py3-none-any.whl (19 kB)
Requirement already satisfied, skipping upgrade: setuptools>=30.0.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Chicago_Taxi_Dataflow/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from tox==3.11.1) (44.1.1)
Collecting grpcio>=1.14.2
  Downloading grpcio-1.29.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting protobuf>=3.5.0.post1
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-1' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283)
	at com.sun.proxy.$Proxy163.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1150)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1142)
	at hudson.Launcher$ProcStarter.join(Launcher.java:470)
	at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
	at hudson.model.Build$BuildExecution.build(Build.java:206)
	at hudson.model.Build$BuildExecution.doRun(Build.java:163)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
	at hudson.model.Run.execute(Run.java:1853)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:427)
Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
	at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1271)
	at hudson.remoting.Channel$1.handle(Channel.java:563)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:85)
Caused by: Command Close created at
	at hudson.remoting.Command.<init>(Command.java:68)
	at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1265)
	at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1263)
	at hudson.remoting.Channel.close(Channel.java:1436)
	at hudson.remoting.Channel.close(Channel.java:1403)
	at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1270)
	... 2 more
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-1 is offline; cannot locate JDK 1.8 (latest)

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_Chicago_Taxi_Dataflow #6

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/6/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #5

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/5/display/redirect?page=changes>

Changes:

[daniel.o.programmer] [BEAM-10235] Adding a CountElms transform to the Go SDK.

[noreply] [BEAM-9679] Add Partition task to Core Transform katas (#11979)


------------------------------------------
[...truncated 92.13 KB...]
  }
  feature {
    name: "trip_start_day"
    value_count {
      min: 1
      max: 1
    }
    type: INT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "tips"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_count: 1
    }
  }
  feature {
    name: "pickup_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "dropoff_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  string_domain {
    name: "company"
    value: "1085 - N and W Cab Co"
    value: "24 Seven Taxi"
    value: "303 Taxi"
    value: "3201 - C & D Cab Co Inc"
    value: "3620 - David K. Cab Corp."
    value: "3897 - Ilie Malec"
    value: "5776 - Mekonen Cab Company"
    value: "American United"
    value: "American United Taxi Affiliation"
    value: "Blue Diamond"
    value: "Blue Ribbon Taxi Association Inc."
    value: "Checker Taxi"
    value: "Checker Taxi Affiliation"
    value: "Chicago Carriage Cab Corp"
    value: "Chicago Elite Cab Corp."
    value: "Chicago Elite Cab Corp. (Chicago Carriag"
    value: "Chicago Independents"
    value: "Chicago Star Taxicab"
    value: "Chicago Taxicab"
    value: "Choice Taxi Association"
    value: "City Service"
    value: "Dispatch Taxi Affiliation"
    value: "Flash Cab"
    value: "Globe Taxi"
    value: "Gold Coast Taxi"
    value: "KOAM Taxi Association"
    value: "Leonard Cab Co"
    value: "Medallion Leasin"
    value: "Metro Jet Taxi A"
    value: "Northwest Management LLC"
    value: "Nova Taxi Affiliation Llc"
    value: "Patriot Taxi Dba Peace Taxi Associat"
    value: "Service Taxi Association"
    value: "Setare Inc"
    value: "Sun Taxi"
    value: "Taxi Affiliation Service Yellow"
    value: "Taxi Affiliation Services"
    value: "Top Cab Affiliation"
    value: "Yellow Cab"
  }
  string_domain {
    name: "payment_type"
    value: "Cash"
    value: "Credit Card"
    value: "Dispute"
    value: "Mobile"
    value: "No Charge"
    value: "Pcard"
    value: "Prcard"
    value: "Split"
    value: "Unknown"
  }
}
anomaly_info {
  key: "company"
  value {
    description: "Examples contain values missing from the schema: 0118 - 42111 Godfrey S.Awir (<1%), 1085 - 72312 N and W Cab Co (<1%), 1469 - 64126 Omar Jada (<1%), 2092 - 61288 Sbeih company (<1%), 2192 - 73487 Zeymane Corp (<1%), 2241 - 44667 - Felman Corp, Manuel Alonso (<1%), 2733 - 74600 Benny Jona (<1%), 2809 - 95474 C & D Cab Co Inc. (<1%), 2823 - 73307 Lee Express Inc (<1%), 3011 - 66308 JBL Cab Inc. (<1%), 3094 - 24059 G.L.B. Cab Co (<1%), 3556 - 36214 RC Andrews Cab (<1%), 3591 - 63480 Chuks Cab (<1%), 3620 - 52292 David K. Cab Corp. (<1%), 3623 - 72222 Arrington Enterprises (<1%), 3721 - Santamaria Express, Alvaro Santamaria (<1%), 4053 - 40193 Adwar H. Nikola (<1%), 4615 - 83503 Tyrone Henderson (<1%), 4623 - 27290 Jay Kim (<1%), 5006 - 39261 Salifu Bawa (<1%), 5062 - 34841 Sam Mestas (<1%), 5074 - 54002 Ahzmi Inc (<1%), 5874 - 73628 Sergey Cab Corp. (<1%), 5997 - 65283 AW Services Inc. (<1%), 6057 - 24657 Richard Addo (<1%), 6574 - Babylon Express Inc. (<1%), 6742 - 83735 Tasha ride inc (<1%), 6743 - 78771 Luhak Corp (<1%), Chicago Medallion Leasing INC (~2%), Chicago Medallion Management (~4%), Star North Management LLC (~19%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: 0118 - 42111 Godfrey S.Awir (<1%), 1085 - 72312 N and W Cab Co (<1%), 1469 - 64126 Omar Jada (<1%), 2092 - 61288 Sbeih company (<1%), 2192 - 73487 Zeymane Corp (<1%), 2241 - 44667 - Felman Corp, Manuel Alonso (<1%), 2733 - 74600 Benny Jona (<1%), 2809 - 95474 C & D Cab Co Inc. (<1%), 2823 - 73307 Lee Express Inc (<1%), 3011 - 66308 JBL Cab Inc. (<1%), 3094 - 24059 G.L.B. Cab Co (<1%), 3556 - 36214 RC Andrews Cab (<1%), 3591 - 63480 Chuks Cab (<1%), 3620 - 52292 David K. Cab Corp. (<1%), 3623 - 72222 Arrington Enterprises (<1%), 3721 - Santamaria Express, Alvaro Santamaria (<1%), 4053 - 40193 Adwar H. Nikola (<1%), 4615 - 83503 Tyrone Henderson (<1%), 4623 - 27290 Jay Kim (<1%), 5006 - 39261 Salifu Bawa (<1%), 5062 - 34841 Sam Mestas (<1%), 5074 - 54002 Ahzmi Inc (<1%), 5874 - 73628 Sergey Cab Corp. (<1%), 5997 - 65283 AW Services Inc. (<1%), 6057 - 24657 Richard Addo (<1%), 6574 - Babylon Express Inc. (<1%), 6742 - 83735 Tasha ride inc (<1%), 6743 - 78771 Luhak Corp (<1%), Chicago Medallion Leasing INC (~2%), Chicago Medallion Management (~4%), Star North Management LLC (~19%). "
    }
    path {
      step: "company"
    }
  }
}
anomaly_info {
  key: "dropoff_community_area"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "dropoff_community_area"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:151: FutureWarning: ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1731: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-06-14 03:02:39.182160: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-06-14 03:02:39.193676: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-06-14 03:02:39.195297: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x73028e0 executing computations on platform Host. Devices:
2020-06-14 03:02:39.195337: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-06-14 03:02:39.213175: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200614-024322/chicago_taxi_output/tft_output/tftransform_tmp/8ea247fe72e4455dac7716424859b008/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200614-024322/chicago_taxi_output/tft_output/tftransform_tmp/8ea247fe72e4455dac7716424859b008/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200614-024322/chicago_taxi_output/tft_output/tftransform_tmp/9dd568c9e43c4728be40ae462644d2e9/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200614-024322/chicago_taxi_output/tft_output/tftransform_tmp/9dd568c9e43c4728be40ae462644d2e9/saved_model.pb
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "preprocess.py", line 255, in <module>
    main()
  File "preprocess.py", line 251, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 184, in transform_data
    result.wait_until_finish()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1622, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020061-06132003-2tx0-harness-5cpn. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 50

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 31m 1s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/5qnasz5zyxdc4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #4

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/4/display/redirect?page=changes>

Changes:

[noreply] [BEAM-9615] Add String UTF8 coder. (#11989)

[noreply] [BEAM-7163] Correcting godoc for passert.Sum (#11999)

[noreply] [BEAM-10250]: Update io_matrix with new SplunkIO (#11998)

[noreply] Remove a hack used to retrieve schematized data from HL7v2 messages, …


------------------------------------------
[...truncated 91.54 KB...]
  }
  feature {
    name: "trip_start_day"
    value_count {
      min: 1
      max: 1
    }
    type: INT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "tips"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_count: 1
    }
  }
  feature {
    name: "pickup_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  feature {
    name: "dropoff_latitude"
    value_count {
      min: 1
      max: 1
    }
    type: FLOAT
    presence {
      min_fraction: 1.0
      min_count: 1
    }
  }
  string_domain {
    name: "company"
    value: "24 Seven Taxi"
    value: "5 Star Taxi"
    value: "American United Taxi Affiliation"
    value: "Blue Diamond"
    value: "Checker Taxi Affiliation"
    value: "Chicago Carriage Cab Corp"
    value: "Chicago Independents"
    value: "Chicago Star Taxicab"
    value: "Chicago Taxicab"
    value: "City Service"
    value: "Flash Cab"
    value: "Globe Taxi"
    value: "Gold Coast Taxi"
    value: "Leonard Cab Co"
    value: "Medallion Leasin"
    value: "Metro Jet Taxi A"
    value: "Nova Taxi Affiliation Llc"
    value: "Patriot Taxi Dba Peace Taxi Associat"
    value: "Setare Inc"
    value: "Sun Taxi"
    value: "Taxi Affiliation Service Yellow"
  }
  string_domain {
    name: "payment_type"
    value: "Cash"
    value: "Credit Card"
    value: "Mobile"
    value: "Pcard"
    value: "Prcard"
    value: "Prepaid"
  }
}
anomaly_info {
  key: "company"
  value {
    description: "The feature was present in fewer examples than expected. Examples contain values missing from the schema: 1247 - 72807 Daniel Ayertey (<1%), 1408 - 89599 Donald Barnes (<1%), 3011 - 66308 JBL Cab Inc. (<1%), 303 Taxi (<1%), 4615 - Tyrone Henderson (<1%), 5129 - 87128 (<1%), 5864 - 73614 Thomas Owusu (<1%), American United (<1%), Blue Ribbon Taxi Association Inc. (<1%), C & D Cab Co Inc (<1%), Checker Taxi (<1%), Chicago Elite Cab Corp. (Chicago Carriag (<1%), Chicago Medallion Management (<1%), Choice Taxi Association (<1%), Dispatch Taxi Affiliation (<1%), KOAM Taxi Association (<1%), Northwest Management LLC (<1%), Service Taxi Association (<1%), Taxi Affiliation Services (<1%), Top Cab Affiliation (<1%), Yellow Cab (<1%). "
    severity: ERROR
    short_description: "Multiple errors"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: 1247 - 72807 Daniel Ayertey (<1%), 1408 - 89599 Donald Barnes (<1%), 3011 - 66308 JBL Cab Inc. (<1%), 303 Taxi (<1%), 4615 - Tyrone Henderson (<1%), 5129 - 87128 (<1%), 5864 - 73614 Thomas Owusu (<1%), American United (<1%), Blue Ribbon Taxi Association Inc. (<1%), C & D Cab Co Inc (<1%), Checker Taxi (<1%), Chicago Elite Cab Corp. (Chicago Carriag (<1%), Chicago Medallion Management (<1%), Choice Taxi Association (<1%), Dispatch Taxi Affiliation (<1%), KOAM Taxi Association (<1%), Northwest Management LLC (<1%), Service Taxi Association (<1%), Taxi Affiliation Services (<1%), Top Cab Affiliation (<1%), Yellow Cab (<1%). "
    }
    path {
      step: "company"
    }
  }
}
anomaly_info {
  key: "payment_type"
  value {
    description: "Examples contain values missing from the schema: Dispute (<1%), No Charge (<1%), Split (<1%), Unknown (<1%). "
    severity: ERROR
    short_description: "Unexpected string values"
    reason {
      type: ENUM_TYPE_UNEXPECTED_STRING_VALUES
      short_description: "Unexpected string values"
      description: "Examples contain values missing from the schema: Dispute (<1%), No Charge (<1%), Split (<1%), Unknown (<1%). "
    }
    path {
      step: "payment_type"
    }
  }
}
anomaly_info {
  key: "pickup_community_area"
  value {
    description: "The feature was present in fewer examples than expected."
    severity: ERROR
    short_description: "Column dropped"
    reason {
      type: FEATURE_TYPE_LOW_FRACTION_PRESENT
      short_description: "Column dropped"
      description: "The feature was present in fewer examples than expected."
    }
    path {
      step: "pickup_community_area"
    }
  }
}
anomaly_name_format: SERIALIZED_PATH

Writing anomalies to anomalies path.
Preprocessing train data...
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

preprocess.py:151: FutureWarning: ReadFromBigQuery is experimental.
  | 'Measure time: start' >> beam.ParDo(MeasureTime(namespace)))
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1731: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  temp_location = pcoll.pipeline.options.view_as(
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:207: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/mappers.py>:1027: to_int64 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:240: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

2020-06-13 02:34:35.027617: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-06-13 02:34:35.037851: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2299995000 Hz
2020-06-13 02:34:35.039504: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7122630 executing computations on platform Host. Devices:
2020-06-13 02:34:35.039550: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-06-13 02:34:35.056954: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:378: The name tf.saved_model.signature_def_utils.predict_signature_def is deprecated. Please use tf.compat.v1.saved_model.signature_def_utils.predict_signature_def instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/saved_model/signature_def_utils_impl.py>:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info.
WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

WARNING:tensorflow:From <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py>:380: The name tf.saved_model.builder.SavedModelBuilder is deprecated. Please use tf.compat.v1.saved_model.builder.SavedModelBuilder instead.

INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200613-021440/chicago_taxi_output/tft_output/tftransform_tmp/5c1d2e0c4af144bfac91729111ec342b/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200613-021440/chicago_taxi_output/tft_output/tftransform_tmp/5c1d2e0c4af144bfac91729111ec342b/saved_model.pb
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:Assets added to graph.
INFO:tensorflow:No assets to write.
INFO:tensorflow:No assets to write.
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200613-021440/chicago_taxi_output/tft_output/tftransform_tmp/5a8c5eccb128423f8d0da86f99996fad/saved_model.pb
INFO:tensorflow:SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200613-021440/chicago_taxi_output/tft_output/tftransform_tmp/5a8c5eccb128423f8d0da86f99996fad/saved_model.pb
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

warning: check: missing required meta-data: url

warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied

WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
Traceback (most recent call last):
  File "preprocess.py", line 255, in <module>
    main()
  File "preprocess.py", line 251, in main
    project=known_args.metric_reporting_project)
  File "preprocess.py", line 184, in transform_data
    result.wait_until_finish()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 1622, in wait_until_finish
    self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
A setup error was detected in chicago-taxi-tfdv-2020061-06121934-lfj1-harness-8qzp. Please refer to the worker-startup log for detailed information.

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 50

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 30m 57s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/dqkdg7egxhr2w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Chicago_Taxi_Dataflow #3

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/3/display/redirect?page=changes>

Changes:

[kcweaver] [BEAM-10234] Fix error message for missing licenses.

[Robin Qiu] Simple code cleanup for ZetaSqlUtils

[noreply] [BEAM-9951] Adding integration tests for synthetic pipelines in Go

[noreply] [BEAM-9217] Update DoFn javadoc for schema type translation (#11984)

[noreply] Bump default Pubsub timeout to 60 seconds (#11985)

[noreply] Merge pull request #11950 from [BEAM-8596]: Add SplunkIO transform to

[noreply] Support HOP and  SESSION as TVF (#11868)


------------------------------------------
[...truncated 47.79 KB...]
  Using cached nbformat-4.4.0-py2.py3-none-any.whl (155 kB)
Collecting ipaddress; python_version == "2.7"
  Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Processing /home/jenkins/.cache/pip/wheels/a2/d8/14/0457f16488d8cbc2cf18bccb5f1ceb59675787a80c649251bc/Send2Trash-1.5.0-py2-none-any.whl
Collecting traitlets>=4.2.1
  Using cached traitlets-4.3.3-py2.py3-none-any.whl (75 kB)
Collecting jinja2
  Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting pyzmq>=17
  Using cached pyzmq-19.0.1-cp27-cp27mu-manylinux1_x86_64.whl (1.1 MB)
Collecting jupyter-client>=5.2.0
  Using cached jupyter_client-5.3.4-py2.py3-none-any.whl (92 kB)
Processing /home/jenkins/.cache/pip/wheels/d8/83/af/e0dc6afbf3a2c51af8d6e3f9fbe790d0c581c2de05bc5d50f5/tornado-5.1.1-cp27-cp27mu-linux_x86_64.whl
Collecting terminado>=0.8.1
  Using cached terminado-0.8.3-py2.py3-none-any.whl (33 kB)
Collecting ipython-genutils
  Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB)
Collecting prometheus-client
  Using cached prometheus_client-0.8.0-py2.py3-none-any.whl (53 kB)
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting backports.weakref>=1.0rc1
  Using cached backports.weakref-1.0.post1-py2.py3-none-any.whl (5.2 kB)
Collecting tensorflow-estimator<1.15.0rc0,>=1.14.0rc0
  Using cached tensorflow_estimator-1.14.0-py2.py3-none-any.whl (488 kB)
Requirement already satisfied: grpcio>=1.8.6 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.29.0)
Collecting tensorboard<1.15.0,>=1.14.0
  Using cached tensorboard-1.14.0-py2-none-any.whl (3.1 MB)
Processing /home/jenkins/.cache/pip/wheels/71/a0/64/e2e0c93740e0460f4b7f036141b7c73b5e44ff38f690ddff9f/Keras_Applications-1.0.8-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/5b/d8/8e/81a83cb5321b940a954996f5b57fddc8976e712b3ac3a1a54b/wrapt-1.12.1-cp27-cp27mu-linux_x86_64.whl
Requirement already satisfied: protobuf>=3.6.1 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (3.12.2)
Collecting google-pasta>=0.1.6
  Using cached google_pasta-0.2.0-py2-none-any.whl (57 kB)
Collecting keras-preprocessing>=1.0.5
  Using cached Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Requirement already satisfied: mock>=2.0.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (2.0.0)
Requirement already satisfied: numpy<2.0,>=1.14.5 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.16.6)
Requirement already satisfied: six>=1.10.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.15.0)
Requirement already satisfied: wheel in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (0.34.2)
Collecting astor>=0.6.0
  Using cached astor-0.8.1-py2.py3-none-any.whl (27 kB)
Requirement already satisfied: enum34>=1.1.6 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.1.10)
Processing /home/jenkins/.cache/pip/wheels/48/54/87/2f4d1a48c87e43906477a3c93d9663c49ca092046d5a4b00b4/termcolor-1.1.0-py2-none-any.whl
Collecting gast>=0.2.0
  Using cached gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting scikit-learn<1,>=0.18
  Using cached scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl (5.5 MB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.11 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.23.0.dev0)
Collecting joblib<1,>=0.12
  Using cached joblib-0.14.1-py2.py3-none-any.whl (294 kB)
Collecting IPython>=5.0
  Using cached ipython-5.10.0-py2-none-any.whl (760 kB)
Requirement already satisfied: pandas<1,>=0.18 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.24.2)
Requirement already satisfied: googleapis-common-protos in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-metadata<0.14,>=0.13.0->-r requirements.txt (line 21)) (1.52.0)
Collecting scipy==1.1.0
  Using cached scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8 MB)
Processing /home/jenkins/.cache/pip/wheels/6a/a5/14/25541ebcdeaf97a37b6d05c7ff15f5bd20f5e91b99d313e5b4/pydot-1.2.4-cp27-none-any.whl
Collecting qtpy
  Using cached QtPy-1.9.0-py2.py3-none-any.whl (54 kB)
Collecting pygments
  Using cached Pygments-2.5.2-py2.py3-none-any.whl (896 kB)
Collecting widgetsnbextension~=3.5.0
  Using cached widgetsnbextension-3.5.1-py2.py3-none-any.whl (2.2 MB)
Collecting prompt-toolkit<2.0.0,>=1.0.0
  Using cached prompt_toolkit-1.0.18-py2-none-any.whl (245 kB)
Collecting mistune<2,>=0.8.1
  Using cached mistune-0.8.4-py2.py3-none-any.whl (16 kB)
Collecting defusedxml
  Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Collecting entrypoints>=0.2.2
  Using cached entrypoints-0.3-py2.py3-none-any.whl (11 kB)
Collecting bleach
  Using cached bleach-3.1.5-py2.py3-none-any.whl (151 kB)
Processing /home/jenkins/.cache/pip/wheels/49/82/c2/20339405e38b5650a69542cbbcb85082f6840c488ecd22d02e/pandocfilters-1.4.2-py2-none-any.whl
Collecting testpath
  Using cached testpath-0.4.4-py2.py3-none-any.whl (163 kB)
Collecting jsonschema!=2.5.0,>=2.4
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Collecting decorator
  Using cached decorator-4.4.2-py2.py3-none-any.whl (9.2 kB)
Collecting MarkupSafe>=0.23
  Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Requirement already satisfied: python-dateutil>=2.1 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jupyter-client>=5.2.0->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (2.8.1)
Collecting backports-abc>=0.4
  Using cached backports_abc-0.5-py2.py3-none-any.whl (5.2 kB)
Requirement already satisfied: singledispatch in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.4.0.3)
Requirement already satisfied: futures in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.3.0)
Collecting ptyprocess; os_name != "nt"
  Using cached ptyprocess-0.6.0-py2.py3-none-any.whl (39 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.1.1-py2.py3-none-any.whl (87 kB)
Requirement already satisfied: setuptools>=41.0.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (44.1.1)
Collecting werkzeug>=0.11.15
  Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting h5py
  Using cached h5py-2.10.0-cp27-cp27mu-manylinux1_x86_64.whl (2.8 MB)
Requirement already satisfied: pbr>=0.11 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (5.4.5)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (1.0.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.5.8)
Requirement already satisfied: avro<1.10.0,>=1.8.1; python_version < "3.0" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.9.2)
Requirement already satisfied: httplib2<0.18.0,>=0.8 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.17.4)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.0)
Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.18.2)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.2)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.10.1)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2020.1)
Requirement already satisfied: pyarrow<0.18.0,>=0.15.1; python_version >= "3.0" or platform_system != "Windows" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.16.0)
Requirement already satisfied: typing<3.8.0,>=3.7.0; python_full_version < "3.5.3" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.1)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.3.1.1)
Requirement already satisfied: fastavro<0.24,>=0.21.4 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.23.4)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8; python_version < "3.0" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.8)
Requirement already satisfied: cachetools<4,>=3.1.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.1.1)
Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.13.0)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.31)
Requirement already satisfied: google-cloud-core<2,>=0.28.1; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.2)
Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.2)
Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0)
Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.42.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0)
Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.0)
Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.24.0)
Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1; extra == "gcp" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7.4)
Collecting backports.shutil-get-terminal-size; python_version == "2.7"
  Using cached backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl (6.5 kB)
Requirement already satisfied: pathlib2; python_version == "2.7" or python_version == "3.3" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.3.5)
Collecting pexpect; sys_platform != "win32"
  Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
Processing /home/jenkins/.cache/pip/wheels/1b/83/23/9d866729c0090bfc62d03a5bd43080fb07a5f4fad10a09399a/simplegeneric-0.8.1-py2-none-any.whl
Collecting pickleshare
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->tensorflow-transform<0.14,>=0.13.0->-r requirements.txt (line 24)) (2.4.7)
Requirement already satisfied: wcwidth in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from prompt-toolkit<2.0.0,>=1.0.0->jupyter-console->jupyter<2,>=1.0->-r requirements.txt (line 17)) (0.2.4)
Requirement already satisfied: configparser>=3.5; python_version == "2.7" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from entrypoints>=0.2.2->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (4.0.2)
Collecting webencodings
  Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from bleach->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (20.4)
Processing /home/jenkins/.cache/pip/wheels/c2/ea/a3/25af52265fad6418a74df0b8d9ca8b89e0b3735dbd4d0d3794/functools32-3.2.3.post2-py2-none-any.whl
Requirement already satisfied: attrs>=17.4.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (19.3.0)
Processing /home/jenkins/.cache/pip/wheels/1f/d0/6d/4eb101c505cdc5e2be006684c0b93f3095a8ac5e0cf9abb35c/pyrsistent-0.16.0-cp27-cp27mu-linux_x86_64.whl
Requirement already satisfied: importlib-metadata; python_version < "3.8" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.6.1)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.23.0)
Requirement already satisfied: rsa>=3.1.4 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (4.2)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.8)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.14.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.20.0)
Requirement already satisfied: fasteners>=0.14 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-apitools<0.5.32,>=0.5.31; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.15)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.12.3)
Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.17.1)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.1)
Requirement already satisfied: scandir; python_version < "3.5" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pathlib2; python_version == "2.7" or python_version == "3.3"->IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.10.0)
Requirement already satisfied: backports.functools-lru-cache>=1.2.1; python_version < "3.2" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from wcwidth->prompt-toolkit<2.0.0,>=1.0.0->jupyter-console->jupyter<2,>=1.0->-r requirements.txt (line 17)) (1.6.1)
Requirement already satisfied: contextlib2; python_version < "3" in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.2.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2020.4.5.2)
Requirement already satisfied: idna<3,>=2.5 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.25.9)
Requirement already satisfied: monotonic>=0.1 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from fasteners>=0.14->google-apitools<0.5.32,>=0.5.31; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.5)
Installing collected packages: decorator, ipython-genutils, traitlets, backports.shutil-get-terminal-size, ptyprocess, pexpect, pygments, prompt-toolkit, simplegeneric, pickleshare, IPython, backports-abc, tornado, pyzmq, jupyter-core, jupyter-client, ipykernel, qtpy, qtconsole, mistune, defusedxml, entrypoints, MarkupSafe, jinja2, webencodings, bleach, pandocfilters, functools32, pyrsistent, jsonschema, nbformat, testpath, nbconvert, ipaddress, Send2Trash, terminado, prometheus-client, notebook, widgetsnbextension, ipywidgets, jupyter-console, jupyter, absl-py, backports.weakref, tensorflow-estimator, markdown, werkzeug, tensorboard, h5py, keras-applications, wrapt, google-pasta, keras-preprocessing, astor, termcolor, gast, tensorflow, scipy, scikit-learn, tensorflow-metadata, joblib, pydot, tensorflow-transform, tensorflow-data-validation, tensorflow-model-analysis, tensorflow-serving-api
  Attempting uninstall: pydot
    Found existing installation: pydot 1.4.1
    Uninstalling pydot-1.4.1:
      Successfully uninstalled pydot-1.4.1
Successfully installed IPython-5.10.0 MarkupSafe-1.1.1 Send2Trash-1.5.0 absl-py-0.9.0 astor-0.8.1 backports-abc-0.5 backports.shutil-get-terminal-size-1.0.0 backports.weakref-1.0.post1 bleach-3.1.5 decorator-4.4.2 defusedxml-0.6.0 entrypoints-0.3 functools32-3.2.3.post2 gast-0.3.3 google-pasta-0.2.0 h5py-2.10.0 ipaddress-1.0.23 ipykernel-4.10.1 ipython-genutils-0.2.0 ipywidgets-7.5.1 jinja2-2.11.2 joblib-0.14.1 jsonschema-3.2.0 jupyter-1.0.0 jupyter-client-5.3.4 jupyter-console-5.2.0 jupyter-core-4.6.3 keras-applications-1.0.8 keras-preprocessing-1.1.2 markdown-3.1.1 mistune-0.8.4 nbconvert-5.6.1 nbformat-4.4.0 notebook-5.7.9 pandocfilters-1.4.2 pexpect-4.8.0 pickleshare-0.7.5 prometheus-client-0.8.0 prompt-toolkit-1.0.18 ptyprocess-0.6.0 pydot-1.2.4 pygments-2.5.2 pyrsistent-0.16.0 pyzmq-19.0.1 qtconsole-4.7.4 qtpy-1.9.0 scikit-learn-0.20.4 scipy-1.1.0 simplegeneric-0.8.1 tensorboard-1.14.0 tensorflow-1.14.0 tensorflow-data-validation-0.13.1 tensorflow-estimator-1.14.0 tensorflow-metadata-0.13.0 tensorflow-model-analysis-0.13.2 tensorflow-serving-api-1.13.1 tensorflow-transform-0.13.0 termcolor-1.1.0 terminado-0.8.3 testpath-0.4.4 tornado-5.1.1 traitlets-4.3.3 webencodings-0.5.1 werkzeug-1.0.1 widgetsnbextension-3.5.1 wrapt-1.12.1

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample
Using GCP project: apache-beam-testing
Job output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200612-124157/chicago_taxi_output
TFDV output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200612-124157/chicago_taxi_output/tfdv_output
Starting distributed TFDV stats computation and schema generation...
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
Traceback (most recent call last):
  File "tfdv_analyze_and_validate.py", line 27, in <module>
    import tensorflow_data_validation as tfdv
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/__init__.py",> line 18, in <module>
    from tensorflow_data_validation.api.stats_api import GenerateStatistics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/api/stats_api.py",> line 49, in <module>
    import apache_beam as beam
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py",> line 96, in <module>
    from apache_beam import io
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/__init__.py",> line 23, in <module>
    from apache_beam.io.avroio import *
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/avroio.py",> line 64, in <module>
    from apache_beam.io import filebasedsink
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/filebasedsink.py",> line 36, in <module>
    from apache_beam.io import iobase
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/iobase.py",> line 57, in <module>
    from apache_beam.transforms import core
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/transforms/__init__.py",> line 25, in <module>
    from apache_beam.transforms.external import *
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/transforms/external.py",> line 43, in <module>
    from apache_beam.runners import pipeline_context
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/__init__.py",> line 31, in <module>
    from apache_beam.runners.dataflow.dataflow_runner import DataflowRunner
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/__init__.py",> line 26, in <module>
    from apache_beam.runners.dataflow.dataflow_runner import DataflowRunner
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py",> line 49, in <module>
    from apache_beam.internal.gcp import json_value
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/internal/gcp/json_value.py",> line 32, in <module>
    from apitools.base.py import extra_types
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apitools/base/py/__init__.py",> line 21, in <module>
    from apitools.base.py.base_api import *
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apitools/base/py/base_api.py",> line 35, in <module>
    from apitools.base.py import http_wrapper
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apitools/base/py/http_wrapper.py",> line 39, in <module>
    from oauth2client.client import HttpAccessTokenRefreshError as TokenRefreshError  # noqa
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/oauth2client/client.py",> line 47, in <module>
    from oauth2client import crypt
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/oauth2client/crypt.py",> line 23, in <module>
    from oauth2client import _pure_python_crypt
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/oauth2client/_pure_python_crypt.py",> line 26, in <module>
    import rsa
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/rsa/__init__.py",> line 24, in <module>
    from rsa.key import newkeys, PrivateKey, PublicKey
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/rsa/key.py",> line 1
SyntaxError: Non-ASCII character '\xc3' in file <https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/rsa/key.py> on line 1, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details

> Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 50

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1m 40s
6 actionable tasks: 6 executed

Publishing build scan...
https://gradle.com/s/onrp7lepmn7z2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org