You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by mw...@apache.org on 2020/05/25 08:50:05 UTC
[beam] branch BEAM-9723-java-dlp updated (c2a6d4d -> 00add36)
This is an automated email from the ASF dual-hosted git repository.
mwalenia pushed a change to branch BEAM-9723-java-dlp
in repository https://gitbox.apache.org/repos/asf/beam.git.
discard c2a6d4d Add javadocs to DLP transforms. Add more tests
discard 72c167b First batch of fixes after code review
discard e4984b7 Add default GCP project for testing
discard b26fba7 Rework DLP transforms into more usable forms
discard 59525ab Modify the batching algorithm
discard 7686ed4 Separate logger for the batching DoFn
discard a6c0dc3 [BEAM-9723] Add DLP integration transforms
add e325044 [BEAM-9580] Allow Flink 1.10 processing timers to finish on pipeline shutdown
add d4790fd Revert "[BEAM-9580] Downgrade Flink version to 1.9 for Nexmark and ValidatesRunner"
add b6dbf2a [BEAM-9557] Fix strings used to verify test output
add e7f6ccb Merge pull request #11346: [BEAM-9580] Allow Flink 1.10 processing timers to finish on pipeline shutdown
add c367536 [BEAM-9714] [Go SDK] Require --region flag in Dataflow runner.
add 76d7732 Merge pull request #11348 from ibzib/beam-9199-go
add 3f92f32 Update session.go
add f449dca Update stage.go
add 632535c Update server_test.go
add a4dcf29 Update materialize.go
add ca70ab8 Update materialize_test.go
add 4a378e9 Update stage_test.go
add b6e0584 Update artifact.go
add 209508c Update provision.go
add de68243 Update retrieval.go
add cf19153 Update staging.go
add 483a9c8 Update translate.go
add 11f086a Update datamgr.go
add 3c77761 Update datamgr_test.go
add 1894be7 Update logging.go
add 1378b31 Update logging_test.go
add e229c74 Update monitoring.go
add d9772ee Update session.go
add e1a2730 Update statemgr.go
add ca30a64 Update statemgr_test.go
add 1f0eb7c Update replace.go
add 46afdfd Update replace_test.go
add 68e369c Update provision.go
add c3b3c77 Update execute.go
add 532ea91 Update job.go
add a4d5648 Update translate.go
add 84ebc24 Update translate.go
add 54014d7 Update job.go
add eab9a0f Update materialize.go
add 2548664 Update translate.go
add 9da745e Update session.go
add ecb852b Update materialize_test.go
add ba6feec Merge pull request #11343 from apache/lostluck-protosuffix
add 826a68a [BEAM-9596] Ensure metrics are available in PipelineResult when the pipeline fails
add c04ac9f Merge pull request #11349: [BEAM-9596] Ensure metrics are available in PipelineResult when the pipeline fails
add 964c307 Updates documentation for WINDOWED_VALUE coder.
add 3038900 Uses iterable coder for windows and copies all of timestamp encoding specification.
add 338168d Merge pull request #11336 from acrites/documentation
add 8fb7f0f Update session.go (#11352)
add b497bf4 [BEAM-9322] [BEAM-1833] Better naming for composite transform output tags.
add cebe628 Merge pull request #11283 [BEAM-9322] [BEAM-1833] Better naming for composite transform output tags.
add 568db83 [BEAM-9618] Java SDK worker support for pulling bundle descriptors. (#11328)
add 82689f1 [BEAM-9716] Alias zone to worker_zone and warn user.
add b56740f Merge pull request #11332 from ibzib/beam-9716
add 6f6809a [Beam-9063]update documentation (#10952)
add af0acea Adds nose back under packages needed for testing.
add e7663b8 Merge pull request #11354: [BEAM-9719] Adds nose back to the base image
add cc5cf30 [BEAM-9618] Mark push registration as deprecated.
add bf4cee8 Merge pull request #11356 from robertwb/proto-notes
add 84d5402 Ensure that empty messages are not flushed to handler.
add 9280e68 Merge pull request #11351 from scwhittle/fix_log
add 71e9d3c [BEAM-9721] Add --region to Dataflow-based load tests
add bb0c0ec [BEAM-9721] LoadTestConfig: handle --region parameter and put default value if absent
add ca4e031 Merge pull request #11345: [BEAM-9721] Add --region to Dataflow-based load tests
add 237a99f [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. (#11193)
add 24108f9 [BEAM-9721]Conditionally add Dataflow region to Dataflow-based performance tests (#11344)
add 00f4f2f [BEAM-9647] fixes MQTT clientId to long
add 2b8f4d9 Merge pull request #11361: [BEAM-9647] Fix MQTT clientId too long
add ac003b6 [BEAM-8280] Document Python 3 annotations support (#11232)
add 5f432a2 [BEAM-9731] Include more detail in passert.Equals errors. (#11359)
add 79b2d87 [BEAM-9085] Fix performance regression in SyntheticSource on Python 3 (#11092)
add 7c46990 [BEAM-9726] [py] Make region optional for non-service Dataflow.
add a32613f [BEAM-9726] [java] Make region optional for non-service runner.
add c245288 Merge pull request #11353 from ibzib/beam-9726
add 80ebb70 [BEAM-4374] Fix missing deletion of metrics.
add 95a5944 Merge pull request #11363 from lukecwik/beam4374
add d36f873 [BEAM-9651] Prevent StreamPool and stream initialization livelock
add 28b081f Merge pull request #11364: [BEAM-9651] Prevent StreamPool and stream initialization livelock
add f251133 Revert "[BEAM-9651] Prevent StreamPool and stream initialization livelock"
add e8fc585 Merge pull request #11367 from scwhittle/revert-11364-contention
add cc42ab8 [BEAM-9727] Automatically set required experiment flags for dataflow runner v2. (#11355)
add 742a8ce Allow unset write threshold for state backed iterable coder.
add 3d0cde3 Merge pull request #11366 State backed iterable fixes.
add 8db19a4 [BEAM-9562, BEAM-6274] Fix-up timers to use Elements.Timer proto in data channel in Beam Java and Python
add 1de50c3 Merge pull request #11314 from boyuanzz/data
add 2498596 Update environments.py to add a method to specify container image (#11370)
add eeb0715 add missing bracket
add 0695414 Merge pull request #11247 from chie8842/patch-1
add 5f574b8 Moving to 2.22.0-SNAPSHOT on master branch.
add 247090f [BEAM-9734] Revert #11122
add 6a4ef33 Merge pull request #11376: [BEAM-9734] Revert #11122
add 1b8ac22 [BEAM-9651] Prevent StreamPool and stream initialization livelock
add 57ca62d Merge pull request #11368: [BEAM-9651] Prevent StreamPool and stream initialization livelock
add 82abec7 Add --region to changelog
add 7fb0abf Merge pull request #11379 from apache/region-changelog
add 5208c3d Upgrades gcsio to 2.1.2
add 75433f0 Merge pull request #11315: [BEAM-8889] Upgrades gcsio to 2.1.2
add c26af84 Attempt to stage resources via new API in portable runner.
add d5929ba Merge pull request #11311 [BEAM-9577] Attempt to stage resources via new API in portable runner.
add 81092b7 Fix from_container_image call
add c17e7c9 Merge pull request #11383 from [BEAM-9736] Fix from_container_image call
add d4c283e [BEAM-9562] Update Element.timer, Element.Timer to Element.timers and Element.Timers.
add 99fa8ac Merge pull request #11373 from boyuanzz/timers
add f0ba6bf [BEAM-9735] Adding Always trigger and using it in Reshuffle
add 7082c77 Merge pull request #11365 [BEAM-9735] Adding Always trigger and using it in Reshuffle
add 2e0cf8f [BEAM-9443] support direct_num_workers=0 (#11372)
add d1c04cb TOIL: Update Unified worker image
add d1e706e Merge pull request #11385 from angoenka/update_um_image
add 8458f47 google-api-client 1.30.9
add 3f99b33 Merge remote-tracking branch 'origin/master' into BEAM-8751
add cf4657b Merge pull request #11208 from suztomo/BEAM-8751
add 9b2dc82 Updates Dataflow stateful DoFn setup to support external transforms
add d566479 Merge pull request #11400: [BEAM-8019] Updates Dataflow stateful DoFn setup to support external transforms
add 537c641 [BEAM-9738] Update dataflow to setup correct docker environment options. (#11371)
add 296f5a7 [BEAM-9136]Add licenses for dependencies for Java (#11243)
add ad804f1 [BEAM-9496] Evaluation of deferred dataframes via Beam operations.
add 2197ba1 Fix and test tuple inputs and outputs.
add b557c12 Comments and clarification.
add b6e5082 Merge pull request #10760 [BEAM-9545] Dataframe transforms
add 009578e [BEAM-9562] Fix output timestamp to be inferred from scheduled time when in the event time domain.
add a7f444f Merge pull request #11402 from lukecwik/timers
add 7b454e9 [BEAM-9744] Add missing region option to py perf tests.
add 6eeed69 Merge pull request #11401 from ibzib/performance-region
add 7e07607 [BEAM-9744] Remove --region option from SQL tests.
add 40903f2 Merge pull request #11408 from ibzib/performance-region
add ec0e157 Merge pull request #11389 from Refactor the BCJ and capture controls to be more testable
add 9336272 [BEAM-i9751] upgrade zetasql to 2020.04.1 (#11410)
add 0595f79 [BEAM-9650] Add PeriodicImpulse Transform and slowly changing side input documentation (#11182)
add a57f3a0 Documentation bug fix for FlatMapElements#via() SimpleFunction in the javadoc should return List<String> instead of Integer
add 55dec55 Merge pull request #11412: Documentation minor fix for FlatMapElements#via()
add 1754d03 [BEAM-7923] Screendiff Integration Tests (#11338)
add f7647ad [BEAM-9642] Add SDF execution units. (#11327)
add f950b71 [BEAM-9136] reduce third_party_dependencies size (#11416)
add acb37bb [BEAM-9746] check for 0 length copies from state (#11413)
add 7f2ab69 [BEAM-9642] Fix infinite recursion.
add d279f4b Merge pull request #11423: [BEAM-9642] Fix infinite recursion.
add a39daa6 [BEAM-2939] Update unbounded source as SDF wrapper to resume successfully.
add 27c2c75 fixup! Fix spotbugs warning
add 1774530 Merge pull request #11409 from lukecwik/splittabledofn
add 34326a2 [BEAM-9577] Fix test to create urls from paths which are compatible with Windows.
add ef6df74 Merge pull request #11420 from lukecwik/beam9577
add 42d3d43 Removing underscore from _ReadFromBigQuery to make it external. It remains experimental.
add b85cdbe Merge pull request #11422 from [BEAM-9763] Removing underscore from _ReadFromBigQuery to make it external. It re…
add d310f98 [BEAM-9756] Nexmark: only use --region in Dataflow.
add 303b371 Merge pull request #11417 from ibzib/nexmark-region
add 744119c [BEAM-8889] add gRPC suport in GCS connector (behind an experimental-flag) (#11381)
add d7e0d5d [BEAM-8466] Make strip_iterable more strict
add 14424cc Merge pull request #11240: [BEAM-8466] Make strip_iterable more strict
add 5f5ae6f [BEAM-9119] Disable flaky test
add 26ee594 Merge pull request #11425: [BEAM-9119] Disable flaky test_large_elements
add 5c35755 Fixing type names for BQ Avro Tools
add 1db7186 Merge pull request #11404 from Fixing type names for BQ Avro Tools
add a562f1e Fix py37-lint
add 7438265 Maven compatible publish repository authentication via settings.xml
add 1658d90 Merge pull request #11399: Interpolate publish credentials as expected for Maven settings.xml
add da4a48d [BEAM-9729, BEAM-8486] Runner-side bundle registration cleanup. (#11358)
add 0a5cb43 Add new release 2.20.0 to beam website (#11285)
add f451643 add 2.20.0 blog post
add 4ebcc59 add a known issue
add 3162ed2 fixup! update 2.20.0 date
add 1d7f640 add 2.20.0 blog post (#11298)
add 0b025e3 Merge pull request #11151 from [BEAM-9468] Hl7v2 io
add 4d7ed73 Fix typo
add c1da629 Merge pull request #11434: Fix typo in WriteToKafka doc string
add a3a9c2d [BEAM-8671] Migrate Load Tests to Python 3.7
add aab7afc Merge pull request #11375: [BEAM-8671] Migrate Load Tests to Python 3.7
add b9de201 Remove outdated doc for ReadFromBigQuery transform
add 209180f Merge pull request #11424: Remove outdated doc for ReadFromBigQuery transform
add 289cb66 Add GBK load tests script for spark structured streaming runner
add 210658a Add CoGBK load tests script for spark structured streaming runner
add 1709a6b Add Combine load tests script for spark structured streaming runner
add 8a14cf0 Add Pardo load tests script for spark structured streaming runner
add 6e8e566 Merge pull request #11135 from echauchot/add_spark-ss-runner-to-GBK-load-tests
add c9d5e93 [BEAM-9765] Exclude module-info.class from vendored Calcite.
add 65c32af Merge pull request #11429 from ibzib/module-info
add 19fe4b5 [BEAM-9678] Create Go SDK introduction kata (#11340)
add 38df510 [BEAM-9769] Ensuring JSON is the default export format for BQ sink
add c21a2a1 Merge pull request #11433 from [BEAM-9769] Ensuring JSON is the default export format for BQ sink
add fc9b349 Merge pull request #11436: Document Beam Schemas (forked PR)
add c3bd485 [BEAM-9648]: DirectRunner should return null on timeout (#11275)
add 7869455 [BEAM-5379] Ignore go.sum files in RAT checks
add 0c86530 Merge pull request #11441 from apache/lostluck-gosum-rat
add 5b41b1f Include user distritribution into metric-dedicated validate runner test.
add 656869f update inline comment.
add 34031ad To allow only assert on committed metrics, bypassing the attempted ones.
add 8dbdce4 Use distribution matcher for testing.
add c7cd259 Merge pull request #11319 from HuangLED/master
add 99444c6 [BEAM-5605, BEAM-2939] Add support for FnApiDoFnRunner to handle split calls. (#11414)
add a1b79fd [BEAM-9674] Don't specify selected fields when fetching BigQuery table size (#11292)
add c38999e [BEAM-9737] Don't use docker create option -u
add 481b1d3 Merge pull request #11386: [BEAM-9737] Fix website postcommit
add 892a0a4 [BEAM-9650] Cleanup documentation on side inputs patterns (#11415)
add cb72032 [BEAM-9768] Gradle command for Python ULR.
add a69d8ec Merge pull request #11430 [BEAM-9768] Gradle command for Python ULR.
add 1b4bf6a [BEAM-8646] Fix external environment on OS X as well. (#11431)
add b6acaef [BEAM-9743] Fix TFRecordCodec to try harder to read/write (#11397)
add cae80ab Correct a typo in documentation
add c60b338 Merge pull request #11398: Correct a typo in documentation
add be57a61 Updates and clarifications on type safety. (#11449)
add 16d23bc [BEAM-9577] Small fixes to portable runner staging.
add d935b5f Merge pull request #11432 [BEAM-9577] Small fixes to portable runner staging.
add 12c66a0 [BEAM-3836] Enable dynamic splitting/checkpointing within the Java SDK harness. (#11448)
add fa4f418 [BEAM-8872] Support split at fraction for OffsetRangeTracker (#11418)
add 494482f [BEAM-9147] Add @Experimental annotation to VideoIntelligence related classes
add b8323c8 Add @Experimental to the package-info as well
add d2089bc Merge pull request #11463 from apache/BEAM-9147-add-experimental-annotation
add 37bb50d [BEAM-9692]: Make CombineValues portable (#11335)
add dee5a0a Add release date for 2.20.0
add d55cab7 Merge pull request #11465 from apache/aaltay-patch-2
add 1e7d2ff Fix user distribution metric test by using less restricting value.
add 1bae13b Apply yapf fix.
add a4e317a Replace all explicit validation.
add 5acd866 Merge pull request #11455 from HuangLED/testFix
add 30fa01f [BEAM-9773]: Update Dataflow Debug Capture to use Google API client Jackson 2
add 1da7b98 Remove all Dataflow google-api-client-jackson(1) dependencies
add b99a3dd Missed cleanup
add 2d98f80 Merge pull request #11442 from stevekoonce/master
add 95db26d [BEAM-6860] Fix iobase non-global windows bug
add a7169f9 Merge pull request #11439: [BEAM-6860] Fix iobase non-global windows bug
add b106e21 [BEAM-9788] Add RetainDockerContainers flag support to Go SDK. (#11467)
add fbf1775 [BEAM-9775] Add Go support for SDF StandardRequirements. (#11443)
add 6060d99 [BEAM-9496] Add to_dataframe and to_pcollection APIs. (#11264)
add 2a931a5 add display:block to datatable so that the columns can have various lengths based on the contents in them.
add fc8d18a Merge pull request #11462 from KevinGG/master
add 37838f2 [BEAM-9569] Fix BeamSqlPojoExample logRecords method to not require Row coder inference
add c7da1b5 Merge pull request #11460: [BEAM-9569] Fix BeamSqlPojoExample logRecords method to not require Row coder inference
add 0988049 Renames run_test -> run_scenario so that nose test runner does not think it's a test method.
add 033c1eb Merge pull request #11457 Rename test-framework-confusing run_test.
add 1b47b2e [BEAM-6960] More sophisticated job server starting and stopping.
add 5878373 Abort pipeline if docker containers die unexpectedly.
add 7181427 [BEAM-6960] Go ULR validates runner tests.
add 488232d lint
add de38f6d Merge pull request #11451 [BEAM-6960] Go ULR validates runner tests.
add 46c8d2d [BEAM-9285] Add Postcommit ValidatesRunner CI Job for Flink on Java 11
add b605c1c Merge pull request #11113: [BEAM-9285] Add Postcommit ValidatesRunner CI Job for Flink on Java 11
add 44638c5 Revert "[BEAM-8131] Provide Kubernetes setup for Prometheus (#9482)" (#11347)
add 1572d57 Merge pull request #11466 from [BEAM-9787] Clear error message on UW + BQSource
add 1905dbd [BEAM-9791] Add precommit for dataflow runner v2
add 5c27e8b Merge pull request #11470 from angoenka/uw_precommit
add 561752b [BEAM-9662][BEAM-9663] Reject Null Limit and Offset
add 8fff6d0 Merge pull request #11471: [BEAM-9662][BEAM-9663] Reject Null Limit and Offset
add 4a7f04c [BEAM-9764] multi threading & optional pulling (#11428)
add 8de324f [BEAM-9608] BundleManagers use BundleContextManager for configuration
add abb7bcb [BEAM-9639] Saving side inputs after producer execution, not before consumption.
add f7ae7f6 [BEAM-9639] Separate Stage and Bundle execution. Improve typing annotations.
add cf821e5 [BEAM-9639][BEAM-9608] Addressing review comments.
add 1fe543e Merge pull request #11270 from [BEAM-9639][BEAM-9608] Improvements for FnApiRunner
add af71782 Fix SplittableParDoNaiveBounded DoFnInvoker.
add c00dc4a Merge pull request #11475 from boyuanzz/fix
add 6e6ff61 [BEAM-9789] Fix lock error. Add test. (#11468)
add 6663da8 Revert "[BEAM-9014] CachingShuffleBatchReader use bytes to limit cache size."
add 623c5ed Merge pull request #11483 from apache/revert-10418-cachesizebytes
add fc37a04 Add a timeout to the TestStream GRPC and fix the Streaming cache timeout
add 7acbff4 Merge pull request #11440 from [BEAM-9767] Add a timeout to the TestStream GRPC and fix the Streaming cache timeout
add 880b062 [BEAM-7981] Correct ParDo(callable) test (#11446)
add d2f91a7 update release 2.20.0 blog post and added contributors name
add e13c1d6 Merge pull request #11476 from mszb/updating_release_blogpost_2_20_0
add 781ff5b Log job id similar to Java and Go
add 75151e3 Merge pull request #11458 from apache/aaltay-patch-1
add 084ac14 [BEAM-6597, BEAM-6467] Add support for reporting monitoring infos to the Java SDK harness. (#11487)
add b091db6 [BEAM-8831] Do not copy generated files for Python source copy
add 7ff0f5a Merge pull request #10230 [BEAM-8831] Exclude generated files for Python source copy
add 6cc6360 Merge pull request #11489 [BEAM-9577] Ensure required directories exist when staging.
add fe3241f [BEAM-9642] Enabling SDF exec runners and fixing small bug. (#11474)
add 66e9040 [BEAM-9755] changed MAKE_ADD stack pop order according to Python version
add 84a914b Merge pull request #11493: [BEAM-9755] changed MAKE_ADD stack pop order according to Python version
add 48db942 [BEAM-9717] update future version to 0.18.2 for Python 3.8 (#11494)
add 76387d9 [BEAM-9577] Use new artifact API to stage go artifacts. (#11490)
add 2f3edaf Force output names to be unicode-compatible on Python 2. (#11485)
add f35cf08 Make license_script.sh tolerate directory already existing (#11501)
add 8cfc8a8 [BEAM-9778] remove temp directory & add docker-pull-licenses to release scripts (#11484)
add b3596b8 [BEAM-8603] Add Python SqlTransform (#10055)
add 5b4ca7b [BEAM-9794] Reduce state cells needed for BufferingDoFnRunner
add 7869d49 Merge pull request #11478: [BEAM-9794] Reduce state cells needed for BufferingDoFnRunner
add ef267d9 [BEAM-9701] Increments fastavro version range upper bound to 0.24. (#11506)
add 93b3a0f [BEAM-2939] Expose HasProgress interface for restriction trackers and use the progress value during splitting
add 7568b06 [BEAM-2939] Add the ability for SDK harness runners to provide additional monitoring infos.
add 7ac97ea [BEAM-2939] Integrate progress reporting for splittable dofns.
add a02eb60 [BEAM-2939] Fold Sizes sub-interfaces into RestrictionTracker
add cfa6692 [BEAM-2939] Drop HasSize in favor of using HasProgress#getProgress#getWorkRemaining as the default if the DoFn doesn't override GetSize.
add 0291976 Merge pull request #11472 from lukecwik/splittabledofn
add f813a90 [BEAM-9577] New artifact staging and retrieval service for Java.
add 9c8718e [BEAM-9577] Multi-threaded artifact staging service backend.
add 01af3aa Use futures, better error handling.
add ec67a93 Merge pull request #11342 [BEAM-9577] New artifact staging and retrieval service for Java.
add 9867aab [BEAM-9812] Fixing bug causing pipelines requiring temp tables to not work
add decccbe Merge pull request #11509 from [BEAM-9812] Fixing bug causing pipelines requiring temp tables to not work
add 55b82fc [BEAM-9514] Ensure nullability passes through sum
add a905f69 Merge pull request #11488: [BEAM-9514] Ensure nullability passes through aggregate
add 71ccd7a [BEAM-7405] Workaround for bad Docker config
add 5761e33 Merge pull request #11512: [BEAM-7405] Workaround for bad Docker config on Jenkins nodes.
add 89958d8 [BEAM-8871] Support trySplit for ByteKeyRangeTracker
add 28fd597 Merge pull request #11454 from boyuanzz/restriction_tracker
add d8519dd [BEAM-9811] Nightly snapshot publish error
add e55a7b3 [BEAM-9775] Adding Go SDF example, adjusting GetProgress signature. (#11499)
add d416fd1 [BEAM-9733] Always let ImpulseSourceFunction emit a final watermark
add 643945a [BEAM-9733] Make up for timers set while processing the bundle
add 4797f31 Merge pull request #11362: [BEAM-9733] Improve watermark and timer handling
add fd74d4d [BEAM-9813] Replace outputs with respect to the correct tag.
add 5262732 Merge pull request #11515: [BEAM-9813] Replace outputs with respect to the correct tag.
add 5d350cb [BEAM-9761] Disable auto builds for tests that are currently failing.
add 022fe5e Merge pull request #11519: [BEAM-9761] Disable auto builds for tests that are currently failing.
add 6d29fb8 [BEAM-9811] Copy pom for all publishMavenJavaPublication tasks
add 1321104 add licenses and license types for zetasql packages (#11516)
add 24361d1 Added a batch example with covid tracking data for interactive notebook. (#11469)
add 4a52fb4 [BEAM-9488] Ensure we pass through PCollection ids instead of attempting to fix them up. (#11514)
add 3777b79 Fix invalid formatting specifier in verify
add 7fd4008 Merge pull request #11525: Fix invalid formatting specifier in verify
add 5fab78a [BEAM-9820] Upgrade Flink 1.9.x to 1.9.3
add b8085ad Merge pull request #11526: [BEAM-9820] Upgrade Flink 1.9.x to 1.9.3
add 9ed5a92 [BEAM-9819] Relaxes the version range for httplib2 to <0.16.0. (#11522)
add 78d2966 BEAM-9826 - Update Tika to 1.24.1
add ec8f60a Merge pull request #11531: [BEAM-9826] Update TikaIO to use Tika version 1.24.1
add 0d12aa5 [BEAM-9827] Ensure minimum watermark hold is computed across all keys
add 439728a Merge pull request #11533: [BEAM-9827] Ensure minimum watermark hold is computed across all keys
add 591de34 Merge pull request #11154: [BEAM-1819] Key should be available in @OnTimer methods
add bfc48ae Updates Dataflow Python containers to 20200423 (#11535)
add 81d7cbe [BEAM-9779] Patch HL7v2IOWriteIT Flakiness (#11450)
add 0c0e8ae Fix JavaSDK typo
add edac60d Add Python SqlTransform to CHANGES.md
add 7da0b1a Add Python SqlTransform to CHANGES.md (#11539)
add 28a7d81 [BEAM-9807] [BEAM-9808] Add missing region to Dataflow examples.
add 89c7db0 Missed a few spots.
add ea858d7 Only add --region for Dataflow runner.
add 0ddf8c4 Merge pull request #11500 from ibzib/mobile-gaming-region
add 9915525 virtualenv (#11502)
add 8ddd7ca [BEAM-9833] Add .asf.yaml file.
add fd7d20e Send issues to github@
add 9070f5e Add license header.
add 2434d49 Merge pull request #11541 from ibzib/BEAM-9833
add 1890696 Merge pull request #11546 from [BEAM-9832] Ensuring tags are not added to ProcessBundleDescriptors o…
add 482bbc0 [BEAM-9824] Do not ignore chained Reshuffles on flink batch runner.
add 164bef3 Merge pull request #11530: [BEAM-9824] Do not ignore chained Reshuffles on flink batch runner.
add 590d819 [BEAM-8790] Kubernetes deployment for InfluxDB
add daee062 [BEAM-8790] Local deployment of InfluxDB with docker-compose.yml
add 0fadb4a Merge pull request #11491: [BEAM-8790] InfluxDB deployment
add 147c34d [BEAM-9758] Use quotes in echo statements to prevent * expansion.
add 480c733 Merge pull request #11542 from ibzib/BEAM-9758
add 1c8519e [BEAM-9443] update document about direct_num_workers=0 for FnApi (#11550)
add 5d93b4e Display correct package in help message
add 2261589 Merge pull request #11461 from tobiaslieber-cognitedata/patch-1
add 7f66ea2 [BEAM-9658] Plumb through WITH OFFSET
add 7c22589 Merge pull request #11540 from apilloud/9658
add a05e18e Speedup on FnApiRunner start up time (#11543)
add 50aec39 [BEAM-6661] Properly close channel for external environment
add 278dcef [BEAM-6661] Avoid FileNotFoundException when no files have been staged
add 9a38a6d [BEAM-6661] Avoid printing empty lines in subprocess job server
add 6eb2c6e Merge pull request #11537: [BEAM-6661] Get rid of a few logging annoyances for execution and shutdown
add d15e29d All Python DirectRunners call setup/teardown on DoFns (#11547)
add 7823cd0 [BEAM-9815] Correct go integration test if clauses. (#11524)
add bfcb17e [BEAM-7923] Support docker screendiff integration tests (#11507)
add feebfcf Use logging to reduce verbosity of license checking when all goes well.
add 0276d85 Merge pull request #11561 Less verbose license checking.
add 06fe9a7 Support schemas in state API
add 74a6565 Merge pull request #10983: [BEAM-9393] Support schemas in state API
add c1319d5 Conditionally cleanup tempdir.
add 199570e Merge pull request #11497 Conditionally cleanup tempdir.
add 068d961 [BEAM-9147] Make VideoIntelligence use PTransform on user-facing API (#11464)
add 138af60 [BEAM-9802] Customization of automatically started services.
add b6f38ac Merge pull request #11495 [BEAM-9802] Customization of automatically started services.
add 2ccb4ad [9577] Attempt to stage artifacts via new API on Java.
add 81002fd Merge pull request #11511 [9577] Attempt to stage artifacts via new API on Java.
add 598402a [BEAM-9771] Fix notebook github URLs
add e173fa8 Merge pull request #11573 from davidcavazos/fix-notebook-urls
add 7f7105c Fix typo in go installation link. (#11445)
add 9ac6711 [BEAM-9846] Clean up references to unused native BQ source/sink experiment in Dataflow
add 837f4a3 Merge pull request #11562 from lukecwik/beam9846
add a010bcd [BEAM-9739]Retry SpannerIO write on Schema change
add 0f421a7 Merge pull request #11392: [BEAM-9739] Retry SpannerIO write on Schema change
add 430b36b [BEAM-9561] Add a framework for running pandas doctests with beam dataframes. (#11419)
add 5390fe2 [BEAM-9720] Add Aws Http client configurations capability. (#11341)
add 605d3c3 [BEAM-5192] move metadata serialization configuration code to WriteFn.setup to avoid doing the configuration for each element.
add 763b7cc Merge pull request #11504: [BEAM-5192] move metadata serialization configuration code to WriteFn setup
add 6196c66 skip pulling licenses by default (#11548)
add ce75c4f [BEAM-9795] Support custom avro DatumWriters when writing to BigQuery
add 144b96d Merge pull request #11479 from [BEAM-9795] Support custom avro DatumWriters when writing to BigQuery
add 20195a6 [BEAM-8078] streaming_wordcount_debugging.py is missing a test (#11568)
add de53fc3 Merge pull request #11538 from [BEAM-9831] Improve UX for HL7v2IO
add 180a810 Update container version
add fbd5b5f Merge pull request #11583 from boyuanzz/py_ver
add c7be705 Guard grpc import.
add b78c7ed Merge pull request #11587 from robertwb/no-grpc
add 44cd117 [BEAM-9692] Replace the apply_read with a PTransformOverride
add 73088bf move redundant testing pieces to function
add 6c78c79 Test simplification.
add 93181e7 Merge pull request #11452 [BEAM-9692] Move apply_Read to PTransformOverride
add c333bf8 [BEAM-9600] Get metrics in Flink uber jar job server.
add 6051439 [BEAM-9600] Add a test for Flink REST metrics.
add 3ea0670 Merge pull request #11369 from ibzib/beam-9600
add 791b3ff [BEAM-9860] Require job_endpoint when using PortableRunner.
add e0403cf5 Replace portableWordCount tests with portableWordCountFlinkRunner.
add 4335173 Merge pull request #11585 from ibzib/BEAM-9758
add 3a042b6 [BEAM-9801] Pass in fire timestamp and pane info to timer callback
add dc8f17e [BEAM-9733] Repeatedly fire in batch mode until there are no more timers
add cfa4ffa9b Merge pull request #11492 from mxm/BEAM-9801
add 848875f remove PipelineRunner.fromOptions call
add 9da835c [BEAM-2128] Remove dependency on PipelineRunner#fromOptions to stage files
add 7df2627 Modify PipelineTest to check if exception is thrown on Pipeline run rather than on creation
add 775bb7d Call FileSystems.setDefaultPipelineOptions in BatchStatefulParDoOverridesTest
add 9bb2990 [BEAM-2128] Remove PipelineRunner.fromOptions call (#11571)
add 360de38 Merge pull request #11523 from [BEAM-8414] Cleanup Python codebase to enable some of the excluded Python lint checks.
add b9f08fa Refactor timer firing in Flink & Spark portable batch.
add 1c0063a [BEAM-9801] Fire timers set within timers in Spark.
add 62d5f26 Merge pull request #11595: [BEAM-9801] Fire timers set within timers in Spark
add 8c26045 [BEAM-9874] Support clearing timers in portable batch mode (Spark/Flink)
add 133d798 Merge pull request #11597: [BEAM-9874] Support clearing timers in portable batch mode (Spark/Flink)
add 561b368 [BEAM-8025] Increase the number of retrials en retrial delay in case of load
add 0e93ccd [BEAM-8025] Trace caught NoHostAvailableException and InterruptedException
add 11de825 Merge pull request #11578: [BEAM-8025] Increase the number of retries in CassandraIOTest
add b00011d [BEAM-9841] Support finite wait on PortableRunner's PipelineResult
add 05bf325 Merge pull request #11556: [BEAM-9841] Support finite wait on PortableRunner's PipelineResult
add da12c3a [BEAM-9870] Always generate Dataflow-compatible FnApi protos. (#11593)
add a172313 Go fmt changes. (#11576)
add 27876f0 [BEAM-9418] Support ANY_VALUE aggregation functions
add 6453e85 Merge pull request #11333 from jhnmora000/master
add 497cd03 Make BatchGroupAlsoByWindowViaIteratorsFn extend the ElementByteSizeObservableIterable so that size estimation is lazy
add 573289a Do not attempt to estimate sizes of group-by-key values behind a key; such iterables can have enormous sizes and size estimates would cause reading the data multiple times. Furthermore, the size of the entire group-by-key collection is already known precisely at read time (and encoded into corresponding counters), which means the estimation is in fact not only expensive but redundant and unnecessary.
add 0cd43d1 remove comments
add 33091d2 Make BatchGroupAlsoByWindowViaIteratorsFn extend the ElementByteSizeObservableIterable so that size estimation is lazy
add 62e4df7 revert changes to grouping shuffle reader and iterable like coder
add fc180dd fix merge conflicts
add dd9ab00 remove obsolete class
add 4d38e39 Merge pull request #11598 from tudorm/no-expensive-size-estimation-gbk
add 95f9a15 [BEAM-9799] Automated validation for RTrackers.
add 0b96845 Merge pull request #11553: [BEAM-9799] Automated validation for RTrackers.
add 5984618 [BEAM-9880] fix cannot touch issue (#11606)
add 77309d8 [BEAM-9643] Adding Go SDF Documentation.
add bf53417 [BEAM-9643] Adjusting signature for TrySplit.
add 0c6155e Merge pull request #11517: [BEAM-9643] Adding Go SDF Documentation.
add 34c58c4 Merge pull request #11560 from [BEAM-9886] Auto-inferring project for ReadFromBigQuery
add 49d3f36 Update error prone
add 54631c0 Aling EP core and annotations versions
add 2f3cb62 Merge pull request #11527: Update error prone plugin
add 2495a04 Changed sns writes to async
add bd85e10 [BEAM-8542] V2 async changes for SNSIO
add 7c7bcd7 Merge pull request #10078: [BEAM-8542] Change write to async in AWS SNS IO & remove retry logic
add bfd661f [BEAM-9659][BEAM-9657][BEAM-9664] Reject unsupported unnest joins
add 9dc7d1e Merge pull request #11604: [BEAM-9659][BEAM-9657][BEAM-9664] Reject unsupported unnest joins
add ab04f80 [BEAM-9661] Fix ORDER BY with LIMIT
add 39495d8 Merge pull request #11602: [BEAM-9661] Fix ORDER BY with LIMIT
add 45a6fc6 [BEAM-9650] Add PeriodicSequence generator. (#11477)
add 5e15717 Pass pipeline options from caller to expansion service (#11574)
add a481397 Disable two flaky tests (BEAM-8035, BEAM-9164)
add e5dfa5b Merge pull request #11614: Disable two flaky tests (BEAM-8035, BEAM-9164)
add 96804c9 [BEAM-9888] Drop data based on input watermark in @RequiresTimeSortedInput
add 26f694d Merge pull request #11612: [BEAM-9888] Drop data based on input watermark in @RequiresTimeSortedInput
add dcd9f75 [BEAM-9840] Support for Parameterized Types when converting from HCatRecords to Rows in HCatalogIO (#11569)
add 24ceb95 [BEAM-9836] Exclude Spark runner from UsesKeyInParDo tests
add 65741a3 Merge pull request #11559: [BEAM-9836] Exclude Spark runner from UsesKeyInParDo tests
add 5971d77 [BEAM-9908] Fix Python build failures in release script.
add 3c8e188 Update instructions in release guide.
add bfefe18 Merge pull request #11623 from ibzib/BEAM-9908
add 85b568c [BEAM-7746] Enable mypy type checking for Beam Python code.
add 314822f Update sdks/python/mypy.ini
add 1e00a0e Merge pull request #11620 from robertwb/enable-mypy
add bd4df94 Remove a bunch of spurious warnings in tests. (#11621)
add 6505ea0 Fix thread local to be initialized on every thread.
add 76fdf60 un-duplicate _BEAM_SERVICES
add 7e0be24 Merge pull request #11627 from robertwb/import-fix-155451253
add a0d215c [BEAM-8944] Improve UnboundedThreadPoolExecutor performance
add b740404 fixup! Fix lint
add 79a66fd Merge pull request #11590: [BEAM-8944] Improve UnboundedThreadPoolExecutor performance
add f05466d [BEAM-8134] Grafana dashboards for Load Tests and IO IT Performance Tests
add 81cc7eb [BEAM-8133] Push ioit tests metrics to influxdb
add bef40cc [BEAM-8742] Add stateful and timely processing benchmarks
add d106f26 [BEAM-9900] Remove shutdownSourcesOnFinalWatermark flag
add c36f08a Merge pull request #11558: [BEAM-8742] Add stateful and timely processing benchmarks
add 6f09890 [BEAM-9913] remove license dir if exists (#11630)
add fb70c2f Merge pull request #11624 from [BEAM-9767] Make streaming_wordcount use a test timeout and increase from 5s to 30s
add df4b112 [BEAM-9731] passert.Equals: sort output strings for easier reading (#11615)
add 25b4ebc Revert "Pass pipeline options from caller to expansion service (#11574)" (#11631)
add e6fb32e [Beam-9679] Add Core Transforms section / Map lesson to the Go SDK katas (#11564)
add f97c215 Remove tests of Java on Dataflows Java Runner Harness
add f3e7f57 Merge pull request #11635: [BEAM-9868] Remove tests of Java on Dataflows Java Runner Harness
add b130aa1 [BEAM-9929] Support UNNEST(array_column) in ZetaSQL.
add 46f42d8 Merge pull request #11636 from amaliujia/rw-support_unnest_column
add e725118 Move job server to its own module.
add 61d0029 [BEAM-9845] Stage artifacts over expansion service.
add 544e568 [BEAM-9577] Resolve dependencies in Java expansion service.
add de83a82 Start artifact service in expansion service driver. 0;256;0c# Please enter the commit message for your changes. Lines starting
add 10dc1bb Merge pull request #11557: [BEAM-9845] Stage artifacts over expansion service
add 791c432 [BEAM-8132, BEAM-8133] Apply InfluxDB pipeline options in Load Tests and Performance Tests
add 734ca2c [BEAM-8132, BEAM-8133] Assume no trailing slash after a hostname
add b0a0f9c Merge pull request #11577: [BEAM-8132, BEAM-8133] Apply InfluxDB pipeline options in Load Tests and Performance Tests
add cecc4db [BEAM-2530] Compile and run tests on java 11 for Precommit portability api
add 3a117f9 Merge pull request #11619: [BEAM-2530] Compile and run tests on java 11 for PreCommit portability api
add 3661495 Remove spurious error message.
add ca3d16d Merge pull request #11438: [BEAM-9505] Remove spurious error message in SpannerIO when streaming.
add d5efe91 [BEAM-9911]Replace SpannerIO.write latency counter to distribution
add 291b5d8 Merge pull request #11628: [BEAM-9911]Replace SpannerIO.write latency counter to distribution
add 1edcb61 [BEAM-9883] Refactor SDF test restrictions. (#11605)
add dd9d73d [BEAM-4782] Remove workaround in Python multimap tests.
add d82d061 Merge pull request #11643 from ibzib/BEAM-4782
add ad0c5ad [BEAM-3288] Add suggested fix to error message (#11622)
add 5ef3d2f [BEAM-9940] Set timer family spec for TimerDeclarations in dataflow runner
add eea3a19 Merge pull request #11649 from y1chi/BEAM-9940
add 8bba19a check lastAttemptedOffset non-null
add da4a1b2 Merge pull request #11648 from jaketf/fix/OffsetRangeTrackerErrorHandling
add 9bd5aae Add a BeamJava test with Flatten with different input and output Coders
add 5312f74 Merge branch 'master' into flatten-test
add e763824 Merge pull request #11646 from CraigChambersG/flatten-test
add fd94927 [BEAM-9930] Beam Summit Digital 2020 announcement on blog
add a55dcce Correct URL in blog post
add a784ea6 Minor (markup) changes
add 127e877 Merge pull request #11640: [BEAM-9930] Beam Summit Digital 2020 announcement on blog
add e0c1b14 [BEAM-9930] Correct authors of beam summit digital blog post
add 5134cde Merge pull request #11654: [BEAM-9930] Correct authors of beam summit digital blog post
add 1e182c6 [BEAM-9439] Return split instead of total backlog size
add 8fdc9ce Merge pull request #11377: [BEAM-9439] Return split instead of total backlog size
add 52962ca Fix InfluxDB credentials binding
add 5e659bb Merge pull request #11660: Fix InfluxDB credentials binding
add 5a72594 [BEAM-9216] Upgrade katas gradle to version 5.2.1
add ac75847 Merge pull request #11664 from Borzoo/upgrade-katas-gradle
add b0932f2 [BEAM-9887] Throw IllegalArgumentException when building Row with logical types with Invalid input (#11609)
add 6ddbe02 [BEAM-9776] Fixes filesystem not found error
add 6d5a5cf Merge pull request #11588:[BEAM-9776] Register default filesystems in Beam SQL enumerable converter (makes them available to SQL shell)
add 45ddff8 Return empty iterator on empty cache
add 5d33f9c Merge pull request #11663 from [BEAM-9767]: Fix flaky streaming wordcount
add 795adaa Merge pull request #11637 from Waiting for BQ Query and Export jobs for more than 5 minutes.
add a824913 Add License file for the Go SDK for pkg.go.dev
add 4997b0a Merge pull request #11657: Add License file for the Go SDK for pkg.go.dev
add d908a75 [BEAM-9884] Add options to SqlTransform for specifying planner (#11647)
add ca5476f [BEAM-9875] Use FlinkRunner instead of PortableRunner in cross-language tests.
add 43102d9 Remove runner check in xlang wordcount.
add 0aa6fea Merge pull request #11603 from ibzib/BEAM-9875
add 126d728 [BEAM-9835] [Portable Spark] Broadcast a PCollection at most once.
add 86cb5b0 Merge pull request #11644 from ibzib/BEAM-9835
add 8a79015 [BEAM-9952] Revert "remove PipelineRunner.fromOptions call"
add c541641 Merge pull request #11668: [BEAM-9952] Revert "remove PipelineRunner.fromOptions call"
add 3dad2e5 [BEAM-9935] Respect allowed split points in Python.
add 773854c More comments.
add cad0333 Merge pull request #11653 from robertwb/split-points
add 744ef96 Make grpc-requiring class definition optional.
add 28b5e10 Merge pull request #11669 Make grpc-requiring class definition optional.
add 8efc3be [BEAM-9642] Adding Go SDF fallback for unexpanded SDFs.
add db9e4a8 Merge pull request #11645: [BEAM-9642] Adding Go SDF fallback for unexpanded SDFs.
add f32a206 [BEAM-6710] Add landing page with links to relevant dashboards
add f74f750 Merge pull request #11629: [BEAM-6710] Add landing page with links to relevant dashboards
add 6656fab [BEAM-9947] Store updated ParDoPayload for length-prefixed timer coders
add 49e7f33 [BEAM-9947] Add unit test to check length prefixing of timer key
add 4128e15 Merge pull request #11658: [BEAM-9947] Store updated ParDoPayload for length-prefixed timer coders
add f4ba22f [BEAM-9930] Add image to Beam Summit blog post
add 34c890e Merge pull request #11655: [BEAM-9930] Add image to Beam Summit blog post
add 18ca048 Fix metrics reporting in HDFS IO IT tests
add ff8d60b Merge pull request #11675: Fix metrics reporting in HDFS IO IT tests
add 5f2010e [BEAM-9963] Fix coder type in failing ParDo streaming load test
add 53e5cee Merge pull request #11677: [BEAM-9963] Fix coder type in failing ParDo streaming load test
add 334682d Merge pull request #11567: [BEAM-8132] Report Python metrics to InfluxDB
add 366dd36 Fix InfluxDB measurement names to match those in Grafana dashboards
add 9587afb Merge pull request #11680: Fix InfluxDB measurement names to match those in Grafana dashboards
add d8e8616 [BEAM-9945] Report data channel progress via a designated counter. (#11652)
add 3584015 [BEAM-9577] Update Java Runners to handle dependency-based artifact staging. (#11521)
add 820f0f5 Merge pull request #11673 from [BEAM-9967] Adding support for BQ labels on Query/Export jobs
add 1f46134 [BEAM-9164] Re-enable UnboundedSourceWrapper#testWatermarkEmission test
add a06334b Merge pull request #11679: [BEAM-9164] Re-enable UnboundedSourceWrapper#testWatermarkEmission test
add 59cdfb6 [BEAM-9622] Add Python SqlTransform test that joins tagged PCollections (#11684)
add 29c9733 [BEAM-9959] Root Transform fixes (#11686)
add 329b8e3 Use csv reader instead of split to read csv data.
add a543a2e Merge pull request #11616 from KevinGG/demo
add fd8d0c6 [BEAM-9945] Ensure that the read index represents the number of fully processed elements including at the end of the channel or after splitting. (#11689)
add 873a3aa [BEAM-9942] reduce groovy code duplication in python test-suites (#11656)
add f399e02 Revert "Merge pull request #11673 from [BEAM-9967] Adding support for BQ labels on Query/Export jobs"
add 485bd08 Merge pull request #11694 from pabloem/revertlabels
add d2ca199 Allow users of AvroIO to specify a custom DatumReader implementation
add 494256f Merge pull request #11641: [BEAM-9931] Support custom Avro DatumReaders in AvroIO
add ae863d4 Disambiguate method filter for toArray.
add 2ef7b9d Merge pull request #11695: [BEAM-9985] Disambiguate method filter for toArray for Java 11.
add a5b2046 [BEAM-9001, BEAM-6327] Ensure that all transforms (except for required runner implemented transforms) have an environment id. (#11670)
add 44a9820 [BEAM-9975] Log invalid dictionary after unsuccessful struct conversion.
add d8b9cac Switch to %s
add a698ae3 Merge pull request #11696 from ibzib/BEAM-9975
add ac2a677 Bump Flink 1.10 version
add 34d6b83 Merge pull request #11683: Bump Flink 1.10 version
add 216dbe6 [BEAM-9935] Respect allowed split points in Java
add 644b219 Merge pull request #11688 from boyuanzz/java_split
add 700bd67 [BEAM-9928] Add qualified import name to task descriptors (#11690)
add 30f9d7d [BEAM-9634] Add natural language analysis transform (#11611)
add b3bc319 [BEAM-9430] Fixes the bounds of initial watermark set to estimators instead of raising an error (#11607)
add 2ddb9c0 [BEAM-9967] Adding support for BQ labels on Query/Export jobs. (Roll forward)
add f81f934 Merge pull request #11700 from [BEAM-9967] Adding support for BQ labels on Query/Export jobs. (Roll …
add 9d27b9e [BEAM-9941] Added a test of a GBK followed by a Flatten with an unknown output coder (#11666)
add 9045b58 Clarify pubsub IO comment about timestamps (#11672)
add 0e9ecb7 Clarifies an error message in Katas to explain what is actually wrong. (#11705)
add aba1db8 Merge pull request #11210 from [BEAM-8949] SpannerIO integration tests
add cc903c8 [BEAM-9833] Add yamllint config
add ef6496f [BEAM-9833] Fix .asf.yaml issues, sort labels and disable rebase button
add 8d13b4f Merge pull request #11613 from [BEAM-9833] Fix .asf.yaml issues, sort labels and disable rebase button
add 1d27008 [BEAM-9876] Migrate the Beam website from Jekyll to Hugo to enable localization of the site content (#11554)
add 10c9ba6 [BEAM-9993] Add option defaults for Flink Python tests.
add 1590b43 Merge pull request #11711 from ibzib/BEAM-9993
add 5d00ccb Update the range for pyarrow to qualify pyarrow 0.17.x (#11699)
add b0844c9 Run Inventory job twice a day at 6 and 18.
add 4e47dea Merge pull request #11713 Run Inventory jobs every 12 hours.
add 844bf45 Update release notes link for 2.20.0
add 5de4080 Merge pull request #11714 from apache/aaltay-patch-2
add 3dd063f [BEAM-2530] PreCommit Dataflow examples - test compiled with java 11
add 238c33c Merge pull request #11659: [BEAM-2530] PreCommit Dataflow examples - test compiled with java 11
add f3b0507 [BEAM-2939] Ensure that we don't checkpoint the initial restriction as it has been checkpointed in a prior bundle. (#11716)
add 84f4c6d [BEAM-9966] Use dataproc staging bucket for checkpoints directory
add c7c7de4 [BEAM-9966] Remove unnecessary Reshuffles
add 1417262 [BEAM-9966] Propagate the keys to the load generator correctly
add 1ddcd46 Merge pull request #11693: [BEAM-9966] Investigate variance for ParDo load test checkpoint duration
add 7342a29 Make Post-Commits status dashboard compatible with the latest Grafana
add e56fd73 Merge pull request #11718 from kamilwu/fix-post-commits-dashboard
add 8862c37 support isRelease tag for docker build command & update release guide (#11584)
add 70218e4 [BEAM-9522] Reject FULL JOIN ON false
add 0c3dc7f Merge pull request #11698: [BEAM-9522] Reject FULL JOIN ON false
add 80b00cf [BEAM-1866] Enable validation of PAssert counts in Java validates runner tests for Dataflow (#11721)
add 44acf5e Modified the codeblock background
add a93e24d Merge pull request #11719 from [BEAM-10001] Change the code block colors from grey to blue to increase the contrast between text and background
add bb3877a [BEAM-9964] Setting --workerCacheMB to make its way to the WindmillStateCache constructor. Right now, this is hardcoded at 100MB
add e5dfe5f [BEAM-9964] Added testMaxWeight method in WIndmillStateCacheTest as per pabloem's comment
add ac190b8 Merge pull request #11710 from [BEAM-9964] Setting --workerCacheMB for Streaming Pipeline
add 4a69c9a Change TestStreamImpl to a producer/consumer pattern
add 578694b Merge pull request #11634 from Change TestStreamImpl to a producer/consumer pattern
add 176e1f0 [BEAM-9951] Creating a synthetic source for the Go SDK.
add 10b0f88 Merge pull request #11665: [BEAM-9951] Creating a synthetic source for the Go SDK.
add 7cf676b [BEAM-9136] Update doc about docker image license pulling
add bdd46e8 Merge pull request #11717 from Hannah-Jiang/new-doc
add 849113b [BEAM-9951] Creating a synthetic step for the Go SDK.
add d299877 Merge pull request #11728: [BEAM-9951] Creating a synthetic step for the Go SDK.
add c395c84 Merge pull request #11725: [BEAM-10015] Fix output timestamp on dataflow runner
add c9d9828 [BEAM-2939] Ensure that we update the watermark even when no elements are processed. (#11735)
add d773f8c [BEAM-2530] Implement Zeta SQL precommit compile tests and run on java 11 (#11692)
add 401f213 [BEAM-6733] Add pipeline option to flush bundle data before checkpointing
add 7c80ecb Merge pull request #11678: [BEAM-6733] Add pipeline option to flush bundle data before checkpointing
add 64414b8 Python3 fix - convert dict.keys() to list before indexing (#11733)
add 1aa715c Updates google-apitools and httplib2 (#11726)
add fc5c981 [BEAM-10018] Fix timestamps in windowing kata
add db5004c [BEAM-10018] Kata failing due to failed parsing
add f214352 Remove unused import
add b18ea2a Add missing dependency
add 80bc613 Fix member variable name in Kata documentation
add 45a0b85 Fix placeholder location
add 1f21a4c Merge pull request #11731 from [BEAM-10018] Fix timestamps in two windowing Python katas
add f4a0f66 Remove all answer placeholder checks as they can be confusing at times for some learners
add 849721f Update course in Stepik
add ddf2927 Merge pull request #11730 from henryken/katas-python-remove-answer-placeholder-check
add de9177e [BEAM-9964] Update CHANGES.md (#11743)
add dce14f8 Support ZetaSQL DATE type as a Beam LogicalType
add 47c246b Merge pull request #11272: [BEAM-9641] Support ZetaSQL DATE type as a Beam LogicalType
add 76fbe45 [BEAM-9577] Artifact v2 support for uber jars. (#11708)
add 7c81b93 Populate all SpannerIO batching parameters in display data.
add 9ded9e2 Fix capitalization, clarify descriptions
add 192e9ad fix capitalization, clarify description Grouped
add 30a68f5 Refactor to extract single method for popuplating displayData
add decd50a [BEAM-9821] Populate all SpannerIO batching parameters in display data. (#11528)
add a70fde0 [BEAM-9339] Ensure that Dataflow's pipeline proto also contains the capabilities (#11748)
add bd4523b [BEAM-9363] TUMBLE as TVF (#10946)
add 03b6052 [BEAM-2530] Sql precommit compile and run on java 11
add 84fad7f Merge pull request #11691: [BEAM-2530] Sql precommit compile and run on java 11
add 629b8f5 Updated Flink runner version in NEXMark documentation
add 6544fc3 Merge pull request #11751: Updated Flink runner version in NEXMark documentation
add 92853fe Upgrade Dataflow Python container versions.
add ddeab8b Merge pull request #11752 from ibzib/py-container-518
add 84c12eb [BEAM-9383] Staging Dataflow artifacts from environment (#11039)
add 03d99df [BEAM-1589] Added @OnWindowExpiration annotation. (#11350)
add 9b93f1a [BEAM-9958] Linkage Checker to use exclusion files as baseline (#11674)
add d64df6a Disable grouping by default when streaming.
add 3f2d648 [BEAM-9822] Disable grouping when streaming (#11532)
add 9d22950 [BEAM-9770] Add BigQueryIO deadletter pattern Decouple .java and .py snippits commit for purpose of PR. Add back changes for Snippets.java
add abd7684 Merge pull request #11437 from rezarokni/BEAM-9770
add d032818 [BEAM-9951] Using the builder pattern for Go synthetic config frontend
add 2eaea23 Merge pull request #11747: [BEAM-9951] Using the builder pattern for Go synthetic config frontend
add b4d17c1 Prevent Dataflow from starting multiple containers for the same image
add 7ad4c4c Merge pull request #11740: [BEAM-8019] Prevent Dataflow from starting multiple containers for the same image
add 27656d7 [BEAM-9984] Support BIT_OR aggregation function in Beam SQL (#11737)
add 2967e3a Katas - Convert task description from HTML to Markdown (#11736)
add 3719e6a [BEAM-9900] Fix polling behavior in UnboundedSourceWrapper
add 77ea885 [BEAM-9900] Add test case for polling idle readers
add 5cc46df Merge pull request #11750: [BEAM-9900] Fix polling behavior in UnboundedSourceWrapper
add a9014b2 [BEAM-9633] Add namespace parameter to MetricReader
add 7708c63 [BEAM-9633] Add more parameters to pubsub matcher
add 7525bdf [BEAM-9633] Add pubsubio performance tests
add a355f6d [BEAM-9633] Add jenkins job for python pubsubio tests
add 836d0ad Merge pull request #11274: [BEAM-9633] Add PubsubIO performance test
add ef2136b Merge pull request #11596 from [BEAM-9856] Optimization/hl7v2 io list messages
add b2fefaf [BEAM-9679] Add Core Transforms section / GroupByKey lesson to the Go SDK katas (#11734)
add 3b50369 [BEAM-10038] Add script to mass-comment Jenkins triggers on PR
add 5dda6a8 Add mass comment script to release guide.
add cdc7821 Update test list.
add 0a8d955 Update verify_release_build.sh to use mass_comment.py.
add 84343b0 Run yapf on mass_comment.py.
add d5d7c88 Remove irrelevant instruction.
add e8d0bd5 Merge pull request #11755 from ibzib/BEAM-10038
add 9818fa8 [BEAM-9699] Add test verifying we can use ZetaSQL in Python SqlTransform (#11575)
add 758d821 [BEAM-10037] BeamSqlExample.java fails to build (#11754)
add cf03756 [BEAM-9899] Fix some issues around storing schema `id` on user types (#11701)
add 9be5a29 Updated Videos and Podcasts page
add e5345fb Merge pull request #11724 from apache/aaltay-patch-1
add 7bdd52e Remove curly quotes from documentation code samples
add 9e092f9 Merge pull request #11762 from [BEAM-10044] Remove curly quotes from documentation code samples
add e1b148b Implement GrowableOffsetRangeTracker
add 87dbf84 Merge pull request #11715 from boyuanzz/grow
add 3c1c757 Merge pull request #11339 from [BEAM-9468] Fhir io
add b33ed49 [BEAM-9822] Simplify pipeline when batching is disabled. (#11529)
add 9cf6f5f Moving to 2.23.0-SNAPSHOT on master branch.
add ffd74b0 [BEAM-10028] Add support for the state backed iterable coder to the Java SDK harness. (#11746)
add 778e0f9 Upgrades gcsio to 2.1.3
add 35db9f7 Add grpc-alts and grpc-netty-shaded explicitly
add 5e132a1 Merge pull request #11651: [BEAM-8889] Upgrades gcsio to 2.1.3
add 13568c8 Fix grammar / spelling
add 799b4e1 Merge pull request #11760: [BEAM-10043] Fix grammar / spelling in language-switch.js
add 22d604b Update changes.md
add ef811fe Merge pull request #11774: [BEAM-1589] Added @OnWindowExpiration annotation.
add 48c2c58 Clarifies Dataflow execution environment model
add 696ebf2 Fixes typos.
add 74a5340 Clarifies text.
add e0ae226 Merge pull request #11757: [BEAM-8019] Clarifies Dataflow execution environment model
add 3e70f16 Make GroupByKey a primitive
add 986de56 Move ReifyWindows etc to DirectRunner, don't subclass from GBK
add 0aa92fe remove references to _GroupByKeyOnly
add cc405fd add back the ReifyWindows to the GBK, some internal tests depend on it.
add e88362e Skip checking input determinism for GBKs embedded in x-lang transforms. We can assume safely assume that the expansion service constructs transforms correctly.
add 16ab595 [BEAM-9692] Make GroupByKey into a primitive (#11503)
add 21da890 [BEAM-10048] Clean up release guide.
add 1404c6a Remove checklist from build_release_candidate.sh.
add 79e84e9 Include additional instructions for staging repository.
add 0c3780c Clarify the usage of sign_hash_python_wheels.sh.
add dfa1e47 Merge pull request #11764 from ibzib/release-guide
add 105f265 Website build: Remove -u root (#11625)
add 73fa135 [BEAM-9722] added SnowflakeIO with Read operation (#11360)
add 393f1ba [BEAM-10060] Upgrading Python containers to beam-master-20200521
add 1560e02 Merge pull request #11783 from angoenka/beam-master-20200521
add b8e582f [BEAM-10052] check hash and avoid duplicated artifacts
add 7cc1a7d Merge pull request #11771: [BEAM-10052] check hash and avoid duplicated artifacts
add 1095db0 [BEAM-9978] Adding functionality and tests to Go offset range tracker.
add 93f605d Merge pull request #11763: [BEAM-9978] Adding functionality and tests to Go offset range tracker.
add e45623e [BEAM-10051] Move closed reader check after sentinel. (#11768)
add 455fca5 [BEAM-10056] Fix validation for struct CoGBKs (#11782)
add e3b6a43 [BEAM-10050] Change labels checked in VideoIntelligenceIT (#11775)
add 7e2d933 [BEAM-9723] Add DLP integration transforms
add 3b87bff Separate logger for the batching DoFn
add d44bb85 Modify the batching algorithm
add 45cd3f5 Rework DLP transforms into more usable forms
add 926a47c Add default GCP project for testing
add 8847d27 First batch of fixes after code review
add 00add36 Add javadocs to DLP transforms. Add more tests
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c2a6d4d)
\
N -- N -- N refs/heads/BEAM-9723-java-dlp (00add36)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 41 +
.github/PULL_REQUEST_TEMPLATE.md | 2 +-
.gitmodules | 3 +
.test-infra/dataproc/flink_cluster.sh | 3 +-
.test-infra/dataproc/init-actions/flink.sh | 11 +-
.test-infra/jenkins/CommonJobProperties.groovy | 5 +
.test-infra/jenkins/CommonTestProperties.groovy | 4 +-
.test-infra/jenkins/Docker.groovy | 3 +-
.test-infra/jenkins/Flink.groovy | 2 +-
.../jenkins/InfluxDBCredentialsHelper.groovy | 35 +
.test-infra/jenkins/LoadTestConfig.groovy | 5 +-
.test-infra/jenkins/LoadTestsBuilder.groovy | 26 +-
.../jenkins/NexmarkBigqueryProperties.groovy | 1 -
.test-infra/jenkins/NexmarkBuilder.groovy | 2 +-
.test-infra/jenkins/job_Inventory.groovy | 2 +-
.../jenkins/job_LoadTests_CoGBK_Java.groovy | 27 +-
...ts_CoGBK_Java_spark_structured_streaming.groovy | 185 +
.../job_LoadTests_Combine_Flink_Python.groovy | 26 +-
.../jenkins/job_LoadTests_Combine_Java.groovy | 22 +-
..._Combine_Java_spark_structured_streaming.groovy | 133 +
.../jenkins/job_LoadTests_Combine_Python.groovy | 17 +-
.../jenkins/job_LoadTests_GBK_Flink_Python.groovy | 31 +-
.test-infra/jenkins/job_LoadTests_GBK_Java.groovy | 36 +-
.../jenkins/job_LoadTests_GBK_Java_Smoke.groovy | 1 +
...ests_GBK_Java_spark_structured_streaming.groovy | 232 +
.../jenkins/job_LoadTests_GBK_Python.groovy | 27 +-
.../job_LoadTests_GBK_Python_reiterate.groovy | 15 +-
.../job_LoadTests_ParDo_Flink_Python.groovy | 168 +-
.../jenkins/job_LoadTests_ParDo_Java.groovy | 25 +-
...ts_ParDo_Java_spark_structured_streaming.groovy | 161 +
.../jenkins/job_LoadTests_ParDo_Python.groovy | 19 +-
.../jenkins/job_LoadTests_ParDo_Python_37.groovy | 71 -
.../jenkins/job_LoadTests_Python_Smoke.groovy | 3 +-
.../job_LoadTests_coGBK_Flink_Python.groovy | 26 +-
.../jenkins/job_LoadTests_coGBK_Python.groovy | 19 +-
.../job_PerformanceTests_BigQueryIO_Java.groovy | 13 +-
.../job_PerformanceTests_BigQueryIO_Python.groovy | 11 +-
.../job_PerformanceTests_FileBasedIO_IT.groovy | 26 +
.../job_PerformanceTests_HadoopFormat.groovy | 6 +
.../jenkins/job_PerformanceTests_JDBC.groovy | 7 +-
.../jenkins/job_PerformanceTests_KafkaIO_IT.groovy | 6 +
.../job_PerformanceTests_MongoDBIO_IT.groovy | 6 +
.../job_PerformanceTests_PubsubIO_Python.groovy | 72 +
.../jenkins/job_PerformanceTests_Python.groovy | 1 +
...ommit_CrossLanguageValidatesRunner_Flink.groovy | 4 +-
...ommit_CrossLanguageValidatesRunner_Spark.groovy | 4 +-
...ava_Dataflow_Portability_Examples_Java11.groovy | 47 -
.../job_PostCommit_Java_Nexmark_Dataflow.groovy | 13 +-
.../job_PostCommit_Java_Nexmark_Direct.groovy | 8 +-
.../job_PostCommit_Java_Nexmark_Flink.groovy | 25 +-
.../job_PostCommit_Java_Nexmark_Spark.groovy | 8 +-
.../job_PostCommit_Java_PortabilityApi.groovy | 51 -
...unner_DataflowPortabilityExecutableStage.groovy | 54 -
...ob_PostCommit_Java_ValidatesRunner_Flink.groovy | 2 +-
...Commit_Java_ValidatesRunner_Flink_Java11.groovy | 60 +
..._ValidatesRunner_PortabilityApi_Dataflow.groovy | 51 -
...tesRunner_PortabilityApi_Dataflow_Java11.groovy | 48 -
.../job_PreCommit_BeamSQL_ZetaSQL_Java11.groovy | 39 +
..._PreCommit_Java_Examples_Dataflow_Java11.groovy | 53 +
...job_PreCommit_Java_PortabilityApi_Java11.groovy | 52 +
.../jenkins/job_PreCommit_SQL_Java11.groovy | 55 +
.test-infra/metrics/README.md | 35 +-
.test-infra/metrics/apply_configmaps.sh | 26 -
.test-infra/metrics/beam-influxdb-autobackup.yaml | 48 +
...eam-influxdb-backups-persistentvolumeclaim.yaml | 28 +
...eam-influxdb-storage-persistentvolumeclaim.yaml | 28 +
.test-infra/metrics/beam-influxdb.yaml | 117 +
.test-infra/metrics/beamgrafana-deploy.yaml | 40 +-
.test-infra/metrics/beamprometheus-deploy.yaml | 125 -
.test-infra/metrics/build.gradle | 13 +
.../metrics/build_and_publish_containers.sh | 6 +
.test-infra/metrics/docker-compose.yml | 61 +-
.test-infra/metrics/grafana/Dockerfile | 2 +-
.../dashboards/Post-Commits_status_dashboard.json | 2 +-
.../grafana/dashboards/home/getting_started.json | 139 +
.../perftests_metrics/Combine_Load_Tests.json | 459 +
.../perftests_metrics/GBK_Load_Tests.json | 922 +
.../Java_IO_IT_Tests_Dataflow.json | 2631 +
.../perftests_metrics/ParDo_Load_Tests.json | 600 +
.../Python_IO_IT_Tests_Dataflow.json | 297 +
.../perftests_metrics/coGBK_Load_Tests.json | 604 +
.../grafana/provisioning/dashboards/all.yaml | 23 +-
.../provisioning/datasources/beaminfluxdb.yaml | 33 +
.../provisioning/datasources/beampostgresql.yaml | 8 +-
.../alertmanager/config/alertmanager.yml | 41 -
.../prometheus/prometheus/config/prometheus.yml | 40 -
.../metrics/prometheus/prometheus/config/rules.yml | 35 -
.yamllint.yml | 25 +
CHANGES.md | 64 +-
LICENSE | 462 -
build.gradle | 55 +-
buildSrc/build.gradle | 3 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 125 +-
.../org/apache/beam/gradle/Repositories.groovy | 4 +
.../org/apache/beam/gradle/VendorJavaPlugin.groovy | 17 +-
.../beam/examples/complete/AutoComplete.java | 4 +-
.../apache/beam/examples/snippets/Snippets.java | 131 +-
.../beam/examples/snippets/SnippetsTest.java | 46 +
.../transforms/python/elementwise/filter-py.ipynb | 155 +-
.../transforms/python/elementwise/flatmap-py.ipynb | 74 +-
.../transforms/python/elementwise/keys-py.ipynb | 7 +-
.../transforms/python/elementwise/kvswap-py.ipynb | 7 +-
.../transforms/python/elementwise/map-py.ipynb | 58 +-
.../transforms/python/elementwise/pardo-py.ipynb | 35 +-
.../python/elementwise/partition-py.ipynb | 51 +-
.../transforms/python/elementwise/regex-py.ipynb | 31 +-
.../python/elementwise/tostring-py.ipynb | 13 +-
.../transforms/python/elementwise/values-py.ipynb | 7 +-
.../python/elementwise/withtimestamps-py.ipynb | 4 +-
gradle.properties | 4 +-
learning/katas/README.md | 2 +-
.../GroupByKey/GroupByKey/cmd/main.go | 43 +
.../Core Transforms/GroupByKey/GroupByKey/go.mod | 26 +
.../Core Transforms/GroupByKey/GroupByKey/go.sum | 315 +
.../GroupByKey/GroupByKey/pkg/task/task.go | 25 +
.../GroupByKey/GroupByKey/task-info.yaml | 35 +
.../GroupByKey/GroupByKey/task-remote-info.yaml | 2 +
.../Core Transforms/GroupByKey/GroupByKey/task.md | 54 +
.../GroupByKey/GroupByKey/test/task_test.go | 57 +
.../Core Transforms/GroupByKey/lesson-info.yaml | 0
.../GroupByKey/lesson-remote-info.yaml | 3 +
.../Map/ParDo OneToMany/cmd/main.go | 41 +
.../go/Core Transforms/Map/ParDo OneToMany/go.mod | 27 +
.../go/Core Transforms/Map/ParDo OneToMany/go.sum | 129 +
.../Map/ParDo OneToMany/pkg/task/task.go | 33 +
.../Map/ParDo OneToMany/task-info.yaml | 38 +
.../Map/ParDo OneToMany/task-remote-info.yaml | 2 +
.../go/Core Transforms/Map/ParDo OneToMany/task.md | 32 +
.../Map/ParDo OneToMany/test/task_test.go | 44 +
.../Core Transforms/Map/ParDo Struct/cmd/main.go | 41 +
.../go/Core Transforms/Map/ParDo Struct/go.mod | 27 +
.../go/Core Transforms/Map/ParDo Struct/go.sum | 129 +
.../Map/ParDo Struct/pkg/task/task.go | 30 +
.../Map/ParDo Struct/task-info.yaml | 41 +
.../Map/ParDo Struct/task-remote-info.yaml | 2 +
.../go/Core Transforms/Map/ParDo Struct/task.md | 34 +
.../Map/ParDo Struct/test/task_test.go | 44 +
.../katas/go/Core Transforms/Map/ParDo/cmd/main.go | 43 +
learning/katas/go/Core Transforms/Map/ParDo/go.mod | 27 +
learning/katas/go/Core Transforms/Map/ParDo/go.sum | 129 +
.../go/Core Transforms/Map/ParDo/pkg/task/task.go | 26 +
.../go/Core Transforms/Map/ParDo/task-info.yaml | 38 +
.../Map/ParDo/task-remote-info.yaml | 2 +
.../katas/go/Core Transforms/Map/ParDo/task.md | 39 +
.../go/Core Transforms/Map/ParDo/test/task_test.go | 45 +
.../katas/go/Core Transforms/Map/lesson-info.yaml | 23 +
.../go/Core Transforms/Map/lesson-remote-info.yaml | 3 +
.../katas/go/Core Transforms/section-info.yaml | 22 +
.../go/Core Transforms/section-remote-info.yaml | 2 +
.../Introduction/Hello Beam/Hello Beam Test/go.mod | 25 +
.../Introduction/Hello Beam/Hello Beam Test/go.sum | 58 +
.../Hello Beam/Hello Beam Test/pkg/task/task.go | 24 +
.../Hello Beam/Hello Beam Test/task-info.yaml | 36 +
.../Hello Beam Test/task-remote-info.yaml | 2 +
.../Hello Beam/Hello Beam Test/task.md | 41 +
.../Hello Beam/Hello Beam Test/test/task_test.go | 39 +
.../Introduction/Hello Beam/Hello Beam/cmd/main.go | 38 +
.../go/Introduction/Hello Beam/Hello Beam/go.mod | 27 +
.../go/Introduction/Hello Beam/Hello Beam/go.sum | 119 +
.../Hello Beam/Hello Beam/pkg/task/task.go | 24 +
.../Hello Beam/Hello Beam/task-info.yaml | 35 +
.../Hello Beam/Hello Beam/task-remote-info.yaml | 2 +
.../go/Introduction/Hello Beam/Hello Beam/task.md | 51 +
.../Hello Beam/Hello Beam/test/task_test.go | 37 +
.../go/Introduction/Hello Beam/lesson-info.yaml | 22 +
.../Hello Beam/lesson-remote-info.yaml | 3 +
learning/katas/go/Introduction/section-info.yaml | 21 +
.../katas/go/Introduction/section-remote-info.yaml | 2 +
learning/katas/go/README.md | 29 +
learning/katas/go/course-info.yaml | 27 +
learning/katas/go/course-remote-info.yaml | 2 +
.../Aggregation/Count/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Count/task.html | 29 -
.../Common Transforms/Aggregation/Count/task.md | 27 +
.../Aggregation/Max/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Max/task.html | 29 -
.../java/Common Transforms/Aggregation/Max/task.md | 27 +
.../Aggregation/Mean/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Mean/task.html | 29 -
.../Common Transforms/Aggregation/Mean/task.md | 27 +
.../Aggregation/Min/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Min/task.html | 29 -
.../java/Common Transforms/Aggregation/Min/task.md | 27 +
.../Aggregation/Sum/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Sum/task.html | 29 -
.../java/Common Transforms/Aggregation/Sum/task.md | 27 +
.../Filter/Filter/task-remote-info.yaml | 2 +-
.../java/Common Transforms/Filter/Filter/task.html | 34 -
.../java/Common Transforms/Filter/Filter/task.md | 30 +
.../Filter/ParDo/task-remote-info.yaml | 2 +-
.../java/Common Transforms/Filter/ParDo/task.html | 33 -
.../java/Common Transforms/Filter/ParDo/task.md | 30 +
.../WithKeys/WithKeys/task-remote-info.yaml | 2 +-
.../Common Transforms/WithKeys/WithKeys/task.html | 34 -
.../Common Transforms/WithKeys/WithKeys/task.md | 33 +
.../Branching/Branching/task-remote-info.yaml | 2 +-
.../Core Transforms/Branching/Branching/task.html | 35 -
.../Core Transforms/Branching/Branching/task.md | 32 +
.../CoGroupByKey/task-remote-info.yaml | 2 +-
.../CoGroupByKey/CoGroupByKey/task.html | 45 -
.../CoGroupByKey/CoGroupByKey/task.md | 43 +
.../BinaryCombineFn Lambda/task-remote-info.yaml | 2 +-
.../Combine/BinaryCombineFn Lambda/task.html | 43 -
.../Combine/BinaryCombineFn Lambda/task.md | 40 +
.../Combine/BinaryCombineFn/task-remote-info.yaml | 2 +-
.../Combine/BinaryCombineFn/task.html | 50 -
.../Combine/BinaryCombineFn/task.md | 45 +
.../Combine/Combine PerKey/task-remote-info.yaml | 2 +-
.../Combine/Combine PerKey/task.html | 48 -
.../Core Transforms/Combine/Combine PerKey/task.md | 46 +
.../Combine/CombineFn/task-remote-info.yaml | 2 +-
.../Core Transforms/Combine/CombineFn/task.html | 52 -
.../java/Core Transforms/Combine/CombineFn/task.md | 47 +
.../Combine/Simple Function/task-remote-info.yaml | 2 +-
.../Combine/Simple Function/task.html | 49 -
.../Combine/Simple Function/task.md | 44 +
.../Composite Transform/task-remote-info.yaml | 2 +-
.../Composite Transform/task.html | 51 -
.../Composite Transform/task.md | 47 +
.../task-remote-info.yaml | 2 +-
.../DoFn Additional Parameters/task.html | 52 -
.../DoFn Additional Parameters/task.md | 38 +
.../Flatten/Flatten/task-remote-info.yaml | 2 +-
.../java/Core Transforms/Flatten/Flatten/task.html | 41 -
.../java/Core Transforms/Flatten/Flatten/task.md | 39 +
.../GroupByKey/GroupByKey/task-remote-info.yaml | 2 +-
.../GroupByKey/GroupByKey/task.html | 45 -
.../Core Transforms/GroupByKey/GroupByKey/task.md | 43 +
.../Map/FlatMapElements/task-remote-info.yaml | 2 +-
.../Core Transforms/Map/FlatMapElements/task.html | 44 -
.../Core Transforms/Map/FlatMapElements/task.md | 39 +
.../Map/MapElements/task-remote-info.yaml | 2 +-
.../java/Core Transforms/Map/MapElements/task.html | 42 -
.../java/Core Transforms/Map/MapElements/task.md | 38 +
.../Map/ParDo OneToMany/task-remote-info.yaml | 2 +-
.../Core Transforms/Map/ParDo OneToMany/task.html | 38 -
.../Core Transforms/Map/ParDo OneToMany/task.md | 37 +
.../Map/ParDo/task-remote-info.yaml | 2 +-
.../katas/java/Core Transforms/Map/ParDo/task.html | 42 -
.../katas/java/Core Transforms/Map/ParDo/task.md | 40 +
.../Partition/Partition/task-remote-info.yaml | 2 +-
.../Core Transforms/Partition/Partition/task.html | 48 -
.../Core Transforms/Partition/Partition/task.md | 44 +
.../Side Input/Side Input/task-remote-info.yaml | 2 +-
.../Side Input/Side Input/task.html | 54 -
.../Core Transforms/Side Input/Side Input/task.md | 52 +
.../Side Output/Side Output/task-remote-info.yaml | 2 +-
.../Side Output/Side Output/task.html | 44 -
.../Side Output/Side Output/task.md | 42 +
.../Word Count/Word Count/task-remote-info.yaml | 2 +-
.../java/Examples/Word Count/Word Count/task.html | 36 -
.../java/Examples/Word Count/Word Count/task.md | 33 +
.../Built-in IOs/task-remote-info.yaml | 2 +-
.../java/IO/Built-in IOs/Built-in IOs/task.html | 33 -
.../java/IO/Built-in IOs/Built-in IOs/task.md | 29 +
.../IO/TextIO/TextIO Read/task-remote-info.yaml | 2 +-
.../katas/java/IO/TextIO/TextIO Read/task.html | 47 -
learning/katas/java/IO/TextIO/TextIO Read/task.md | 44 +
.../Hello Beam/Hello Beam/task-remote-info.yaml | 2 +-
.../Introduction/Hello Beam/Hello Beam/task.html | 53 -
.../Introduction/Hello Beam/Hello Beam/task.md | 49 +
.../Early Triggers/task-remote-info.yaml | 2 +-
.../Early Triggers/Early Triggers/task.html | 59 -
.../Triggers/Early Triggers/Early Triggers/task.md | 60 +
.../Event Time Triggers/task-remote-info.yaml | 2 +-
.../Event Time Triggers/task.html | 78 -
.../Event Time Triggers/task.md | 72 +
.../Window Accumulation Mode/task-remote-info.yaml | 2 +-
.../Window Accumulation Mode/task.html | 63 -
.../Window Accumulation Mode/task.md | 65 +
.../Adding Timestamp/ParDo/task-remote-info.yaml | 2 +-
.../Windowing/Adding Timestamp/ParDo/task.html | 48 -
.../java/Windowing/Adding Timestamp/ParDo/task.md | 46 +
.../WithTimestamps/task-remote-info.yaml | 2 +-
.../Adding Timestamp/WithTimestamps/task.html | 42 -
.../Adding Timestamp/WithTimestamps/task.md | 39 +
.../Fixed Time Window/task-remote-info.yaml | 2 +-
.../Fixed Time Window/Fixed Time Window/task.html | 61 -
.../Fixed Time Window/Fixed Time Window/task.md | 53 +
learning/katas/java/course-remote-info.yaml | 2 +-
.../katas/java/gradle/wrapper/gradle-wrapper.jar | Bin 54413 -> 55190 bytes
.../java/gradle/wrapper/gradle-wrapper.properties | 2 +-
.../Aggregation/Count/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Count/task.html | 29 -
.../Common Transforms/Aggregation/Count/task.md | 27 +
.../Common Transforms/Aggregation/Count/tests.py | 4 +-
.../Aggregation/Largest/task-remote-info.yaml | 2 +-
.../Aggregation/Largest/task.html | 29 -
.../Common Transforms/Aggregation/Largest/task.md | 27 +
.../Common Transforms/Aggregation/Largest/tests.py | 4 +-
.../Aggregation/Mean/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Mean/task.html | 29 -
.../Common Transforms/Aggregation/Mean/task.md | 27 +
.../Common Transforms/Aggregation/Mean/tests.py | 4 +-
.../Aggregation/Smallest/task-remote-info.yaml | 2 +-
.../Aggregation/Smallest/task.html | 29 -
.../Common Transforms/Aggregation/Smallest/task.md | 27 +
.../Aggregation/Smallest/tests.py | 4 +-
.../Aggregation/Sum/task-remote-info.yaml | 2 +-
.../Common Transforms/Aggregation/Sum/task.html | 30 -
.../Common Transforms/Aggregation/Sum/task.md | 28 +
.../Common Transforms/Aggregation/Sum/tests.py | 4 +-
.../Filter/Filter/task-remote-info.yaml | 2 +-
.../Common Transforms/Filter/Filter/task.html | 34 -
.../python/Common Transforms/Filter/Filter/task.md | 30 +
.../Common Transforms/Filter/Filter/tests.py | 16 +-
.../Filter/ParDo/task-remote-info.yaml | 2 +-
.../Common Transforms/Filter/ParDo/task.html | 31 -
.../python/Common Transforms/Filter/ParDo/task.md | 28 +
.../python/Common Transforms/Filter/ParDo/tests.py | 4 +-
.../WithKeys/WithKeys/task-remote-info.yaml | 2 +-
.../Common Transforms/WithKeys/WithKeys/task.html | 30 -
.../Common Transforms/WithKeys/WithKeys/task.md | 28 +
.../Common Transforms/WithKeys/WithKeys/tests.py | 16 +-
.../Branching/Branching/task-remote-info.yaml | 2 +-
.../Core Transforms/Branching/Branching/task.html | 35 -
.../Core Transforms/Branching/Branching/task.md | 31 +
.../Core Transforms/Branching/Branching/tests.py | 4 +-
.../CoGroupByKey/task-remote-info.yaml | 2 +-
.../CoGroupByKey/CoGroupByKey/task.html | 42 -
.../CoGroupByKey/CoGroupByKey/task.md | 40 +
.../CoGroupByKey/CoGroupByKey/tests.py | 4 +-
.../Combine/Combine PerKey/task-remote-info.yaml | 2 +-
.../Combine/Combine PerKey/task.html | 48 -
.../Core Transforms/Combine/Combine PerKey/task.md | 46 +
.../Combine/Combine PerKey/tests.py | 16 +-
.../Combine/CombineFn/task-remote-info.yaml | 2 +-
.../Core Transforms/Combine/CombineFn/task.html | 52 -
.../Core Transforms/Combine/CombineFn/task.md | 47 +
.../Core Transforms/Combine/CombineFn/tests.py | 16 +-
.../Combine/Simple Function/task-remote-info.yaml | 2 +-
.../Combine/Simple Function/task.html | 47 -
.../Combine/Simple Function/task.md | 42 +
.../Combine/Simple Function/tests.py | 16 +-
.../Composite Transform/task-remote-info.yaml | 2 +-
.../Composite Transform/task.html | 49 -
.../Composite Transform/task.md | 46 +
.../Composite Transform/tests.py | 16 +-
.../Flatten/Flatten/task-remote-info.yaml | 2 +-
.../Core Transforms/Flatten/Flatten/task.html | 40 -
.../python/Core Transforms/Flatten/Flatten/task.md | 38 +
.../Core Transforms/Flatten/Flatten/tests.py | 16 +-
.../GroupByKey/GroupByKey/task-remote-info.yaml | 2 +-
.../GroupByKey/GroupByKey/task.html | 44 -
.../Core Transforms/GroupByKey/GroupByKey/task.md | 42 +
.../Core Transforms/GroupByKey/GroupByKey/tests.py | 4 +-
.../Map/FlatMap/task-remote-info.yaml | 2 +-
.../python/Core Transforms/Map/FlatMap/task.html | 43 -
.../python/Core Transforms/Map/FlatMap/task.md | 39 +
.../python/Core Transforms/Map/FlatMap/tests.py | 16 +-
.../Core Transforms/Map/Map/task-remote-info.yaml | 2 +-
.../katas/python/Core Transforms/Map/Map/task.html | 39 -
.../katas/python/Core Transforms/Map/Map/task.md | 36 +
.../katas/python/Core Transforms/Map/Map/tests.py | 16 +-
.../Map/ParDo OneToMany/task-remote-info.yaml | 2 +-
.../Core Transforms/Map/ParDo OneToMany/task.html | 43 -
.../Core Transforms/Map/ParDo OneToMany/task.md | 43 +
.../Core Transforms/Map/ParDo OneToMany/tests.py | 27 +-
.../Map/ParDo/task-remote-info.yaml | 2 +-
.../python/Core Transforms/Map/ParDo/task.html | 45 -
.../katas/python/Core Transforms/Map/ParDo/task.md | 44 +
.../python/Core Transforms/Map/ParDo/tests.py | 27 +-
.../Partition/Partition/task-remote-info.yaml | 2 +-
.../Core Transforms/Partition/Partition/task.html | 47 -
.../Core Transforms/Partition/Partition/task.md | 43 +
.../Core Transforms/Partition/Partition/tests.py | 16 +-
.../Side Input/Side Input/task-remote-info.yaml | 2 +-
.../Side Input/Side Input/task.html | 53 -
.../Core Transforms/Side Input/Side Input/task.md | 51 +
.../Core Transforms/Side Input/Side Input/tests.py | 27 +-
.../Side Output/Side Output/task-remote-info.yaml | 2 +-
.../Side Output/Side Output/task.html | 44 -
.../Side Output/Side Output/task.md | 42 +
.../Side Output/Side Output/tests.py | 27 +-
.../Word Count/Word Count/task-remote-info.yaml | 2 +-
.../Examples/Word Count/Word Count/task.html | 40 -
.../python/Examples/Word Count/Word Count/task.md | 38 +
.../python/Examples/Word Count/Word Count/tests.py | 4 +-
.../Built-in IOs/task-remote-info.yaml | 2 +-
.../python/IO/Built-in IOs/Built-in IOs/task.html | 32 -
.../python/IO/Built-in IOs/Built-in IOs/task.md | 28 +
.../IO/TextIO/ReadFromText/task-remote-info.yaml | 2 +-
.../katas/python/IO/TextIO/ReadFromText/task.html | 45 -
.../katas/python/IO/TextIO/ReadFromText/task.md | 42 +
.../katas/python/IO/TextIO/ReadFromText/tests.py | 16 +-
.../Hello Beam/Hello Beam/task-remote-info.yaml | 2 +-
.../Introduction/Hello Beam/Hello Beam/task.html | 53 -
.../Introduction/Hello Beam/Hello Beam/task.md | 49 +
.../Introduction/Hello Beam/Hello Beam/tests.py | 15 +-
.../Adding Timestamp/ParDo/task-info.yaml | 6 +-
.../Adding Timestamp/ParDo/task-remote-info.yaml | 2 +-
.../Windowing/Adding Timestamp/ParDo/task.html | 47 -
.../Windowing/Adding Timestamp/ParDo/task.md | 45 +
.../Windowing/Adding Timestamp/ParDo/task.py | 20 +-
.../Windowing/Adding Timestamp/ParDo/tests.py | 37 +-
.../Fixed Time Window/task-info.yaml | 2 +-
.../Fixed Time Window/task-remote-info.yaml | 2 +-
.../Fixed Time Window/Fixed Time Window/task.html | 61 -
.../Fixed Time Window/Fixed Time Window/task.md | 54 +
.../Fixed Time Window/Fixed Time Window/task.py | 21 +-
.../Fixed Time Window/Fixed Time Window/tests.py | 16 +-
learning/katas/python/course-remote-info.yaml | 2 +-
learning/katas/python/requirements.txt | 2 +
learning/katas/python/test_helper.py | 3 +-
.../fn-execution/src/main/proto/beam_fn_api.proto | 17 +-
.../pipeline/src/main/proto/beam_runner_api.proto | 69 +-
model/pipeline/src/main/proto/metrics.proto | 16 +-
.../src/main/groovy/MobileGamingCommands.groovy | 20 +-
release/src/main/groovy/TestScripts.groovy | 2 +-
.../src/main/scripts/build_release_candidate.sh | 28 +-
release/src/main/scripts/mass_comment.py | 147 +
release/src/main/scripts/verify_release_build.sh | 39 +-
runners/apex/build.gradle | 1 +
.../translation/operators/ApexParDoOperator.java | 1 +
.../operators/ApexTimerInternalsTest.java | 6 +-
.../core/construction/ArtifactResolver.java | 4 +
.../construction/AvroGenericCoderTranslator.java | 4 +-
.../core/construction/CoderTranslation.java | 35 +-
.../runners/core/construction/CoderTranslator.java | 8 +-
.../core/construction/CoderTranslators.java | 9 +-
.../core/construction/DefaultArtifactResolver.java | 19 +
.../runners/core/construction/Environments.java | 70 +-
.../beam/runners/core/construction/External.java | 86 +-
.../core/construction/ModelCoderRegistrar.java | 11 +-
.../runners/core/construction/ModelCoders.java | 18 +-
.../core/construction/PTransformTranslation.java | 40 +-
.../core/construction/ParDoTranslation.java | 90 +-
.../core/construction/RehydratedComponents.java | 4 +-
.../runners/core/construction/SplittableParDo.java | 6 -
.../construction/SplittableParDoNaiveBounded.java | 12 +-
.../beam/runners/core/construction/Timer.java | 33 +-
.../core/construction/graph/PipelineTrimmer.java | 69 -
.../core/construction/graph/PipelineValidator.java | 9 +
.../graph/TrivialNativeTransformExpander.java | 74 +
.../core/construction/CoderTranslationTest.java | 5 +-
.../runners/core/construction/CommonCoderTest.java | 3 +-
.../core/construction/EnvironmentsTest.java | 7 +
.../core/construction/ParDoTranslationTest.java | 62 +-
.../core/construction/PipelineTranslationTest.java | 5 +-
.../construction/graph/QueryablePipelineTest.java | 6 +-
.../org/apache/beam/runners/core/DoFnRunner.java | 9 +-
.../beam/runners/core/InMemoryTimerInternals.java | 22 +-
.../runners/core/LateDataDroppingDoFnRunner.java | 10 +-
...TimeBoundedSplittableProcessElementInvoker.java | 31 +-
.../apache/beam/runners/core/ProcessFnRunner.java | 3 +-
.../runners/core/PushbackSideInputDoFnRunner.java | 3 +-
.../beam/runners/core/ReduceFnContextFactory.java | 9 +-
.../apache/beam/runners/core/SimpleDoFnRunner.java | 234 +-
.../core/SimplePushbackSideInputDoFnRunner.java | 5 +-
.../core/SplittableParDoViaKeyedWorkItems.java | 3 +-
.../core/SplittableProcessElementInvoker.java | 9 +-
.../beam/runners/core/StatefulDoFnRunner.java | 21 +-
.../apache/beam/runners/core/TimerInternals.java | 32 +-
.../core/metrics/MetricsContainerStepMap.java | 14 +-
.../core/metrics/MonitoringInfoConstants.java | 4 +
.../TriggerStateMachineContextFactory.java | 5 +
.../runners/core/InMemoryTimerInternalsTest.java | 38 +-
.../beam/runners/core/KeyedWorkItemCoderTest.java | 6 +-
.../apache/beam/runners/core/ReduceFnTester.java | 4 +-
.../beam/runners/core/SimpleDoFnRunnerTest.java | 3 +
.../SimplePushbackSideInputDoFnRunnerTest.java | 16 +-
.../runners/core/SplittableParDoProcessFnTest.java | 3 +-
.../beam/runners/core/StatefulDoFnRunnerTest.java | 42 +
.../beam/runners/core/TimerInternalsTest.java | 37 +-
.../core/triggers/TriggerStateMachineTester.java | 9 +-
runners/direct-java/build.gradle | 7 +
...LifecycleManagerRemovingTransformEvaluator.java | 4 +-
.../direct/ExecutorServiceParallelExecutor.java | 36 +-
.../apache/beam/runners/direct/ParDoEvaluator.java | 3 +-
.../direct/StatefulParDoEvaluatorFactory.java | 3 +-
.../beam/runners/direct/DirectRunnerTest.java | 2 +-
.../runners/direct/DirectTimerInternalsTest.java | 26 +-
...cycleManagerRemovingTransformEvaluatorTest.java | 10 +-
.../beam/runners/direct/EvaluationContextTest.java | 3 +-
.../beam/runners/direct/WatermarkManagerTest.java | 148 +-
runners/flink/1.10/build.gradle | 2 +-
.../apache/beam/runners/flink/FlinkRunnerTest.java | 4 +-
.../flink/streaming/FlinkStateInternalsTest.java | 152 -
runners/flink/1.9/build.gradle | 2 +-
runners/flink/flink_runner.gradle | 9 +-
runners/flink/job-server/flink_job_server.gradle | 3 +-
.../flink/FlinkBatchTransformTranslators.java | 12 +-
.../runners/flink/FlinkExecutionEnvironments.java | 18 +
.../apache/beam/runners/flink/FlinkJobInvoker.java | 8 +-
.../beam/runners/flink/FlinkJobServerDriver.java | 2 +-
.../flink/FlinkPipelineExecutionEnvironment.java | 11 +
.../beam/runners/flink/FlinkPipelineOptions.java | 51 +-
.../beam/runners/flink/FlinkPipelineRunner.java | 11 +-
.../flink/FlinkPortableClientEntryPoint.java | 8 +-
.../runners/flink/FlinkPortableRunnerResult.java | 7 +-
.../org/apache/beam/runners/flink/FlinkRunner.java | 25 -
.../FlinkStreamingPortablePipelineTranslator.java | 13 +-
.../apache/beam/runners/flink/TestFlinkRunner.java | 1 -
.../flink/metrics/DoFnRunnerWithMetricsUpdate.java | 10 +-
.../functions/FlinkExecutableStageFunction.java | 73 +-
.../functions/FlinkStatefulDoFnFunction.java | 14 +-
.../functions/ImpulseSourceFunction.java | 51 +-
.../flink/translation/utils/CheckpointStats.java | 48 +
.../flink/translation/utils/Workarounds.java | 25 +
.../wrappers/streaming/DoFnOperator.java | 328 +-
.../streaming/ExecutableStageDoFnOperator.java | 330 +-
.../wrappers/streaming/SplittableDoFnOperator.java | 15 +-
.../wrappers/streaming/WindowDoFnOperator.java | 9 +-
.../streaming/io/UnboundedSourceWrapper.java | 63 +-
.../streaming/stableinput/BufferedElements.java | 16 +-
.../streaming/stableinput/BufferingDoFnRunner.java | 110 +-
.../streaming/state/FlinkStateInternals.java | 93 +-
.../flink/FlinkExecutionEnvironmentsTest.java | 36 +
.../runners/flink/FlinkJobServerDriverTest.java | 2 +-
.../runners/flink/FlinkPipelineOptionsTest.java | 4 +-
.../flink/FlinkRequiresStableInputTest.java | 2 +-
.../beam/runners/flink/FlinkSavepointTest.java | 38 +-
.../beam/runners/flink/FlinkSubmissionTest.java | 3 -
.../beam/runners/flink/PortableExecutionTest.java | 3 +-
.../runners/flink/PortableStateExecutionTest.java | 3 +-
.../runners/flink/PortableTimersExecutionTest.java | 36 +-
.../beam/runners/flink/ReadSourcePortableTest.java | 3 +-
.../beam/runners/flink/batch/ReshuffleTest.java | 104 +
.../FlinkBroadcastStateInternalsTest.java | 0
.../flink/streaming/FlinkStateInternalsTest.java | 183 +
.../flink/streaming/GroupByWithNullValuesTest.java | 1 -
.../FlinkExecutableStageFunctionTest.java | 14 +
.../functions/ImpulseSourceFunctionTest.java | 27 +-
.../wrappers/streaming/DoFnOperatorTest.java | 134 +-
.../streaming/ExecutableStageDoFnOperatorTest.java | 313 +-
.../wrappers/streaming/WindowDoFnOperatorTest.java | 4 +-
.../streaming/io/UnboundedSourceWrapperTest.java | 250 +-
.../stableinput/BufferedElementsTest.java | 6 +-
.../stableinput/BufferingDoFnRunnerTest.java | 171 +
.../website/PipelineOptionsTableGenerator.java | 4 +-
runners/gearpump/build.gradle | 1 +
runners/google-cloud-dataflow-java/build.gradle | 84 +-
.../dataflow/DataflowPipelineTranslator.java | 22 +-
.../beam/runners/dataflow/DataflowRunner.java | 117 +-
.../dataflow/PrimitiveParDoSingleFactory.java | 47 +-
.../beam/runners/dataflow/TestDataflowRunner.java | 8 +-
.../beam/runners/dataflow/util/GcsStager.java | 33 +-
.../beam/runners/dataflow/util/PackageUtil.java | 171 +-
.../apache/beam/runners/dataflow/util/Stager.java | 14 +-
.../dataflow/BatchStatefulParDoOverridesTest.java | 5 +
.../dataflow/DataflowPipelineTranslatorTest.java | 278 +-
.../beam/runners/dataflow/DataflowRunnerTest.java | 55 +-
.../beam/runners/dataflow/util/GCSUploadMain.java | 20 +-
.../runners/dataflow/util/PackageUtilTest.java | 99 +-
.../google-cloud-dataflow-java/worker/build.gradle | 2 +-
.../worker/ApplianceShuffleEntryReader.java | 6 +-
.../dataflow/worker/BatchDataflowWorker.java | 9 +-
.../dataflow/worker/BatchModeExecutionContext.java | 48 +-
.../worker/BeamFnMapTaskExecutorFactory.java | 11 -
.../worker/ChunkingShuffleBatchReader.java | 8 +-
.../dataflow/worker/DataflowExecutionContext.java | 6 +-
.../dataflow/worker/DataflowProcessFnRunner.java | 8 +-
.../dataflow/worker/FnApiWindowMappingFn.java | 13 +-
.../dataflow/worker/GroupAlsoByWindowFnRunner.java | 6 +-
.../runners/dataflow/worker/SimpleParDoFn.java | 14 +-
.../dataflow/worker/StreamingDataflowWorker.java | 17 +-
.../StreamingKeyedWorkItemSideInputDoFnRunner.java | 8 +-
.../worker/StreamingModeExecutionContext.java | 22 +-
.../worker/StreamingSideInputDoFnRunner.java | 8 +-
.../dataflow/worker/WindmillStateCache.java | 13 +-
.../dataflow/worker/WindmillTimerInternals.java | 152 +-
.../fn/control/ProcessRemoteBundleOperation.java | 22 +-
.../dataflow/worker/fn/control/TimerReceiver.java | 268 -
.../worker/fn/data/BeamFnDataGrpcService.java | 2 +-
.../fn/data/RemoteGrpcPortReadOperation.java | 2 +-
.../fn/data/RemoteGrpcPortWriteOperation.java | 2 +-
.../worker/graph/RegisterNodeFunction.java | 16 +-
.../JulHandlerPrintStreamAdapterFactory.java | 44 +-
.../dataflow/worker/status/DebugCapture.java | 9 +-
.../util/BatchGroupAlsoByWindowViaIteratorsFn.java | 17 +-
.../common/worker/CachingShuffleBatchReader.java | 61 +-
.../util/common/worker/ShuffleBatchReader.java | 5 +-
.../dataflow/worker/FnApiWindowMappingFnTest.java | 4 +
.../worker/StreamingGroupAlsoByWindowFnsTest.java | 1 +
...eamingKeyedWorkItemSideInputDoFnRunnerTest.java | 1 +
.../worker/StreamingModeExecutionContextTest.java | 11 +-
.../worker/StreamingSideInputFetcherTest.java | 1 +
.../dataflow/worker/UserParDoFnFactoryTest.java | 4 +
.../dataflow/worker/WindmillKeyedWorkItemTest.java | 3 +-
.../dataflow/worker/WindmillStateCacheTest.java | 13 +-
.../worker/WindmillStateInternalsTest.java | 7 +-
.../worker/WindmillTimerInternalsTest.java | 48 +-
.../dataflow/worker/WorkerCustomSourcesTest.java | 16 +-
.../fn/control/BeamFnMapTaskExecutorTest.java | 10 +-
.../RegisterAndProcessBundleOperationTest.java | 44 +-
.../worker/fn/control/TimerReceiverTest.java | 543 -
.../worker/fn/data/BeamFnDataGrpcServiceTest.java | 6 +-
.../fn/data/RemoteGrpcPortReadOperationTest.java | 8 +-
.../fn/data/RemoteGrpcPortWriteOperationTest.java | 6 +-
.../graph/LengthPrefixUnknownCodersTest.java | 2 +-
.../JulHandlerPrintStreamAdapterFactoryTest.java | 21 +
.../dataflow/worker/status/DebugCaptureTest.java | 2 +-
.../worker/BatchingShuffleEntryReaderTest.java | 18 +-
.../worker/CachingShuffleBatchReaderTest.java | 4 +-
runners/java-fn-execution/build.gradle | 1 -
.../beam/runners/fnexecution/GrpcFnServer.java | 56 +
.../artifact/ArtifactRetrievalService.java | 127 +
.../artifact/ArtifactStagingService.java | 655 +
...BeamFileSystemLegacyArtifactStagingService.java | 4 +-
.../control/DefaultJobBundleFactory.java | 86 +-
.../fnexecution/control/FnApiControlClient.java | 13 +-
.../control/InstructionRequestHandler.java | 2 +
.../fnexecution/control/OutputReceiverFactory.java | 2 +-
.../control/ProcessBundleDescriptors.java | 193 +-
.../runners/fnexecution/control/RemoteBundle.java | 16 +
.../fnexecution/control/SdkHarnessClient.java | 271 +-
.../SingleEnvironmentInstanceJobBundleFactory.java | 23 +-
.../fnexecution/control/StageBundleFactory.java | 10 +
.../fnexecution/control/TimerReceiverFactory.java | 91 +-
.../runners/fnexecution/data/GrpcDataService.java | 2 +-
.../environment/DockerEnvironmentFactory.java | 8 +-
.../environment/EmbeddedEnvironmentFactory.java | 9 +-
.../environment/EnvironmentFactory.java | 7 +-
.../environment/ExternalEnvironmentFactory.java | 50 +-
.../environment/ProcessEnvironmentFactory.java | 8 +-
.../StaticRemoteEnvironmentFactory.java | 6 +-
.../jobsubmission/InMemoryJobService.java | 488 -
.../fnexecution/jobsubmission/JobInvocation.java | 268 -
.../fnexecution/jobsubmission/JobInvoker.java | 57 -
.../fnexecution/jobsubmission/JobPreparation.java | 47 -
.../fnexecution/jobsubmission/JobServerDriver.java | 265 -
.../jobsubmission/PortablePipelineJarCreator.java | 295 -
.../jobsubmission/PortablePipelineJarUtils.java | 145 -
.../jobsubmission/PortablePipelineResult.java | 34 -
.../jobsubmission/PortablePipelineRunner.java | 26 -
.../fnexecution/jobsubmission/package-info.java | 20 -
.../provisioning/StaticGrpcProvisionService.java | 36 +-
.../translation/PipelineTranslatorUtils.java | 46 +-
.../runners/fnexecution/EmbeddedSdkHarness.java | 2 +-
.../artifact/ArtifactRetrievalServiceTest.java | 132 +
.../artifact/ArtifactStagingServiceTest.java | 173 +
.../control/DefaultJobBundleFactoryTest.java | 71 +-
.../control/FnApiControlClientTest.java | 19 -
.../control/ProcessBundleDescriptorsTest.java | 71 +-
.../fnexecution/control/RemoteExecutionTest.java | 710 +-
.../fnexecution/control/SdkHarnessClientTest.java | 99 +-
...gleEnvironmentInstanceJobBundleFactoryTest.java | 14 +-
.../control/TimerReceiverFactoryTest.java | 37 +
.../fnexecution/data/GrpcDataServiceTest.java | 4 +-
.../environment/DockerEnvironmentFactoryTest.java | 12 +-
.../environment/ProcessEnvironmentFactoryTest.java | 13 +-
.../jobsubmission/InMemoryJobServiceTest.java | 297 -
.../jobsubmission/JobInvocationTest.java | 218 -
.../PortablePipelineJarCreatorTest.java | 172 -
.../StaticGrpcProvisionServiceTest.java | 5 +-
runners/java-job-service/build.gradle | 40 +
.../runners/jobsubmission/InMemoryJobService.java | 527 +
.../beam/runners/jobsubmission/JobInvocation.java | 268 +
.../beam/runners/jobsubmission/JobInvoker.java | 57 +
.../beam/runners/jobsubmission/JobPreparation.java | 47 +
.../runners/jobsubmission/JobServerDriver.java | 280 +
.../jobsubmission/PortablePipelineJarCreator.java | 295 +
.../jobsubmission/PortablePipelineJarUtils.java | 145 +
.../jobsubmission/PortablePipelineResult.java | 34 +
.../jobsubmission/PortablePipelineRunner.java | 26 +
.../beam/runners/jobsubmission/package-info.java | 20 +
.../jobsubmission/InMemoryJobServiceTest.java | 307 +
.../runners/jobsubmission/JobInvocationTest.java | 218 +
.../PortablePipelineJarCreatorTest.java | 171 +
runners/jet/build.gradle | 1 +
.../runners/jet/processors/StatefulParDoP.java | 1 +
runners/portability/java/build.gradle | 1 +
.../beam/runners/portability/PortableRunner.java | 25 +-
.../testing/TestPortablePipelineOptions.java | 2 +-
.../portability/testing/TestPortableRunner.java | 2 +-
runners/samza/build.gradle | 2 +
.../beam/runners/samza/SamzaExecutionContext.java | 3 +-
.../beam/runners/samza/SamzaJobServerDriver.java | 6 +-
.../beam/runners/samza/SamzaPipelineRunner.java | 4 +-
.../runners/samza/SamzaPortablePipelineResult.java | 2 +-
.../org/apache/beam/runners/samza/SamzaRunner.java | 2 +-
.../samza/metrics/DoFnRunnerWithMetrics.java | 10 +-
.../apache/beam/runners/samza/runtime/DoFnOp.java | 2 +
.../runtime/DoFnRunnerWithKeyedInternals.java | 11 +-
.../beam/runners/samza/runtime/KeyedTimerData.java | 2 +-
.../runners/samza/runtime/SamzaDoFnRunners.java | 6 +-
.../samza/runtime/SamzaTimerInternalsFactory.java | 13 +-
.../runners/samza/runtime/KeyedTimerDataTest.java | 2 +-
.../runtime/SamzaTimerInternalsFactoryTest.java | 25 +-
runners/spark/build.gradle | 7 +-
runners/spark/job-server/build.gradle | 2 +
.../apache/beam/runners/spark/SparkJobInvoker.java | 8 +-
.../beam/runners/spark/SparkJobServerDriver.java | 2 +-
.../beam/runners/spark/SparkPipelineResult.java | 2 +-
.../beam/runners/spark/SparkPipelineRunner.java | 11 +-
.../translation/batch/DoFnRunnerWithMetrics.java | 10 +-
.../spark/translation/DoFnRunnerWithMetrics.java | 10 +-
.../SparkBatchPortablePipelineTranslator.java | 47 +-
.../translation/SparkExecutableStageFunction.java | 125 +-
.../spark/translation/SparkProcessContext.java | 1 +
.../runners/spark/SparkPortableExecutionTest.java | 2 +-
.../SparkExecutableStageFunctionTest.java | 20 +-
sdks/go/README.md | 2 +-
sdks/go/cmd/beamctl/cmd/artifact.go | 8 +-
sdks/go/cmd/beamctl/cmd/provision.go | 6 +-
sdks/go/examples/stringsplit/stringsplit.go | 232 +
sdks/go/pkg/beam/artifact/gcsproxy/retrieval.go | 20 +-
sdks/go/pkg/beam/artifact/gcsproxy/staging.go | 20 +-
sdks/go/pkg/beam/artifact/materialize.go | 62 +-
sdks/go/pkg/beam/artifact/materialize_test.go | 77 +-
sdks/go/pkg/beam/artifact/server_test.go | 26 +-
sdks/go/pkg/beam/artifact/stage.go | 32 +-
sdks/go/pkg/beam/artifact/stage_test.go | 12 +-
sdks/go/pkg/beam/core/funcx/fn.go | 7 +-
sdks/go/pkg/beam/core/graph/fn.go | 24 +-
sdks/go/pkg/beam/core/graph/fn_test.go | 99 +-
sdks/go/pkg/beam/core/metrics/store.go | 6 +
sdks/go/pkg/beam/core/runtime/exec/fn.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/pardo.go | 30 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 406 +
.../beam/core/runtime/exec/sdf_invokers_test.go | 309 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 388 +
sdks/go/pkg/beam/core/runtime/exec/translate.go | 98 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 263 +-
.../pkg/beam/core/runtime/graphx/translate_test.go | 56 +-
sdks/go/pkg/beam/core/runtime/harness/datamgr.go | 53 +-
.../pkg/beam/core/runtime/harness/datamgr_test.go | 14 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 13 +-
.../pkg/beam/core/runtime/harness/harness_test.go | 165 +
sdks/go/pkg/beam/core/runtime/harness/logging.go | 30 +-
.../pkg/beam/core/runtime/harness/logging_test.go | 6 +-
.../go/pkg/beam/core/runtime/harness/monitoring.go | 44 +-
sdks/go/pkg/beam/core/runtime/harness/session.go | 12 +-
sdks/go/pkg/beam/core/runtime/harness/statemgr.go | 58 +-
.../pkg/beam/core/runtime/harness/statemgr_test.go | 210 +-
sdks/go/pkg/beam/core/runtime/options.go | 9 +-
sdks/go/pkg/beam/core/runtime/pipelinex/clone.go | 3 +-
sdks/go/pkg/beam/core/runtime/pipelinex/replace.go | 68 +-
.../beam/core/runtime/pipelinex/replace_test.go | 116 +-
sdks/go/pkg/beam/core/runtime/pipelinex/util.go | 35 +-
.../pkg/beam/core/runtime/pipelinex/util_test.go | 231 +
sdks/go/pkg/beam/core/sdf/sdf.go | 79 +-
.../beam/io/rtrackers/offsetrange/offsetrange.go | 168 +
.../io/rtrackers/offsetrange/offsetrange_test.go | 212 +
sdks/go/pkg/beam/io/synthetic/rand.go | 25 +
sdks/go/pkg/beam/io/synthetic/source.go | 213 +
sdks/go/pkg/beam/io/synthetic/source_test.go | 134 +
sdks/go/pkg/beam/io/synthetic/step.go | 252 +
sdks/go/pkg/beam/io/synthetic/step_test.go | 223 +
.../beam/model/fnexecution_v1/beam_fn_api.pb.go | 506 +-
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 51 +-
sdks/go/pkg/beam/options/jobopts/options.go | 4 +
sdks/go/pkg/beam/pardo.go | 92 +-
sdks/go/pkg/beam/provision/provision.go | 20 +-
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 7 +-
.../pkg/beam/runners/dataflow/dataflowlib/job.go | 4 +-
.../beam/runners/dataflow/dataflowlib/translate.go | 26 +-
sdks/go/pkg/beam/runners/direct/direct.go | 9 +-
sdks/go/pkg/beam/runners/session/session.go | 30 +-
.../beam/runners/universal/runnerlib/execute.go | 4 +-
.../go/pkg/beam/runners/universal/runnerlib/job.go | 14 +-
.../pkg/beam/runners/universal/runnerlib/stage.go | 102 +-
sdks/go/pkg/beam/runners/universal/universal.go | 7 +-
sdks/go/pkg/beam/testing/passert/equals.go | 102 +
sdks/go/pkg/beam/testing/passert/equals_test.go | 99 +
sdks/go/pkg/beam/testing/passert/passert.go | 25 +-
sdks/go/pkg/beam/testing/passert/passert.shims.go | 28 +
sdks/go/test/build.gradle | 24 +
sdks/go/test/run_integration_tests.sh | 97 +-
sdks/java/bom/build.gradle | 4 +-
sdks/java/build-tools/beam-linkage-check.sh | 66 +-
.../src/main/resources/beam/suppressions.xml | 1 +
sdks/java/container/Dockerfile | 2 +
sdks/java/container/build.gradle | 37 +-
.../container/license_scripts/dep_urls_java.yaml | 203 +
.../container/license_scripts/license_script.sh | 48 +
.../license_scripts/pull_licenses_java.py | 298 +
.../java/container/license_scripts/requirement.txt | 22 +
.../apache/beam/sdk/coders/IterableLikeCoder.java | 22 +-
.../main/java/org/apache/beam/sdk/io/AvroIO.java | 30 +-
.../java/org/apache/beam/sdk/io/AvroSource.java | 86 +-
.../apache/beam/sdk/io/ClassLoaderFileSystem.java | 161 +
.../src/main/java/org/apache/beam/sdk/io/Read.java | 383 +-
.../java/org/apache/beam/sdk/io/TFRecordIO.java | 55 +-
.../java/org/apache/beam/sdk/io/WriteFiles.java | 43 +-
.../org/apache/beam/sdk/io/range/ByteKeyRange.java | 2 +-
.../beam/sdk/options/PipelineOptionsFactory.java | 2 +-
.../apache/beam/sdk/schemas/logicaltypes/Date.java | 65 +
.../beam/sdk/schemas/logicaltypes/SqlTypes.java | 30 +
.../beam/sdk/schemas/utils/ByteBuddyUtils.java | 8 +-
.../java/org/apache/beam/sdk/state/StateSpecs.java | 53 +-
.../main/java/org/apache/beam/sdk/state/Timer.java | 22 +
.../java/org/apache/beam/sdk/state/Timers.java | 3 +
.../apache/beam/sdk/testing/UsesKeyInParDo.java | 30 +
.../beam/sdk/testing/UsesOnWindowExpiration.java | 27 +
.../java/org/apache/beam/sdk/transforms/DoFn.java | 46 +-
.../org/apache/beam/sdk/transforms/DoFnTester.java | 6 +
.../beam/sdk/transforms/FlatMapElements.java | 2 +-
.../org/apache/beam/sdk/transforms/GroupByKey.java | 6 +-
.../java/org/apache/beam/sdk/transforms/ParDo.java | 52 +-
.../beam/sdk/transforms/PeriodicImpulse.java | 86 +
.../beam/sdk/transforms/PeriodicSequence.java | 210 +
.../org/apache/beam/sdk/transforms/Sample.java | 38 +
.../sdk/transforms/SerializableBiConsumer.java | 30 +
.../reflect/ByteBuddyDoFnInvokerFactory.java | 21 +-
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 28 +-
.../beam/sdk/transforms/reflect/DoFnSignature.java | 38 +
.../sdk/transforms/reflect/DoFnSignatures.java | 41 +-
.../splittabledofn/ByteKeyRangeTracker.java | 98 +-
.../splittabledofn/GrowableOffsetRangeTracker.java | 143 +
.../splittabledofn/OffsetRangeTracker.java | 73 +-
.../splittabledofn/RestrictionTracker.java | 76 +-
.../beam/sdk/transforms/splittabledofn/Sizes.java | 54 -
.../splittabledofn/WatermarkEstimators.java | 28 +-
.../sdk/transforms/windowing/BoundedWindow.java | 14 +
.../util/BufferedElementCountingOutputStream.java | 14 +-
.../java/org/apache/beam/sdk/util/ZipFiles.java | 2 +-
.../java/org/apache/beam/sdk/values/RowUtils.java | 2 +-
.../java/org/apache/beam/sdk/PipelineTest.java | 15 +-
.../org/apache/beam/sdk/io/AvroSourceTest.java | 45 +
.../beam/sdk/io/ClassLoaderFileSystemTest.java | 76 +
.../org/apache/beam/sdk/io/TFRecordIOTest.java | 130 +
.../apache/beam/sdk/io/range/ByteKeyRangeTest.java | 7 +-
.../apache/beam/sdk/transforms/FlattenTest.java | 50 +
.../beam/sdk/transforms/GroupIntoBatchesTest.java | 51 +-
.../beam/sdk/transforms/ParDoSchemaTest.java | 273 +
.../org/apache/beam/sdk/transforms/ParDoTest.java | 281 +-
.../beam/sdk/transforms/PeriodicImpulseTest.java | 79 +
.../beam/sdk/transforms/PeriodicSequenceTest.java | 82 +
.../org/apache/beam/sdk/transforms/WatchTest.java | 2 +
.../splittabledofn/ByteKeyRangeTrackerTest.java | 132 +-
.../GrowableOffsetRangeTrackerTest.java | 255 +
.../splittabledofn/OffsetRangeTrackerTest.java | 131 +-
.../splittabledofn/WatermarkEstimatorsTest.java | 62 +-
.../BufferedElementCountingOutputStreamTest.java | 16 +-
.../java/org/apache/beam/sdk/values/RowTest.java | 29 +-
sdks/java/expansion-service/build.gradle | 1 +
.../sdk/expansion/service/ExpansionServer.java | 2 +
.../sdk/expansion/service/ExpansionService.java | 26 +-
.../sdk/extensions/gcp/options/GcpOptions.java | 8 +-
.../beam/sdk/extensions/gcp/util/GcsUtil.java | 18 +-
sdks/java/extensions/ml/build.gradle | 3 +
.../beam/sdk/extensions/ml/AnnotateText.java | 90 +
.../beam/sdk/extensions/ml/AnnotateVideo.java | 103 -
.../ml/AnnotateVideoBytesWithContextFn.java | 50 +
.../beam/sdk/extensions/ml/AnnotateVideoFn.java | 105 +
.../extensions/ml/AnnotateVideoFromBytesFn.java | 55 +
.../sdk/extensions/ml/AnnotateVideoFromURIFn.java | 54 +
.../ml/AnnotateVideoURIWithContextFn.java | 49 +
.../beam/sdk/extensions/ml/VideoIntelligence.java | 148 +-
.../beam/sdk/extensions/ml/package-info.java | 3 +
.../beam/sdk/extensions/ml/AnnotateTextIT.java | 68 +
.../beam/sdk/extensions/ml/AnnotateVideoTest.java | 16 +-
.../sdk/extensions/ml/VideoIntelligenceIT.java | 10 +-
sdks/java/extensions/sql/build.gradle | 2 -
.../sql/meta/provider/datacatalog/SchemaUtils.java | 3 +-
.../extensions/sql/expansion-service/build.gradle | 41 +
.../expansion/ExternalSqlTransformRegistrar.java | 82 +
.../sdk/extensions/sql/expansion/package-info.java | 20 +
.../provider/bigquery/BigQueryIOPushDownIT.java | 9 +
.../beam/sdk/extensions/sql/SqlTransform.java | 19 +-
.../sdk/extensions/sql/example/BeamSqlExample.java | 56 +-
.../extensions/sql/example/BeamSqlPojoExample.java | 8 +-
.../sdk/extensions/sql/example/model/Customer.java | 34 +-
.../sdk/extensions/sql/example/model/Order.java | 5 +
.../extensions/sql/impl/planner/BeamRuleSets.java | 3 +-
.../sdk/extensions/sql/impl/rel/BeamCalcRel.java | 38 +-
.../sql/impl/rel/BeamEnumerableConverter.java | 18 +-
.../sdk/extensions/sql/impl/rel/BeamJoinRel.java | 5 +-
.../sql/impl/rel/BeamTableFunctionScanRel.java | 162 +
.../sql/impl/rule/BeamTableFunctionScanRule.java | 71 +
.../extensions/sql/impl/schema/BeamTableUtils.java | 14 +-
.../impl/transform/BeamBuiltinAggregations.java | 46 +-
.../extensions/sql/impl/utils/CalciteUtils.java | 28 +-
.../sql/impl/utils/TVFStreamingUtils.java | 24 +
.../meta/provider/datastore/DataStoreV1Table.java | 5 +-
.../sdk/extensions/sql/BeamComplexTypeTest.java | 79 +-
.../beam/sdk/extensions/sql/BeamSqlCastTest.java | 22 +-
.../beam/sdk/extensions/sql/BeamSqlCliTest.java | 3 +-
.../extensions/sql/BeamSqlDslAggregationTest.java | 76 +
.../sql/BeamSqlDslSqlStdOperatorsTest.java | 33 +-
.../BeamSqlDateFunctionsIntegrationTest.java | 9 +-
sdks/java/extensions/sql/zetasql/build.gradle | 2 +-
.../sdk/extensions/sql/zetasql/SqlAnalyzer.java | 47 +-
.../sql/zetasql/SqlStdOperatorMappingTable.java | 37 +-
.../sql/zetasql/SqlWindowTableFunction.java | 116 +
.../beam/sdk/extensions/sql/zetasql/TestInput.java | 30 +-
.../sdk/extensions/sql/zetasql/ZetaSqlUtils.java | 77 +-
.../translation/AggregateScanConverter.java | 28 +-
.../translation/ArrayScanColumnRefToUncollect.java | 90 +
.../ArrayScanLiteralToUncollectConverter.java | 65 +
.../translation/ArrayScanToJoinConverter.java | 34 +-
.../translation/ArrayScanToUncollectConverter.java | 60 -
.../zetasql/translation/ExpressionConverter.java | 66 +-
.../LimitOffsetScanToLimitConverter.java | 6 +
.../LimitOffsetScanToOrderByLimitConverter.java | 16 +-
.../translation/QueryStatementConverter.java | 5 +-
.../sql/zetasql/translation/TVFScanConverter.java | 86 +
.../sql/zetasql/ZetaSQLDialectSpecTest.java | 574 +-
.../sdk/fn/data/BeamFnDataGrpcMultiplexer.java | 66 +-
.../sdk/fn/data/BeamFnDataInboundObserver.java | 35 +-
...amFnDataSizeBasedBufferingOutboundObserver.java | 38 +-
.../apache/beam/sdk/fn/data/LogicalEndpoint.java | 20 +-
.../sdk/fn/splittabledofn/RestrictionTrackers.java | 18 +-
.../sdk/fn/data/BeamFnDataGrpcMultiplexerTest.java | 49 +-
...DataSizeBasedBufferingOutboundObserverTest.java | 148 +-
...DataTimeBasedBufferingOutboundObserverTest.java | 84 +-
.../fn/splittabledofn/RestrictionTrackersTest.java | 14 +-
.../beam/fn/harness/BeamFnDataReadRunner.java | 107 +-
.../beam/fn/harness/BeamFnDataWriteRunner.java | 31 +-
.../beam/fn/harness/BoundedSourceRunner.java | 3 +
.../org/apache/beam/fn/harness/CombineRunners.java | 3 +
.../org/apache/beam/fn/harness/FlattenRunner.java | 3 +
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 587 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 38 +-
.../org/apache/beam/fn/harness/HandlesSplits.java | 8 +
.../org/apache/beam/fn/harness/MapFnRunners.java | 3 +
.../beam/fn/harness/PTransformRunnerFactory.java | 17 +
.../fn/harness/control/BeamFnControlClient.java | 19 +-
.../fn/harness/control/BundleSplitListener.java | 35 +-
.../fn/harness/control/ProcessBundleHandler.java | 231 +-
.../beam/fn/harness/data/BeamFnDataGrpcClient.java | 12 +-
.../beam/fn/harness/data/BeamFnTimerClient.java | 52 +
.../fn/harness/data/BeamFnTimerGrpcClient.java | 99 +
.../apache/beam/fn/harness/state/BagUserState.java | 2 +-
.../beam/fn/harness/state/FnApiStateAccessor.java | 22 +-
.../beam/fn/harness/state/MultimapSideInput.java | 6 +-
.../beam/fn/harness/state/StateBackedIterable.java | 224 +
.../fn/harness/state/StateFetchingIterators.java | 2 +-
.../beam/fn/harness/AssignWindowsRunnerTest.java | 2 +
.../beam/fn/harness/BeamFnDataReadRunnerTest.java | 904 +-
.../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 11 +-
.../beam/fn/harness/BoundedSourceRunnerTest.java | 2 +
.../apache/beam/fn/harness/CombineRunnersTest.java | 60 +-
.../apache/beam/fn/harness/FlattenRunnerTest.java | 4 +
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 496 +-
.../apache/beam/fn/harness/MapFnRunnersTest.java | 6 +
.../harness/control/BundleSplitListenerTest.java | 57 +
.../harness/control/ProcessBundleHandlerTest.java | 110 +-
.../fn/harness/data/BeamFnDataGrpcClientTest.java | 4 +-
.../data/BeamFnDataInboundObserverTest.java | 22 +-
.../fn/harness/data/FakeBeamFnTimerClient.java | 115 +
.../harness/data/QueueingBeamFnDataClientTest.java | 4 +-
.../fn/harness/state/StateBackedIterableTest.java | 184 +
.../apache/beam/sdk/io/aws/options/AwsModule.java | 112 +-
.../apache/beam/sdk/io/aws/options/AwsOptions.java | 31 +-
.../options/AwsHttpClientConfigurationTest.java | 51 +
.../beam/sdk/io/aws/options/AwsModuleTest.java | 15 +
.../apache/beam/sdk/io/aws2/options/AwsModule.java | 99 +
.../beam/sdk/io/aws2/options/AwsOptions.java | 27 +
.../io/aws2/sns/BasicSnsAsyncClientProvider.java | 57 +
.../sdk/io/aws2/sns/SnsAsyncClientProvider.java | 31 +
.../beam/sdk/io/aws2/sns/SnsClientProvider.java | 2 +-
.../org/apache/beam/sdk/io/aws2/sns/SnsIO.java | 188 +-
.../apache/beam/sdk/io/aws2/sns/SnsResponse.java | 55 +
.../beam/sdk/io/aws2/sns/SnsResponseCoder.java | 95 +
.../beam/sdk/io/aws2/options/AwsModuleTest.java | 26 +
.../sdk/io/aws2/sns/MockSnsAsyncBaseClient.java | 31 +
.../beam/sdk/io/aws2/sns/MockSnsAsyncClient.java | 46 +
.../io/aws2/sns/MockSnsAsyncExceptionClient.java | 38 +
.../beam/sdk/io/aws2/sns/SnsIOWriteTest.java | 165 +
.../beam/sdk/io/aws2/sns/SnsResponseCoderTest.java | 77 +
.../beam/sdk/bigqueryioperftests/BigQueryIOIT.java | 20 +-
.../beam/sdk/io/cassandra/CassandraIOTest.java | 20 +-
.../beam/sdk/io/common/IOTestPipelineOptions.java | 18 +
.../beam/sdk/io/elasticsearch/ElasticsearchIO.java | 8 +-
.../java/org/apache/beam/sdk/io/avro/AvroIOIT.java | 14 +-
.../apache/beam/sdk/io/parquet/ParquetIOIT.java | 14 +-
.../java/org/apache/beam/sdk/io/text/TextIOIT.java | 14 +-
.../apache/beam/sdk/io/tfrecord/TFRecordIOIT.java | 11 +-
.../java/org/apache/beam/sdk/io/xml/XmlIOIT.java | 14 +-
sdks/java/io/google-cloud-platform/build.gradle | 7 +-
.../beam/sdk/io/gcp/bigquery/AvroRowWriter.java | 15 +-
.../sdk/io/gcp/bigquery/BigQueryAvroUtils.java | 37 +
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 75 +-
.../io/gcp/bigquery/BigQueryStorageSourceBase.java | 7 +-
.../gcp/bigquery/BigQueryStorageTableSource.java | 12 +-
.../beam/sdk/io/gcp/bigquery/RowWriterFactory.java | 29 +-
.../apache/beam/sdk/io/gcp/healthcare/FhirIO.java | 1176 +
.../apache/beam/sdk/io/gcp/healthcare/HL7v2IO.java | 819 +
.../beam/sdk/io/gcp/healthcare/HL7v2Message.java | 222 +
.../sdk/io/gcp/healthcare/HL7v2MessageCoder.java | 73 +
.../sdk/io/gcp/healthcare/HealthcareApiClient.java | 186 +
.../sdk/io/gcp/healthcare/HealthcareIOError.java | 87 +
.../io/gcp/healthcare/HealthcareIOErrorCoder.java | 67 +
.../healthcare/HealthcareIOErrorToTableRow.java | 95 +
.../io/gcp/healthcare/HttpHealthcareApiClient.java | 695 +
.../beam/sdk/io/gcp/healthcare/package-info.java | 28 +
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 4 +-
.../apache/beam/sdk/io/gcp/pubsub/TestPubsub.java | 4 +-
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 235 +-
.../apache/beam/sdk/io/gcp/GcpApiSurfaceTest.java | 1 +
.../beam/sdk/io/gcp/bigquery/BigQueryIOReadIT.java | 27 +-
.../gcp/bigquery/BigQueryIOStorageQueryTest.java | 67 +-
.../io/gcp/bigquery/BigQueryIOStorageReadTest.java | 183 +-
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 65 +-
.../sdk/io/gcp/bigquery/BigQueryToTableIT.java | 44 -
.../beam/sdk/io/gcp/datastore/V1TestUtil.java | 2 +-
.../beam/sdk/io/gcp/healthcare/FhirIOReadIT.java | 147 +
.../beam/sdk/io/gcp/healthcare/FhirIOTest.java | 112 +
.../sdk/io/gcp/healthcare/FhirIOTestOptions.java | 46 +
.../beam/sdk/io/gcp/healthcare/FhirIOTestUtil.java | 127 +
.../beam/sdk/io/gcp/healthcare/FhirIOWriteIT.java | 129 +
.../io/gcp/healthcare/HL7V2MessagePagesTest.java | 99 +
.../beam/sdk/io/gcp/healthcare/HL7v2IOReadIT.java | 136 +
.../sdk/io/gcp/healthcare/HL7v2IOReadWriteIT.java | 129 +
.../beam/sdk/io/gcp/healthcare/HL7v2IOTest.java | 84 +
.../sdk/io/gcp/healthcare/HL7v2IOTestUtil.java | 231 +
.../beam/sdk/io/gcp/healthcare/HL7v2IOWriteIT.java | 102 +
.../sdk/io/gcp/spanner/SpannerIOWriteTest.java | 274 +-
...ik437_ed7a9f5c-37ea-4767-95ba-a6783e9500b3.json | 14018 ++++
...pe518_1fd2683f-2a56-47c7-b674-98f2cc8319e7.json | 10877 +++
...ch576_4ecb4cbb-6df7-41e0-8e89-6e7a142721a5.json | 17399 ++++
...co882_8ed31d3e-7352-4055-89c4-f017db3f594e.json | 9279 +++
...tz995_f04ef974-6d6f-4e1c-804f-cd4d62aabb4f.json | 10047 +++
.../DSTU2/hospitalInformation1586309771387.json | 825 +
.../practitionerInformation1586309771387.json | 617 +
...ka837_d89e3bd8-4d0f-4735-8d16-d0f646a9dcd6.json | 16391 ++++
...in195_af0e4a42-a1ef-4c2f-ad31-9338a8b8fb7b.json | 31841 ++++++++
...le117_a5e08ef9-fd71-4273-a53a-d5f5df7926f4.json | 16971 ++++
...ue211_fcf2f472-77ac-47d7-9c9a-a6702bd2bb80.json | 80348 +++++++++++++++++++
...an202_55a5307d-5f23-49c1-9100-7d5c513abca3.json | 16018 ++++
.../R4/hospitalInformation1586368892823.json | 1182 +
.../R4/practitionerInformation1586368892823.json | 978 +
...era67_02a63c07-9fcc-42ba-aec0-9d5399ac4796.json | 16003 ++++
...ll264_88fb71f7-d445-4e5b-8af2-962e8f8e5fb6.json | 15372 ++++
...ng846_df27a976-5c5e-4b84-ad00-fe32972dce9c.json | 22688 ++++++
...ll178_136f997d-0a94-4573-97da-a53b5060a612.json | 28126 +++++++
...io310_74779846-85a4-4b26-9da4-414a5fec1aed.json | 18231 +++++
...ll811_3024090f-fe14-40a9-8fae-79952d3c95ce.json | 32061 ++++++++
.../STU3/hospitalInformation1586298239556.json | 880 +
.../STU3/practitionerInformation1586298239556.json | 523 +
.../sdk/io/hadoop/format/HadoopFormatIOIT.java | 10 +
.../apache/beam/sdk/io/hcatalog/SchemaUtils.java | 68 +-
.../beam/sdk/io/hcatalog/SchemaUtilsTest.java | 45 +
.../java/org/apache/beam/sdk/io/jdbc/JdbcIOIT.java | 10 +
.../org/apache/beam/sdk/io/kafka/KafkaIOIT.java | 13 +-
.../apache/beam/sdk/io/kinesis/KinesisReader.java | 47 +-
.../beam/sdk/io/kinesis/ShardReadersPool.java | 17 +-
.../beam/sdk/io/kinesis/ShardRecordsIterator.java | 38 +-
.../beam/sdk/io/kinesis/KinesisReaderTest.java | 35 +-
.../beam/sdk/io/kinesis/ShardReadersPoolTest.java | 28 +-
.../sdk/io/kinesis/ShardRecordsIteratorTest.java | 30 +-
.../apache/beam/sdk/io/mongodb/MongoDBIOIT.java | 10 +
.../java/org/apache/beam/sdk/io/mqtt/MqttIO.java | 5 +
sdks/java/io/snowflake/build.gradle | 42 +
.../beam/sdk/io/snowflake/CloudProvider.java | 32 +
.../apache/beam/sdk/io/snowflake/SnowflakeIO.java | 759 +
.../sdk/io/snowflake/SnowflakePipelineOptions.java | 133 +
.../beam/sdk/io/snowflake/SnowflakeService.java | 36 +
.../sdk/io/snowflake/SnowflakeServiceImpl.java | 90 +
.../credentials/KeyPairSnowflakeCredentials.java | 81 +
.../OAuthTokenSnowflakeCredentials.java | 31 +
.../credentials/SnowflakeCredentials.java | 24 +
.../credentials/SnowflakeCredentialsFactory.java | 55 +
.../UsernamePasswordSnowflakeCredentials.java | 37 +
.../sdk/io/snowflake/credentials/package-info.java | 20 +
.../apache/beam/sdk/io/snowflake/package-info.java | 20 +
.../test/FakeSnowflakeBasicDataSource.java | 298 +
.../io/snowflake/test/FakeSnowflakeDatabase.java | 81 +
.../snowflake/test/FakeSnowflakeServiceImpl.java | 64 +
.../beam/sdk/io/snowflake/test/TestUtils.java | 40 +
.../beam/sdk/io/snowflake/test/package-info.java | 20 +
.../test/unit/BatchTestPipelineOptions.java | 28 +
.../test/unit/DataSourceConfigurationTest.java | 159 +
.../KeyPairSnowflakeCredentialsTest.java | 38 +
.../OAuthTokenSnowflakeCredentialsTest.java | 46 +
.../SnowflakeCredentialsFactoryTest.java | 77 +
.../UsernamePasswordSnowflakeCredentialsTest.java | 50 +
.../test/unit/read/SnowflakeIOReadTest.java | 278 +
.../snowflake/src/test/resources/test_rsa_key.p8 | 29 +
sdks/java/io/tika/build.gradle | 2 +-
.../org/apache/beam/sdk/loadtests/LoadTest.java | 48 +-
.../apache/beam/sdk/loadtests/LoadTestOptions.java | 24 +
sdks/java/testing/test-utils/build.gradle | 11 +
.../beam/sdk/testutils/metrics/IOITMetrics.java | 28 +-
.../testutils/publishing/InfluxDBPublisher.java | 103 +
.../sdk/testutils/publishing/InfluxDBSettings.java | 79 +
.../testutils/jvmverification/JvmVerification.java | 88 +
sdks/python/.pylintrc | 2 -
sdks/python/apache_beam/coders/coders.py | 10 +-
.../apache_beam/coders/standard_coders_test.py | 3 +-
sdks/python/apache_beam/dataframe/convert.py | 98 +
sdks/python/apache_beam/dataframe/convert_test.py | 64 +
sdks/python/apache_beam/dataframe/doctests.py | 288 +
sdks/python/apache_beam/dataframe/doctests_test.py | 90 +
sdks/python/apache_beam/dataframe/expressions.py | 23 +-
sdks/python/apache_beam/dataframe/frames.py | 6 +-
sdks/python/apache_beam/dataframe/transforms.py | 291 +
.../apache_beam/dataframe/transforms_test.py | 134 +
.../examples/cookbook/bigquery_tornadoes.py | 2 +-
.../apache_beam/examples/snippets/snippets.py | 76 +
.../apache_beam/examples/snippets/snippets_test.py | 75 +-
.../examples/snippets/snippets_test_py3.py | 21 +-
.../examples/streaming_wordcount_debugging.py | 26 +-
.../streaming_wordcount_debugging_it_test.py | 33 +-
.../examples/streaming_wordcount_debugging_test.py | 110 +
.../python/apache_beam/examples/wordcount_xlang.py | 4 -
.../apache_beam/examples/wordcount_xlang_sql.py | 112 +
sdks/python/apache_beam/io/external/kafka.py | 2 +-
sdks/python/apache_beam/io/fileio_test.py | 8 +-
.../io/gcp/big_query_query_to_table_pipeline.py | 2 +-
sdks/python/apache_beam/io/gcp/bigquery.py | 75 +-
.../apache_beam/io/gcp/bigquery_avro_tools.py | 3 +-
.../apache_beam/io/gcp/bigquery_avro_tools_test.py | 7 +-
.../apache_beam/io/gcp/bigquery_file_loads.py | 6 +-
.../apache_beam/io/gcp/bigquery_file_loads_test.py | 7 +-
.../io/gcp/bigquery_io_read_pipeline.py | 6 +-
.../apache_beam/io/gcp/bigquery_read_it_test.py | 9 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 10 +-
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 62 +-
.../io/gcp/experimental/spannerio_read_it_test.py | 138 +
.../io/gcp/experimental/spannerio_write_it_test.py | 195 +
sdks/python/apache_beam/io/gcp/gcsio_test.py | 2 +-
.../apache_beam/io/gcp/pubsub_io_perf_test.py | 220 +
.../apache_beam/io/gcp/tests/pubsub_matcher.py | 25 +-
.../hdfs_integration_test/hdfs_integration_test.sh | 5 +
sdks/python/apache_beam/io/iobase.py | 2 +-
sdks/python/apache_beam/io/localfilesystem.py | 3 +
sdks/python/apache_beam/io/parquetio.py | 3 +-
sdks/python/apache_beam/io/restriction_trackers.py | 2 +-
sdks/python/apache_beam/io/textio_test.py | 23 +-
sdks/python/apache_beam/metrics/execution_test.py | 6 +-
sdks/python/apache_beam/metrics/metric_test.py | 21 +
.../python/apache_beam/metrics/monitoring_infos.py | 62 +-
.../python/apache_beam/options/pipeline_options.py | 21 +-
.../options/pipeline_options_validator.py | 7 +-
.../options/pipeline_options_validator_test.py | 27 +
sdks/python/apache_beam/pipeline.py | 255 +-
sdks/python/apache_beam/pipeline_test.py | 72 +-
sdks/python/apache_beam/runners/common.py | 24 +-
.../runners/dataflow/dataflow_runner.py | 155 +-
.../runners/dataflow/dataflow_runner_test.py | 203 +-
.../runners/dataflow/internal/apiclient.py | 82 +-
.../runners/dataflow/internal/apiclient_test.py | 64 +-
.../apache_beam/runners/dataflow/internal/names.py | 4 +-
.../runners/dataflow/ptransform_overrides.py | 73 +
.../apache_beam/runners/direct/direct_runner.py | 130 +-
.../apache_beam/runners/direct/direct_userstate.py | 2 +-
.../apache_beam/runners/direct/test_stream_impl.py | 64 +-
.../runners/direct/transform_evaluator.py | 11 +-
.../runners/interactive/background_caching_job.py | 58 +-
.../interactive/background_caching_job_test.py | 4 +-
.../runners/interactive/caching/streaming_cache.py | 19 +-
.../interactive/caching/streaming_cache_test.py | 11 +
.../interactive/display/pcoll_visualization.py | 2 +-
.../interactive/examples/UsCovidDataExample.ipynb | 513 +
.../runners/interactive/interactive_beam.py | 2 +-
.../runners/interactive/interactive_runner_test.py | 25 +-
.../runners/interactive/options/capture_control.py | 20 +-
.../interactive/options/capture_control_test.py | 68 +-
.../interactive/options/capture_limiters.py | 70 +
.../runners/interactive/pipeline_analyzer_test.py | 2 +-
.../interactive/pipeline_instrument_test.py | 12 +-
.../interactive/testing/integration}/__init__.py | 0
.../Darwin/7a35f487b2a5f3a9b9852a8659eeb4bd.png | Bin 0 -> 762141 bytes
.../Linux/7a35f487b2a5f3a9b9852a8659eeb4bd.png | Bin 0 -> 717124 bytes
.../testing/integration/notebook_executor.py | 141 +
.../interactive/testing/integration/screen_diff.py | 254 +
.../test_notebooks/init_square_cube.ipynb | 178 +
.../integration/tests/init_square_cube_test.py | 34 +
sdks/python/apache_beam/runners/job/utils.py | 7 +-
.../python/apache_beam/runners/pipeline_context.py | 2 +-
.../runners/portability/abstract_job_service.py | 85 +-
.../runners/portability/artifact_service.py | 53 +
.../runners/portability/artifact_service_test.py | 3 +-
.../runners/portability/expansion_service.py | 2 +-
.../runners/portability/flink_runner_test.py | 13 +-
.../portability/flink_uber_jar_job_server.py | 25 +-
.../portability/flink_uber_jar_job_server_test.py | 36 +
.../runners/portability/fn_api_runner/execution.py | 225 +-
.../runners/portability/fn_api_runner/fn_runner.py | 510 +-
.../portability/fn_api_runner/fn_runner_test.py | 76 +-
.../portability/fn_api_runner/translations.py | 88 +-
.../portability/fn_api_runner/worker_handlers.py | 55 +-
.../apache_beam/runners/portability/job_server.py | 78 -
.../runners/portability/local_job_service.py | 1 +
.../runners/portability/local_job_service_main.py | 113 +-
.../runners/portability/local_job_service_test.py | 15 -
.../runners/portability/portable_runner.py | 141 +-
.../portability/spark_uber_jar_job_server.py | 6 -
.../portability/spark_uber_jar_job_server_test.py | 23 +-
.../apache_beam/runners/worker/bundle_processor.py | 396 +-
.../runners/worker/bundle_processor_test.py | 142 +
.../apache_beam/runners/worker/data_plane.py | 201 +-
.../apache_beam/runners/worker/opcounters_test.py | 2 +-
.../apache_beam/runners/worker/operations.pxd | 4 +-
.../apache_beam/runners/worker/operations.py | 107 +-
.../apache_beam/runners/worker/sdk_worker.py | 1 -
.../apache_beam/runners/worker/worker_pool_main.py | 6 +-
.../testing/benchmarks/chicago_taxi/preprocess.py | 3 +-
.../benchmarks/chicago_taxi/process_tfma.py | 3 +-
.../chicago_taxi/tfdv_analyze_and_validate.py | 3 +-
.../apache_beam/testing/load_tests/build.gradle | 7 +
.../testing/load_tests/co_group_by_key_test.py | 2 +
.../apache_beam/testing/load_tests/combine_test.py | 2 +
.../testing/load_tests/group_by_key_test.py | 2 +
.../apache_beam/testing/load_tests/load_test.py | 86 +-
.../testing/load_tests/load_test_metrics_utils.py | 98 +-
.../apache_beam/testing/load_tests/pardo_test.py | 105 +-
.../apache_beam/testing/synthetic_pipeline.py | 48 +-
sdks/python/apache_beam/testing/test_pipeline.py | 7 +-
sdks/python/apache_beam/testing/util.py | 2 -
sdks/python/apache_beam/transforms/core.py | 148 +-
.../apache_beam/transforms/dofn_lifecycle_test.py | 16 +
sdks/python/apache_beam/transforms/environments.py | 11 +-
sdks/python/apache_beam/transforms/external.py | 100 +-
.../apache_beam/transforms/periodicsequence.py | 192 +
.../transforms/periodicsequence_test.py | 102 +
sdks/python/apache_beam/transforms/ptransform.py | 26 +-
.../apache_beam/transforms/ptransform_test.py | 18 +-
sdks/python/apache_beam/transforms/sql.py | 76 +
sdks/python/apache_beam/transforms/sql_test.py | 154 +
sdks/python/apache_beam/transforms/timeutil.py | 6 +-
sdks/python/apache_beam/transforms/trigger.py | 48 +-
sdks/python/apache_beam/transforms/trigger_test.py | 39 +-
sdks/python/apache_beam/transforms/userstate.py | 14 +-
sdks/python/apache_beam/transforms/util.py | 9 +-
sdks/python/apache_beam/transforms/util_test.py | 4 +
.../transforms/validate_runner_xlang_test.py | 80 +-
sdks/python/apache_beam/transforms/window.py | 3 +-
sdks/python/apache_beam/typehints/opcodes.py | 10 +-
sdks/python/apache_beam/typehints/schemas.py | 11 +-
sdks/python/apache_beam/typehints/schemas_test.py | 11 +
.../apache_beam/typehints/typed_pipeline_test.py | 5 +-
.../typehints/typed_pipeline_test_py3.py | 17 +-
sdks/python/apache_beam/utils/subprocess_server.py | 131 +-
.../apache_beam/utils/subprocess_server_test.py | 6 +
.../apache_beam/utils/thread_pool_executor.py | 102 +-
sdks/python/apache_beam/version.py | 2 +-
sdks/python/build-requirements.txt | 2 +-
sdks/python/build.gradle | 12 +
sdks/python/container/Dockerfile | 9 +-
sdks/python/container/base_image_requirements.txt | 1 +
.../container/license_scripts/dep_urls_py.yaml | 2 +
.../container/license_scripts/pull_licenses_py.py | 14 +-
sdks/python/container/py2/build.gradle | 4 +-
sdks/python/container/py35/build.gradle | 4 +-
sdks/python/container/py36/build.gradle | 4 +-
sdks/python/container/py37/build.gradle | 4 +-
sdks/python/mypy.ini | 62 +
sdks/python/scripts/generate_pydoc.sh | 1 +
sdks/python/scripts/run_pylint.sh | 1 +
sdks/python/setup.py | 26 +-
sdks/python/test-suites/dataflow/common.gradle | 112 +
sdks/python/test-suites/dataflow/py2/build.gradle | 87 +-
sdks/python/test-suites/dataflow/py35/build.gradle | 93 +-
sdks/python/test-suites/dataflow/py36/build.gradle | 97 +-
sdks/python/test-suites/dataflow/py37/build.gradle | 170 +-
sdks/python/test-suites/direct/common.gradle | 53 +
sdks/python/test-suites/direct/py35/build.gradle | 36 +-
sdks/python/test-suites/direct/py36/build.gradle | 36 +-
sdks/python/test-suites/direct/py37/build.gradle | 34 +-
sdks/python/test-suites/portable/common.gradle | 40 +-
sdks/python/test-suites/portable/py2/build.gradle | 84 +-
sdks/python/test-suites/portable/py35/build.gradle | 45 +-
sdks/python/test-suites/portable/py36/build.gradle | 45 +-
sdks/python/test-suites/portable/py37/build.gradle | 45 +-
sdks/python/test-suites/tox/common.gradle | 32 +
sdks/python/test-suites/tox/py35/build.gradle | 16 +-
sdks/python/test-suites/tox/py36/build.gradle | 16 +-
sdks/python/test-suites/tox/py37/build.gradle | 16 +-
sdks/python/tox.ini | 3 +-
settings.gradle | 3 +
vendor/calcite-1_20_0/build.gradle | 3 +-
website/.gitignore | 10 +
website/CONTRIBUTE.md | 394 +
website/Dockerfile | 91 +-
website/Gemfile | 38 -
website/Gemfile.lock | 94 -
website/README.md | 42 +-
website/Rakefile | 25 -
website/_config.yml | 70 -
website/_config_test.yml | 21 -
website/append_index_html_to_internal_links.py | 24 +
website/build.gradle | 108 +-
website/notebooks/generate.py | 6 +-
website/src/.htaccess | 24 -
website/src/_data/authors.yml | 146 -
website/src/_data/capability-matrix.yml | 1708 -
website/src/_data/logos.yml | 21 -
website/src/_data/meetings.yml | 39 -
website/src/_includes/button-pydoc.md | 23 -
website/src/_includes/button.md | 21 -
website/src/_includes/buttons-code-snippet.md | 43 -
website/src/_includes/capability-matrix-common.md | 20 -
.../src/_includes/capability-matrix-row-blog.md | 14 -
.../src/_includes/capability-matrix-row-full.md | 14 -
.../src/_includes/capability-matrix-row-summary.md | 14 -
website/src/_includes/capability-matrix.md | 48 -
.../src/_includes/flink_java_pipeline_options.html | 145 -
.../_includes/flink_python_pipeline_options.html | 145 -
website/src/_includes/footer.html | 66 -
website/src/_includes/head.html | 42 -
website/src/_includes/header.html | 94 -
website/src/_includes/icon-github.html | 13 -
website/src/_includes/icon-github.svg | 19 -
website/src/_includes/icon-twitter.html | 13 -
website/src/_includes/icon-twitter.svg | 19 -
website/src/_includes/page-toc.html | 88 -
website/src/_includes/section-menu/community.html | 31 -
website/src/_includes/section-menu/contribute.html | 45 -
.../src/_includes/section-menu/documentation.html | 295 -
.../src/_includes/section-menu/get-started.html | 33 -
website/src/_includes/section-menu/roadmap.html | 49 -
website/src/_includes/section-menu/runners.html | 23 -
website/src/_includes/section-menu/sdks.html | 109 -
website/src/_layouts/default.html | 23 -
website/src/_layouts/page.html | 26 -
website/src/_layouts/post.html | 32 -
website/src/_layouts/section.html | 38 -
website/src/_layouts/v2home.html | 217 -
.../src/_posts/2016-02-22-beam-has-a-logo.markdown | 41 -
.../2016-02-25-python-sdk-now-public.markdown | 35 -
website/src/_posts/2016-03-17-capability-matrix.md | 611 -
.../_posts/2016-04-03-presentation-materials.md | 37 -
.../_posts/2016-05-18-splitAtFraction-method.md | 30 -
.../2016-05-20-where-is-my-pcollection-dot-map.md | 105 -
.../2016-06-13-flink-batch-runner-milestone.md | 45 -
website/src/_posts/2016-06-15-first-release.md | 52 -
website/src/_posts/2016-08-03-six-months.md | 56 -
.../2016-10-12-strata-hadoop-world-and-beam.md | 45 -
website/src/_posts/2016-10-20-test-stream.md | 322 -
website/src/_posts/2017-01-09-added-apex-runner.md | 52 -
website/src/_posts/2017-01-10-beam-graduates.md | 78 -
.../_posts/2017-02-01-graduation-media-recap.md | 65 -
.../src/_posts/2017-02-13-stateful-processing.md | 636 -
.../src/_posts/2017-03-16-python-sdk-release.md | 85 -
.../_posts/2017-05-17-beam-first-stable-release.md | 121 -
website/src/_posts/2017-08-04-splittable-do-fn.md | 537 -
website/src/_posts/2017-08-28-timely-processing.md | 612 -
website/src/_posts/2018-01-09-beam-a-look-back.md | 145 -
website/src/_posts/2018-02-19-beam-2.3.0.md | 102 -
website/src/_posts/2018-06-26-beam-2.5.0.md | 98 -
website/src/_posts/2018-08-10-beam-2.6.0.md | 88 -
...2018-08-20-review-input-streaming-connectors.md | 238 -
.../src/_posts/2018-08-21-beam-summit-europe.md | 53 -
website/src/_posts/2018-10-03-beam-2.7.0.md | 76 -
website/src/_posts/2018-10-29-beam-2.8.0.md | 89 -
.../src/_posts/2018-10-30-beam-summit-aftermath.md | 111 -
website/src/_posts/2018-12-13-beam-2.9.0.md | 62 -
website/src/_posts/2019-02-15-beam-2.10.0.md | 118 -
website/src/_posts/2019-03-05-beam-2.11.0.md | 113 -
website/src/_posts/2019-03-18-beam-summit-site.md | 38 -
website/src/_posts/2019-04-19-season-of-docs.md | 64 -
website/src/_posts/2019-04-25-beam-2.12.0.md | 73 -
website/src/_posts/2019-04-25-beam-kotlin.md | 114 -
.../2019-05-01-adding-data-sources-to-sql.md | 202 -
.../_posts/2019-05-11-beam-summit-europe-2019.md | 88 -
website/src/_posts/2019-05-22-beam-2.13.0.md | 77 -
website/src/_posts/2019-05-30-beam-kata-release.md | 59 -
website/src/_posts/2019-06-11-looping-timers.md | 349 -
website/src/_posts/2019-07-31-beam-2.14.0.md | 107 -
website/src/_posts/2019-08-22-beam-2.15.0.md | 88 -
website/src/_posts/2019-09-04-gsoc-19.md | 93 -
website/src/_posts/2019-10-07-beam-2.16.0.md | 103 -
website/src/_posts/2020-01-06-beam-2.17.0.md | 99 -
website/src/_posts/2020-01-13-beam-2.18.0.md | 109 -
website/src/_posts/2020-02-04-beam-2.19.0.md | 97 -
website/src/_sass/_page-nav.sass | 53 -
website/src/_sass/_syntax-highlighting.scss | 101 -
website/src/blog/index.md | 51 -
website/src/coming-soon.md | 22 -
website/src/community/contact-us.md | 45 -
website/src/community/in-person.md | 51 -
website/src/community/integrations.md | 36 -
website/src/community/logos.md | 80 -
website/src/community/policies.md | 32 -
website/src/community/presentation-materials.md | 47 -
website/src/community/twitter-handle.md | 41 -
website/src/community/youtube-channel.md | 48 -
website/src/contribute/become-a-committer.md | 100 -
website/src/contribute/committer-guide.md | 138 -
website/src/contribute/dependencies.md | 95 -
website/src/contribute/design-documents.md | 20 -
website/src/contribute/feature-branches.md | 99 -
website/src/contribute/get-help.md | 27 -
website/src/contribute/index.md | 296 -
website/src/contribute/jira-priorities.md | 76 -
website/src/contribute/postcommits-guides.md | 74 -
.../src/contribute/postcommits-policies-details.md | 111 -
website/src/contribute/postcommits-policies.md | 102 -
website/src/contribute/precommit-policies.md | 66 -
website/src/contribute/precommit-triage-guide.md | 123 -
website/src/contribute/ptransform-style-guide.md | 556 -
website/src/contribute/release-blocking.md | 41 -
website/src/contribute/release-guide.md | 1358 -
website/src/contribute/runner-guide.md | 1103 -
website/src/contribute/team.md | 23 -
website/src/contribute/testing.md | 18 -
website/src/css/site.scss | 42 -
.../dsls/sql/calcite/aggregate-functions.md | 33 -
.../documentation/dsls/sql/calcite/data-types.md | 45 -
.../dsls/sql/calcite/lexical-structure.md | 1049 -
.../src/documentation/dsls/sql/calcite/overview.md | 81 -
.../documentation/dsls/sql/calcite/query-syntax.md | 716 -
.../dsls/sql/calcite/scalar-functions.md | 133 -
.../dsls/sql/extensions/create-external-table.md | 417 -
.../src/documentation/dsls/sql/extensions/joins.md | 73 -
.../src/documentation/dsls/sql/extensions/set.md | 56 -
.../dsls/sql/extensions/user-defined-functions.md | 128 -
.../sql/extensions/windowing-and-triggering.md | 67 -
website/src/documentation/dsls/sql/overview.md | 68 -
website/src/documentation/dsls/sql/shell.md | 153 -
website/src/documentation/dsls/sql/walkthrough.md | 160 -
.../dsls/sql/zetasql/aggregate-functions.md | 210 -
.../dsls/sql/zetasql/conditional-expressions.md | 116 -
.../dsls/sql/zetasql/conversion-rules.md | 193 -
.../documentation/dsls/sql/zetasql/data-types.md | 457 -
.../src/documentation/dsls/sql/zetasql/lexical.md | 573 -
.../dsls/sql/zetasql/math-functions.md | 132 -
.../documentation/dsls/sql/zetasql/operators.md | 597 -
.../src/documentation/dsls/sql/zetasql/overview.md | 67 -
.../documentation/dsls/sql/zetasql/query-syntax.md | 1215 -
.../dsls/sql/zetasql/string-functions.md | 657 -
.../src/documentation/dsls/sql/zetasql/syntax.md | 34 -
website/src/documentation/index.md | 70 -
.../documentation/io/built-in-google-bigquery.md | 870 -
website/src/documentation/io/built-in-hadoop.md | 433 -
website/src/documentation/io/built-in-hcatalog.md | 158 -
website/src/documentation/io/built-in-parquet.md | 148 -
website/src/documentation/io/built-in.md | 147 -
website/src/documentation/io/developing-io-java.md | 368 -
.../src/documentation/io/developing-io-overview.md | 180 -
.../src/documentation/io/developing-io-python.md | 281 -
website/src/documentation/io/testing.md | 432 -
website/src/documentation/patterns/custom-io.md | 42 -
.../src/documentation/patterns/custom-windows.md | 114 -
.../src/documentation/patterns/file-processing.md | 107 -
website/src/documentation/patterns/overview.md | 48 -
.../src/documentation/patterns/pipeline-options.md | 47 -
website/src/documentation/patterns/side-inputs.md | 48 -
.../pipelines/create-your-pipeline.md | 105 -
.../pipelines/design-your-pipeline.md | 221 -
.../documentation/pipelines/test-your-pipeline.md | 294 -
website/src/documentation/programming-guide.md | 3674 -
.../documentation/resources/learning-resources.md | 152 -
.../documentation/resources/videos-and-podcasts.md | 136 -
website/src/documentation/runners/apex.md | 79 -
.../src/documentation/runners/capability-matrix.md | 60 -
website/src/documentation/runners/dataflow.md | 247 -
website/src/documentation/runners/direct.md | 173 -
website/src/documentation/runners/flink.md | 400 -
website/src/documentation/runners/gearpump.md | 142 -
website/src/documentation/runners/jet.md | 232 -
website/src/documentation/runners/jstorm.md | 115 -
website/src/documentation/runners/mapreduce.md | 93 -
website/src/documentation/runners/nemo.md | 169 -
website/src/documentation/runners/samza.md | 202 -
website/src/documentation/runners/spark.md | 390 -
website/src/documentation/runtime/environments.md | 186 -
website/src/documentation/runtime/model.md | 212 -
.../documentation/runtime/sdk-harness-config.md | 57 -
website/src/documentation/sdks/euphoria.md | 595 -
.../src/documentation/sdks/feature-comparison.md | 20 -
website/src/documentation/sdks/go.md | 33 -
.../src/documentation/sdks/java-dependencies.md | 76 -
website/src/documentation/sdks/java-extensions.md | 73 -
website/src/documentation/sdks/java-thirdparty.md | 113 -
website/src/documentation/sdks/java.md | 51 -
website/src/documentation/sdks/nexmark.md | 726 -
.../src/documentation/sdks/python-dependencies.md | 66 -
.../sdks/python-pipeline-dependencies.md | 127 -
website/src/documentation/sdks/python-streaming.md | 188 -
.../src/documentation/sdks/python-type-safety.md | 153 -
website/src/documentation/sdks/python.md | 53 -
.../java/aggregation/approximatequantiles.md | 43 -
.../java/aggregation/approximateunique.md | 42 -
.../transforms/java/aggregation/cogroupbykey.md | 73 -
.../transforms/java/aggregation/combine.md | 82 -
.../java/aggregation/combinewithcontext.md | 37 -
.../transforms/java/aggregation/count.md | 50 -
.../transforms/java/aggregation/distinct.md | 43 -
.../transforms/java/aggregation/groupbykey.md | 50 -
.../java/aggregation/groupintobatches.md | 42 -
.../transforms/java/aggregation/hllcount.md | 77 -
.../transforms/java/aggregation/latest.md | 52 -
.../transforms/java/aggregation/max.md | 56 -
.../transforms/java/aggregation/mean.md | 58 -
.../transforms/java/aggregation/min.md | 42 -
.../transforms/java/aggregation/sample.md | 40 -
.../transforms/java/aggregation/sum.md | 51 -
.../transforms/java/aggregation/top.md | 39 -
.../transforms/java/element-wise/filter.md | 62 -
.../java/element-wise/flatmapelements.md | 40 -
.../transforms/java/element-wise/keys.md | 43 -
.../transforms/java/element-wise/kvswap.md | 43 -
.../transforms/java/element-wise/mapelements.md | 63 -
.../transforms/java/element-wise/pardo.md | 152 -
.../transforms/java/element-wise/partition.md | 62 -
.../transforms/java/element-wise/regex.md | 36 -
.../transforms/java/element-wise/reify.md | 39 -
.../transforms/java/element-wise/tostring.md | 37 -
.../transforms/java/element-wise/values.md | 44 -
.../transforms/java/element-wise/withkeys.md | 55 -
.../transforms/java/element-wise/withtimestamps.md | 36 -
website/src/documentation/transforms/java/index.md | 82 -
.../documentation/transforms/java/other/create.md | 40 -
.../documentation/transforms/java/other/flatten.md | 67 -
.../documentation/transforms/java/other/passert.md | 61 -
.../documentation/transforms/java/other/view.md | 37 -
.../documentation/transforms/java/other/window.md | 40 -
.../python/aggregation/approximatequantiles.md | 26 -
.../python/aggregation/approximateunique.md | 25 -
.../transforms/python/aggregation/cogroupbykey.md | 45 -
.../python/aggregation/combineglobally.md | 43 -
.../python/aggregation/combinewithcontext.md | 26 -
.../transforms/python/aggregation/count.md | 36 -
.../transforms/python/aggregation/distinct.md | 37 -
.../transforms/python/aggregation/groupbykey.md | 41 -
.../python/aggregation/groupintobatches.md | 26 -
.../transforms/python/aggregation/latest.md | 26 -
.../transforms/python/aggregation/max.md | 26 -
.../transforms/python/aggregation/mean.md | 39 -
.../transforms/python/aggregation/min.md | 26 -
.../transforms/python/aggregation/sample.md | 38 -
.../transforms/python/aggregation/sum.md | 26 -
.../transforms/python/aggregation/top.md | 38 -
.../transforms/python/elementwise/filter.md | 176 -
.../transforms/python/elementwise/flatmap.md | 240 -
.../transforms/python/elementwise/keys.md | 56 -
.../transforms/python/elementwise/kvswap.md | 57 -
.../transforms/python/elementwise/map.md | 216 -
.../transforms/python/elementwise/pardo.md | 167 -
.../transforms/python/elementwise/partition.md | 144 -
.../transforms/python/elementwise/regex.md | 299 -
.../transforms/python/elementwise/reify.md | 28 -
.../transforms/python/elementwise/tostring.md | 104 -
.../transforms/python/elementwise/values.md | 56 -
.../transforms/python/elementwise/withkeys.md | 27 -
.../python/elementwise/withtimestamps.md | 120 -
.../src/documentation/transforms/python/index.md | 86 -
.../transforms/python/other/create.md | 38 -
.../transforms/python/other/flatten.md | 43 -
.../transforms/python/other/passert.md | 25 -
.../transforms/python/other/reshuffle.md | 41 -
.../documentation/transforms/python/other/view.md | 25 -
.../transforms/python/other/windowinto.md | 41 -
website/src/feed.xml | 39 -
website/src/get-started/beam-overview.md | 74 -
website/src/get-started/downloads.md | 240 -
website/src/get-started/index.md | 48 -
website/src/get-started/mobile-gaming-example.md | 410 -
website/src/get-started/quickstart-go.md | 91 -
website/src/get-started/quickstart-java.md | 444 -
website/src/get-started/quickstart-py.md | 229 -
website/src/get-started/try-apache-beam.md | 192 -
website/src/get-started/wordcount-example.md | 1581 -
website/src/index.md | 176 -
website/src/js/language-switch.js | 132 -
website/src/js/section-nav.js | 171 -
website/src/privacy_policy/index.md | 32 -
website/src/roadmap/apex-runner.md | 26 -
website/src/roadmap/connectors-go-sdk.md | 28 -
website/src/roadmap/connectors-java-sdk.md | 39 -
website/src/roadmap/connectors-multi-sdk.md | 100 -
website/src/roadmap/connectors-python-sdk.md | 32 -
website/src/roadmap/dataflow-runner.md | 26 -
website/src/roadmap/euphoria.md | 49 -
website/src/roadmap/flink-runner.md | 26 -
website/src/roadmap/gearpump-runner.md | 26 -
website/src/roadmap/go-sdk.md | 78 -
website/src/roadmap/index.md | 89 -
website/src/roadmap/java-sdk.md | 30 -
website/src/roadmap/nemo-runner.md | 27 -
website/src/roadmap/portability.md | 171 -
website/src/roadmap/python-sdk.md | 43 -
website/src/roadmap/samza-runner.md | 26 -
website/src/roadmap/spark-runner.md | 29 -
website/src/roadmap/sql.md | 26 -
website/src/security/CVE-2020-1929.md | 17 -
website/src/security/index.md | 56 -
website/src/v2/index.md | 51 -
website/www/build_github_samples.sh | 41 +
website/www/check-links.sh | 93 +
website/www/package.json | 19 +
website/www/site/archetypes/blog.md | 21 +
website/www/site/archetypes/default.md | 16 +
.../_sass => www/site/assets/scss}/_bootstrap.scss | 0
.../site/assets/scss}/_breakpoints.sass | 0
.../_sass => www/site/assets/scss}/_button.sass | 0
.../_sass => www/site/assets/scss}/_cards.sass | 0
.../{src/_sass => www/site/assets/scss}/_ctas.sass | 0
.../_sass => www/site/assets/scss}/_footer.sass | 0
.../_sass => www/site/assets/scss}/_global.sass | 0
.../_sass => www/site/assets/scss}/_graphic.sass | 0
.../_sass => www/site/assets/scss}/_header.sass | 0
.../{src/_sass => www/site/assets/scss}/_hero.sass | 0
.../_sass => www/site/assets/scss}/_layout.scss | 0
.../_sass => www/site/assets/scss}/_logos.sass | 0
.../_sass => www/site/assets/scss}/_navbar.sass | 0
website/www/site/assets/scss/_page-nav.sass | 62 +
.../_sass => www/site/assets/scss}/_pillars.sass | 0
.../site/assets/scss}/_section-nav.sass | 0
.../www/site/assets/scss/_syntax-highlighting.scss | 105 +
website/www/site/assets/scss/_table-wrapper.sass | 24 +
.../site/assets/scss}/_toggler-nav.scss | 0
.../{src/_sass => www/site/assets/scss}/_type.sass | 0
.../{src/_sass => www/site/assets/scss}/_vars.sass | 0
.../site/assets/scss}/bootstrap/_alerts.scss | 0
.../site/assets/scss}/bootstrap/_badges.scss | 0
.../site/assets/scss}/bootstrap/_breadcrumbs.scss | 0
.../assets/scss}/bootstrap/_button-groups.scss | 0
.../site/assets/scss}/bootstrap/_buttons.scss | 0
.../site/assets/scss}/bootstrap/_carousel.scss | 0
.../site/assets/scss}/bootstrap/_close.scss | 0
.../site/assets/scss}/bootstrap/_code.scss | 0
.../scss}/bootstrap/_component-animations.scss | 0
.../site/assets/scss}/bootstrap/_dropdowns.scss | 0
.../site/assets/scss}/bootstrap/_forms.scss | 0
.../site/assets/scss}/bootstrap/_glyphicons.scss | 0
.../site/assets/scss}/bootstrap/_grid.scss | 0
.../site/assets/scss}/bootstrap/_input-groups.scss | 0
.../site/assets/scss}/bootstrap/_jumbotron.scss | 0
.../site/assets/scss}/bootstrap/_labels.scss | 0
.../site/assets/scss}/bootstrap/_list-group.scss | 0
.../site/assets/scss}/bootstrap/_media.scss | 0
.../site/assets/scss}/bootstrap/_mixins.scss | 0
.../site/assets/scss}/bootstrap/_modals.scss | 0
.../site/assets/scss}/bootstrap/_navbar.scss | 0
.../site/assets/scss}/bootstrap/_navs.scss | 0
.../site/assets/scss}/bootstrap/_normalize.scss | 0
.../site/assets/scss}/bootstrap/_pager.scss | 0
.../site/assets/scss}/bootstrap/_pagination.scss | 0
.../site/assets/scss}/bootstrap/_panels.scss | 0
.../site/assets/scss}/bootstrap/_popovers.scss | 0
.../site/assets/scss}/bootstrap/_print.scss | 0
.../assets/scss}/bootstrap/_progress-bars.scss | 0
.../assets/scss}/bootstrap/_responsive-embed.scss | 0
.../scss}/bootstrap/_responsive-utilities.scss | 0
.../site/assets/scss}/bootstrap/_scaffolding.scss | 0
.../site/assets/scss}/bootstrap/_tables.scss | 0
.../site/assets/scss}/bootstrap/_theme.scss | 0
.../site/assets/scss}/bootstrap/_thumbnails.scss | 0
.../site/assets/scss}/bootstrap/_tooltip.scss | 0
.../site/assets/scss}/bootstrap/_type.scss | 0
.../site/assets/scss}/bootstrap/_utilities.scss | 0
.../site/assets/scss}/bootstrap/_variables.scss | 0
.../site/assets/scss}/bootstrap/_wells.scss | 0
.../assets/scss}/bootstrap/mixins/_alerts.scss | 0
.../bootstrap/mixins/_background-variant.scss | 0
.../scss}/bootstrap/mixins/_border-radius.scss | 0
.../assets/scss}/bootstrap/mixins/_buttons.scss | 0
.../scss}/bootstrap/mixins/_center-block.scss | 0
.../assets/scss}/bootstrap/mixins/_clearfix.scss | 0
.../site/assets/scss}/bootstrap/mixins/_forms.scss | 0
.../assets/scss}/bootstrap/mixins/_gradients.scss | 0
.../scss}/bootstrap/mixins/_grid-framework.scss | 0
.../site/assets/scss}/bootstrap/mixins/_grid.scss | 0
.../assets/scss}/bootstrap/mixins/_hide-text.scss | 0
.../site/assets/scss}/bootstrap/mixins/_image.scss | 0
.../assets/scss}/bootstrap/mixins/_labels.scss | 0
.../assets/scss}/bootstrap/mixins/_list-group.scss | 0
.../scss}/bootstrap/mixins/_nav-divider.scss | 0
.../bootstrap/mixins/_nav-vertical-align.scss | 0
.../assets/scss}/bootstrap/mixins/_opacity.scss | 0
.../assets/scss}/bootstrap/mixins/_pagination.scss | 0
.../assets/scss}/bootstrap/mixins/_panels.scss | 0
.../scss}/bootstrap/mixins/_progress-bar.scss | 0
.../scss}/bootstrap/mixins/_reset-filter.scss | 0
.../assets/scss}/bootstrap/mixins/_reset-text.scss | 0
.../assets/scss}/bootstrap/mixins/_resize.scss | 0
.../bootstrap/mixins/_responsive-visibility.scss | 0
.../site/assets/scss}/bootstrap/mixins/_size.scss | 0
.../assets/scss}/bootstrap/mixins/_tab-focus.scss | 0
.../assets/scss}/bootstrap/mixins/_table-row.scss | 0
.../scss}/bootstrap/mixins/_text-emphasis.scss | 0
.../scss}/bootstrap/mixins/_text-overflow.scss | 0
.../scss}/bootstrap/mixins/_vendor-prefixes.scss | 0
.../site/assets/scss}/capability-matrix.scss | 0
website/www/site/assets/scss/main.scss | 42 +
website/www/site/config.toml | 112 +
website/www/site/content/en/_index.md | 17 +
.../www/site/content/en/blog/added-apex-runner.md | 53 +
.../content/en/blog/adding-data-sources-to-sql.md | 201 +
website/www/site/content/en/blog/beam-2.10.0.md | 119 +
website/www/site/content/en/blog/beam-2.11.0.md | 114 +
website/www/site/content/en/blog/beam-2.12.0.md | 74 +
website/www/site/content/en/blog/beam-2.13.0.md | 77 +
website/www/site/content/en/blog/beam-2.14.0.md | 106 +
website/www/site/content/en/blog/beam-2.15.0.md | 87 +
website/www/site/content/en/blog/beam-2.16.0.md | 102 +
website/www/site/content/en/blog/beam-2.17.0.md | 98 +
website/www/site/content/en/blog/beam-2.18.0.md | 109 +
website/www/site/content/en/blog/beam-2.19.0.md | 96 +
website/www/site/content/en/blog/beam-2.20.0.md | 77 +
website/www/site/content/en/blog/beam-2.3.0.md | 103 +
website/www/site/content/en/blog/beam-2.5.0.md | 99 +
website/www/site/content/en/blog/beam-2.6.0.md | 89 +
website/www/site/content/en/blog/beam-2.7.0.md | 76 +
website/www/site/content/en/blog/beam-2.8.0.md | 90 +
website/www/site/content/en/blog/beam-2.9.0.md | 63 +
.../www/site/content/en/blog/beam-a-look-back.md | 146 +
.../content/en/blog/beam-first-stable-release.md | 122 +
website/www/site/content/en/blog/beam-graduates.md | 79 +
.../www/site/content/en/blog/beam-has-a-logo.md | 44 +
.../www/site/content/en/blog/beam-kata-release.md | 60 +
website/www/site/content/en/blog/beam-kotlin.md | 115 +
.../site/content/en/blog/beam-summit-aftermath.md | 112 +
.../content/en/blog/beam-summit-digital-2020.md | 55 +
.../content/en/blog/beam-summit-europe-2019.md | 91 +
.../www/site/content/en/blog/beam-summit-europe.md | 54 +
.../www/site/content/en/blog/beam-summit-site.md | 40 +
.../www/site/content/en/blog/capability-matrix.md | 40 +
website/www/site/content/en/blog/first-release.md | 54 +
.../en/blog/flink-batch-runner-milestone.md | 46 +
.../site/content/en/blog/graduation-media-recap.md | 66 +
website/www/site/content/en/blog/gsoc-19.md | 94 +
website/www/site/content/en/blog/looping-timers.md | 350 +
.../site/content/en/blog/presentation-materials.md | 39 +
.../site/content/en/blog/python-sdk-now-public.md | 38 +
.../www/site/content/en/blog/python-sdk-release.md | 86 +
.../en/blog/review-input-streaming-connectors.md | 239 +
website/www/site/content/en/blog/season-of-docs.md | 65 +
website/www/site/content/en/blog/six-months.md | 57 +
.../site/content/en/blog/splitAtFraction-method.md | 31 +
.../www/site/content/en/blog/splittable-do-fn.md | 532 +
.../site/content/en/blog/stateful-processing.md | 638 +
.../en/blog/strata-hadoop-world-and-beam.md | 47 +
website/www/site/content/en/blog/test-stream.md | 323 +
.../www/site/content/en/blog/timely-processing.md | 611 +
.../en/blog/where-is-my-pcollection-dot-map.md | 106 +
.../www/site/content/en/community/contact-us.md | 47 +
website/www/site/content/en/community/in-person.md | 49 +
.../www/site/content/en/community/integrations.md | 32 +
website/www/site/content/en/community/logos.md | 45 +
website/www/site/content/en/community/policies.md | 29 +
.../content/en/community/presentation-materials.md | 44 +
.../site/content/en/community/twitter-handle.md | 38 +
.../site/content/en/community/youtube-channel.md | 45 +
website/www/site/content/en/contribute/_index.md | 285 +
.../content/en/contribute/become-a-committer.md | 97 +
.../site/content/en/contribute/committer-guide.md | 135 +
.../www/site/content/en/contribute/dependencies.md | 92 +
.../site/content/en/contribute/design-documents.md | 20 +
.../site/content/en/contribute/feature-branches.md | 95 +
website/www/site/content/en/contribute/get-help.md | 24 +
.../site/content/en/contribute/jira-priorities.md | 73 +
.../content/en/contribute/postcommits-guides.md | 71 +
.../en/contribute/postcommits-policies-details.md | 108 +
.../content/en/contribute/postcommits-policies.md | 99 +
.../content/en/contribute/precommit-policies.md | 63 +
.../en/contribute/precommit-triage-guide.md | 120 +
.../en/contribute/ptransform-style-guide.md | 552 +
.../site/content/en/contribute/release-blocking.md | 39 +
.../site/content/en/contribute/release-guide.md | 1233 +
.../www/site/content/en/contribute/runner-guide.md | 1072 +
website/www/site/content/en/contribute/team.md | 20 +
website/www/site/content/en/contribute/testing.md | 22 +
.../www/site/content/en/documentation/_index.md | 67 +
.../dsls/sql/calcite/aggregate-functions.md | 32 +
.../documentation/dsls/sql/calcite/data-types.md | 44 +
.../dsls/sql/calcite/lexical-structure.md | 1049 +
.../en/documentation/dsls/sql/calcite/overview.md | 67 +
.../documentation/dsls/sql/calcite/query-syntax.md | 715 +
.../dsls/sql/calcite/scalar-functions.md | 138 +
.../dsls/sql/extensions/create-external-table.md | 415 +
.../en/documentation/dsls/sql/extensions/joins.md | 71 +
.../en/documentation/dsls/sql/extensions/set.md | 54 +
.../dsls/sql/extensions/user-defined-functions.md | 126 +
.../sql/extensions/windowing-and-triggering.md | 65 +
.../content/en/documentation/dsls/sql/overview.md | 62 +
.../content/en/documentation/dsls/sql/shell.md | 151 +
.../en/documentation/dsls/sql/walkthrough.md | 156 +
.../dsls/sql/zetasql/aggregate-functions.md | 209 +
.../dsls/sql/zetasql/conditional-expressions.md | 115 +
.../dsls/sql/zetasql/conversion-rules.md | 193 +
.../documentation/dsls/sql/zetasql/data-types.md | 483 +
.../en/documentation/dsls/sql/zetasql/lexical.md | 575 +
.../dsls/sql/zetasql/math-functions.md | 132 +
.../en/documentation/dsls/sql/zetasql/operators.md | 598 +
.../en/documentation/dsls/sql/zetasql/overview.md | 62 +
.../documentation/dsls/sql/zetasql/query-syntax.md | 1250 +
.../dsls/sql/zetasql/string-functions.md | 656 +
.../en/documentation/dsls/sql/zetasql/syntax.md | 32 +
.../site/content/en/documentation/io/built-in.md | 144 +
.../documentation/io/built-in/google-bigquery.md | 923 +
.../content/en/documentation/io/built-in/hadoop.md | 430 +
.../en/documentation/io/built-in/hcatalog.md | 158 +
.../en/documentation/io/built-in/parquet.md | 149 +
.../en/documentation/io/developing-io-java.md | 365 +
.../en/documentation/io/developing-io-overview.md | 176 +
.../en/documentation/io/developing-io-python.md | 284 +
.../site/content/en/documentation/io/testing.md | 423 +
.../content/en/documentation/patterns/custom-io.md | 33 +
.../en/documentation/patterns/custom-windows.md | 106 +
.../en/documentation/patterns/file-processing.md | 106 +
.../content/en/documentation/patterns/overview.md | 45 +
.../en/documentation/patterns/pipeline-options.md | 36 +
.../en/documentation/patterns/side-inputs.md | 78 +
.../pipelines/create-your-pipeline.md | 102 +
.../pipelines/design-your-pipeline.md | 212 +
.../documentation/pipelines/test-your-pipeline.md | 286 +
.../content/en/documentation/programming-guide.md | 4879 ++
.../documentation/resources/learning-resources.md | 148 +
.../documentation/resources/videos-and-podcasts.md | 150 +
.../site/content/en/documentation/runners/apex.md | 77 +
.../en/documentation/runners/capability-matrix.md | 42 +
.../content/en/documentation/runners/dataflow.md | 244 +
.../content/en/documentation/runners/direct.md | 168 +
.../site/content/en/documentation/runners/flink.md | 405 +
.../content/en/documentation/runners/gearpump.md | 141 +
.../site/content/en/documentation/runners/jet.md | 229 +
.../content/en/documentation/runners/jstorm.md | 113 +
.../content/en/documentation/runners/mapreduce.md | 91 +
.../site/content/en/documentation/runners/nemo.md | 167 +
.../site/content/en/documentation/runners/samza.md | 200 +
.../site/content/en/documentation/runners/spark.md | 388 +
.../en/documentation/runtime/environments.md | 162 +
.../site/content/en/documentation/runtime/model.md | 197 +
.../en/documentation/runtime/sdk-harness-config.md | 54 +
.../en/documentation/sdks/feature-comparison.md | 18 +
.../www/site/content/en/documentation/sdks/go.md | 31 +
.../en/documentation/sdks/java-dependencies.md | 74 +
.../en/documentation/sdks/java-extensions.md | 71 +
.../en/documentation/sdks/java-thirdparty.md | 111 +
.../www/site/content/en/documentation/sdks/java.md | 49 +
.../content/en/documentation/sdks/java/euphoria.md | 593 +
.../en/documentation/sdks/java/testing/nexmark.md | 722 +
.../en/documentation/sdks/python-dependencies.md | 64 +
.../sdks/python-pipeline-dependencies.md | 125 +
.../en/documentation/sdks/python-streaming.md | 180 +
.../en/documentation/sdks/python-type-safety.md | 234 +
.../site/content/en/documentation/sdks/python.md | 51 +
.../java/aggregation/approximatequantiles.md | 41 +
.../java/aggregation/approximateunique.md | 40 +
.../transforms/java/aggregation/cogroupbykey.md | 71 +
.../transforms/java/aggregation/combine.md | 80 +
.../java/aggregation/combinewithcontext.md | 35 +
.../transforms/java/aggregation/count.md | 48 +
.../transforms/java/aggregation/distinct.md | 41 +
.../transforms/java/aggregation/groupbykey.md | 48 +
.../java/aggregation/groupintobatches.md | 40 +
.../transforms/java/aggregation/hllcount.md | 75 +
.../transforms/java/aggregation/latest.md | 50 +
.../transforms/java/aggregation/max.md | 54 +
.../transforms/java/aggregation/mean.md | 56 +
.../transforms/java/aggregation/min.md | 40 +
.../transforms/java/aggregation/sample.md | 38 +
.../transforms/java/aggregation/sum.md | 49 +
.../transforms/java/aggregation/top.md | 37 +
.../transforms/java/elementwise/filter.md | 60 +
.../transforms/java/elementwise/flatmapelements.md | 38 +
.../transforms/java/elementwise/keys.md | 41 +
.../transforms/java/elementwise/kvswap.md | 41 +
.../transforms/java/elementwise/mapelements.md | 61 +
.../transforms/java/elementwise/pardo.md | 150 +
.../transforms/java/elementwise/partition.md | 60 +
.../transforms/java/elementwise/regex.md | 34 +
.../transforms/java/elementwise/reify.md | 37 +
.../transforms/java/elementwise/tostring.md | 35 +
.../transforms/java/elementwise/values.md | 42 +
.../transforms/java/elementwise/withkeys.md | 53 +
.../transforms/java/elementwise/withtimestamps.md | 34 +
.../documentation/transforms/java/other/create.md | 38 +
.../documentation/transforms/java/other/flatten.md | 66 +
.../documentation/transforms/java/other/passert.md | 59 +
.../en/documentation/transforms/java/other/view.md | 35 +
.../documentation/transforms/java/other/window.md | 38 +
.../en/documentation/transforms/java/overview.md | 79 +
.../python/aggregation/approximatequantiles.md | 23 +
.../python/aggregation/approximateunique.md | 22 +
.../transforms/python/aggregation/cogroupbykey.md | 44 +
.../python/aggregation/combineglobally.md | 42 +
.../python/aggregation/combinewithcontext.md | 23 +
.../transforms/python/aggregation/count.md | 35 +
.../transforms/python/aggregation/distinct.md | 36 +
.../transforms/python/aggregation/groupbykey.md | 40 +
.../python/aggregation/groupintobatches.md | 23 +
.../transforms/python/aggregation/latest.md | 23 +
.../transforms/python/aggregation/max.md | 23 +
.../transforms/python/aggregation/mean.md | 38 +
.../transforms/python/aggregation/min.md | 23 +
.../transforms/python/aggregation/sample.md | 37 +
.../transforms/python/aggregation/sum.md | 23 +
.../transforms/python/aggregation/top.md | 37 +
.../transforms/python/elementwise/filter.md | 177 +
.../transforms/python/elementwise/flatmap.md | 245 +
.../transforms/python/elementwise/keys.md | 52 +
.../transforms/python/elementwise/kvswap.md | 53 +
.../transforms/python/elementwise/map.md | 219 +
.../transforms/python/elementwise/pardo.md | 165 +
.../transforms/python/elementwise/partition.md | 142 +
.../transforms/python/elementwise/regex.md | 303 +
.../transforms/python/elementwise/reify.md | 25 +
.../transforms/python/elementwise/tostring.md | 102 +
.../transforms/python/elementwise/values.md | 52 +
.../transforms/python/elementwise/withkeys.md | 24 +
.../python/elementwise/withtimestamps.md | 120 +
.../transforms/python/other/create.md | 37 +
.../transforms/python/other/flatten.md | 43 +
.../transforms/python/other/passert.md | 22 +
.../transforms/python/other/reshuffle.md | 40 +
.../documentation/transforms/python/other/view.md | 22 +
.../transforms/python/other/windowinto.md | 40 +
.../en/documentation/transforms/python/overview.md | 83 +
website/www/site/content/en/get-started/_index.md | 47 +
.../site/content/en/get-started/beam-overview.md | 72 +
.../www/site/content/en/get-started/downloads.md | 244 +
.../en/get-started/mobile-gaming-example.md | 418 +
.../site/content/en/get-started/quickstart-go.md | 85 +
.../site/content/en/get-started/quickstart-java.md | 400 +
.../site/content/en/get-started/quickstart-py.md | 206 +
.../site/content/en/get-started/try-apache-beam.md | 188 +
.../content/en/get-started/wordcount-example.md | 1495 +
.../www/site/content/en/privacy_policy/_index.md | 30 +
website/www/site/content/en/roadmap/_index.md | 86 +
website/www/site/content/en/roadmap/apex-runner.md | 23 +
.../site/content/en/roadmap/connectors-go-sdk.md | 25 +
.../site/content/en/roadmap/connectors-java-sdk.md | 36 +
.../content/en/roadmap/connectors-multi-sdk.md | 97 +
.../content/en/roadmap/connectors-python-sdk.md | 29 +
.../www/site/content/en/roadmap/dataflow-runner.md | 23 +
website/www/site/content/en/roadmap/euphoria.md | 45 +
.../www/site/content/en/roadmap/flink-runner.md | 23 +
.../www/site/content/en/roadmap/gearpump-runner.md | 23 +
website/www/site/content/en/roadmap/go-sdk.md | 75 +
website/www/site/content/en/roadmap/java-sdk.md | 27 +
website/www/site/content/en/roadmap/nemo-runner.md | 23 +
website/www/site/content/en/roadmap/portability.md | 169 +
website/www/site/content/en/roadmap/python-sdk.md | 40 +
.../www/site/content/en/roadmap/samza-runner.md | 23 +
.../www/site/content/en/roadmap/spark-runner.md | 26 +
website/www/site/content/en/roadmap/sql.md | 23 +
.../www/site/content/en/security/CVE-2020-1929.md | 16 +
website/www/site/content/en/security/_index.md | 54 +
website/www/site/data/authors.yml | 156 +
website/www/site/data/capability_matrix.yaml | 1706 +
.../www/site/data/capability_matrix_snapshot.yaml | 567 +
website/www/site/data/en/cards.yaml | 18 +
website/www/site/data/en/pillars.yaml | 18 +
website/www/site/data/logos.yml | 22 +
website/www/site/data/meetings.yml | 38 +
website/www/site/data/works_with.yaml | 30 +
website/www/site/i18n/blog/en.yaml | 18 +
website/www/site/i18n/footer/en.yaml | 58 +
website/www/site/i18n/home/en.yaml | 44 +
website/www/site/i18n/navbar/en.yaml | 42 +
website/www/site/layouts/_default/baseof.html | 30 +
website/www/site/layouts/blog/baseof.html | 25 +
website/www/site/layouts/blog/list.html | 50 +
website/www/site/layouts/blog/single.html | 36 +
website/www/site/layouts/community/baseof.html | 40 +
website/www/site/layouts/contribute/baseof.html | 40 +
website/www/site/layouts/documentation/baseof.html | 40 +
website/www/site/layouts/get-started/baseof.html | 40 +
website/www/site/layouts/index.feed.xml | 53 +
website/www/site/layouts/index.html | 150 +
website/www/site/layouts/languages/baseof.html | 41 +
website/www/site/layouts/partials/footer.html | 63 +
website/www/site/layouts/partials/head.html | 56 +
website/www/site/layouts/partials/header.html | 94 +
.../partials/section-menu/en/community.html | 31 +
.../partials/section-menu/en/contribute.html | 45 +
.../partials/section-menu/en/documentation.html | 307 +
.../partials/section-menu/en/get-started.html | 33 +
.../layouts/partials/section-menu/en/roadmap.html | 49 +
.../layouts/partials/section-menu/en/runners.html | 23 +
.../layouts/partials/section-menu/en/sdks.html | 109 +
.../www/site/layouts/privacy_policy/baseof.html | 25 +
website/www/site/layouts/roadmap/baseof.html | 40 +
website/www/site/layouts/runners/baseof.html | 40 +
website/www/site/layouts/security/baseof.html | 41 +
.../www/site/layouts/shortcodes/button-pydoc.html | 30 +
.../layouts/shortcodes/buttons-code-snippet.html | 32 +
.../shortcodes/capability-matrix-common.html | 19 +
.../site/layouts/shortcodes/capability-matrix.html | 98 +
.../www/site/layouts/shortcodes/colors/png.html | 33 +
.../www/site/layouts/shortcodes/colors/svg.html | 28 +
.../shortcodes/flink_java_pipeline_options.html | 160 +
.../shortcodes/flink_python_pipeline_options.html | 160 +
.../www/site/layouts/shortcodes/github_sample.html | 15 +
website/www/site/layouts/shortcodes/highlight.html | 31 +
.../site/layouts/shortcodes/language-switcher.html | 28 +
.../www/site/layouts/shortcodes/localstorage.html | 15 +
website/www/site/layouts/shortcodes/paragraph.html | 17 +
website/www/site/layouts/shortcodes/table.html | 17 +
website/www/site/layouts/shortcodes/toc.html | 13 +
website/www/site/static/.htaccess | 24 +
.../site/static}/downloads/beam-doap.rdf | 0
.../{src => www/site/static}/downloads/logos.zip | Bin
.../{src => www/site/static}/downloads/palette.pdf | Bin
.../bootstrap/glyphicons-halflings-regular.eot | Bin
.../bootstrap/glyphicons-halflings-regular.svg | 0
.../bootstrap/glyphicons-halflings-regular.ttf | Bin
.../bootstrap/glyphicons-halflings-regular.woff | Bin
.../bootstrap/glyphicons-halflings-regular.woff2 | Bin
.../site/static}/images/apache_logo_circle.svg | 0
.../site/static}/images/beam_architecture.png | Bin
.../site/static}/images/beam_logo_circle.svg | 0
.../site/static}/images/beam_logo_navbar.png | Bin
.../site/static}/images/beam_logo_s.png | Bin
.../site/static}/images/beam_sql_dsl_workflow.png | Bin
.../images/blog/2017-look-back/timeline.png | Bin
.../site/static}/images/blog/Facebook-AD.png | Bin
.../static}/images/blog/IMG_20160927_170455.jpg | Bin
.../static}/images/blog/IMG_20160927_170956.jpg | Bin
.../{src => www/site/static}/images/blog/SoD.png | Bin
.../blog/beam-kata/beam-kata-intellij-edu-1.png | Bin
.../blog/beam-kata/beam-kata-intellij-edu-2.png | Bin
.../blog/beam-kata/beam-kata-pycharm-edu-1.png | Bin
.../blog/beam-kata/beam-kata-pycharm-edu-2.png | Bin
.../images/blog/beamsummit/beamsummit-digital.png | Bin 0 -> 63238 bytes
.../site/static}/images/blog/kotlin.png | Bin
.../images/blog/simple-wordcount-pipeline.png | Bin
.../images/blog/splittable-do-fn/blocks.png | Bin
.../blog/splittable-do-fn/jdbcio-expansion.png | Bin
.../blog/splittable-do-fn/kafka-splitting.png | Bin
.../images/blog/splittable-do-fn/restrictions.png | Bin
.../blog/splittable-do-fn/transform-expansion.png | Bin
.../blog/stateful-processing/assign-indices.png | Bin
.../images/blog/stateful-processing/combinefn.png | Bin
.../blog/stateful-processing/combiner-lifting.png | Bin
.../blog/stateful-processing/pardo-and-gbk.png | Bin
.../images/blog/stateful-processing/pipeline.png | Bin
.../images/blog/stateful-processing/plaid.png | Bin
.../blog/stateful-processing/stateful-dofn.png | Bin
.../blog/stateful-processing/stateful-pardo.png | Bin
.../blog/test-stream/elements-all-on-time.png | Bin
.../blog/test-stream/elements-droppably-late.png | Bin
.../blog/test-stream/elements-observably-late.png | Bin
.../elements-processing-speculative.png | Bin
.../test-stream/elements-unobservably-late.png | Bin
.../blog/timely-processing/BatchedRpcExpiry.png | Bin
.../blog/timely-processing/BatchedRpcStale.png | Bin
.../blog/timely-processing/BatchedRpcState.png | Bin
.../blog/timely-processing/CombinePerKey.png | Bin
.../images/blog/timely-processing/ParDo.png | Bin
.../blog/timely-processing/StateAndTimers.png | Bin
.../images/blog/timely-processing/UnifiedModel.png | Bin
.../blog/timely-processing/WindowingChoices.png | Bin
.../site/static}/images/card_border.svg | 0
.../{src => www/site/static}/images/cards_bg.svg | 0
.../site/static}/images/contribution-diversity.png | Bin
.../site/static}/images/contribution-guide-1.png | Bin
.../design-your-pipeline-additional-outputs.svg | 0
.../images/design-your-pipeline-flatten.svg | 0
.../static}/images/design-your-pipeline-join.svg | 0
.../static}/images/design-your-pipeline-linear.svg | 0
.../design-your-pipeline-multiple-pcollections.svg | 0
.../site/static}/images/dofn-sequence-diagram.svg | 0
.../static}/images/execution_model_bundling.svg | 0
.../execution_model_bundling_coupled_failure.svg | 0
.../images/execution_model_bundling_gantt.svg | 0
.../images/execution_model_bundling_gantt_max.svg | 0
.../images/execution_model_bundling_multi.svg | 0
.../execution_model_bundling_multi_gantt.svg | 0
.../images/execution_model_failure_retry.svg | 0
.../site/static}/images/external-link-icon.png | Bin
.../{src => www/site/static}/images/favicon.ico | Bin
.../site/static}/images/fixed-time-windows.png | Bin
.../site/static}/images/gaming-example-basic.png | Bin
.../images/gaming-example-event-time-narrow.gif | Bin
.../images/gaming-example-proc-time-narrow.gif | Bin
.../images/gaming-example-session-windows.png | Bin
.../images/gaming-example-team-scores-narrow.gif | Bin
.../site/static}/images/gaming-example.gif | Bin
.../{src => www/site/static}/images/hero_bg.svg | 0
.../site/static}/images/hero_bg_flat.svg | 0
.../{src => www/site/static}/images/logo_apex.png | Bin
.../{src => www/site/static}/images/logo_flink.png | Bin
.../site/static}/images/logo_gearpump.png | Bin
.../site/static}/images/logo_google_cloud.png | Bin
.../{src => www/site/static}/images/logo_samza.png | Bin
.../{src => www/site/static}/images/logo_spark.png | Bin
.../beam-logo-3-color-name-bottom-100.png | Bin
.../beam-logo-3-color-name-bottom-1000.png | Bin
.../beam-logo-3-color-name-bottom-200.png | Bin
.../beam-logo-3-color-name-bottom-500.png | Bin
.../name-bottom/beam-logo-3-color-name-bottom.svg | 0
.../beam-logo-3-color-name-right-100.png | Bin
.../beam-logo-3-color-name-right-1000.png | Bin
.../beam-logo-3-color-name-right-200.png | Bin
.../beam-logo-3-color-name-right-500.png | Bin
.../name-right/beam-logo-3-color-name-right.svg | 0
.../nameless/beam-logo-3-color-nameless-100.png | Bin
.../nameless/beam-logo-3-color-nameless-1000.png | Bin
.../nameless/beam-logo-3-color-nameless-200.png | Bin
.../nameless/beam-logo-3-color-nameless-500.png | Bin
.../nameless/beam-logo-3-color-nameless.svg | 0
.../name-bottom/beam-logo-bw-name-bottom-100.png | Bin
.../name-bottom/beam-logo-bw-name-bottom-1000.png | Bin
.../name-bottom/beam-logo-bw-name-bottom-200.png | Bin
.../name-bottom/beam-logo-bw-name-bottom-500.png | Bin
.../bw/name-bottom/beam-logo-bw-name-bottom.svg | 0
.../bw/name-right/beam-logo-bw-name-right-100.png | Bin
.../bw/name-right/beam-logo-bw-name-right-1000.png | Bin
.../bw/name-right/beam-logo-bw-name-right-200.png | Bin
.../bw/name-right/beam-logo-bw-name-right-500.png | Bin
.../bw/name-right/beam-logo-bw-name-right.svg | 0
.../bw/nameless/beam-logo-bw-nameless-100.png | Bin
.../bw/nameless/beam-logo-bw-nameless-1000.png | Bin
.../bw/nameless/beam-logo-bw-nameless-200.png | Bin
.../bw/nameless/beam-logo-bw-nameless-500.png | Bin
.../logos/bw/nameless/beam-logo-bw-nameless.svg | 0
.../beam-logo-full-color-name-bottom-100.png | Bin
.../beam-logo-full-color-name-bottom-1000.png | Bin
.../beam-logo-full-color-name-bottom-200.png | Bin
.../beam-logo-full-color-name-bottom-500.png | Bin
.../beam-logo-full-color-name-bottom.svg | 0
.../beam-logo-full-color-name-right-100.png | Bin
.../beam-logo-full-color-name-right-1000.png | Bin
.../beam-logo-full-color-name-right-200.png | Bin
.../beam-logo-full-color-name-right-500.png | Bin
.../name-right/beam-logo-full-color-name-right.svg | 0
.../nameless/beam-logo-full-color-nameless-100.png | Bin
.../beam-logo-full-color-nameless-1000.png | Bin
.../nameless/beam-logo-full-color-nameless-200.png | Bin
.../nameless/beam-logo-full-color-nameless-500.png | Bin
.../nameless/beam-logo-full-color-nameless.svg | 0
.../site/static}/images/logos/runners/apex.png | Bin
.../site/static}/images/logos/runners/dataflow.png | Bin
.../site/static}/images/logos/runners/flink.png | Bin
.../site/static}/images/logos/runners/gearpump.png | Bin
.../site/static}/images/logos/runners/jet.png | Bin
.../site/static}/images/logos/runners/jstorm.png | Bin
.../site/static}/images/logos/runners/samza.png | Bin
.../site/static}/images/logos/runners/spark.png | Bin
.../site/static}/images/logos/sdks/go.png | Bin
.../site/static}/images/logos/sdks/java.png | Bin
.../site/static}/images/logos/sdks/python.png | Bin
.../site/static}/images/logos/sdks/scala.png | Bin
.../site/static}/images/precommit_dashboard.png | Bin
.../images/precommit_graph_queuing_time.png | Bin
.../site/static}/images/release-guide-1.png | Bin
.../static}/images/resources/se-radio-podcast.png | Bin
.../static}/images/resources/streaming-101.png | Bin
.../static}/images/resources/streaming-102.png | Bin
.../site/static}/images/session-windows.png | Bin
.../site/static}/images/sliding-time-windows.png | Bin
.../static}/images/source-sequence-diagram.svg | 0
.../images/standard-vs-dynamic-sessions.png | Bin
.../site/static}/images/trigger-accumulation.png | Bin
.../static}/images/unwindowed-pipeline-bounded.svg | 0
.../static}/images/windowing-pipeline-bounded.svg | 0
.../images/windowing-pipeline-unbounded.svg | 0
.../site/static}/images/wordcount-pipeline.svg | 0
.../site/static}/js/bootstrap-sprockets.js | 0
website/{src => www/site/static}/js/bootstrap.js | 0
.../{src => www/site/static}/js/bootstrap.min.js | 0
.../{src => www/site/static}/js/bootstrap/affix.js | 0
.../{src => www/site/static}/js/bootstrap/alert.js | 0
.../site/static}/js/bootstrap/button.js | 0
.../site/static}/js/bootstrap/carousel.js | 0
.../site/static}/js/bootstrap/collapse.js | 0
.../site/static}/js/bootstrap/dropdown.js | 0
.../{src => www/site/static}/js/bootstrap/modal.js | 0
.../site/static}/js/bootstrap/popover.js | 0
.../site/static}/js/bootstrap/scrollspy.js | 0
.../{src => www/site/static}/js/bootstrap/tab.js | 0
.../site/static}/js/bootstrap/tooltip.js | 0
.../site/static}/js/bootstrap/transition.js | 0
website/{src => www/site/static}/js/fix-menu.js | 0
website/www/site/static/js/language-switch.js | 132 +
website/{src => www/site/static}/js/page-nav.js | 0
website/www/site/static/js/section-nav.js | 176 +
website/www/site/themes/docsy | 1 +
website/www/yarn.lock | 828 +
2148 files changed, 463793 insertions(+), 62254 deletions(-)
create mode 100644 .asf.yaml
create mode 100644 .gitmodules
create mode 100644 .test-infra/jenkins/InfluxDBCredentialsHelper.groovy
create mode 100644 .test-infra/jenkins/job_LoadTests_CoGBK_Java_spark_structured_streaming.groovy
create mode 100644 .test-infra/jenkins/job_LoadTests_Combine_Java_spark_structured_streaming.groovy
create mode 100644 .test-infra/jenkins/job_LoadTests_GBK_Java_spark_structured_streaming.groovy
create mode 100644 .test-infra/jenkins/job_LoadTests_ParDo_Java_spark_structured_streaming.groovy
delete mode 100644 .test-infra/jenkins/job_LoadTests_ParDo_Python_37.groovy
create mode 100644 .test-infra/jenkins/job_PerformanceTests_PubsubIO_Python.groovy
delete mode 100644 .test-infra/jenkins/job_PostCommit_Java_Dataflow_Portability_Examples_Java11.groovy
delete mode 100644 .test-infra/jenkins/job_PostCommit_Java_PortabilityApi.groovy
delete mode 100644 .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_DataflowPortabilityExecutableStage.groovy
create mode 100644 .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_Flink_Java11.groovy
delete mode 100644 .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow.groovy
delete mode 100644 .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Java11.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_BeamSQL_ZetaSQL_Java11.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Java_Examples_Dataflow_Java11.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Java_PortabilityApi_Java11.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_SQL_Java11.groovy
delete mode 100755 .test-infra/metrics/apply_configmaps.sh
create mode 100644 .test-infra/metrics/beam-influxdb-autobackup.yaml
create mode 100644 .test-infra/metrics/beam-influxdb-backups-persistentvolumeclaim.yaml
create mode 100644 .test-infra/metrics/beam-influxdb-storage-persistentvolumeclaim.yaml
create mode 100644 .test-infra/metrics/beam-influxdb.yaml
delete mode 100644 .test-infra/metrics/beamprometheus-deploy.yaml
create mode 100644 .test-infra/metrics/grafana/dashboards/home/getting_started.json
create mode 100644 .test-infra/metrics/grafana/dashboards/perftests_metrics/Combine_Load_Tests.json
create mode 100644 .test-infra/metrics/grafana/dashboards/perftests_metrics/GBK_Load_Tests.json
create mode 100644 .test-infra/metrics/grafana/dashboards/perftests_metrics/Java_IO_IT_Tests_Dataflow.json
create mode 100644 .test-infra/metrics/grafana/dashboards/perftests_metrics/ParDo_Load_Tests.json
create mode 100644 .test-infra/metrics/grafana/dashboards/perftests_metrics/Python_IO_IT_Tests_Dataflow.json
create mode 100644 .test-infra/metrics/grafana/dashboards/perftests_metrics/coGBK_Load_Tests.json
create mode 100644 .test-infra/metrics/grafana/provisioning/datasources/beaminfluxdb.yaml
delete mode 100644 .test-infra/metrics/prometheus/alertmanager/config/alertmanager.yml
delete mode 100644 .test-infra/metrics/prometheus/prometheus/config/prometheus.yml
delete mode 100644 .test-infra/metrics/prometheus/prometheus/config/rules.yml
create mode 100644 .yamllint.yml
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/cmd/main.go
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/go.mod
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/go.sum
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/pkg/task/task.go
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/task-info.yaml
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/task-remote-info.yaml
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/task.md
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/GroupByKey/test/task_test.go
copy learning/katas/{python => go}/Core Transforms/GroupByKey/lesson-info.yaml (100%)
create mode 100644 learning/katas/go/Core Transforms/GroupByKey/lesson-remote-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/cmd/main.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/go.mod
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/go.sum
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/pkg/task/task.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/task-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/task-remote-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/task.md
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo OneToMany/test/task_test.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/cmd/main.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/go.mod
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/go.sum
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/pkg/task/task.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/task-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/task-remote-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/task.md
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo Struct/test/task_test.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/cmd/main.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/go.mod
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/go.sum
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/pkg/task/task.go
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/task-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/task-remote-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/task.md
create mode 100644 learning/katas/go/Core Transforms/Map/ParDo/test/task_test.go
create mode 100644 learning/katas/go/Core Transforms/Map/lesson-info.yaml
create mode 100644 learning/katas/go/Core Transforms/Map/lesson-remote-info.yaml
create mode 100644 learning/katas/go/Core Transforms/section-info.yaml
create mode 100644 learning/katas/go/Core Transforms/section-remote-info.yaml
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/go.mod
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/go.sum
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/pkg/task/task.go
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/task-info.yaml
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/task-remote-info.yaml
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/task.md
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam Test/test/task_test.go
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/cmd/main.go
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/go.mod
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/go.sum
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/pkg/task/task.go
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/task-info.yaml
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/task-remote-info.yaml
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/task.md
create mode 100644 learning/katas/go/Introduction/Hello Beam/Hello Beam/test/task_test.go
create mode 100644 learning/katas/go/Introduction/Hello Beam/lesson-info.yaml
create mode 100644 learning/katas/go/Introduction/Hello Beam/lesson-remote-info.yaml
create mode 100644 learning/katas/go/Introduction/section-info.yaml
create mode 100644 learning/katas/go/Introduction/section-remote-info.yaml
create mode 100644 learning/katas/go/README.md
create mode 100644 learning/katas/go/course-info.yaml
create mode 100644 learning/katas/go/course-remote-info.yaml
delete mode 100644 learning/katas/java/Common Transforms/Aggregation/Count/task.html
create mode 100644 learning/katas/java/Common Transforms/Aggregation/Count/task.md
delete mode 100644 learning/katas/java/Common Transforms/Aggregation/Max/task.html
create mode 100644 learning/katas/java/Common Transforms/Aggregation/Max/task.md
delete mode 100644 learning/katas/java/Common Transforms/Aggregation/Mean/task.html
create mode 100644 learning/katas/java/Common Transforms/Aggregation/Mean/task.md
delete mode 100644 learning/katas/java/Common Transforms/Aggregation/Min/task.html
create mode 100644 learning/katas/java/Common Transforms/Aggregation/Min/task.md
delete mode 100644 learning/katas/java/Common Transforms/Aggregation/Sum/task.html
create mode 100644 learning/katas/java/Common Transforms/Aggregation/Sum/task.md
delete mode 100644 learning/katas/java/Common Transforms/Filter/Filter/task.html
create mode 100644 learning/katas/java/Common Transforms/Filter/Filter/task.md
delete mode 100644 learning/katas/java/Common Transforms/Filter/ParDo/task.html
create mode 100644 learning/katas/java/Common Transforms/Filter/ParDo/task.md
delete mode 100644 learning/katas/java/Common Transforms/WithKeys/WithKeys/task.html
create mode 100644 learning/katas/java/Common Transforms/WithKeys/WithKeys/task.md
delete mode 100644 learning/katas/java/Core Transforms/Branching/Branching/task.html
create mode 100644 learning/katas/java/Core Transforms/Branching/Branching/task.md
delete mode 100644 learning/katas/java/Core Transforms/CoGroupByKey/CoGroupByKey/task.html
create mode 100644 learning/katas/java/Core Transforms/CoGroupByKey/CoGroupByKey/task.md
delete mode 100644 learning/katas/java/Core Transforms/Combine/BinaryCombineFn Lambda/task.html
create mode 100644 learning/katas/java/Core Transforms/Combine/BinaryCombineFn Lambda/task.md
delete mode 100644 learning/katas/java/Core Transforms/Combine/BinaryCombineFn/task.html
create mode 100644 learning/katas/java/Core Transforms/Combine/BinaryCombineFn/task.md
delete mode 100644 learning/katas/java/Core Transforms/Combine/Combine PerKey/task.html
create mode 100644 learning/katas/java/Core Transforms/Combine/Combine PerKey/task.md
delete mode 100644 learning/katas/java/Core Transforms/Combine/CombineFn/task.html
create mode 100644 learning/katas/java/Core Transforms/Combine/CombineFn/task.md
delete mode 100644 learning/katas/java/Core Transforms/Combine/Simple Function/task.html
create mode 100644 learning/katas/java/Core Transforms/Combine/Simple Function/task.md
delete mode 100644 learning/katas/java/Core Transforms/Composite Transform/Composite Transform/task.html
create mode 100644 learning/katas/java/Core Transforms/Composite Transform/Composite Transform/task.md
delete mode 100644 learning/katas/java/Core Transforms/DoFn Additional Parameters/DoFn Additional Parameters/task.html
create mode 100644 learning/katas/java/Core Transforms/DoFn Additional Parameters/DoFn Additional Parameters/task.md
delete mode 100644 learning/katas/java/Core Transforms/Flatten/Flatten/task.html
create mode 100644 learning/katas/java/Core Transforms/Flatten/Flatten/task.md
delete mode 100644 learning/katas/java/Core Transforms/GroupByKey/GroupByKey/task.html
create mode 100644 learning/katas/java/Core Transforms/GroupByKey/GroupByKey/task.md
delete mode 100644 learning/katas/java/Core Transforms/Map/FlatMapElements/task.html
create mode 100644 learning/katas/java/Core Transforms/Map/FlatMapElements/task.md
delete mode 100644 learning/katas/java/Core Transforms/Map/MapElements/task.html
create mode 100644 learning/katas/java/Core Transforms/Map/MapElements/task.md
delete mode 100644 learning/katas/java/Core Transforms/Map/ParDo OneToMany/task.html
create mode 100644 learning/katas/java/Core Transforms/Map/ParDo OneToMany/task.md
delete mode 100644 learning/katas/java/Core Transforms/Map/ParDo/task.html
create mode 100644 learning/katas/java/Core Transforms/Map/ParDo/task.md
delete mode 100644 learning/katas/java/Core Transforms/Partition/Partition/task.html
create mode 100644 learning/katas/java/Core Transforms/Partition/Partition/task.md
delete mode 100644 learning/katas/java/Core Transforms/Side Input/Side Input/task.html
create mode 100644 learning/katas/java/Core Transforms/Side Input/Side Input/task.md
delete mode 100644 learning/katas/java/Core Transforms/Side Output/Side Output/task.html
create mode 100644 learning/katas/java/Core Transforms/Side Output/Side Output/task.md
delete mode 100644 learning/katas/java/Examples/Word Count/Word Count/task.html
create mode 100644 learning/katas/java/Examples/Word Count/Word Count/task.md
delete mode 100644 learning/katas/java/IO/Built-in IOs/Built-in IOs/task.html
create mode 100644 learning/katas/java/IO/Built-in IOs/Built-in IOs/task.md
delete mode 100644 learning/katas/java/IO/TextIO/TextIO Read/task.html
create mode 100644 learning/katas/java/IO/TextIO/TextIO Read/task.md
delete mode 100644 learning/katas/java/Introduction/Hello Beam/Hello Beam/task.html
create mode 100644 learning/katas/java/Introduction/Hello Beam/Hello Beam/task.md
delete mode 100644 learning/katas/java/Triggers/Early Triggers/Early Triggers/task.html
create mode 100644 learning/katas/java/Triggers/Early Triggers/Early Triggers/task.md
delete mode 100644 learning/katas/java/Triggers/Event Time Triggers/Event Time Triggers/task.html
create mode 100644 learning/katas/java/Triggers/Event Time Triggers/Event Time Triggers/task.md
delete mode 100644 learning/katas/java/Triggers/Window Accumulation Mode/Window Accumulation Mode/task.html
create mode 100644 learning/katas/java/Triggers/Window Accumulation Mode/Window Accumulation Mode/task.md
delete mode 100644 learning/katas/java/Windowing/Adding Timestamp/ParDo/task.html
create mode 100644 learning/katas/java/Windowing/Adding Timestamp/ParDo/task.md
delete mode 100644 learning/katas/java/Windowing/Adding Timestamp/WithTimestamps/task.html
create mode 100644 learning/katas/java/Windowing/Adding Timestamp/WithTimestamps/task.md
delete mode 100644 learning/katas/java/Windowing/Fixed Time Window/Fixed Time Window/task.html
create mode 100644 learning/katas/java/Windowing/Fixed Time Window/Fixed Time Window/task.md
delete mode 100644 learning/katas/python/Common Transforms/Aggregation/Count/task.html
create mode 100644 learning/katas/python/Common Transforms/Aggregation/Count/task.md
delete mode 100644 learning/katas/python/Common Transforms/Aggregation/Largest/task.html
create mode 100644 learning/katas/python/Common Transforms/Aggregation/Largest/task.md
delete mode 100644 learning/katas/python/Common Transforms/Aggregation/Mean/task.html
create mode 100644 learning/katas/python/Common Transforms/Aggregation/Mean/task.md
delete mode 100644 learning/katas/python/Common Transforms/Aggregation/Smallest/task.html
create mode 100644 learning/katas/python/Common Transforms/Aggregation/Smallest/task.md
delete mode 100644 learning/katas/python/Common Transforms/Aggregation/Sum/task.html
create mode 100644 learning/katas/python/Common Transforms/Aggregation/Sum/task.md
delete mode 100644 learning/katas/python/Common Transforms/Filter/Filter/task.html
create mode 100644 learning/katas/python/Common Transforms/Filter/Filter/task.md
delete mode 100644 learning/katas/python/Common Transforms/Filter/ParDo/task.html
create mode 100644 learning/katas/python/Common Transforms/Filter/ParDo/task.md
delete mode 100644 learning/katas/python/Common Transforms/WithKeys/WithKeys/task.html
create mode 100644 learning/katas/python/Common Transforms/WithKeys/WithKeys/task.md
delete mode 100644 learning/katas/python/Core Transforms/Branching/Branching/task.html
create mode 100644 learning/katas/python/Core Transforms/Branching/Branching/task.md
delete mode 100644 learning/katas/python/Core Transforms/CoGroupByKey/CoGroupByKey/task.html
create mode 100644 learning/katas/python/Core Transforms/CoGroupByKey/CoGroupByKey/task.md
delete mode 100644 learning/katas/python/Core Transforms/Combine/Combine PerKey/task.html
create mode 100644 learning/katas/python/Core Transforms/Combine/Combine PerKey/task.md
delete mode 100644 learning/katas/python/Core Transforms/Combine/CombineFn/task.html
create mode 100644 learning/katas/python/Core Transforms/Combine/CombineFn/task.md
delete mode 100644 learning/katas/python/Core Transforms/Combine/Simple Function/task.html
create mode 100644 learning/katas/python/Core Transforms/Combine/Simple Function/task.md
delete mode 100644 learning/katas/python/Core Transforms/Composite Transform/Composite Transform/task.html
create mode 100644 learning/katas/python/Core Transforms/Composite Transform/Composite Transform/task.md
delete mode 100644 learning/katas/python/Core Transforms/Flatten/Flatten/task.html
create mode 100644 learning/katas/python/Core Transforms/Flatten/Flatten/task.md
delete mode 100644 learning/katas/python/Core Transforms/GroupByKey/GroupByKey/task.html
create mode 100644 learning/katas/python/Core Transforms/GroupByKey/GroupByKey/task.md
delete mode 100644 learning/katas/python/Core Transforms/Map/FlatMap/task.html
create mode 100644 learning/katas/python/Core Transforms/Map/FlatMap/task.md
delete mode 100644 learning/katas/python/Core Transforms/Map/Map/task.html
create mode 100644 learning/katas/python/Core Transforms/Map/Map/task.md
delete mode 100644 learning/katas/python/Core Transforms/Map/ParDo OneToMany/task.html
create mode 100644 learning/katas/python/Core Transforms/Map/ParDo OneToMany/task.md
delete mode 100644 learning/katas/python/Core Transforms/Map/ParDo/task.html
create mode 100644 learning/katas/python/Core Transforms/Map/ParDo/task.md
delete mode 100644 learning/katas/python/Core Transforms/Partition/Partition/task.html
create mode 100644 learning/katas/python/Core Transforms/Partition/Partition/task.md
delete mode 100644 learning/katas/python/Core Transforms/Side Input/Side Input/task.html
create mode 100644 learning/katas/python/Core Transforms/Side Input/Side Input/task.md
delete mode 100644 learning/katas/python/Core Transforms/Side Output/Side Output/task.html
create mode 100644 learning/katas/python/Core Transforms/Side Output/Side Output/task.md
delete mode 100644 learning/katas/python/Examples/Word Count/Word Count/task.html
create mode 100644 learning/katas/python/Examples/Word Count/Word Count/task.md
delete mode 100644 learning/katas/python/IO/Built-in IOs/Built-in IOs/task.html
create mode 100644 learning/katas/python/IO/Built-in IOs/Built-in IOs/task.md
delete mode 100644 learning/katas/python/IO/TextIO/ReadFromText/task.html
create mode 100644 learning/katas/python/IO/TextIO/ReadFromText/task.md
delete mode 100644 learning/katas/python/Introduction/Hello Beam/Hello Beam/task.html
create mode 100644 learning/katas/python/Introduction/Hello Beam/Hello Beam/task.md
delete mode 100644 learning/katas/python/Windowing/Adding Timestamp/ParDo/task.html
create mode 100644 learning/katas/python/Windowing/Adding Timestamp/ParDo/task.md
delete mode 100644 learning/katas/python/Windowing/Fixed Time Window/Fixed Time Window/task.html
create mode 100644 learning/katas/python/Windowing/Fixed Time Window/Fixed Time Window/task.md
create mode 100644 release/src/main/scripts/mass_comment.py
delete mode 100644 runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/graph/PipelineTrimmer.java
create mode 100644 runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/graph/TrivialNativeTransformExpander.java
delete mode 100644 runners/flink/1.8/src/test/java/org/apache/beam/runners/flink/streaming/FlinkStateInternalsTest.java
create mode 100644 runners/flink/src/main/java/org/apache/beam/runners/flink/translation/utils/CheckpointStats.java
create mode 100644 runners/flink/src/test/java/org/apache/beam/runners/flink/batch/ReshuffleTest.java
rename runners/flink/{1.8 => }/src/test/java/org/apache/beam/runners/flink/streaming/FlinkBroadcastStateInternalsTest.java (100%)
create mode 100644 runners/flink/src/test/java/org/apache/beam/runners/flink/streaming/FlinkStateInternalsTest.java
create mode 100644 runners/flink/src/test/java/org/apache/beam/runners/flink/translation/wrappers/streaming/stableinput/BufferingDoFnRunnerTest.java
delete mode 100644 runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/fn/control/TimerReceiver.java
delete mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/fn/control/TimerReceiverTest.java
create mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/artifact/ArtifactRetrievalService.java
create mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/artifact/ArtifactStagingService.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/InMemoryJobService.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/JobInvocation.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/JobInvoker.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/JobPreparation.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/JobServerDriver.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/PortablePipelineJarCreator.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/PortablePipelineJarUtils.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/PortablePipelineResult.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/PortablePipelineRunner.java
delete mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/package-info.java
create mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/artifact/ArtifactRetrievalServiceTest.java
create mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/artifact/ArtifactStagingServiceTest.java
create mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/control/TimerReceiverFactoryTest.java
delete mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/jobsubmission/InMemoryJobServiceTest.java
delete mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/jobsubmission/JobInvocationTest.java
delete mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/jobsubmission/PortablePipelineJarCreatorTest.java
create mode 100644 runners/java-job-service/build.gradle
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/InMemoryJobService.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/JobInvocation.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/JobInvoker.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/JobPreparation.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/JobServerDriver.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/PortablePipelineJarCreator.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/PortablePipelineJarUtils.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/PortablePipelineResult.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/PortablePipelineRunner.java
create mode 100644 runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/package-info.java
create mode 100644 runners/java-job-service/src/test/java/org/apache/beam/runners/jobsubmission/InMemoryJobServiceTest.java
create mode 100644 runners/java-job-service/src/test/java/org/apache/beam/runners/jobsubmission/JobInvocationTest.java
create mode 100644 runners/java-job-service/src/test/java/org/apache/beam/runners/jobsubmission/PortablePipelineJarCreatorTest.java
create mode 100644 sdks/go/examples/stringsplit/stringsplit.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/sdf.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/sdf_test.go
create mode 100644 sdks/go/pkg/beam/core/runtime/harness/harness_test.go
create mode 100644 sdks/go/pkg/beam/core/runtime/pipelinex/util_test.go
create mode 100644 sdks/go/pkg/beam/io/rtrackers/offsetrange/offsetrange.go
create mode 100644 sdks/go/pkg/beam/io/rtrackers/offsetrange/offsetrange_test.go
create mode 100644 sdks/go/pkg/beam/io/synthetic/rand.go
create mode 100644 sdks/go/pkg/beam/io/synthetic/source.go
create mode 100644 sdks/go/pkg/beam/io/synthetic/source_test.go
create mode 100644 sdks/go/pkg/beam/io/synthetic/step.go
create mode 100644 sdks/go/pkg/beam/io/synthetic/step_test.go
create mode 100644 sdks/go/pkg/beam/testing/passert/equals.go
create mode 100644 sdks/go/pkg/beam/testing/passert/equals_test.go
create mode 100644 sdks/java/container/license_scripts/dep_urls_java.yaml
create mode 100755 sdks/java/container/license_scripts/license_script.sh
create mode 100644 sdks/java/container/license_scripts/pull_licenses_java.py
create mode 100644 sdks/java/container/license_scripts/requirement.txt
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/io/ClassLoaderFileSystem.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/logicaltypes/Date.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/logicaltypes/SqlTypes.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/testing/UsesKeyInParDo.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/testing/UsesOnWindowExpiration.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/PeriodicImpulse.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/PeriodicSequence.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/SerializableBiConsumer.java
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/splittabledofn/GrowableOffsetRangeTracker.java
delete mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/splittabledofn/Sizes.java
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/io/ClassLoaderFileSystemTest.java
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/PeriodicImpulseTest.java
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/PeriodicSequenceTest.java
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/splittabledofn/GrowableOffsetRangeTrackerTest.java
create mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateText.java
delete mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateVideo.java
create mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateVideoBytesWithContextFn.java
create mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateVideoFn.java
create mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateVideoFromBytesFn.java
create mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateVideoFromURIFn.java
create mode 100644 sdks/java/extensions/ml/src/main/java/org/apache/beam/sdk/extensions/ml/AnnotateVideoURIWithContextFn.java
create mode 100644 sdks/java/extensions/ml/src/test/java/org/apache/beam/sdk/extensions/ml/AnnotateTextIT.java
create mode 100644 sdks/java/extensions/sql/expansion-service/build.gradle
create mode 100644 sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/ExternalSqlTransformRegistrar.java
create mode 100644 sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/package-info.java
create mode 100644 sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/rel/BeamTableFunctionScanRel.java
create mode 100644 sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/rule/BeamTableFunctionScanRule.java
create mode 100644 sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/utils/TVFStreamingUtils.java
create mode 100644 sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/SqlWindowTableFunction.java
create mode 100644 sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/ArrayScanColumnRefToUncollect.java
create mode 100644 sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/ArrayScanLiteralToUncollectConverter.java
delete mode 100644 sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/ArrayScanToUncollectConverter.java
create mode 100644 sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/TVFScanConverter.java
create mode 100644 sdks/java/harness/src/main/java/org/apache/beam/fn/harness/data/BeamFnTimerClient.java
create mode 100644 sdks/java/harness/src/main/java/org/apache/beam/fn/harness/data/BeamFnTimerGrpcClient.java
create mode 100644 sdks/java/harness/src/main/java/org/apache/beam/fn/harness/state/StateBackedIterable.java
create mode 100644 sdks/java/harness/src/test/java/org/apache/beam/fn/harness/control/BundleSplitListenerTest.java
create mode 100644 sdks/java/harness/src/test/java/org/apache/beam/fn/harness/data/FakeBeamFnTimerClient.java
create mode 100644 sdks/java/harness/src/test/java/org/apache/beam/fn/harness/state/StateBackedIterableTest.java
create mode 100644 sdks/java/io/amazon-web-services/src/test/java/org/apache/beam/sdk/io/aws/options/AwsHttpClientConfigurationTest.java
create mode 100644 sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sns/BasicSnsAsyncClientProvider.java
create mode 100644 sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sns/SnsAsyncClientProvider.java
create mode 100644 sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sns/SnsResponse.java
create mode 100644 sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sns/SnsResponseCoder.java
create mode 100644 sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/sns/MockSnsAsyncBaseClient.java
create mode 100644 sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/sns/MockSnsAsyncClient.java
create mode 100644 sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/sns/MockSnsAsyncExceptionClient.java
create mode 100644 sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/sns/SnsIOWriteTest.java
create mode 100644 sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/sns/SnsResponseCoderTest.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IO.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2Message.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2MessageCoder.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HealthcareApiClient.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HealthcareIOError.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HealthcareIOErrorCoder.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HealthcareIOErrorToTableRow.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HttpHealthcareApiClient.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/package-info.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIOReadIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIOTest.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIOTestOptions.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIOTestUtil.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIOWriteIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/HL7V2MessagePagesTest.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IOReadIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IOReadWriteIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IOTest.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IOTestUtil.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IOWriteIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/Amelia635_Krajcik437_ed7a9f5c-37ea-4767-95ba-a6783e9500b3.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/Elma843_Hoppe518_1fd2683f-2a56-47c7-b674-98f2cc8319e7.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/Ernesto186_Dietrich576_4ecb4cbb-6df7-41e0-8e89-6e7a142721a5.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/Kortney212_Bosco882_8ed31d3e-7352-4055-89c4-f017db3f594e.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/Terry864_Hintz995_f04ef974-6d6f-4e1c-804f-cd4d62aabb4f.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/hospitalInformation1586309771387.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/DSTU2/practitionerInformation1586309771387.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/Emerson869_Prohaska837_d89e3bd8-4d0f-4735-8d16-d0f646a9dcd6.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/Lorette239_Marvin195_af0e4a42-a1ef-4c2f-ad31-9338a8b8fb7b.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/Norberto865_Cole117_a5e08ef9-fd71-4273-a53a-d5f5df7926f4.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/Robbyn526_DuBuque211_fcf2f472-77ac-47d7-9c9a-a6702bd2bb80.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/Seymour882_Shanahan202_55a5307d-5f23-49c1-9100-7d5c513abca3.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/hospitalInformation1586368892823.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/R4/practitionerInformation1586368892823.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/Alexander630_Romaguera67_02a63c07-9fcc-42ba-aec0-9d5399ac4796.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/Basil991_Pfannerstill264_88fb71f7-d445-4e5b-8af2-962e8f8e5fb6.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/Cris921_Lang846_df27a976-5c5e-4b84-ad00-fe32972dce9c.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/Damon455_Will178_136f997d-0a94-4573-97da-a53b5060a612.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/Dannette613_Maggio310_74779846-85a4-4b26-9da4-414a5fec1aed.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/Shavonne800_Hilll811_3024090f-fe14-40a9-8fae-79952d3c95ce.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/hospitalInformation1586298239556.json
create mode 100644 sdks/java/io/google-cloud-platform/src/test/resources/STU3/practitionerInformation1586298239556.json
create mode 100644 sdks/java/io/hcatalog/src/test/java/org/apache/beam/sdk/io/hcatalog/SchemaUtilsTest.java
create mode 100644 sdks/java/io/snowflake/build.gradle
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/CloudProvider.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakeIO.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakePipelineOptions.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakeService.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakeServiceImpl.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/credentials/KeyPairSnowflakeCredentials.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/credentials/OAuthTokenSnowflakeCredentials.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/credentials/SnowflakeCredentials.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/credentials/SnowflakeCredentialsFactory.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/credentials/UsernamePasswordSnowflakeCredentials.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/credentials/package-info.java
create mode 100644 sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/package-info.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/FakeSnowflakeBasicDataSource.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/FakeSnowflakeDatabase.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/FakeSnowflakeServiceImpl.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/TestUtils.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/package-info.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/BatchTestPipelineOptions.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/DataSourceConfigurationTest.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/credentials/KeyPairSnowflakeCredentialsTest.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/credentials/OAuthTokenSnowflakeCredentialsTest.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/credentials/SnowflakeCredentialsFactoryTest.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/credentials/UsernamePasswordSnowflakeCredentialsTest.java
create mode 100644 sdks/java/io/snowflake/src/test/java/org/apache/beam/sdk/io/snowflake/test/unit/read/SnowflakeIOReadTest.java
create mode 100644 sdks/java/io/snowflake/src/test/resources/test_rsa_key.p8
create mode 100644 sdks/java/testing/test-utils/src/main/java/org/apache/beam/sdk/testutils/publishing/InfluxDBPublisher.java
create mode 100644 sdks/java/testing/test-utils/src/main/java/org/apache/beam/sdk/testutils/publishing/InfluxDBSettings.java
create mode 100644 sdks/java/testing/test-utils/src/test/java/org/apache/beam/sdk/testutils/jvmverification/JvmVerification.java
create mode 100644 sdks/python/apache_beam/dataframe/convert.py
create mode 100644 sdks/python/apache_beam/dataframe/convert_test.py
create mode 100644 sdks/python/apache_beam/dataframe/doctests.py
create mode 100644 sdks/python/apache_beam/dataframe/doctests_test.py
create mode 100644 sdks/python/apache_beam/dataframe/transforms.py
create mode 100644 sdks/python/apache_beam/dataframe/transforms_test.py
create mode 100644 sdks/python/apache_beam/examples/streaming_wordcount_debugging_test.py
create mode 100644 sdks/python/apache_beam/examples/wordcount_xlang_sql.py
create mode 100644 sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py
create mode 100644 sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py
create mode 100644 sdks/python/apache_beam/io/gcp/pubsub_io_perf_test.py
create mode 100644 sdks/python/apache_beam/runners/interactive/examples/UsCovidDataExample.ipynb
create mode 100644 sdks/python/apache_beam/runners/interactive/options/capture_limiters.py
copy sdks/python/apache_beam/{testing/load_tests/streaming => runners/interactive/testing/integration}/__init__.py (100%)
create mode 100644 sdks/python/apache_beam/runners/interactive/testing/integration/goldens/Darwin/7a35f487b2a5f3a9b9852a8659eeb4bd.png
create mode 100644 sdks/python/apache_beam/runners/interactive/testing/integration/goldens/Linux/7a35f487b2a5f3a9b9852a8659eeb4bd.png
create mode 100644 sdks/python/apache_beam/runners/interactive/testing/integration/notebook_executor.py
create mode 100644 sdks/python/apache_beam/runners/interactive/testing/integration/screen_diff.py
create mode 100644 sdks/python/apache_beam/runners/interactive/testing/integration/test_notebooks/init_square_cube.ipynb
create mode 100644 sdks/python/apache_beam/runners/interactive/testing/integration/tests/init_square_cube_test.py
create mode 100644 sdks/python/apache_beam/runners/worker/bundle_processor_test.py
create mode 100644 sdks/python/apache_beam/transforms/periodicsequence.py
create mode 100644 sdks/python/apache_beam/transforms/periodicsequence_test.py
create mode 100644 sdks/python/apache_beam/transforms/sql.py
create mode 100644 sdks/python/apache_beam/transforms/sql_test.py
create mode 100644 sdks/python/test-suites/dataflow/common.gradle
create mode 100644 sdks/python/test-suites/direct/common.gradle
create mode 100644 sdks/python/test-suites/tox/common.gradle
create mode 100644 website/CONTRIBUTE.md
delete mode 100644 website/Gemfile
delete mode 100644 website/Gemfile.lock
delete mode 100644 website/Rakefile
delete mode 100644 website/_config.yml
delete mode 100644 website/_config_test.yml
delete mode 100644 website/src/.htaccess
delete mode 100644 website/src/_data/authors.yml
delete mode 100644 website/src/_data/capability-matrix.yml
delete mode 100644 website/src/_data/logos.yml
delete mode 100644 website/src/_data/meetings.yml
delete mode 100644 website/src/_includes/button-pydoc.md
delete mode 100644 website/src/_includes/button.md
delete mode 100644 website/src/_includes/buttons-code-snippet.md
delete mode 100644 website/src/_includes/capability-matrix-common.md
delete mode 100644 website/src/_includes/capability-matrix-row-blog.md
delete mode 100644 website/src/_includes/capability-matrix-row-full.md
delete mode 100644 website/src/_includes/capability-matrix-row-summary.md
delete mode 100644 website/src/_includes/capability-matrix.md
delete mode 100644 website/src/_includes/flink_java_pipeline_options.html
delete mode 100644 website/src/_includes/flink_python_pipeline_options.html
delete mode 100644 website/src/_includes/footer.html
delete mode 100644 website/src/_includes/head.html
delete mode 100644 website/src/_includes/header.html
delete mode 100644 website/src/_includes/icon-github.html
delete mode 100644 website/src/_includes/icon-github.svg
delete mode 100644 website/src/_includes/icon-twitter.html
delete mode 100644 website/src/_includes/icon-twitter.svg
delete mode 100644 website/src/_includes/page-toc.html
delete mode 100644 website/src/_includes/section-menu/community.html
delete mode 100644 website/src/_includes/section-menu/contribute.html
delete mode 100644 website/src/_includes/section-menu/documentation.html
delete mode 100644 website/src/_includes/section-menu/get-started.html
delete mode 100644 website/src/_includes/section-menu/roadmap.html
delete mode 100644 website/src/_includes/section-menu/runners.html
delete mode 100644 website/src/_includes/section-menu/sdks.html
delete mode 100644 website/src/_layouts/default.html
delete mode 100644 website/src/_layouts/page.html
delete mode 100644 website/src/_layouts/post.html
delete mode 100644 website/src/_layouts/section.html
delete mode 100644 website/src/_layouts/v2home.html
delete mode 100644 website/src/_posts/2016-02-22-beam-has-a-logo.markdown
delete mode 100644 website/src/_posts/2016-02-25-python-sdk-now-public.markdown
delete mode 100644 website/src/_posts/2016-03-17-capability-matrix.md
delete mode 100644 website/src/_posts/2016-04-03-presentation-materials.md
delete mode 100644 website/src/_posts/2016-05-18-splitAtFraction-method.md
delete mode 100644 website/src/_posts/2016-05-20-where-is-my-pcollection-dot-map.md
delete mode 100644 website/src/_posts/2016-06-13-flink-batch-runner-milestone.md
delete mode 100644 website/src/_posts/2016-06-15-first-release.md
delete mode 100644 website/src/_posts/2016-08-03-six-months.md
delete mode 100644 website/src/_posts/2016-10-12-strata-hadoop-world-and-beam.md
delete mode 100644 website/src/_posts/2016-10-20-test-stream.md
delete mode 100644 website/src/_posts/2017-01-09-added-apex-runner.md
delete mode 100644 website/src/_posts/2017-01-10-beam-graduates.md
delete mode 100644 website/src/_posts/2017-02-01-graduation-media-recap.md
delete mode 100644 website/src/_posts/2017-02-13-stateful-processing.md
delete mode 100644 website/src/_posts/2017-03-16-python-sdk-release.md
delete mode 100644 website/src/_posts/2017-05-17-beam-first-stable-release.md
delete mode 100644 website/src/_posts/2017-08-04-splittable-do-fn.md
delete mode 100644 website/src/_posts/2017-08-28-timely-processing.md
delete mode 100644 website/src/_posts/2018-01-09-beam-a-look-back.md
delete mode 100644 website/src/_posts/2018-02-19-beam-2.3.0.md
delete mode 100644 website/src/_posts/2018-06-26-beam-2.5.0.md
delete mode 100644 website/src/_posts/2018-08-10-beam-2.6.0.md
delete mode 100644 website/src/_posts/2018-08-20-review-input-streaming-connectors.md
delete mode 100644 website/src/_posts/2018-08-21-beam-summit-europe.md
delete mode 100644 website/src/_posts/2018-10-03-beam-2.7.0.md
delete mode 100644 website/src/_posts/2018-10-29-beam-2.8.0.md
delete mode 100644 website/src/_posts/2018-10-30-beam-summit-aftermath.md
delete mode 100644 website/src/_posts/2018-12-13-beam-2.9.0.md
delete mode 100644 website/src/_posts/2019-02-15-beam-2.10.0.md
delete mode 100644 website/src/_posts/2019-03-05-beam-2.11.0.md
delete mode 100644 website/src/_posts/2019-03-18-beam-summit-site.md
delete mode 100644 website/src/_posts/2019-04-19-season-of-docs.md
delete mode 100644 website/src/_posts/2019-04-25-beam-2.12.0.md
delete mode 100644 website/src/_posts/2019-04-25-beam-kotlin.md
delete mode 100644 website/src/_posts/2019-05-01-adding-data-sources-to-sql.md
delete mode 100644 website/src/_posts/2019-05-11-beam-summit-europe-2019.md
delete mode 100644 website/src/_posts/2019-05-22-beam-2.13.0.md
delete mode 100644 website/src/_posts/2019-05-30-beam-kata-release.md
delete mode 100644 website/src/_posts/2019-06-11-looping-timers.md
delete mode 100644 website/src/_posts/2019-07-31-beam-2.14.0.md
delete mode 100644 website/src/_posts/2019-08-22-beam-2.15.0.md
delete mode 100644 website/src/_posts/2019-09-04-gsoc-19.md
delete mode 100644 website/src/_posts/2019-10-07-beam-2.16.0.md
delete mode 100644 website/src/_posts/2020-01-06-beam-2.17.0.md
delete mode 100644 website/src/_posts/2020-01-13-beam-2.18.0.md
delete mode 100644 website/src/_posts/2020-02-04-beam-2.19.0.md
delete mode 100644 website/src/_sass/_page-nav.sass
delete mode 100644 website/src/_sass/_syntax-highlighting.scss
delete mode 100644 website/src/blog/index.md
delete mode 100644 website/src/coming-soon.md
delete mode 100644 website/src/community/contact-us.md
delete mode 100644 website/src/community/in-person.md
delete mode 100644 website/src/community/integrations.md
delete mode 100644 website/src/community/logos.md
delete mode 100644 website/src/community/policies.md
delete mode 100644 website/src/community/presentation-materials.md
delete mode 100644 website/src/community/twitter-handle.md
delete mode 100644 website/src/community/youtube-channel.md
delete mode 100644 website/src/contribute/become-a-committer.md
delete mode 100644 website/src/contribute/committer-guide.md
delete mode 100644 website/src/contribute/dependencies.md
delete mode 100644 website/src/contribute/design-documents.md
delete mode 100644 website/src/contribute/feature-branches.md
delete mode 100644 website/src/contribute/get-help.md
delete mode 100644 website/src/contribute/index.md
delete mode 100644 website/src/contribute/jira-priorities.md
delete mode 100644 website/src/contribute/postcommits-guides.md
delete mode 100644 website/src/contribute/postcommits-policies-details.md
delete mode 100644 website/src/contribute/postcommits-policies.md
delete mode 100644 website/src/contribute/precommit-policies.md
delete mode 100644 website/src/contribute/precommit-triage-guide.md
delete mode 100644 website/src/contribute/ptransform-style-guide.md
delete mode 100644 website/src/contribute/release-blocking.md
delete mode 100644 website/src/contribute/release-guide.md
delete mode 100644 website/src/contribute/runner-guide.md
delete mode 100644 website/src/contribute/team.md
delete mode 100644 website/src/contribute/testing.md
delete mode 100644 website/src/css/site.scss
delete mode 100644 website/src/documentation/dsls/sql/calcite/aggregate-functions.md
delete mode 100644 website/src/documentation/dsls/sql/calcite/data-types.md
delete mode 100644 website/src/documentation/dsls/sql/calcite/lexical-structure.md
delete mode 100644 website/src/documentation/dsls/sql/calcite/overview.md
delete mode 100644 website/src/documentation/dsls/sql/calcite/query-syntax.md
delete mode 100644 website/src/documentation/dsls/sql/calcite/scalar-functions.md
delete mode 100644 website/src/documentation/dsls/sql/extensions/create-external-table.md
delete mode 100644 website/src/documentation/dsls/sql/extensions/joins.md
delete mode 100644 website/src/documentation/dsls/sql/extensions/set.md
delete mode 100644 website/src/documentation/dsls/sql/extensions/user-defined-functions.md
delete mode 100644 website/src/documentation/dsls/sql/extensions/windowing-and-triggering.md
delete mode 100644 website/src/documentation/dsls/sql/overview.md
delete mode 100644 website/src/documentation/dsls/sql/shell.md
delete mode 100644 website/src/documentation/dsls/sql/walkthrough.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/aggregate-functions.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/conditional-expressions.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/conversion-rules.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/data-types.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/lexical.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/math-functions.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/operators.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/overview.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/query-syntax.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/string-functions.md
delete mode 100644 website/src/documentation/dsls/sql/zetasql/syntax.md
delete mode 100644 website/src/documentation/index.md
delete mode 100644 website/src/documentation/io/built-in-google-bigquery.md
delete mode 100644 website/src/documentation/io/built-in-hadoop.md
delete mode 100644 website/src/documentation/io/built-in-hcatalog.md
delete mode 100644 website/src/documentation/io/built-in-parquet.md
delete mode 100644 website/src/documentation/io/built-in.md
delete mode 100644 website/src/documentation/io/developing-io-java.md
delete mode 100644 website/src/documentation/io/developing-io-overview.md
delete mode 100644 website/src/documentation/io/developing-io-python.md
delete mode 100644 website/src/documentation/io/testing.md
delete mode 100644 website/src/documentation/patterns/custom-io.md
delete mode 100644 website/src/documentation/patterns/custom-windows.md
delete mode 100644 website/src/documentation/patterns/file-processing.md
delete mode 100644 website/src/documentation/patterns/overview.md
delete mode 100644 website/src/documentation/patterns/pipeline-options.md
delete mode 100644 website/src/documentation/patterns/side-inputs.md
delete mode 100644 website/src/documentation/pipelines/create-your-pipeline.md
delete mode 100644 website/src/documentation/pipelines/design-your-pipeline.md
delete mode 100644 website/src/documentation/pipelines/test-your-pipeline.md
delete mode 100644 website/src/documentation/programming-guide.md
delete mode 100644 website/src/documentation/resources/learning-resources.md
delete mode 100644 website/src/documentation/resources/videos-and-podcasts.md
delete mode 100644 website/src/documentation/runners/apex.md
delete mode 100644 website/src/documentation/runners/capability-matrix.md
delete mode 100644 website/src/documentation/runners/dataflow.md
delete mode 100644 website/src/documentation/runners/direct.md
delete mode 100644 website/src/documentation/runners/flink.md
delete mode 100644 website/src/documentation/runners/gearpump.md
delete mode 100644 website/src/documentation/runners/jet.md
delete mode 100644 website/src/documentation/runners/jstorm.md
delete mode 100644 website/src/documentation/runners/mapreduce.md
delete mode 100644 website/src/documentation/runners/nemo.md
delete mode 100644 website/src/documentation/runners/samza.md
delete mode 100644 website/src/documentation/runners/spark.md
delete mode 100644 website/src/documentation/runtime/environments.md
delete mode 100644 website/src/documentation/runtime/model.md
delete mode 100644 website/src/documentation/runtime/sdk-harness-config.md
delete mode 100644 website/src/documentation/sdks/euphoria.md
delete mode 100644 website/src/documentation/sdks/feature-comparison.md
delete mode 100644 website/src/documentation/sdks/go.md
delete mode 100644 website/src/documentation/sdks/java-dependencies.md
delete mode 100644 website/src/documentation/sdks/java-extensions.md
delete mode 100644 website/src/documentation/sdks/java-thirdparty.md
delete mode 100644 website/src/documentation/sdks/java.md
delete mode 100644 website/src/documentation/sdks/nexmark.md
delete mode 100644 website/src/documentation/sdks/python-dependencies.md
delete mode 100644 website/src/documentation/sdks/python-pipeline-dependencies.md
delete mode 100644 website/src/documentation/sdks/python-streaming.md
delete mode 100644 website/src/documentation/sdks/python-type-safety.md
delete mode 100644 website/src/documentation/sdks/python.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/approximatequantiles.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/approximateunique.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/cogroupbykey.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/combine.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/combinewithcontext.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/count.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/distinct.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/groupbykey.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/groupintobatches.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/hllcount.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/latest.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/max.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/mean.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/min.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/sample.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/sum.md
delete mode 100644 website/src/documentation/transforms/java/aggregation/top.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/filter.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/flatmapelements.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/keys.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/kvswap.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/mapelements.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/pardo.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/partition.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/regex.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/reify.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/tostring.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/values.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/withkeys.md
delete mode 100644 website/src/documentation/transforms/java/element-wise/withtimestamps.md
delete mode 100644 website/src/documentation/transforms/java/index.md
delete mode 100644 website/src/documentation/transforms/java/other/create.md
delete mode 100644 website/src/documentation/transforms/java/other/flatten.md
delete mode 100644 website/src/documentation/transforms/java/other/passert.md
delete mode 100644 website/src/documentation/transforms/java/other/view.md
delete mode 100644 website/src/documentation/transforms/java/other/window.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/approximatequantiles.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/approximateunique.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/cogroupbykey.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/combineglobally.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/combinewithcontext.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/count.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/distinct.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/groupbykey.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/groupintobatches.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/latest.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/max.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/mean.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/min.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/sample.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/sum.md
delete mode 100644 website/src/documentation/transforms/python/aggregation/top.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/filter.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/flatmap.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/keys.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/kvswap.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/map.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/pardo.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/partition.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/regex.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/reify.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/tostring.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/values.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/withkeys.md
delete mode 100644 website/src/documentation/transforms/python/elementwise/withtimestamps.md
delete mode 100644 website/src/documentation/transforms/python/index.md
delete mode 100644 website/src/documentation/transforms/python/other/create.md
delete mode 100644 website/src/documentation/transforms/python/other/flatten.md
delete mode 100644 website/src/documentation/transforms/python/other/passert.md
delete mode 100644 website/src/documentation/transforms/python/other/reshuffle.md
delete mode 100644 website/src/documentation/transforms/python/other/view.md
delete mode 100644 website/src/documentation/transforms/python/other/windowinto.md
delete mode 100644 website/src/feed.xml
delete mode 100644 website/src/get-started/beam-overview.md
delete mode 100644 website/src/get-started/downloads.md
delete mode 100644 website/src/get-started/index.md
delete mode 100644 website/src/get-started/mobile-gaming-example.md
delete mode 100644 website/src/get-started/quickstart-go.md
delete mode 100644 website/src/get-started/quickstart-java.md
delete mode 100644 website/src/get-started/quickstart-py.md
delete mode 100644 website/src/get-started/try-apache-beam.md
delete mode 100644 website/src/get-started/wordcount-example.md
delete mode 100644 website/src/index.md
delete mode 100644 website/src/js/language-switch.js
delete mode 100644 website/src/js/section-nav.js
delete mode 100644 website/src/privacy_policy/index.md
delete mode 100644 website/src/roadmap/apex-runner.md
delete mode 100644 website/src/roadmap/connectors-go-sdk.md
delete mode 100644 website/src/roadmap/connectors-java-sdk.md
delete mode 100644 website/src/roadmap/connectors-multi-sdk.md
delete mode 100644 website/src/roadmap/connectors-python-sdk.md
delete mode 100644 website/src/roadmap/dataflow-runner.md
delete mode 100644 website/src/roadmap/euphoria.md
delete mode 100644 website/src/roadmap/flink-runner.md
delete mode 100644 website/src/roadmap/gearpump-runner.md
delete mode 100644 website/src/roadmap/go-sdk.md
delete mode 100644 website/src/roadmap/index.md
delete mode 100644 website/src/roadmap/java-sdk.md
delete mode 100644 website/src/roadmap/nemo-runner.md
delete mode 100644 website/src/roadmap/portability.md
delete mode 100644 website/src/roadmap/python-sdk.md
delete mode 100644 website/src/roadmap/samza-runner.md
delete mode 100644 website/src/roadmap/spark-runner.md
delete mode 100644 website/src/roadmap/sql.md
delete mode 100644 website/src/security/CVE-2020-1929.md
delete mode 100644 website/src/security/index.md
delete mode 100644 website/src/v2/index.md
create mode 100755 website/www/build_github_samples.sh
create mode 100755 website/www/check-links.sh
create mode 100644 website/www/package.json
create mode 100644 website/www/site/archetypes/blog.md
create mode 100644 website/www/site/archetypes/default.md
rename website/{src/_sass => www/site/assets/scss}/_bootstrap.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/_breakpoints.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_button.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_cards.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_ctas.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_footer.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_global.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_graphic.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_header.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_hero.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_layout.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/_logos.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_navbar.sass (100%)
create mode 100644 website/www/site/assets/scss/_page-nav.sass
rename website/{src/_sass => www/site/assets/scss}/_pillars.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_section-nav.sass (100%)
create mode 100644 website/www/site/assets/scss/_syntax-highlighting.scss
create mode 100644 website/www/site/assets/scss/_table-wrapper.sass
rename website/{src/_sass => www/site/assets/scss}/_toggler-nav.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/_type.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/_vars.sass (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_alerts.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_badges.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_breadcrumbs.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_button-groups.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_buttons.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_carousel.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_close.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_code.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_component-animations.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_dropdowns.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_forms.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_glyphicons.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_grid.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_input-groups.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_jumbotron.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_labels.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_list-group.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_media.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_mixins.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_modals.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_navbar.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_navs.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_normalize.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_pager.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_pagination.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_panels.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_popovers.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_print.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_progress-bars.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_responsive-embed.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_responsive-utilities.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_scaffolding.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_tables.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_theme.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_thumbnails.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_tooltip.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_type.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_utilities.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_variables.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/_wells.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_alerts.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_background-variant.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_border-radius.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_buttons.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_center-block.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_clearfix.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_forms.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_gradients.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_grid-framework.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_grid.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_hide-text.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_image.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_labels.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_list-group.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_nav-divider.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_nav-vertical-align.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_opacity.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_pagination.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_panels.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_progress-bar.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_reset-filter.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_reset-text.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_resize.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_responsive-visibility.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_size.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_tab-focus.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_table-row.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_text-emphasis.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_text-overflow.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/bootstrap/mixins/_vendor-prefixes.scss (100%)
rename website/{src/_sass => www/site/assets/scss}/capability-matrix.scss (100%)
create mode 100644 website/www/site/assets/scss/main.scss
create mode 100644 website/www/site/config.toml
create mode 100644 website/www/site/content/en/_index.md
create mode 100644 website/www/site/content/en/blog/added-apex-runner.md
create mode 100644 website/www/site/content/en/blog/adding-data-sources-to-sql.md
create mode 100644 website/www/site/content/en/blog/beam-2.10.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.11.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.12.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.13.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.14.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.15.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.16.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.17.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.18.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.19.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.20.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.3.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.5.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.6.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.7.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.8.0.md
create mode 100644 website/www/site/content/en/blog/beam-2.9.0.md
create mode 100644 website/www/site/content/en/blog/beam-a-look-back.md
create mode 100644 website/www/site/content/en/blog/beam-first-stable-release.md
create mode 100644 website/www/site/content/en/blog/beam-graduates.md
create mode 100644 website/www/site/content/en/blog/beam-has-a-logo.md
create mode 100644 website/www/site/content/en/blog/beam-kata-release.md
create mode 100644 website/www/site/content/en/blog/beam-kotlin.md
create mode 100644 website/www/site/content/en/blog/beam-summit-aftermath.md
create mode 100644 website/www/site/content/en/blog/beam-summit-digital-2020.md
create mode 100644 website/www/site/content/en/blog/beam-summit-europe-2019.md
create mode 100644 website/www/site/content/en/blog/beam-summit-europe.md
create mode 100644 website/www/site/content/en/blog/beam-summit-site.md
create mode 100644 website/www/site/content/en/blog/capability-matrix.md
create mode 100644 website/www/site/content/en/blog/first-release.md
create mode 100644 website/www/site/content/en/blog/flink-batch-runner-milestone.md
create mode 100644 website/www/site/content/en/blog/graduation-media-recap.md
create mode 100644 website/www/site/content/en/blog/gsoc-19.md
create mode 100644 website/www/site/content/en/blog/looping-timers.md
create mode 100644 website/www/site/content/en/blog/presentation-materials.md
create mode 100644 website/www/site/content/en/blog/python-sdk-now-public.md
create mode 100644 website/www/site/content/en/blog/python-sdk-release.md
create mode 100644 website/www/site/content/en/blog/review-input-streaming-connectors.md
create mode 100644 website/www/site/content/en/blog/season-of-docs.md
create mode 100644 website/www/site/content/en/blog/six-months.md
create mode 100644 website/www/site/content/en/blog/splitAtFraction-method.md
create mode 100644 website/www/site/content/en/blog/splittable-do-fn.md
create mode 100644 website/www/site/content/en/blog/stateful-processing.md
create mode 100644 website/www/site/content/en/blog/strata-hadoop-world-and-beam.md
create mode 100644 website/www/site/content/en/blog/test-stream.md
create mode 100644 website/www/site/content/en/blog/timely-processing.md
create mode 100644 website/www/site/content/en/blog/where-is-my-pcollection-dot-map.md
create mode 100644 website/www/site/content/en/community/contact-us.md
create mode 100644 website/www/site/content/en/community/in-person.md
create mode 100644 website/www/site/content/en/community/integrations.md
create mode 100644 website/www/site/content/en/community/logos.md
create mode 100644 website/www/site/content/en/community/policies.md
create mode 100644 website/www/site/content/en/community/presentation-materials.md
create mode 100644 website/www/site/content/en/community/twitter-handle.md
create mode 100644 website/www/site/content/en/community/youtube-channel.md
create mode 100644 website/www/site/content/en/contribute/_index.md
create mode 100644 website/www/site/content/en/contribute/become-a-committer.md
create mode 100644 website/www/site/content/en/contribute/committer-guide.md
create mode 100644 website/www/site/content/en/contribute/dependencies.md
create mode 100644 website/www/site/content/en/contribute/design-documents.md
create mode 100644 website/www/site/content/en/contribute/feature-branches.md
create mode 100644 website/www/site/content/en/contribute/get-help.md
create mode 100644 website/www/site/content/en/contribute/jira-priorities.md
create mode 100644 website/www/site/content/en/contribute/postcommits-guides.md
create mode 100644 website/www/site/content/en/contribute/postcommits-policies-details.md
create mode 100644 website/www/site/content/en/contribute/postcommits-policies.md
create mode 100644 website/www/site/content/en/contribute/precommit-policies.md
create mode 100644 website/www/site/content/en/contribute/precommit-triage-guide.md
create mode 100644 website/www/site/content/en/contribute/ptransform-style-guide.md
create mode 100644 website/www/site/content/en/contribute/release-blocking.md
create mode 100644 website/www/site/content/en/contribute/release-guide.md
create mode 100644 website/www/site/content/en/contribute/runner-guide.md
create mode 100644 website/www/site/content/en/contribute/team.md
create mode 100644 website/www/site/content/en/contribute/testing.md
create mode 100644 website/www/site/content/en/documentation/_index.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/calcite/aggregate-functions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/calcite/data-types.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/calcite/lexical-structure.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/calcite/overview.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/calcite/query-syntax.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/calcite/scalar-functions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/extensions/create-external-table.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/extensions/joins.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/extensions/set.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/extensions/user-defined-functions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/extensions/windowing-and-triggering.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/overview.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/shell.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/walkthrough.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/aggregate-functions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/conditional-expressions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/conversion-rules.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/data-types.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/lexical.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/math-functions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/operators.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/overview.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/query-syntax.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/string-functions.md
create mode 100644 website/www/site/content/en/documentation/dsls/sql/zetasql/syntax.md
create mode 100644 website/www/site/content/en/documentation/io/built-in.md
create mode 100644 website/www/site/content/en/documentation/io/built-in/google-bigquery.md
create mode 100644 website/www/site/content/en/documentation/io/built-in/hadoop.md
create mode 100644 website/www/site/content/en/documentation/io/built-in/hcatalog.md
create mode 100644 website/www/site/content/en/documentation/io/built-in/parquet.md
create mode 100644 website/www/site/content/en/documentation/io/developing-io-java.md
create mode 100644 website/www/site/content/en/documentation/io/developing-io-overview.md
create mode 100644 website/www/site/content/en/documentation/io/developing-io-python.md
create mode 100644 website/www/site/content/en/documentation/io/testing.md
create mode 100644 website/www/site/content/en/documentation/patterns/custom-io.md
create mode 100644 website/www/site/content/en/documentation/patterns/custom-windows.md
create mode 100644 website/www/site/content/en/documentation/patterns/file-processing.md
create mode 100644 website/www/site/content/en/documentation/patterns/overview.md
create mode 100644 website/www/site/content/en/documentation/patterns/pipeline-options.md
create mode 100644 website/www/site/content/en/documentation/patterns/side-inputs.md
create mode 100644 website/www/site/content/en/documentation/pipelines/create-your-pipeline.md
create mode 100644 website/www/site/content/en/documentation/pipelines/design-your-pipeline.md
create mode 100644 website/www/site/content/en/documentation/pipelines/test-your-pipeline.md
create mode 100644 website/www/site/content/en/documentation/programming-guide.md
create mode 100644 website/www/site/content/en/documentation/resources/learning-resources.md
create mode 100644 website/www/site/content/en/documentation/resources/videos-and-podcasts.md
create mode 100644 website/www/site/content/en/documentation/runners/apex.md
create mode 100644 website/www/site/content/en/documentation/runners/capability-matrix.md
create mode 100644 website/www/site/content/en/documentation/runners/dataflow.md
create mode 100644 website/www/site/content/en/documentation/runners/direct.md
create mode 100644 website/www/site/content/en/documentation/runners/flink.md
create mode 100644 website/www/site/content/en/documentation/runners/gearpump.md
create mode 100644 website/www/site/content/en/documentation/runners/jet.md
create mode 100644 website/www/site/content/en/documentation/runners/jstorm.md
create mode 100644 website/www/site/content/en/documentation/runners/mapreduce.md
create mode 100644 website/www/site/content/en/documentation/runners/nemo.md
create mode 100644 website/www/site/content/en/documentation/runners/samza.md
create mode 100644 website/www/site/content/en/documentation/runners/spark.md
create mode 100644 website/www/site/content/en/documentation/runtime/environments.md
create mode 100644 website/www/site/content/en/documentation/runtime/model.md
create mode 100644 website/www/site/content/en/documentation/runtime/sdk-harness-config.md
create mode 100644 website/www/site/content/en/documentation/sdks/feature-comparison.md
create mode 100644 website/www/site/content/en/documentation/sdks/go.md
create mode 100644 website/www/site/content/en/documentation/sdks/java-dependencies.md
create mode 100644 website/www/site/content/en/documentation/sdks/java-extensions.md
create mode 100644 website/www/site/content/en/documentation/sdks/java-thirdparty.md
create mode 100644 website/www/site/content/en/documentation/sdks/java.md
create mode 100644 website/www/site/content/en/documentation/sdks/java/euphoria.md
create mode 100644 website/www/site/content/en/documentation/sdks/java/testing/nexmark.md
create mode 100644 website/www/site/content/en/documentation/sdks/python-dependencies.md
create mode 100644 website/www/site/content/en/documentation/sdks/python-pipeline-dependencies.md
create mode 100644 website/www/site/content/en/documentation/sdks/python-streaming.md
create mode 100644 website/www/site/content/en/documentation/sdks/python-type-safety.md
create mode 100644 website/www/site/content/en/documentation/sdks/python.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/approximatequantiles.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/approximateunique.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/cogroupbykey.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/combine.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/combinewithcontext.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/count.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/distinct.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/groupbykey.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/groupintobatches.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/hllcount.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/latest.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/max.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/mean.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/min.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/sample.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/sum.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/aggregation/top.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/filter.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/flatmapelements.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/keys.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/kvswap.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/mapelements.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/pardo.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/partition.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/regex.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/reify.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/tostring.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/values.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/withkeys.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/elementwise/withtimestamps.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/other/create.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/other/flatten.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/other/passert.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/other/view.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/other/window.md
create mode 100644 website/www/site/content/en/documentation/transforms/java/overview.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/approximatequantiles.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/approximateunique.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/cogroupbykey.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/combineglobally.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/combinewithcontext.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/count.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/distinct.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/groupbykey.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/groupintobatches.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/latest.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/max.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/mean.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/min.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/sample.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/sum.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/aggregation/top.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/filter.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/flatmap.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/keys.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/kvswap.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/map.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/pardo.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/partition.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/regex.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/reify.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/tostring.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/values.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/withkeys.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/withtimestamps.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/other/create.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/other/flatten.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/other/passert.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/other/reshuffle.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/other/view.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/other/windowinto.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/overview.md
create mode 100644 website/www/site/content/en/get-started/_index.md
create mode 100644 website/www/site/content/en/get-started/beam-overview.md
create mode 100644 website/www/site/content/en/get-started/downloads.md
create mode 100644 website/www/site/content/en/get-started/mobile-gaming-example.md
create mode 100644 website/www/site/content/en/get-started/quickstart-go.md
create mode 100644 website/www/site/content/en/get-started/quickstart-java.md
create mode 100644 website/www/site/content/en/get-started/quickstart-py.md
create mode 100644 website/www/site/content/en/get-started/try-apache-beam.md
create mode 100644 website/www/site/content/en/get-started/wordcount-example.md
create mode 100644 website/www/site/content/en/privacy_policy/_index.md
create mode 100644 website/www/site/content/en/roadmap/_index.md
create mode 100644 website/www/site/content/en/roadmap/apex-runner.md
create mode 100644 website/www/site/content/en/roadmap/connectors-go-sdk.md
create mode 100644 website/www/site/content/en/roadmap/connectors-java-sdk.md
create mode 100644 website/www/site/content/en/roadmap/connectors-multi-sdk.md
create mode 100644 website/www/site/content/en/roadmap/connectors-python-sdk.md
create mode 100644 website/www/site/content/en/roadmap/dataflow-runner.md
create mode 100644 website/www/site/content/en/roadmap/euphoria.md
create mode 100644 website/www/site/content/en/roadmap/flink-runner.md
create mode 100644 website/www/site/content/en/roadmap/gearpump-runner.md
create mode 100644 website/www/site/content/en/roadmap/go-sdk.md
create mode 100644 website/www/site/content/en/roadmap/java-sdk.md
create mode 100644 website/www/site/content/en/roadmap/nemo-runner.md
create mode 100644 website/www/site/content/en/roadmap/portability.md
create mode 100644 website/www/site/content/en/roadmap/python-sdk.md
create mode 100644 website/www/site/content/en/roadmap/samza-runner.md
create mode 100644 website/www/site/content/en/roadmap/spark-runner.md
create mode 100644 website/www/site/content/en/roadmap/sql.md
create mode 100644 website/www/site/content/en/security/CVE-2020-1929.md
create mode 100644 website/www/site/content/en/security/_index.md
create mode 100644 website/www/site/data/authors.yml
create mode 100644 website/www/site/data/capability_matrix.yaml
create mode 100644 website/www/site/data/capability_matrix_snapshot.yaml
create mode 100644 website/www/site/data/en/cards.yaml
create mode 100644 website/www/site/data/en/pillars.yaml
create mode 100644 website/www/site/data/logos.yml
create mode 100644 website/www/site/data/meetings.yml
create mode 100644 website/www/site/data/works_with.yaml
create mode 100644 website/www/site/i18n/blog/en.yaml
create mode 100644 website/www/site/i18n/footer/en.yaml
create mode 100644 website/www/site/i18n/home/en.yaml
create mode 100644 website/www/site/i18n/navbar/en.yaml
create mode 100644 website/www/site/layouts/_default/baseof.html
create mode 100644 website/www/site/layouts/blog/baseof.html
create mode 100644 website/www/site/layouts/blog/list.html
create mode 100644 website/www/site/layouts/blog/single.html
create mode 100644 website/www/site/layouts/community/baseof.html
create mode 100644 website/www/site/layouts/contribute/baseof.html
create mode 100644 website/www/site/layouts/documentation/baseof.html
create mode 100644 website/www/site/layouts/get-started/baseof.html
create mode 100644 website/www/site/layouts/index.feed.xml
create mode 100644 website/www/site/layouts/index.html
create mode 100644 website/www/site/layouts/languages/baseof.html
create mode 100644 website/www/site/layouts/partials/footer.html
create mode 100644 website/www/site/layouts/partials/head.html
create mode 100644 website/www/site/layouts/partials/header.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/community.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/contribute.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/documentation.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/get-started.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/roadmap.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/runners.html
create mode 100644 website/www/site/layouts/partials/section-menu/en/sdks.html
create mode 100644 website/www/site/layouts/privacy_policy/baseof.html
create mode 100644 website/www/site/layouts/roadmap/baseof.html
create mode 100644 website/www/site/layouts/runners/baseof.html
create mode 100644 website/www/site/layouts/security/baseof.html
create mode 100644 website/www/site/layouts/shortcodes/button-pydoc.html
create mode 100644 website/www/site/layouts/shortcodes/buttons-code-snippet.html
create mode 100644 website/www/site/layouts/shortcodes/capability-matrix-common.html
create mode 100644 website/www/site/layouts/shortcodes/capability-matrix.html
create mode 100644 website/www/site/layouts/shortcodes/colors/png.html
create mode 100644 website/www/site/layouts/shortcodes/colors/svg.html
create mode 100644 website/www/site/layouts/shortcodes/flink_java_pipeline_options.html
create mode 100644 website/www/site/layouts/shortcodes/flink_python_pipeline_options.html
create mode 100644 website/www/site/layouts/shortcodes/github_sample.html
create mode 100644 website/www/site/layouts/shortcodes/highlight.html
create mode 100644 website/www/site/layouts/shortcodes/language-switcher.html
create mode 100644 website/www/site/layouts/shortcodes/localstorage.html
create mode 100644 website/www/site/layouts/shortcodes/paragraph.html
create mode 100644 website/www/site/layouts/shortcodes/table.html
create mode 100644 website/www/site/layouts/shortcodes/toc.html
create mode 100644 website/www/site/static/.htaccess
rename website/{src => www/site/static}/downloads/beam-doap.rdf (100%)
rename website/{src => www/site/static}/downloads/logos.zip (100%)
rename website/{src => www/site/static}/downloads/palette.pdf (100%)
rename website/{src => www/site/static}/fonts/bootstrap/glyphicons-halflings-regular.eot (100%)
rename website/{src => www/site/static}/fonts/bootstrap/glyphicons-halflings-regular.svg (100%)
rename website/{src => www/site/static}/fonts/bootstrap/glyphicons-halflings-regular.ttf (100%)
rename website/{src => www/site/static}/fonts/bootstrap/glyphicons-halflings-regular.woff (100%)
rename website/{src => www/site/static}/fonts/bootstrap/glyphicons-halflings-regular.woff2 (100%)
rename website/{src => www/site/static}/images/apache_logo_circle.svg (100%)
rename website/{src => www/site/static}/images/beam_architecture.png (100%)
rename website/{src => www/site/static}/images/beam_logo_circle.svg (100%)
rename website/{src => www/site/static}/images/beam_logo_navbar.png (100%)
rename website/{src => www/site/static}/images/beam_logo_s.png (100%)
rename website/{src => www/site/static}/images/beam_sql_dsl_workflow.png (100%)
rename website/{src => www/site/static}/images/blog/2017-look-back/timeline.png (100%)
rename website/{src => www/site/static}/images/blog/Facebook-AD.png (100%)
rename website/{src => www/site/static}/images/blog/IMG_20160927_170455.jpg (100%)
rename website/{src => www/site/static}/images/blog/IMG_20160927_170956.jpg (100%)
rename website/{src => www/site/static}/images/blog/SoD.png (100%)
rename website/{src => www/site/static}/images/blog/beam-kata/beam-kata-intellij-edu-1.png (100%)
rename website/{src => www/site/static}/images/blog/beam-kata/beam-kata-intellij-edu-2.png (100%)
rename website/{src => www/site/static}/images/blog/beam-kata/beam-kata-pycharm-edu-1.png (100%)
rename website/{src => www/site/static}/images/blog/beam-kata/beam-kata-pycharm-edu-2.png (100%)
create mode 100644 website/www/site/static/images/blog/beamsummit/beamsummit-digital.png
rename website/{src => www/site/static}/images/blog/kotlin.png (100%)
rename website/{src => www/site/static}/images/blog/simple-wordcount-pipeline.png (100%)
rename website/{src => www/site/static}/images/blog/splittable-do-fn/blocks.png (100%)
rename website/{src => www/site/static}/images/blog/splittable-do-fn/jdbcio-expansion.png (100%)
rename website/{src => www/site/static}/images/blog/splittable-do-fn/kafka-splitting.png (100%)
rename website/{src => www/site/static}/images/blog/splittable-do-fn/restrictions.png (100%)
rename website/{src => www/site/static}/images/blog/splittable-do-fn/transform-expansion.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/assign-indices.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/combinefn.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/combiner-lifting.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/pardo-and-gbk.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/pipeline.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/plaid.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/stateful-dofn.png (100%)
rename website/{src => www/site/static}/images/blog/stateful-processing/stateful-pardo.png (100%)
rename website/{src => www/site/static}/images/blog/test-stream/elements-all-on-time.png (100%)
rename website/{src => www/site/static}/images/blog/test-stream/elements-droppably-late.png (100%)
rename website/{src => www/site/static}/images/blog/test-stream/elements-observably-late.png (100%)
rename website/{src => www/site/static}/images/blog/test-stream/elements-processing-speculative.png (100%)
rename website/{src => www/site/static}/images/blog/test-stream/elements-unobservably-late.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/BatchedRpcExpiry.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/BatchedRpcStale.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/BatchedRpcState.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/CombinePerKey.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/ParDo.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/StateAndTimers.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/UnifiedModel.png (100%)
rename website/{src => www/site/static}/images/blog/timely-processing/WindowingChoices.png (100%)
rename website/{src => www/site/static}/images/card_border.svg (100%)
rename website/{src => www/site/static}/images/cards_bg.svg (100%)
rename website/{src => www/site/static}/images/contribution-diversity.png (100%)
rename website/{src => www/site/static}/images/contribution-guide-1.png (100%)
rename website/{src => www/site/static}/images/design-your-pipeline-additional-outputs.svg (100%)
rename website/{src => www/site/static}/images/design-your-pipeline-flatten.svg (100%)
rename website/{src => www/site/static}/images/design-your-pipeline-join.svg (100%)
rename website/{src => www/site/static}/images/design-your-pipeline-linear.svg (100%)
rename website/{src => www/site/static}/images/design-your-pipeline-multiple-pcollections.svg (100%)
rename website/{src => www/site/static}/images/dofn-sequence-diagram.svg (100%)
rename website/{src => www/site/static}/images/execution_model_bundling.svg (100%)
rename website/{src => www/site/static}/images/execution_model_bundling_coupled_failure.svg (100%)
rename website/{src => www/site/static}/images/execution_model_bundling_gantt.svg (100%)
rename website/{src => www/site/static}/images/execution_model_bundling_gantt_max.svg (100%)
rename website/{src => www/site/static}/images/execution_model_bundling_multi.svg (100%)
rename website/{src => www/site/static}/images/execution_model_bundling_multi_gantt.svg (100%)
rename website/{src => www/site/static}/images/execution_model_failure_retry.svg (100%)
rename website/{src => www/site/static}/images/external-link-icon.png (100%)
rename website/{src => www/site/static}/images/favicon.ico (100%)
rename website/{src => www/site/static}/images/fixed-time-windows.png (100%)
rename website/{src => www/site/static}/images/gaming-example-basic.png (100%)
rename website/{src => www/site/static}/images/gaming-example-event-time-narrow.gif (100%)
rename website/{src => www/site/static}/images/gaming-example-proc-time-narrow.gif (100%)
rename website/{src => www/site/static}/images/gaming-example-session-windows.png (100%)
rename website/{src => www/site/static}/images/gaming-example-team-scores-narrow.gif (100%)
rename website/{src => www/site/static}/images/gaming-example.gif (100%)
rename website/{src => www/site/static}/images/hero_bg.svg (100%)
rename website/{src => www/site/static}/images/hero_bg_flat.svg (100%)
rename website/{src => www/site/static}/images/logo_apex.png (100%)
rename website/{src => www/site/static}/images/logo_flink.png (100%)
rename website/{src => www/site/static}/images/logo_gearpump.png (100%)
rename website/{src => www/site/static}/images/logo_google_cloud.png (100%)
rename website/{src => www/site/static}/images/logo_samza.png (100%)
rename website/{src => www/site/static}/images/logo_spark.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-bottom/beam-logo-3-color-name-bottom-100.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-bottom/beam-logo-3-color-name-bottom-1000.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-bottom/beam-logo-3-color-name-bottom-200.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-bottom/beam-logo-3-color-name-bottom-500.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-bottom/beam-logo-3-color-name-bottom.svg (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-right/beam-logo-3-color-name-right-100.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-right/beam-logo-3-color-name-right-1000.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-right/beam-logo-3-color-name-right-200.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-right/beam-logo-3-color-name-right-500.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/name-right/beam-logo-3-color-name-right.svg (100%)
rename website/{src => www/site/static}/images/logos/3-color/nameless/beam-logo-3-color-nameless-100.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/nameless/beam-logo-3-color-nameless-1000.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/nameless/beam-logo-3-color-nameless-200.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/nameless/beam-logo-3-color-nameless-500.png (100%)
rename website/{src => www/site/static}/images/logos/3-color/nameless/beam-logo-3-color-nameless.svg (100%)
rename website/{src => www/site/static}/images/logos/bw/name-bottom/beam-logo-bw-name-bottom-100.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-bottom/beam-logo-bw-name-bottom-1000.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-bottom/beam-logo-bw-name-bottom-200.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-bottom/beam-logo-bw-name-bottom-500.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-bottom/beam-logo-bw-name-bottom.svg (100%)
rename website/{src => www/site/static}/images/logos/bw/name-right/beam-logo-bw-name-right-100.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-right/beam-logo-bw-name-right-1000.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-right/beam-logo-bw-name-right-200.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-right/beam-logo-bw-name-right-500.png (100%)
rename website/{src => www/site/static}/images/logos/bw/name-right/beam-logo-bw-name-right.svg (100%)
rename website/{src => www/site/static}/images/logos/bw/nameless/beam-logo-bw-nameless-100.png (100%)
rename website/{src => www/site/static}/images/logos/bw/nameless/beam-logo-bw-nameless-1000.png (100%)
rename website/{src => www/site/static}/images/logos/bw/nameless/beam-logo-bw-nameless-200.png (100%)
rename website/{src => www/site/static}/images/logos/bw/nameless/beam-logo-bw-nameless-500.png (100%)
rename website/{src => www/site/static}/images/logos/bw/nameless/beam-logo-bw-nameless.svg (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-bottom/beam-logo-full-color-name-bottom-100.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-bottom/beam-logo-full-color-name-bottom-1000.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-bottom/beam-logo-full-color-name-bottom-200.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-bottom/beam-logo-full-color-name-bottom-500.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-bottom/beam-logo-full-color-name-bottom.svg (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-right/beam-logo-full-color-name-right-100.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-right/beam-logo-full-color-name-right-1000.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-right/beam-logo-full-color-name-right-200.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-right/beam-logo-full-color-name-right-500.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/name-right/beam-logo-full-color-name-right.svg (100%)
rename website/{src => www/site/static}/images/logos/full-color/nameless/beam-logo-full-color-nameless-100.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/nameless/beam-logo-full-color-nameless-1000.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/nameless/beam-logo-full-color-nameless-200.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/nameless/beam-logo-full-color-nameless-500.png (100%)
rename website/{src => www/site/static}/images/logos/full-color/nameless/beam-logo-full-color-nameless.svg (100%)
rename website/{src => www/site/static}/images/logos/runners/apex.png (100%)
rename website/{src => www/site/static}/images/logos/runners/dataflow.png (100%)
rename website/{src => www/site/static}/images/logos/runners/flink.png (100%)
rename website/{src => www/site/static}/images/logos/runners/gearpump.png (100%)
rename website/{src => www/site/static}/images/logos/runners/jet.png (100%)
rename website/{src => www/site/static}/images/logos/runners/jstorm.png (100%)
rename website/{src => www/site/static}/images/logos/runners/samza.png (100%)
rename website/{src => www/site/static}/images/logos/runners/spark.png (100%)
rename website/{src => www/site/static}/images/logos/sdks/go.png (100%)
rename website/{src => www/site/static}/images/logos/sdks/java.png (100%)
rename website/{src => www/site/static}/images/logos/sdks/python.png (100%)
rename website/{src => www/site/static}/images/logos/sdks/scala.png (100%)
rename website/{src => www/site/static}/images/precommit_dashboard.png (100%)
rename website/{src => www/site/static}/images/precommit_graph_queuing_time.png (100%)
rename website/{src => www/site/static}/images/release-guide-1.png (100%)
rename website/{src => www/site/static}/images/resources/se-radio-podcast.png (100%)
rename website/{src => www/site/static}/images/resources/streaming-101.png (100%)
rename website/{src => www/site/static}/images/resources/streaming-102.png (100%)
rename website/{src => www/site/static}/images/session-windows.png (100%)
rename website/{src => www/site/static}/images/sliding-time-windows.png (100%)
rename website/{src => www/site/static}/images/source-sequence-diagram.svg (100%)
rename website/{src => www/site/static}/images/standard-vs-dynamic-sessions.png (100%)
rename website/{src => www/site/static}/images/trigger-accumulation.png (100%)
rename website/{src => www/site/static}/images/unwindowed-pipeline-bounded.svg (100%)
rename website/{src => www/site/static}/images/windowing-pipeline-bounded.svg (100%)
rename website/{src => www/site/static}/images/windowing-pipeline-unbounded.svg (100%)
rename website/{src => www/site/static}/images/wordcount-pipeline.svg (100%)
rename website/{src => www/site/static}/js/bootstrap-sprockets.js (100%)
rename website/{src => www/site/static}/js/bootstrap.js (100%)
rename website/{src => www/site/static}/js/bootstrap.min.js (100%)
rename website/{src => www/site/static}/js/bootstrap/affix.js (100%)
rename website/{src => www/site/static}/js/bootstrap/alert.js (100%)
rename website/{src => www/site/static}/js/bootstrap/button.js (100%)
rename website/{src => www/site/static}/js/bootstrap/carousel.js (100%)
rename website/{src => www/site/static}/js/bootstrap/collapse.js (100%)
rename website/{src => www/site/static}/js/bootstrap/dropdown.js (100%)
rename website/{src => www/site/static}/js/bootstrap/modal.js (100%)
rename website/{src => www/site/static}/js/bootstrap/popover.js (100%)
rename website/{src => www/site/static}/js/bootstrap/scrollspy.js (100%)
rename website/{src => www/site/static}/js/bootstrap/tab.js (100%)
rename website/{src => www/site/static}/js/bootstrap/tooltip.js (100%)
rename website/{src => www/site/static}/js/bootstrap/transition.js (100%)
rename website/{src => www/site/static}/js/fix-menu.js (100%)
create mode 100644 website/www/site/static/js/language-switch.js
rename website/{src => www/site/static}/js/page-nav.js (100%)
create mode 100644 website/www/site/static/js/section-nav.js
create mode 160000 website/www/site/themes/docsy
create mode 100644 website/www/yarn.lock