You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2020/10/05 17:49:36 UTC

[beam] branch master updated (fe6c2c7 -> 29787b3)

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from fe6c2c7  [BEAM-7463] Fix BQ IT flake with streaming inserts (#12951)
     new be0bd98  [BEAM-10124] Add ContextualTextIO as a copy of TextIO
     new 07b4d17  [BEAM-10124] Change access modifiers. * Change access modifiers of the following function for visibility outside the package * modify access modifier for getEmptyMatchTreatment() and getWatchInterval() from FileIO * modify access modifier for getSingleFileMetadata() from FileBasedSource
     new f61aad0  [BEAM-10124] Add ContextualTextIO Implementation * Modify and add additional tests for ContextualTextIO * Add implementation for ContextualTextIO
     new 90617ce  [BEAM-10124] Refactor Code and Add option for recordOffset * Refactored requested changes * Add recordOffset feild that gives the offset of a record in the file
     new 85d576e  [BEAM-10124] Refactor requested changes
     new e60c4fa  [BEAM-10124] Refactor requested changes
     new 4bbd2ca  [BEAM-10124] Change from RecordWithMetadata To Row
     new 0f7ebc5  Fixup Co-authored-by: Lukasz Cwik <lc...@google.com>
     new 1aaa1e9  Update sdks/java/io/contextual-text-io/build.gradle
     new 8404af2  Update sdks/java/io/contextual-text-io/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIO.java
     new 35d8567  [BEAM-10124] Change default for RecordNum to be false. Add Check for trigger Change module location Change to MultiMapView
     new 29787b3  Merge pull request #12924 from rezarokni/contextualio_rebase

The 29114 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../org/apache/beam/sdk/io/FileBasedSource.java    |   2 +-
 .../main/java/org/apache/beam/sdk/io/FileIO.java   |   4 +-
 .../io/{splunk => contextualtextio}/build.gradle   |  28 +-
 .../sdk/io/contextualtextio/ContextualTextIO.java  | 707 +++++++++++++++++++
 .../contextualtextio/ContextualTextIOSource.java}  | 143 +++-
 .../io/contextualtextio/RecordWithMetadata.java    | 112 +++
 .../sdk/io/contextualtextio}/package-info.java     |   7 +-
 .../io/contextualtextio/ContextualTextIOTest.java} | 753 +++++++++++++++++----
 settings.gradle                                    |   1 +
 9 files changed, 1557 insertions(+), 200 deletions(-)
 copy sdks/java/io/{splunk => contextualtextio}/build.gradle (55%)
 create mode 100644 sdks/java/io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIO.java
 copy sdks/java/{core/src/main/java/org/apache/beam/sdk/io/TextSource.java => io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIOSource.java} (67%)
 create mode 100644 sdks/java/io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio/RecordWithMetadata.java
 copy sdks/java/{extensions/sql/datacatalog/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider/datacatalog => io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio}/package-info.java (83%)
 copy sdks/java/{core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java => io/contextualtextio/src/test/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIOTest.java} (50%)