You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by ak...@apache.org on 2022/10/07 22:32:44 UTC
[hudi] branch master updated (06d924137b -> 5d2c2853ea)
This is an automated email from the ASF dual-hosted git repository.
akudinkin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 06d924137b [HUDI-2786] Docker demo on mac aarch64 (#6859)
add 9c1fa14fd6 add support for unraveling proto schemas
add 510d525e15 fix some compile issues
add aad9ec1320 naming and style updates
add 8899274444 make test data random, reuse code
add a922a5beca add test for 2 different recursion depths, fix schema cache key
add 3b37dc95d9 add unsigned long support
add 706291d4f3 better handle other types
add c28e874fca rebase on 4904
add 190cc16381 get all tests working
add f18fff886e fix oneof expected schema, update tests after rebase
add ff5baa8706 revert scala binary change
add 0069da2d1a try a different method to avoid avro version
add 71a39bf488 Merge remote-tracking branch 'origin/master' into HUDI-4905
add c5dff63375 delete unused file
add f53d47ea3b address PR feedback, update decimal precision
add 1831639e39 fix isNullable issue, check if class is Int64value
add eca2992d65 checkstyle fix
add 423da6f7bb change wrapper descriptor set initialization
add fb2d9f0030 add in testing for unsigned long to BigInteger conversion
add f03f9610cf shade protobuf dependency
add 57f8b81194 Merge remote-tracking branch 'origin/master' into HUDI-4905
add 7d5b9dc0a9 Revert "shade protobuf dependency"
new 5d2c2853ea [HUDI-4905] Improve type handling in proto schema conversion
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
hudi-utilities/pom.xml | 1 -
.../schema/ProtoClassBasedSchemaProvider.java | 19 +-
.../sources/helpers/ProtoConversionUtil.java | 242 ++++++++++++++-------
.../schema/TestProtoClassBasedSchemaProvider.java | 21 +-
.../utilities/sources/TestProtoKafkaSource.java | 2 +-
.../sources/helpers/TestProtoConversionUtil.java | 100 +++++++--
.../schema-provider/proto/oneof_schema.avsc | 42 ++++
.../resources/schema-provider/proto/sample.proto | 8 +
..._flattened.avsc => sample_schema_defaults.avsc} | 31 ++-
...le_schema_wrapped_and_timestamp_as_record.avsc} | 16 +-
10 files changed, 357 insertions(+), 125 deletions(-)
create mode 100644 hudi-utilities/src/test/resources/schema-provider/proto/oneof_schema.avsc
rename hudi-utilities/src/test/resources/schema-provider/proto/{sample_schema_flattened.avsc => sample_schema_defaults.avsc} (92%)
rename hudi-utilities/src/test/resources/schema-provider/proto/{sample_schema_nested.avsc => sample_schema_wrapped_and_timestamp_as_record.avsc} (95%)
[hudi] 01/01: [HUDI-4905] Improve type handling in proto schema conversion
Posted by ak...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
akudinkin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 5d2c2853ea37ca8268f0d049460bedddde026216
Merge: 06d924137b 7d5b9dc0a9
Author: Alexey Kudinkin <al...@gmail.com>
AuthorDate: Fri Oct 7 15:32:38 2022 -0700
[HUDI-4905] Improve type handling in proto schema conversion
hudi-utilities/pom.xml | 1 -
.../schema/ProtoClassBasedSchemaProvider.java | 19 +-
.../sources/helpers/ProtoConversionUtil.java | 242 ++++++++++++++-------
.../schema/TestProtoClassBasedSchemaProvider.java | 21 +-
.../utilities/sources/TestProtoKafkaSource.java | 2 +-
.../sources/helpers/TestProtoConversionUtil.java | 100 +++++++--
.../schema-provider/proto/oneof_schema.avsc | 42 ++++
.../resources/schema-provider/proto/sample.proto | 8 +
..._flattened.avsc => sample_schema_defaults.avsc} | 31 ++-
...le_schema_wrapped_and_timestamp_as_record.avsc} | 16 +-
10 files changed, 357 insertions(+), 125 deletions(-)