You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by ju...@apache.org on 2025/12/11 13:49:34 UTC

(incubator-wayang) branch main updated (f05a09fc0 -> b893e2cfd)

This is an automated email from the ASF dual-hosted git repository.

juri pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git


    from f05a09fc0 Merge pull request #639 from zkaoudi/main
     add afb8e413c Ported object-file IO onto a safe codec to mitigate gadget chain attack that runs arbitrary bytecode inside the Wayang JVM
     add 0d640ddbb updated to a centralized warning
     add f0bc5f149 Switch JavaObjectFileSourceTest to legacy serialization fixture
     add 81658cf0e Switch JavaObjectFileSourceTest to legacy serialization fixture
     add 6189abbe8 SparkObjectFileSource now just relies on ObjectFileSource#getSerializationMode and SparkObjectFileSink.encodeBuffer to inline the BytesWritable construction for readability
     new b893e2cfd Merge pull request #640 from 2pk03/feature/object-file-serialization

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 wayang-api/wayang-api-python/pom.xml               |  21 ++++
 .../basic/operators/ObjectFileSerialization.java   | 139 +++++++++++++++++++++
 .../operators/ObjectFileSerializationMode.java}    |  19 +--
 .../wayang/basic/operators/ObjectFileSink.java     |  39 ++++++
 .../wayang/basic/operators/ObjectFileSource.java   |  36 ++++++
 .../operators/ObjectFileSerializationTest.java     |  79 ++++++++++++
 .../flink/compiler/WayangFileOutputFormat.java     |  25 ++--
 .../flink/operators/FlinkObjectFileSink.java       |   7 +-
 .../flink/operators/FlinkObjectFileSource.java     |  11 +-
 .../wayang/java/operators/JavaObjectFileSink.java  |  17 +--
 .../java/operators/JavaObjectFileSource.java       |  51 ++++----
 .../java/operators/JavaObjectFileSourceTest.java   |   1 +
 .../spark/operators/SparkObjectFileSink.java       |  54 +++++++-
 .../spark/operators/SparkObjectFileSource.java     |  21 +++-
 .../spark/operators/SparkObjectFileSourceTest.java |   1 +
 15 files changed, 451 insertions(+), 70 deletions(-)
 create mode 100644 wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/operators/ObjectFileSerialization.java
 copy wayang-commons/{wayang-core/src/main/java/org/apache/wayang/core/platform/ExecutionResource.java => wayang-basic/src/main/java/org/apache/wayang/basic/operators/ObjectFileSerializationMode.java} (62%)
 create mode 100644 wayang-commons/wayang-basic/src/test/java/org/apache/wayang/basic/operators/ObjectFileSerializationTest.java


(incubator-wayang) 01/01: Merge pull request #640 from 2pk03/feature/object-file-serialization

Posted by ju...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

juri pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git

commit b893e2cfd64c63b0a4bf2d283649908a661e1361
Merge: f05a09fc0 6189abbe8
Author: Juri Petersen <43...@users.noreply.github.com>
AuthorDate: Thu Dec 11 14:49:29 2025 +0100

    Merge pull request #640 from 2pk03/feature/object-file-serialization
    
    Ported object-file IO onto a safe codec to mitigate gadget chain attack

 wayang-api/wayang-api-python/pom.xml               |  21 ++++
 .../basic/operators/ObjectFileSerialization.java   | 139 +++++++++++++++++++++
 .../operators/ObjectFileSerializationMode.java     |  37 ++++++
 .../wayang/basic/operators/ObjectFileSink.java     |  39 ++++++
 .../wayang/basic/operators/ObjectFileSource.java   |  36 ++++++
 .../operators/ObjectFileSerializationTest.java     |  79 ++++++++++++
 .../flink/compiler/WayangFileOutputFormat.java     |  25 ++--
 .../flink/operators/FlinkObjectFileSink.java       |   7 +-
 .../flink/operators/FlinkObjectFileSource.java     |  11 +-
 .../wayang/java/operators/JavaObjectFileSink.java  |  17 +--
 .../java/operators/JavaObjectFileSource.java       |  51 ++++----
 .../java/operators/JavaObjectFileSourceTest.java   |   1 +
 .../spark/operators/SparkObjectFileSink.java       |  54 +++++++-
 .../spark/operators/SparkObjectFileSource.java     |  21 +++-
 .../spark/operators/SparkObjectFileSourceTest.java |   1 +
 15 files changed, 477 insertions(+), 62 deletions(-)