You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by rp...@apache.org on 2022/07/08 12:04:32 UTC

[incubator-wayang] 01/01: Merge pull request #256 from apache/s3

This is an automated email from the ASF dual-hosted git repository.

rpardomeza pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git

commit eff3d39cc70e777b0823756b311faf563f94de05
Merge: 6ef1100b 476cf5fb
Author: Rodrigo Pardo Meza <ro...@gmail.com>
AuthorDate: Fri Jul 8 08:04:26 2022 -0400

    Merge pull request #256 from apache/s3
    
    Support for S3 files locations

 .dlc.json                                          |   6 +
 .gitignore                                         |   1 +
 README.md                                          |  42 ++++
 bin/wayang-submit                                  | 105 +++++++++
 {bin => build}/build.sh                            |   0
 {bin => build}/change-scala-version.sh             |   0
 {bin => build}/check-license.sh                    |   3 +
 {bin => build}/check-release.sh                    |   0
 {bin => build}/contains-scala-dependencies.sh      |   0
 {bin => build}/create_scala_structure.sh           |   0
 {bin => build}/detect-scala-dependent-projects.sh  |   0
 {bin => build}/pyplangenerator.sh                  |   0
 {bin => build}/rename_org.sh                       |   0
 {bin => build}/rm-pom-backups.sh                   |   0
 {bin => build}/rollback_release.sh                 |   0
 conf/flink/default.properties                      |  30 +++
 conf/spark/default.properties                      |  21 ++
 pom.xml                                            |   4 +-
 wayang-assembly/README.md                          |  23 ++
 wayang-assembly/pom.xml                            | 141 ++++++++++++
 wayang-assembly/src/main/assembly/assembly.xml     |  87 +++++++
 wayang-benchmark/README.md                         |   4 +-
 .../java/org/apache/wayang/apps/sgd/SGDImpl.java   |   7 +-
 wayang-benchmark/pom.xml                           |  15 ++
 wayang-commons/pom.xml                             |   8 +
 wayang-commons/wayang-core/pom.xml                 |  22 +-
 .../apache/wayang/core/util/fs/FileSystems.java    |   3 +-
 .../apache/wayang/core/util/fs/S3FileSystem.java   | 253 +++++++++++++++++++++
 .../wayang/spark/platform/SparkPlatform.java       |  17 +-
 wayang-platforms/wayang-spark/pom.xml              |  12 +-
 30 files changed, 794 insertions(+), 10 deletions(-)