You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amaterasu.apache.org by ya...@apache.org on 2018/01/14 11:51:16 UTC
[incubator-amaterasu] branch master updated (8b07446 -> 0f0b0ae)
This is an automated email from the ASF dual-hosted git repository.
yaniv pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from 8b07446 Merge pull request #3 from eyalbenivri/feature/yarn-support-pyfix
add 9b48e0e 1.SparkSql runner can read a dataframe from previous action through AmaContext; 2.SparkSql runner can parse amacontext in user supplied query; 3.SparkSql can read/write data directly from a sql,json,parquet, orm and text file. JDBC support will be available in future releases
add 0acf1ee If no dataframe read format is specified by user, parquet is used as default file format to load data from previous actions
add c8e8cd0 Updated parser to parse advanced queries
add 3d316d7 Merge branch 'master' into AMATERASU-13
add 8a94f89 Merge branch 'master' into AMATERASU-13
new 0f0b0ae Merge pull request #2 from kirupagaran/AMATERASU-13
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../runners/spark/SparkSql/SparkSqlRunner.scala | 121 ++++++++++++++++-----
.../resources/SparkSql/csv/SparkSqlTestCsv.csv | 4 +
.../resources/SparkSql/json/SparkSqlTestData.json | 6 +-
.../amaterasu/spark/SparkSqlRunnerTests.scala | 100 +++++++++++++++--
4 files changed, 191 insertions(+), 40 deletions(-)
create mode 100644 executor/src/test/resources/SparkSql/csv/SparkSqlTestCsv.csv
--
To stop receiving notification emails like this one, please contact
['"commits@amaterasu.apache.org" <co...@amaterasu.apache.org>'].
[incubator-amaterasu] 01/01: Merge pull request #2 from
kirupagaran/AMATERASU-13
Posted by ya...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
yaniv pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git
commit 0f0b0ae28bb322d1904d84b0cbd6f3d30a9275de
Merge: 8b07446 8a94f89
Author: Yaniv Rodenski <ro...@gmail.com>
AuthorDate: Sun Jan 14 22:51:14 2018 +1100
Merge pull request #2 from kirupagaran/AMATERASU-13
Amaterasu 13
.../runners/spark/SparkSql/SparkSqlRunner.scala | 121 ++++++++++++++++-----
.../resources/SparkSql/csv/SparkSqlTestCsv.csv | 4 +
.../resources/SparkSql/json/SparkSqlTestData.json | 6 +-
.../amaterasu/spark/SparkSqlRunnerTests.scala | 100 +++++++++++++++--
4 files changed, 191 insertions(+), 40 deletions(-)
--
To stop receiving notification emails like this one, please contact
"commits@amaterasu.apache.org" <co...@amaterasu.apache.org>.