You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemds.apache.org by ba...@apache.org on 2020/10/22 09:29:21 UTC
[systemds-website] branch master updated (7dd1385 -> 9471330)
This is an automated email from the ASF dual-hosted git repository.
baunsgaard pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/systemds-website.git.
from 7dd1385 [MINOR] Change chair to Matthias Boehm
new 22d1f7b [MINOR] Add new PMCs
new 2b10202 [MINOR] Main readme cleanup
new 9471330 [DOCS] Update to 2.0.0 release
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 31 +++++-----
_src/_data/contributors.yml | 4 +-
_src/_data/project.yml | 4 +-
_src/_includes/themes/apache/home.html | 2 +-
_src/documentation.html | 17 +++---
_src/download.html | 71 ++++++++++------------
_src/release-notes/systemds-release-notes-2.0.0.md | 62 +++++++++++++++++++
7 files changed, 125 insertions(+), 66 deletions(-)
create mode 100644 _src/release-notes/systemds-release-notes-2.0.0.md
[systemds-website] 03/03: [DOCS] Update to 2.0.0 release
Posted by ba...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
baunsgaard pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/systemds-website.git
commit 947133059638994ced765a1dffb172dd34a0c3f1
Author: baunsgaard <ba...@tugraz.at>
AuthorDate: Thu Oct 22 11:26:14 2020 +0200
[DOCS] Update to 2.0.0 release
---
_src/_data/project.yml | 4 +-
_src/_includes/themes/apache/home.html | 2 +-
_src/documentation.html | 17 +++---
_src/download.html | 71 ++++++++++------------
_src/release-notes/systemds-release-notes-2.0.0.md | 62 +++++++++++++++++++
5 files changed, 108 insertions(+), 48 deletions(-)
diff --git a/_src/_data/project.yml b/_src/_data/project.yml
index 6316ac5..49020b2 100644
--- a/_src/_data/project.yml
+++ b/_src/_data/project.yml
@@ -42,8 +42,8 @@ issues_list_archive_markmail:
jira: SYSTEMDS
-release_name: systemml
-release_version: 1.2.0
+release_name: systemds
+release_version: 2.0.0
source_repository: https://git-wip-us.apache.org/repos/asf/systemds.git
source_repository_mirror: https://github.com/apache/systemds
diff --git a/_src/_includes/themes/apache/home.html b/_src/_includes/themes/apache/home.html
index e22f1ec..5c4e606 100644
--- a/_src/_includes/themes/apache/home.html
+++ b/_src/_includes/themes/apache/home.html
@@ -41,7 +41,7 @@ limitations under the License.
</div>
<div class="col-8">
<h3>Name change from SystemML to SystemDS</h3>
- <p>To reflect the change of focus to the wider Data Science Lifecycle
+ <p>To reflect the change of focus to the end-to-end data science lifecycle
</div>
</div>
</section>
diff --git a/_src/documentation.html b/_src/documentation.html
index 1695d62..6d5abcf 100644
--- a/_src/documentation.html
+++ b/_src/documentation.html
@@ -37,17 +37,20 @@ limitations under the License.
<div class="col col-4">
<p>Documentation such as programming guides, reference guides, and API docs is available for SystemDS below:</p>
<a class="button button-primary" href="{{ site.data.project.docs }}">Latest</a>
+ <p></p>
+ <a class="button button-primary" href="docs/2.0.0/index">2.0.0</a>
+ <a class="button button-primary" href="release-notes/systemds-release-notes-2.0.0.html">ReleaseNotes</a>
</div>
<div class="col col-4">
<p>each released version of SystemML:</p>
<ul>
- <li><a href="docs/1.2.0/index">1.2.0</a></li>
- <li><a href="docs/1.1.0/index">1.1.0</a></li>
- <li><a href="docs/1.0.0/index">1.0.0</a></li>
- <li><a href="docs/0.15.0/index">0.15.0</a></li>
- <li><a href="docs/0.14.0/index">0.14.0</a></li>
- <li><a href="docs/0.13.0/index">0.13.0</a></li>
- <li><a href="docs/0.12.0/index">0.12.0</a></li>
+ <li><a href="docs/1.2.0/index">1.2.0</a>, <a href="release-notes/systemml-release-notes-1.2.0.html">ReleaseNotes</a></li>
+ <li><a href="docs/1.1.0/index">1.1.0</a>, <a href="release-notes/systemml-release-notes-1.1.0.html">ReleaseNotes</a></li>
+ <li><a href="docs/1.0.0/index">1.0.0</a>, <a href="release-notes/systemml-release-notes-1.0.0.html">ReleaseNotes</a></li>
+ <li><a href="docs/0.15.0/index">0.15.0</a>, <a href="release-notes/systemml-release-notes-0.15.0.html">ReleaseNotes</a></li>
+ <li><a href="docs/0.14.0/index">0.14.0</a>, <a href="release-notes/systemml-release-notes-0.14.0-incubating.html">ReleaseNotes</a></li>
+ <li><a href="docs/0.13.0/index">0.13.0</a>, <a href="release-notes/systemml-release-notes-0.13.0-incubating.html">ReleaseNotes</a></li>
+ <li><a href="docs/0.12.0/index">0.12.0</a>, <a href="release-notes/systemml-release-notes-0.12.0-incubating.html">ReleaseNotes</a></li>
</ul>
</div>
</div>
diff --git a/_src/download.html b/_src/download.html
index 981d16f..248bb65 100644
--- a/_src/download.html
+++ b/_src/download.html
@@ -32,30 +32,16 @@ limitations under the License.
</div>
</section>
-<!-- Announcements Banner -->
-<section class="full-stripe full-stripe--alternate">
- <div class="ml-container ml-container--narrow">
- <div class="col-8">
- <h2>Build from Source</h2>
- <p>Since SystemDS is not released yet we suggest to build from source.</p>
- </div>
- <div class="col-4 content-group">
- <div></div>
- <a class="button button-primary" href="{{ site.data.project.docs }}site/install">Install SystemDS</a>
- </div>
- </div>
-</section>
-
<section class="full-stripe full-stripe--alternate">
<div class="ml-container">
<div class="col col-12 content-group content-group--medium-bottom-margin">
- <h2>Downloads SystemML</h2>
- <p>Apache SystemML is released as a source artifact. Binary artifacts (including the ones available in Maven) are
- made available for your convenience. You will be prompted for a mirror Apache SystemML is distributed under the
+ <h2>Downloads SystemDS</h2>
+ <p>Apache SystemDS is released as a source artifact. Binary artifacts (including the ones available in Maven) are
+ made available for your convenience. You will be prompted for a mirror Apache SystemDS is distributed under the
<a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, version 2.0</a>. </p>
</div>
<div class="col col-12 content-group">
- <h2>Download SystemML {{ site.data.project.release_version }} for Spark 2.0.2 and above</h2>
+ <h2>Download SystemDS {{ site.data.project.release_version }} for Spark 2.0.2 and above</h2>
</div>
<div class="col col-12 content-group row">
@@ -68,67 +54,67 @@ limitations under the License.
</tr>
<tr>
<td><a
- href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz"
+ href="http://www.apache.org/dyn/closer.lua/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-bin.tgz"
target="_blank"> {{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Binary
tgz)</a></td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz.sha512">SHA512</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-bin.tgz.sha512">SHA512</a>
</td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz.asc">ASC</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-bin.tgz.asc">ASC</a>
</td>
</tr>
<tr>
<td><a
- href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip"
+ href="http://www.apache.org/dyn/closer.lua/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-bin.zip"
target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Binary
zip)</a></td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip.sha512">SHA512</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-bin.zip.sha512">SHA512</a>
</td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip.asc">ASC</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-bin.zip.asc">ASC</a>
</td>
</tr>
<tr>
<td><a
- href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz"
+ href="http://www.apache.org/dyn/closer.lua/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-src.tgz"
target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Source
tgz)</a></td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz.sha512">SHA512</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-src.tgz.sha512">SHA512</a>
</td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz.asc">ASC</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-src.tgz.asc">ASC</a>
</td>
</tr>
<tr>
<td><a
- href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip"
+ href="http://www.apache.org/dyn/closer.lua/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-src.zip"
target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Source
zip)</a></td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip.sha512">SHA512</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-src.zip.sha512">SHA512</a>
</td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip.asc">ASC</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-src.zip.asc">ASC</a>
</td>
</tr>
<tr>
<td><a
- href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz"
+ href="http://www.apache.org/dyn/closer.lua/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-python.tgz"
target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Python
package .tgz)</a></td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz.sha512">SHA512</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-python.tgz.sha512">SHA512</a>
</td>
<td><a
- href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz.asc">ASC</a>
+ href="https://www.apache.org/dist/systemds/{{ site.data.project.release_version }}/systemds-{{ site.data.project.release_version }}-python.tgz.asc">ASC</a>
</td>
</tr>
<tr>
- <td><a href="release-notes/systemml-release-notes-{{ site.data.project.release_version }}.html">Release
+ <td><a href="release-notes/systemds-release-notes-{{ site.data.project.release_version }}.html">Release
Notes</a></td>
<td></td>
<td></td>
@@ -154,17 +140,26 @@ limitations under the License.
<p>Add the following dependencies to your Maven pom.xml.</p>
<pre><dependency>
- <groupId>org.apache.systemml</groupId>
- <artifactId>systemml</artifactId>
+ <groupId>org.apache.systemds</groupId>
+ <artifactId>systemds</artifactId>
<version>{{ site.data.project.release_version }}</version>
</dependency></pre>
<h3>Previous Releases</h3>
- <p>Previous releases of Apache SystemML can be obtained from <a href="http://archive.apache.org/dist/systemml/"
+ <p>Previous releases of Apache SystemML can be obtained from <a href="http://archive.apache.org/dist/systemds/"
target="_blank">archives</a>. Previous incubator releases can be obtained from <a
- href="http://archive.apache.org/dist/incubator/systemml/" target="_blank">incubator archives</a>. For Spark
+ href="http://archive.apache.org/dist/incubator/systemds/" target="_blank">incubator archives</a>. For Spark
1.6 support, please use Apache SystemML 0.12.</p>
</div>
</div>
</div>
+ <div class="ml-container">
+
+ <div class="col col-12 content-group content-group--medium-bottom-margin">
+ <h2>Build from Source</h2>
+ <p>If you want the latest in development version you can follow the build from source guide.</p>
+
+ <a class="button button-primary" href="{{ site.data.project.docs }}site/install">Install SystemDS</a>
+ </div>
+ </div>
</section>
\ No newline at end of file
diff --git a/_src/release-notes/systemds-release-notes-2.0.0.md b/_src/release-notes/systemds-release-notes-2.0.0.md
new file mode 100644
index 0000000..2ec9ac6
--- /dev/null
+++ b/_src/release-notes/systemds-release-notes-2.0.0.md
@@ -0,0 +1,62 @@
+---
+layout: page
+title: SystemML 1.2.0 Release Notes
+description: Project Release Notes
+group: nav-right
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+<section class="full-stripe full-stripe--subpage-header clear-header">
+ <div class="ml-container ml-container--horizontally-center">
+ <div class="col col-12 content-group content-group--center-content content-group--center-align">
+ <h1>{{ site.data.project.name }} 2.0.0 Release Notes</h1>
+ </div>
+ </div>
+</section>
+
+<section class="full-stripe full-stripe--alternate">
+ <div class="ml-container">
+ <div class="col col-12 content-group content-group--medium-bottom-margin" markdown="1">
+
+## Release notes for SystemDS 2.0.
+
+SystemDS 2.0 is the first major release under the new name. This release contains a major refactoring, a few major
+features, a large number of improvements and fixes, and some experimental features to better support the end-to-end
+data science lifecycle. In addition to that, this release also removes several features that are not up date and
+outdated.
+
+The major changes (compared to SystemML 1.2) include
+
+- New mechanism for DML-bodied (script-level) builtin functions, and a wealth of new built-in functions for data preprocessing including data cleaning, augmentation and feature engineering techniques, new ML algorithms, and model debugging.
+- Several methods for data cleaning have been implemented including multiple imputations with multivariate imputation by chained equations (MICE) and other techniques, SMOTE, an oversampling technique for class imbalance, forward and backward NA filling, cleaning using schema and length information, support for outlier detection using standard deviation and inter-quartile range, and functional dependency discovery.
+- A complete framework for lineage tracing and reuse including support for loop deduplication, full and partial reuse, compiler assisted reuse, several new rewrites to facilitate reuse.
+- New federated runtime backend including support for federated matrices and frames, federated builtins (transform-encode, decode etc.).
+- Refactor compression package and add functionalities including quantization for lossy compression, binary cell operations, left matrix multiplication. [experimental]
+- New python bindings with supports for several builtins, matrix operations, federated tensors and lineage traces.
+- Cuda implementation of cumulative aggregate operators (cumsum, cumprod etc.)
+- New model debugging technique with slice finder.
+- New tensor data model (basic tensors of different value types, data tensors with schema) [experimental]
+- Cloud deployment scripts for AWS and scripts to set up and start federated operations.
+- Performance improvements with parallel sort, gpu cum agg, append cbind etc.
+- Various compiler and runtime improvements including new and improved rewrites, reduced Spark context creation, new eval framework, list operations, updated native kernel libraries to name a few.
+- New data reader/writer for json frames and support for sql as a data source.
+- Miscellaneous improvements: improved documentation, better testing, run/release scripts, improved packaging, Docker container for systemds, support for lambda expressions, bug fixes.
+- Removed MapReduce compiler and runtime backend, pydml parser, Java-UDF framework, script-level debugger.
+- Deprecated ./scripts/algorithms, as those algorithms gradually will be part of SystemDS builtins.
\ No newline at end of file
[systemds-website] 02/03: [MINOR] Main readme cleanup
Posted by ba...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
baunsgaard pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/systemds-website.git
commit 2b102021d38cdb249b873e1b84885da85e4b7724
Author: baunsgaard <ba...@tugraz.at>
AuthorDate: Wed Oct 21 14:04:33 2020 +0200
[MINOR] Main readme cleanup
---
README.md | 31 +++++++++++++++----------------
1 file changed, 15 insertions(+), 16 deletions(-)
diff --git a/README.md b/README.md
index 1175882..3b94b06 100644
--- a/README.md
+++ b/README.md
@@ -1,33 +1,32 @@
-SystemML Website
-================
+# SystemML Website
-Build System dependencies
--------------------------
+## Dependencies
-#### Node.js and npm
+### Node.js and npm
-In order to build this project you will need the latest version of [node.js and npm](https://nodejs.org/). Detailed instructions for download and installation can be found [here](https://github.com/nodejs/node#download).
+In order to build this project you will need the latest version of [node.js and npm](https://nodejs.org/).
+Detailed instructions for download and installation can be found [here](https://github.com/nodejs/node#download).
-#### Gulp
+### Gulp
We use Gulp to compile Sass and JS as well as run the Jekyll build. You can install it with npm:
-```
-$ sudo npm install -g gulp
+```bash
+sudo npm install -g gulp
```
-### Building the website
+## Building the website
-#### Download website dependancies
+### Download website dependancies
-```
-$ npm install
+```bash
+npm install
```
-#### Build website contents
+### Build website contents
-```
-$ gulp
+```bash
+gulp
```
If all goes well it open the site in your browser at `http://localhost:3000`.
[systemds-website] 01/03: [MINOR] Add new PMCs
Posted by ba...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
baunsgaard pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/systemds-website.git
commit 22d1f7b147824bad92bcae3402d5ffa716882e74
Author: baunsgaard <ba...@tugraz.at>
AuthorDate: Mon Oct 19 14:30:21 2020 +0200
[MINOR] Add new PMCs
---
_src/_data/contributors.yml | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/_src/_data/contributors.yml b/_src/_data/contributors.yml
index 65e1323..e6028a8 100644
--- a/_src/_data/contributors.yml
+++ b/_src/_data/contributors.yml
@@ -24,7 +24,7 @@
- name: Arnab Phani
apacheId: arnabp20
githubId: phaniarnab
- role: Committer
+ role: PMC Member
org: TU Graz
- name: Arvind Surve
@@ -174,7 +174,7 @@
- name: Sebastian Baunsgaard
apacheId: baunsgaard
githubId: Baunsgaard
- role: Committer
+ role: PMC Member
org: TU Graz
- name: Shirish Tatikonda