You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemml.apache.org by ni...@apache.org on 2019/03/24 16:08:57 UTC

[systemml] branch gh-pages updated (2eed56f -> 878f757)

This is an automated email from the ASF dual-hosted git repository.

niketanpansare pushed a change to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/systemml.git.


    from 2eed56f  [MINOR][DOC] Updated Deep Learning documentation
     new 4032594  [SYSTEMML-540] Invoke update immediately after backward call at the script-level.
     new 878f757  [SYSTEMML-540] Added ternary aggregate operators for GPU backend

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 release-creation-process.md |  3 +++
 release-process.md          | 25 ++++++++++++++++++++-----
 2 files changed, 23 insertions(+), 5 deletions(-)


[systemml] 02/02: [SYSTEMML-540] Added ternary aggregate operators for GPU backend

Posted by ni...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

niketanpansare pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/systemml.git

commit 878f757f1825a7fe22370dff0e23114fc0434308
Author: Niketan Pansare <np...@us.ibm.com>
AuthorDate: Sun Mar 24 09:06:55 2019 -0700

    [SYSTEMML-540] Added ternary aggregate operators for GPU backend
    
    - Also added steps to upload SystemML's python package to pypi.
---
 release-process.md | 25 ++++++++++++++++++++-----
 1 file changed, 20 insertions(+), 5 deletions(-)

diff --git a/release-process.md b/release-process.md
index 2477cd0..c50a27e 100644
--- a/release-process.md
+++ b/release-process.md
@@ -388,7 +388,7 @@ file and remove all the `@Ignore` annotations from all the tests. Then run the N
 # Run other GPU Unit Tests 
 
 	rm result.txt
-	for t in AggregateUnaryOpTests  BinaryOpTests  MatrixMatrixElementWiseOpTests  RightIndexingTests AppendTest  MatrixMultiplicationOpTest ReorgOpTests ScalarMatrixElementwiseOpTests UnaryOpTests LstmTest LstmCPUTest
+	for t in AggregateUnaryOpTests AggregateTernaryTests  BinaryOpTests  MatrixMatrixElementWiseOpTests  RightIndexingTests AppendTest  MatrixMultiplicationOpTest ReorgOpTests ScalarMatrixElementwiseOpTests UnaryOpTests LstmTest LstmCPUTest
 	do
 		mvn -Dit.test="org.apache.sysml.test.gpu."$t verify -PgpuTests &> tmp.txt
 		SUCCESS=`grep "BUILD SUCCESS" tmp.txt`
@@ -503,8 +503,23 @@ The versioned project documentation is now deployed to the main website, and the
 
 ## Update Crawler configuration for the search indexing
 
-Create a PR or an issue to update the version number in the crawler configuration. 
-Please see the `start_urls` tag in the file [https://github.com/algolia/docsearch-configs/blob/master/configs/apache_systemml.json](https://github.com/algolia/docsearch-configs/blob/master/configs/apache_systemml.json).
-If the Algolia team provides us an updated `apiKey` or `indexName` credentials, then please update the corresponding entries in the file 
+- Create a PR or an issue to update the version number in the crawler configuration. Please see the `start_urls` tag in the file [https://github.com/algolia/docsearch-configs/blob/master/configs/apache_systemml.json](https://github.com/algolia/docsearch-configs/blob/master/configs/apache_systemml.json).
+- If the Algolia team provides us an updated `apiKey` or `indexName` credentials, then please update the corresponding entries in the file 
 [https://github.com/apache/systemml/blob/master/docs/_layouts/global.html](https://github.com/apache/systemml/blob/master/docs/_layouts/global.html) 
-(see for `Algolia search section` in the previously mentioned HTML file).
\ No newline at end of file
+(see for `Algolia search section` in the previously mentioned HTML file).
+
+## Upload Python package to PyPI
+
+Download the released `systemml-*-python.tar.gz` and `systemml-*-python.tar.gz`.
+
+	$ wget https://dist.apache.org/repos/dist/release/systemml/1.0.0/systemml-1.0.0-python.tar.gz
+	$ wget https://dist.apache.org/repos/dist/release/systemml/1.0.0/systemml-1.0.0-python.tar.gz.asc
+	
+Rename the files to remove `-python` suffix.
+
+	$ mv systemml-1.0.0-python.tar.gz systemml-1.0.0.tar.gz
+	$ mv systemml-1.0.0-python.tar.gz.asc systemml-1.0.0.tar.gz.asc
+
+Upload the Python package to PyPI using [twine](https://pypi.org/project/twine/).
+
+	$ twine upload -u systemml systemml-1.0.0.tar.gz systemml-1.0.0.tar.gz.asc 
\ No newline at end of file


[systemml] 01/02: [SYSTEMML-540] Invoke update immediately after backward call at the script-level.

Posted by ni...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

niketanpansare pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/systemml.git

commit 4032594bc737d41efe06606e801dd61be27413ee
Author: Niketan Pansare <np...@us.ibm.com>
AuthorDate: Sat Mar 23 21:51:45 2019 -0700

    [SYSTEMML-540] Invoke update immediately after backward call at the script-level.
    
    - This reduces the chance of unnecessary evictions especially when there are statement block cuts.
    - The configuration property `perform_fused_backward_update` allows the user to toggle this behavior and control the script-generation process.
    - Also, updated the release creation document to ensure that untracked files are not included in the artifacts.
    - For Resnet-200, the eviction time was reduced from 173.488 seconds to 60.048 seconds with minibatch size of 96.
---
 release-creation-process.md | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/release-creation-process.md b/release-creation-process.md
index 3115390..bf05000 100644
--- a/release-creation-process.md
+++ b/release-creation-process.md
@@ -42,6 +42,9 @@ Step 1: Prepare the release.
 
 	# Extract latest code to a directory
 	<GitRepoHome>
+	
+	# Check if there are any untracked files (created by the unit tests) and remove them to avoid packing them in the artifacts
+	git status
 
 	# Go to dev/release directory
 	cd <GitRepoHome>/dev/release