You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Niketan Pansare (JIRA)" <ji...@apache.org> on 2016/08/28 17:24:20 UTC

[jira] [Commented] (SYSTEMML-855) Add a "Get Started" tutorial for Python users

    [ https://issues.apache.org/jira/browse/SYSTEMML-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15443806#comment-15443806 ] 

Niketan Pansare commented on SYSTEMML-855:
------------------------------------------

Fixed as part of commit: https://github.com/apache/incubator-systemml/commit/48a7267f804f56cc9859b6a89d3e5f491f5a4558

Link: https://apache.github.io/incubator-systemml/beginners-guide-python.html

> Add a "Get Started" tutorial for Python users
> ---------------------------------------------
>
>                 Key: SYSTEMML-855
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-855
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Niketan Pansare
>
> As an example, this tutorial could have following sections:
> 1. Steps to start Python shell (or cloud service like datascientistworkbench) with SystemML support:
> wget https://raw.githubusercontent.com/apache/incubator-systemml/master/src/main/java/org/apache/sysml/api/python/SystemML.py
> wget https://sparktc.ibmcloud.com/repo/latest/SystemML.jar
> pyspark --master local[*] --driver-class-path SystemML.jar
> OR
> Use pip installer.
> 2. Give context for one of the algorithm: For example: Linear regression. We can borrow the technical detail from http://apache.github.io/incubator-systemml/algorithms-regression.html#description
> 3. Explain steps to download data we will use and how to implement Linear regression DS using embedded Python DSL:
> https://github.com/apache/incubator-systemml/pull/197
> import numpy as np
> from sklearn import datasets
> diabetes = datasets.load_diabetes()
> diabetes_X = diabetes.data[:, np.newaxis, 2]
> diabetes_X_train = diabetes_X[:-20]
> diabetes_X_test = diabetes_X[-20:]
> diabetes_y_train = diabetes.target[:-20]
> diabetes_y_test = diabetes.target[-20:]
> 4. Explain how to use our algorithm instead:
> http://apache.github.io/incubator-systemml/algorithms-regression.html#examples
> 5. To explain tradeoffs of using NumPy or Scikit-Learn v/s SystemML's embedded DSL or SystemML's mllearn, increase the data size. For example: use twitter feed.
> By the end of tutorial, the programmer should understand at very high-level:
> 1. Moving to SystemML is painless. Almost as simple as changing "import"
> 2. SystemML has a sophisticated optimizer that allows it to adapt to different data/cluster characteristics and allows the code and algorithm to scale.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)