You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by jeffsteinmetz <gi...@git.apache.org> on 2015/11/22 08:27:31 UTC
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
GitHub user jeffsteinmetz opened a pull request:
https://github.com/apache/incubator-zeppelin/pull/460
Vagrant Virtual Machine and Readme.md
This script creates a virtual machine that launches a repeatable, known set of core dependencies required for developing Zeppelin. It can also be used to run an existing Zeppelin build if you don't plan to build from source. For pyspark users, this script also includes several helpful Python Libraries and one obscure configuration to help with matplotlib plotting inside Zeppelin.
The virtual machine consists of:
- Ubuntu Server 14.04 LTS
- Node.js 0.12.7
- npm 2.11.3
- Maven 3.3.3
- Git
- Unzip
- libfontconfig to avoid phatomJs missing dependency issues
- openjdk-7-jdk
- Python addons: pip, matplotlib, scipy, numpy, pandas
- Changes are made to the python backend configuration so that pyspark can render matplotlib plots without an interactive window
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jeffsteinmetz/incubator-zeppelin master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-zeppelin/pull/460.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #460
----
commit 1eb27eb0728e8037b4c68e866ab64cfe3458dc8d
Author: Jeff Steinmetz <je...@gmail.com>
Date: 2015-11-08T03:31:47Z
expanded build instructions to include pyspark, and clarified maven and node.js requirements
commit 5888360f5a9e74c26667c43fde1f1ef29d094609
Author: Jeff Steinmetz <je...@gmail.com>
Date: 2015-11-22T05:07:12Z
merge upstream
commit fb31785f70e003704bc48e6db9556ec14bcf3582
Author: Jeff Steinmetz <je...@gmail.com>
Date: 2015-11-22T05:28:10Z
initial commit of vagrant virtual machine script
commit ff8078aae31da754722f277ea23a9c7f267ace8c
Author: Jeff Steinmetz <je...@gmail.com>
Date: 2015-11-22T07:18:18Z
vagrant virtual machine and readme
commit 853ddcaa80cda6f5fcad820921aa3f65d4bc61ce
Author: Jeff Steinmetz <je...@gmail.com>
Date: 2015-11-22T07:24:16Z
vagrant virtual machine and readme
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-158853272
Tried and working nicely.
Could you take care of Apache license header in *.yml, *.sh, Vagrantfile, deb_nodesource_com_node.pref.2 file?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159811072
Just updated PR with license removed.
From: Felix Cheung
Reply-To: apache/incubator-zeppelin
Date: Wednesday, November 25, 2015 at 9:13 PM
To: apache/incubator-zeppelin
Cc: Jeff Steinmetz
Subject: Re: [incubator-zeppelin] Vagrant Virtual Machine and Readme.md (#460)
Please note my question above - @jeffsteinmetz ?
—
Reply to this email directly or view it on GitHub.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159067963
Added virtual machine to install section of docs as well.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by felixcheung <gi...@git.apache.org>.
Github user felixcheung commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159814694
Ok, 2 places we might have questions on,
1. Nodejs Ansible seems to be from NodeSource
https://github.com/jeffsteinmetz/incubator-zeppelin/commit/de07f000faad4a25294f389d1c5ff45400c91572#diff-cebcea46aa802ff8d55e875878c93dd0
2. apache-mirror-selector.py, which I've suggested as reference, is from
https://github.com/y-higuchi/apache-mirror-selector
https://github.com/jeffsteinmetz/incubator-zeppelin/commit/5c31125fd7118568f2377ddc49f87e3c802dcc30#diff-911ac3a0d00cf86d2243682dc6f84156
Could someone please review process of including these into Apache source & license.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159995837
One small addition added that may be helpful: Adds ruby 1.9.3 + bundler, rake, make (only required for building jekyll documentation) + port 4000 forwarding in vagrant.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by prabhjyotsingh <gi...@git.apache.org>.
Github user prabhjyotsingh commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159808421
LGTM, works fine. Thanks for really useful feature.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159064202
Updated to use the apache-mirror-selector script.
The python example configures matplotlib within the script instead of the global environment.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by felixcheung <gi...@git.apache.org>.
Github user felixcheung commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159985660
looks good to me. thank you Jeff for making changes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-zeppelin/pull/460
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159816049
I can easily replace the node steps in the ansible role with a direct download from the official Node.js binary.
https://nodejs.org/download/
Not sure about: https://github.com/y-higuchi/apache-mirror-selector
I can probably use the ansible json parser and do basically the same thing. Let me look.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-160580851
As a followup, you can add a link https://github.com/apache/incubator-zeppelin/blob/master/docs/_includes/themes/zeppelin/_navigation.html#L26
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-160054201
Looks good to me!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-160833568
Looks like this PR was closed. Link added and new PR at
https://github.com/apache/incubator-zeppelin/pull/494
From: Lee moon soo
Reply-To: apache/incubator-zeppelin
Date: Monday, November 30, 2015 at 1:55 AM
To: apache/incubator-zeppelin
Cc: Jeff Steinmetz
Subject: Re: [incubator-zeppelin] Vagrant Virtual Machine and Readme.md (#460)
As a followup, you can add a link https://github.com/apache/incubator-zeppelin/blob/master/docs/_includes/themes/zeppelin/_navigation.html#L26
—
Reply to this email directly or view it on GitHub.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by felixcheung <gi...@git.apache.org>.
Github user felixcheung commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159096407
Aside from licenses and a minor typo, looks good. Thanks for contributing all of these!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-160340548
Merge if there're no more discussions. Thanks @jeffsteinmetz for the great work.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159781681
Thanks for the great contribution. LGTM.
Merge if there's no more discussions.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159314464
All comments have been addressed. Feel free to merge when appropriate.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by felixcheung <gi...@git.apache.org>.
Github user felixcheung commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159808187
Please note my question above - @jeffsteinmetz ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: Vagrant Virtual Machine and Readm...
Posted by jeffsteinmetz <gi...@git.apache.org>.
Github user jeffsteinmetz commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/460#issuecomment-159834455
Node js is now downloaded from official Node.js distribution. apache-mirror python script removed - ansible native json parsing used instead.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---