You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@sdap.apache.org by fg...@apache.org on 2018/07/07 23:55:14 UTC

[incubator-sdap-nexus] branch master updated: Update README.md

This is an automated email from the ASF dual-hosted git repository.

fgreg pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-sdap-nexus.git


The following commit(s) were added to refs/heads/master by this push:
     new 321db0c  Update README.md
321db0c is described below

commit 321db0c0520a3b8c1427735daa15dfedf33813e6
Author: fgreg <fg...@gmail.com>
AuthorDate: Sat Jul 7 16:55:12 2018 -0700

    Update README.md
---
 README.md | 113 --------------------------------------------------------------
 1 file changed, 113 deletions(-)

diff --git a/README.md b/README.md
index cc6ea8e..114c89e 100644
--- a/README.md
+++ b/README.md
@@ -3,116 +3,3 @@ nexus
 
 The next generation cloud-based science data service platform
 
-# Developer Installation
-
-1. Follow instructions for installing [nexusproto](nexus-ingest/nexus-messages/README.md)
-2. Follow instructions for installing [data-access](data-access/README.md)
-3. Follow instructions for setting up [nexus-ingest](nexus-ingest/developer-box/README.md)
-  1. [Ingest some data](nexus-ingest/developer-box/README.md#ingesting-data)
-4. Follow instructions for running [analysis](analysis/README.md)
-
-
-# Installation Instructions
-
-## Zookeeper Setup
-
-1. Install and configure Apache Zookeeper 3.4.x
-2. Create chroots `solr`, `xd`, and `kafka`
-
-## Database Setup
-
-### Apache Solr
-
-1. Install and configure [Apache Solr Cloud 5.3.x](http://archive.apache.org/dist/lucene/solr/)
-2. Download [JTS Topology Suite v1.13](https://sourceforge.net/projects/jts-topo-suite/files/jts/1.13/) and extract the zip.
-3. From the exploded JTS zip, copy `$JTS_ZIP/lib/jts-1.13.jar` and `$JTS_ZIP/lib/jtsio-1.13.jar` into `$SOLR_INSTALL_DIR/server/lib/ext` on all Solr nodes.
-4. Configure Solr Cloud to use the `/solr` chroot of zookeeper
-5. On one of the Solr cloud nodes, upload the `nexustiles` configuration (located in [data-access/config/schemas/solr](data-access/config/schemas/solr)) as a configset
-
-    ````
-    ./zkcli.sh -cmd upconfig -z $ZK_SERVERS/solr -confname nexustiles -confdir /path/to/nexustiles/conf
-    ````
-
-6. [Create a new collection](https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api1) with the name nexustiles. Use the nexustiles configset uploaded previously.
-
-    ````
-    curl "http://<SOLR_HOST>/solr/admin/collections?action=CREATE&name=nexustiles&collection.configName=nexustiles"
-    ````
-7. Repeat steps 5 & 6 for the [datasets](data-access/config/schemas/solr) collection.
-
-
-### Apache Cassandra
-
-1. Install and configure [Apache Cassandra 2.2.x](http://cassandra.apache.org/download/)
-2. Execute the DDL located in [nexustiles.cql](data-access/config/schemas/cassandra/nexustiles.cql)
-
-### HSQLDB
-
-1. Install and run [HSQLDB 2.3.x](http://hsqldb.org/)
-
-### Redis
-
-1. Install and run [Redis 3.0.x](http://redis.io/)
-
-## Apache Kafka
-
-1. Install and configure [Apache Kafka 2.11-0.9.0.1](http://kafka.apache.org/)
-2. Configure Kafka to use the `/kafka` chroot of zookeeper
-
-## Spring XD
-
-1. Install [Spring XD 1.3.1.RELEASE](http://docs.spring.io/spring-xd/docs/1.3.1.RELEASE/reference/html/)
-2. Optionally install [Flo for Spring XD](https://docs.pivotal.io/spring-flo/installing-flo.html)
-3. Configure to use previously installed Apache Kafka as messaging bus
-4. Configure to use previously installed Redis for analytics
-5. Configure to use previously installed HSQLDB for Job Repository
-6. Configure to use previously installed Apache Zookeeper using the `xd` chroot
-7. Choose and configure a location for the [custom module registry](http://docs.spring.io/spring-xd/docs/current/reference/html/#_the_module_registry)
-8. Create a directory called `none` in `$SPRING_XD_HOME/xd/lib`
-
-### Preparing the XD Containers
-
-In order for streams to use the custom python and groovy scripts found in nexus-ingest, the machines that will be running Spring XD containers need to have some software installed on them.
-
-#### Anaconda
-
-1. Install [Anaconda 4.0.0](https://www.continuum.io/downloads) with Python 2.7
-2. Create an Anaconda environment
-
-    ````
-    conda create --name nexus-xd-python-modules python
-    ````
-    
-3. Install conda dependencies
-
-    ````
-    conda install libnetcdf
-    conda install netcdf4
-    conda install numpy
-    ````
-    
-4. Install [nexusproto](nexus-ingest/nexus-messages)
-5. Install [spring-xd-python](nexus-ingest/spring-xd-python)
-6. Install [nexus-xd-python-modules](nexus-ingest/nexus-xd-python-modules)
-
-#### Java 8
-
-1. Install Java 8 JDK. Either Oracle or OpenJDK.
-
-#### nexus-messages
-
-1. The [nexus-messages](nexus-ingest/nexus-messages) JAR needs to be available via Maven. There are a number of ways to do this. One way is to explicitly install the dependency into the local maven cache on each XD Container node.
-
-    ````
-    mvn install:install-file -DpomFile=nexus-messages-VERSION.xml -Dfile=nexus-messages-VERSION.jar
-    ````
-
-#### Groovy Scripts
-
-1. Place the [groovy-scripts](nexus-ingest/groovy-scripts) in a location that will be accessible to all XD Container nodes
-
-#### Custom Modules
-
-1. Upload the [dataset-tiler](nexus-ingest/dataset-tiler) custom module
-2. Upload the [tcpshell](nexus-ingest/tcp-shell) custom module
-3. Upload the [nexus-sink](nexus-ingest/nexus-sink) custom module