You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "YoungWoo Kim (JIRA)" <ji...@apache.org> on 2015/02/17 08:17:12 UTC
[jira] [Updated] (BIGTOP-1561) Add Presto as a component
[ https://issues.apache.org/jira/browse/BIGTOP-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
YoungWoo Kim updated BIGTOP-1561:
---------------------------------
Attachment: BIGTOP-1561.1.patch
Patch, [^BIGTOP-1561.1.patch]:
I revise my stuff to build Presto on Bigtop. Attached a *WIP* patch.
Regarding build and Installation on single-node presto server:
1) Build requirements - JDK8 and Maven 3.2.3 or higher:
{noformat}
# export JAVA8_HOME=/usr/lib/jvm/java-1.8.0
# export export JAVA_HOME=$JAVA8_HOME
{noformat}
2) Build
{noformat}
# apply the patch...and then
# ./gradlew presto-rpm
...
# ls -als output/presto/*/*
296 -rw-r--r--. 1 root root 300368 2015-02-17 15:38 output/presto/noarch/presto-doc-0.93-1.el6.noarch.rpm
5112 -rw-r--r--. 1 root root 5233672 2015-02-17 15:38 output/presto/noarch/presto-jdbc-0.93-1.el6.noarch.rpm
352456 -rw-r--r--. 1 root root 360906880 2015-02-17 15:38 output/presto/x86_64/presto-0.93-1.el6.x86_64.rpm
10552 -rw-r--r--. 1 root root 10803264 2015-02-17 15:38 output/presto/x86_64/presto-cli-0.93-1.el6.x86_64.rpm
4 -rw-r--r--. 1 root root 1648 2015-02-17 15:38 output/presto/x86_64/presto-debuginfo-0.93-1.el6.x86_64.rpm
8 -rw-r--r--. 1 root root 4284 2015-02-17 15:38 output/presto/x86_64/presto-server-0.93-1.el6.x86_64.rpm
45004 -rw-r--r--. 1 root root 46080608 2015-02-17 15:38 output/presto/x86_64/presto-verifier-0.93-1.el6.x86_64.rpm
{noformat}
3) Install presto-server and presto-cli:
{noformat}
{noformat}
4) Edit /etc/default/presto.
{noformat}
JAVA8_HOME=/usr/lib/jvm/java-1.8.0
export JAVA_HOME=${JAVA8_HOME}
export PATH=${JAVA8_HOME}/bin:$PATH
{noformat}
5) Edit /etc/presto/etc/config.properties:
{noformat}
coordinator=true
node-scheduler.include-coordinator=true
http-server.http.port=8080
task.max-memory=1GB
discovery-server.enabled=true
discovery.uri=http://HOSTNAME:8080
{noformat}
HOSTNAME Should be replaced your vm' or host' hostname (e.g., $ hostname -f)
6) Start presto-server:
{noformat}
# service presto-server start
{noformat}
7) Run presto-cli like below:
{noformat}
presto:jmx> show catalogs;
Catalog
---------
jmx
tpch
(2 rows)
Query 20150217_065531_00012_czxxz, FINISHED, 1 node
Splits: 2 total, 2 done (100.00%)
0:00 [2 rows, 14B] [22 rows/s, 159B/s]
presto:jmx> show schemas from jmx;
Schema
--------------------
information_schema
jmx
sys
(3 rows)
Query 20150217_065617_00015_czxxz, FINISHED, 1 node
Splits: 2 total, 2 done (100.00%)
0:00 [3 rows, 75B] [40 rows/s, 1004B/s]
presto:jmx> use jmx.sys;
presto:sys> show tables;
Table
---------
catalog
node
query
task
(4 rows)
Query 20150217_065633_00018_czxxz, FINISHED, 1 node
Splits: 2 total, 2 done (100.00%)
0:00 [4 rows, 144B] [66 rows/s, 2.33KB/s]
presto:sys> select * from node;
node_id | http_uri | node_version | is_active
---------+----------------------------+------------------+-----------
NODE_ID | http://172.27.199.181:8080 | presto-main:0.93 | true
(1 row)
Query 20150217_065639_00019_czxxz, FINISHED, 1 node
Splits: 2 total, 2 done (100.00%)
0:00 [1 rows, 50B] [22 rows/s, 1.09KB/s]
presto:sys> show schemas from tpch;
Schema
--------------------
information_schema
sf1
sf100
sf1000
sf10000
sf100000
sf300
sf3000
sf30000
sys
tiny
(11 rows)
Query 20150217_065711_00020_czxxz, FINISHED, 1 node
Splits: 2 total, 2 done (100.00%)
0:00 [11 rows, 163B] [247 rows/s, 3.59KB/s]
presto:sys> use tpch.sf1;
presto:sf1> show tables;
Table
----------
customer
lineitem
nation
orders
part
partsupp
region
supplier
(8 rows)
Query 20150217_065736_00023_czxxz, FINISHED, 1 node
Splits: 2 total, 2 done (100.00%)
0:00 [8 rows, 230B] [153 rows/s, 4.32KB/s]
presto:sf1> select count(*) from customer;
_col0
--------
150000
(1 row)
Query 20150217_065746_00024_czxxz, FINISHED, 1 node
Splits: 9 total, 9 done (100.00%)
0:04 [150K rows, 0B] [36.7K rows/s, 0B/s]
presto:sf1> exit;
{noformat}
Now, 'jmx' and 'tpch' are built-in catalogs for default.
I'll update this patch and add instructions for integrate Hadoop and Hive.
> Add Presto as a component
> -------------------------
>
> Key: BIGTOP-1561
> URL: https://issues.apache.org/jira/browse/BIGTOP-1561
> Project: Bigtop
> Issue Type: Bug
> Components: general
> Affects Versions: backlog
> Reporter: Rob Leidle
> Fix For: backlog
>
> Attachments: BIGTOP-1561.1.patch
>
>
> Bring Presto into Bigtop
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)