You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Miklos Szegedi <mi...@cloudera.com> on 2017/06/09 02:50:10 UTC
How to start impalad
Hello,
I built impala using the instructions here:
https://cwiki.apache.org/confluence/display/IMPALA/Bootstrapping+an+Impala+
Development+Environment+From+Scratch
My question is how to start it. When I launch impalad, it seems to start up
as statestored:
root@8682379ba09f:/incubator-impala/be/build/release/service# ps -Af
UID PID PPID C STIME TTY TIME CMD
root 1 0 0 02:10 ? 00:00:00 bash
root 22 1 0 02:11 ? 00:00:00 ./statestored
root 97 1 0 02:13 ? 00:00:01 ./catalogd
root 239 1 0 02:38 ? 00:00:00 ./impalad
--flagfile=/flags
root 279 1 0 02:44 ? 00:00:00 ps -Af
root@8682379ba09f:/incubator-impala/be/build/release/service# cat
/proc/239/net/tcp
sl local_address rem_address st tx_queue rx_queue tr tm->when retrnsmt
uid timeout inode
0: 00000000:5DC0 00000000:0000 0A 00000000:00000000 00:00000000 00000000
0 0 1072893 1 ffff880757a626c0 100 0 0 10 0
1: 00000000:61B2 00000000:0000 0A 00000000:00000000 00:00000000 00000000
0 0 922388 1 ffff88075b7dbe00 100 0 0 10 0
*5DC0 is port 24000 not 21000*
Here are my flags:
-beeswax_port=21000
-fe_port=21000
-be_port=22000
-llama_callback_port=28000
-hs2_port=21050
-enable_webserver=true
-mem_limit=21917574758
-max_log_files=10
-webserver_port=25000
-max_result_cache_size=100000
-state_store_subscriber_port=23000
-statestore_subscriber_timeout_seconds=30
-scratch_dirs=/impala/impalad
-default_query_options
-load_auth_to_local_rules=false
-log_filename=impalad
-audit_event_log_dir=/var/log/impalad/audit
-max_audit_event_log_file_size=5000
-abort_on_failed_audit_event=false
-minidump_path=/var/log/impala-minidumps
-max_minidumps=9
-lineage_event_log_dir=/var/log/impalad/lineage
-max_lineage_log_file_size=5000
-hostname=example.com
-state_store_host=localhost
-enable_rm=false
-state_store_port=24000
-catalog_service_host=localhost
-catalog_service_port=26000
-local_library_dir=/var/lib/impala/udfs
-disable_admission_control=false
-queue_wait_timeout_ms=60000
-disk_spill_encryption=false
-abort_on_config_error=true
-kudu_master_hosts=example.com
End of logs:
I0609 02:38:58.544764 239 init.cc:218] Cpu Info:
Model: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
Cores: 16
Max Possible Cores: 16
L1 Cache: 32.00 KB (Line: 64.00 B)
L2 Cache: 256.00 KB (Line: 64.00 B)
L3 Cache: 25.00 MB (Line: 64.00 B)
Hardware Supports:
ssse3
sse4_1
sse4_2
popcnt
avx
Numa Nodes: 1
Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 |
7->0 | 8->0 | 9->0 | 10->0 | 11->0 | 12->0 | 13->0 | 14->0 | 15->0 |
I0609 02:38:58.544772 239 init.cc:219] Disk Info:
Num disks 3:
xvda (rotational=false)
xvdb (rotational=false)
xvdc (rotational=false)
I0609 02:38:58.544790 239 init.cc:220] Physical Memory: 29.03 GB
I0609 02:38:58.544795 239 init.cc:221] OS version: Linux version
3.10.0-514.2.2.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version
4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) ) #1 SMP Tue Dec 6 23:06:41 UTC 2016
Clock: clocksource: 'xen', clockid_t: CLOCK_MONOTONIC_COARSE
I0609 02:38:58.544800 239 init.cc:222] Process ID: 239
Thanks,
Miklos
Re: How to start impalad
Posted by Tim Armstrong <ta...@cloudera.com>.
The development minicluster should have a statestored, a catalogd and three
impalads. Is that what you're seeing? In the local development environment
if you run ./bin/start-impala-cluster.py with no arguments that's what it
does by default.
On Thu, Jun 8, 2017 at 7:50 PM, Miklos Szegedi <mi...@cloudera.com>
wrote:
> Hello,
>
> I built impala using the instructions here:
> https://cwiki.apache.org/confluence/display/IMPALA/
> Bootstrapping+an+Impala+
> Development+Environment+From+Scratch
>
> My question is how to start it. When I launch impalad, it seems to start up
> as statestored:
>
> root@8682379ba09f:/incubator-impala/be/build/release/service# ps -Af
>
> UID PID PPID C STIME TTY TIME CMD
>
> root 1 0 0 02:10 ? 00:00:00 bash
>
> root 22 1 0 02:11 ? 00:00:00 ./statestored
>
> root 97 1 0 02:13 ? 00:00:01 ./catalogd
>
> root 239 1 0 02:38 ? 00:00:00 ./impalad
> --flagfile=/flags
>
> root 279 1 0 02:44 ? 00:00:00 ps -Af
>
> root@8682379ba09f:/incubator-impala/be/build/release/service# cat
> /proc/239/net/tcp
>
> sl local_address rem_address st tx_queue rx_queue tr tm->when retrnsmt
> uid timeout inode
>
> 0: 00000000:5DC0 00000000:0000 0A 00000000:00000000 00:00000000 00000000
> 0 0 1072893 1 ffff880757a626c0 100 0 0 10 0
>
> 1: 00000000:61B2 00000000:0000 0A 00000000:00000000 00:00000000 00000000
> 0 0 922388 1 ffff88075b7dbe00 100 0 0 10 0
>
> *5DC0 is port 24000 not 21000*
>
> Here are my flags:
>
> -beeswax_port=21000
>
> -fe_port=21000
>
> -be_port=22000
>
> -llama_callback_port=28000
>
> -hs2_port=21050
>
> -enable_webserver=true
>
> -mem_limit=21917574758
>
> -max_log_files=10
>
> -webserver_port=25000
>
> -max_result_cache_size=100000
>
> -state_store_subscriber_port=23000
>
> -statestore_subscriber_timeout_seconds=30
>
> -scratch_dirs=/impala/impalad
>
> -default_query_options
>
> -load_auth_to_local_rules=false
>
> -log_filename=impalad
>
> -audit_event_log_dir=/var/log/impalad/audit
>
> -max_audit_event_log_file_size=5000
>
> -abort_on_failed_audit_event=false
>
> -minidump_path=/var/log/impala-minidumps
>
> -max_minidumps=9
>
> -lineage_event_log_dir=/var/log/impalad/lineage
>
> -max_lineage_log_file_size=5000
>
> -hostname=example.com
>
> -state_store_host=localhost
>
> -enable_rm=false
>
> -state_store_port=24000
>
> -catalog_service_host=localhost
>
> -catalog_service_port=26000
>
> -local_library_dir=/var/lib/impala/udfs
>
> -disable_admission_control=false
>
> -queue_wait_timeout_ms=60000
>
> -disk_spill_encryption=false
>
> -abort_on_config_error=true
>
> -kudu_master_hosts=example.com
>
> End of logs:
> I0609 02:38:58.544764 239 init.cc:218] Cpu Info:
>
> Model: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
>
> Cores: 16
>
> Max Possible Cores: 16
>
> L1 Cache: 32.00 KB (Line: 64.00 B)
>
> L2 Cache: 256.00 KB (Line: 64.00 B)
>
> L3 Cache: 25.00 MB (Line: 64.00 B)
>
> Hardware Supports:
>
> ssse3
>
> sse4_1
>
> sse4_2
>
> popcnt
>
> avx
>
> Numa Nodes: 1
>
> Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 |
> 7->0 | 8->0 | 9->0 | 10->0 | 11->0 | 12->0 | 13->0 | 14->0 | 15->0 |
>
> I0609 02:38:58.544772 239 init.cc:219] Disk Info:
>
> Num disks 3:
>
> xvda (rotational=false)
>
> xvdb (rotational=false)
>
> xvdc (rotational=false)
>
> I0609 02:38:58.544790 239 init.cc:220] Physical Memory: 29.03 GB
>
> I0609 02:38:58.544795 239 init.cc:221] OS version: Linux version
> 3.10.0-514.2.2.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version
> 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) ) #1 SMP Tue Dec 6 23:06:41 UTC
> 2016
>
> Clock: clocksource: 'xen', clockid_t: CLOCK_MONOTONIC_COARSE
>
> I0609 02:38:58.544800 239 init.cc:222] Process ID: 239
>
> Thanks,
>
> Miklos
>