You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by Revan1988 <an...@gmail.com> on 2015/06/04 10:58:14 UTC
Configure accumulo-env.sh with 40GB of memory
Hi,
In my server (only one cluster) i've got 40GB of memory size.
I configured my accumulo-env.sh in this way:
is it a good configuration?
on my hardware (8 core/40gb/btfs hdd 7200) i've got about 50k~150k
ingest/second... it's a good performance?
<http://apache-accumulo.1065345.n5.nabble.com/file/n14304/Schermata_2015-06-04_alle_10.png>
Thank you very much!
-----
Andrea Leoni
Italy
Computer Engineer
--
View this message in context: http://apache-accumulo.1065345.n5.nabble.com/Configure-accumulo-env-sh-with-40GB-of-memory-tp14304.html
Sent from the Developers mailing list archive at Nabble.com.
Re: Configure accumulo-env.sh with 40GB of memory
Posted by Revan1988 <an...@gmail.com>.
I've got a single node... here's my config:
test -z "$ACCUMULO_TSERVER_OPTS" && export ACCUMULO_TSERVER_OPTS="${POLICY}
-Xmx10g -Xms10g"
test -z "$ACCUMULO_MASTER_OPTS" && export ACCUMULO_MASTER_OPTS="${POLICY}
-Xmx6g -Xms6g"
test -z "$ACCUMULO_MONITOR_OPTS" && export ACCUMULO_MONITOR_OPTS="${POLICY}
-Xmx1g -Xms256m"
test -z "$ACCUMULO_GC_OPTS" && export ACCUMULO_GC_OPTS="-Xmx1g -Xms1g"
test -z "$ACCUMULO_GENERAL_OPTS" && export
ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -Djava.net.preferIPv4Stack=true"
test -z "$ACCUMULO_OTHER_OPTS" && export ACCUMULO_OTHER_OPTS="-Xmx1g
-Xms256m"
Thank you!
-----
Andrea Leoni
Italy
Computer Engineer
--
View this message in context: http://apache-accumulo.1065345.n5.nabble.com/Configure-accumulo-env-sh-with-40GB-of-memory-tp14304p14362.html
Sent from the Developers mailing list archive at Nabble.com.
Re: Configure accumulo-env.sh with 40GB of memory
Posted by Eric Newton <er...@gmail.com>.
The apache mailing lists do not pass through email attachments. You could
try posting your config on https://paste.apache.org/.
150K / node for small, independent mutations is very good.
Make sure you have 20-80 splits (total) per node, for the tables you are
ingesting. You may be limited by the number / threads you have in your
client.
-Eric
On Thu, Jun 4, 2015 at 4:58 AM, Revan1988 <an...@gmail.com> wrote:
> Hi,
> In my server (only one cluster) i've got 40GB of memory size.
> I configured my accumulo-env.sh in this way:
>
>
>
> is it a good configuration?
> on my hardware (8 core/40gb/btfs hdd 7200) i've got about 50k~150k
> ingest/second... it's a good performance?
>
> <
> http://apache-accumulo.1065345.n5.nabble.com/file/n14304/Schermata_2015-06-04_alle_10.png
> >
>
>
> Thank you very much!
>
>
>
> -----
> Andrea Leoni
> Italy
> Computer Engineer
> --
> View this message in context:
> http://apache-accumulo.1065345.n5.nabble.com/Configure-accumulo-env-sh-with-40GB-of-memory-tp14304.html
> Sent from the Developers mailing list archive at Nabble.com.
>