You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@kudu.apache.org by "Will Berkeley (Code Review)" <ge...@cloudera.org> on 2017/12/14 17:56:39 UTC
[kudu-CR] [docs] Add scaling guide
Will Berkeley has uploaded this change for review. ( http://gerrit.cloudera.org:8080/8842
Change subject: [docs] Add scaling guide
......................................................................
[docs] Add scaling guide
This adds some more detailed information on how Kudu scales w.r.t
several resources and provides some background on the scale limits
and how to plan capacity for a Kudu deployment.
Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
---
A docs/scaling.adoc
1 file changed, 184 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/42/8842/1
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 1
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 3:
(7 comments)
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc
File docs/scaling_guide.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@15
PS3, Line 15: Please
> Remove
Done
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@20
PS3, Line 20: on use
> a line break?
Done
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@28
PS3, Line 28: a
> A
Done
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@31
PS3, Line 31: a
> A
Done
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@32
PS3, Line 32: say
> for example,
Done
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@35
PS3, Line 35: the
> The
Done
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@165
PS3, Line 165: limit
> OS limit
Done
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 3
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Alex Rodoni <ar...@cloudera.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Thu, 08 Feb 2018 18:43:54 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Alex Rodoni (Code Review)" <ge...@cloudera.org>.
Alex Rodoni has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 3:
(7 comments)
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc
File docs/scaling_guide.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@15
PS3, Line 15: Please
Remove
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@20
PS3, Line 20: on use
a line break?
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@28
PS3, Line 28: a
A
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@31
PS3, Line 31: a
A
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@32
PS3, Line 32: say
for example,
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@35
PS3, Line 35: the
The
http://gerrit.cloudera.org:8080/#/c/8842/3/docs/scaling_guide.adoc@165
PS3, Line 165: limit
OS limit
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 3
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Alex Rodoni <ar...@cloudera.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Tue, 06 Feb 2018 23:48:50 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Mike Percy (Code Review)" <ge...@cloudera.org>.
Mike Percy has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 4: Verified+1 Code-Review+2
(1 comment)
Nice work!
http://gerrit.cloudera.org:8080/#/c/8842/4/docs/scaling_guide.adoc
File docs/scaling_guide.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/4/docs/scaling_guide.adoc@67
PS4, Line 67: Hot Replicas
Potential pop group name?
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 4
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Alex Rodoni <ar...@cloudera.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Tue, 13 Feb 2018 02:59:57 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
[docs] Add scaling guide
This adds some more detailed information on how Kudu scales w.r.t
several resources and provides some background on the scale limits
and how to plan capacity for a Kudu deployment.
Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Reviewed-on: http://gerrit.cloudera.org:8080/8842
Reviewed-by: Mike Percy <mp...@apache.org>
Tested-by: Mike Percy <mp...@apache.org>
---
A docs/scaling_guide.adoc
1 file changed, 182 insertions(+), 0 deletions(-)
Approvals:
Mike Percy: Looks good to me, approved; Verified
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 5
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Alex Rodoni <ar...@cloudera.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Hello Mike Percy, Jean-Daniel Cryans, Kudu Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/8842
to look at the new patch set (#2).
Change subject: [docs] Add scaling guide
......................................................................
[docs] Add scaling guide
This adds some more detailed information on how Kudu scales w.r.t
several resources and provides some background on the scale limits
and how to plan capacity for a Kudu deployment.
Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
---
A docs/scaling_guide.adoc
1 file changed, 183 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/42/8842/2
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 2
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 1:
Check out https://github.com/wdberkeley/kudu/blob/showdocs/docs/scaling.adoc
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 1
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Fri, 15 Dec 2017 18:46:24 +0000
Gerrit-HasComments: No
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Hello Mike Percy, Jean-Daniel Cryans, Kudu Jenkins, Todd Lipcon,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/8842
to look at the new patch set (#3).
Change subject: [docs] Add scaling guide
......................................................................
[docs] Add scaling guide
This adds some more detailed information on how Kudu scales w.r.t
several resources and provides some background on the scale limits
and how to plan capacity for a Kudu deployment.
Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
---
A docs/scaling_guide.adoc
1 file changed, 182 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/42/8842/3
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 3
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
[kudu-CR] [docs] Add scaling guide
Posted by "Mike Percy (Code Review)" <ge...@cloudera.org>.
Mike Percy has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 1:
Mind pushing a rev of this to your personal GitHub so we can read it rendered? i.e. https://github.com/mpercy/kudu/blob/master/docs/schema_design.adoc or something like that.
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 1
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Fri, 15 Dec 2017 01:26:50 +0000
Gerrit-HasComments: No
[kudu-CR] [docs] Add scaling guide
Posted by "Mike Percy (Code Review)" <ge...@cloudera.org>.
Mike Percy has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 1:
(17 comments)
This is a great and useful doc. I did a first pass, and while I didn't validate the numbers and have various "usability" related comments.
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc
File docs/scaling.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@1
PS1, Line 1: [[scaling]]
name this file scaling_guide.adoc for SEO reasons
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@2
PS1, Line 2: Scaling
Scaling Guide
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@13
PS1, Line 13:
Add a blurb at the top of this document describing the purpose of the document
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@46
PS1, Line 46: /
nit: missing space before slash
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@57
PS1, Line 57: Memory
Memory Consumption?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@61
PS1, Line 61: baseline
rough estimate
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@62
PS1, Line 62: limit
approximate memory requirements
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@66
PS1, Line 66: Scaling
Is scaling the right word here?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@68
PS1, Line 68: Data on disk
"Memory required per TB of data on disk" ?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@68
PS1, Line 68: /
Here and below, i mentally read this as "divided by" when you mean "per". I think we should write out "per" here.
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@95
PS1, Line 95: Verifying a Memory Limit
Verifying if the memory limit is sufficient?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@129
PS1, Line 129: | File cache | 40% of process maximum | Percentage of maximum allowed open fds reserved for use by
can we indicate how this can be tuned?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@133
PS1, Line 133: /
per
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@150
PS1, Line 150: / cold replica
how about: * 1600 cold replicas
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@151
PS1, Line 151: | 200 hot replicas | 2 / segment * 10 segments/hot replica * 200 hot replicas + 1 / index * 10 indices / hot replica * 200 hot replicas = 6000 fds
having a hard time parsing this expression; consider writing it like (2 fds * 10 segments * 200 hot replicas) + (1 fd * 10 indices * 200 hot replicas) = 6000 fds
except frankly i'm not sure how you're supposed to know how many WAL indexes there are and you might need to state some assumptions here given that we say there are 200 hot replicas
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@177
PS1, Line 177: /
nit: per, here and below
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@183
PS1, Line 183: /
per
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 1
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Fri, 15 Dec 2017 23:25:32 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 1:
(16 comments)
New rendering: https://github.com/wdberkeley/kudu/blob/scalingguide/docs/scaling_guide.adoc
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc
File docs/scaling.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@1
PS1, Line 1: [[scaling]]
> name this file scaling_guide.adoc for SEO reasons
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@2
PS1, Line 2: Scaling
> Scaling Guide
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@13
PS1, Line 13:
> Add a blurb at the top of this document describing the purpose of the docum
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@46
PS1, Line 46: /
> nit: missing space before slash
s|/|per|g
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@57
PS1, Line 57: Memory
> Memory Consumption?
The section titles name the resource being examined: Memory, File Descriptors, Threads; they could equally be the Memory Consumption, File Descriptor Consumption, Thread Consumption, or s/Consumption/Usage/g, but I don't want to be inconsistent and have e.g. "Memory Consumption" but then "Threads". Which variation do you prefer?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@61
PS1, Line 61: baseline
> rough estimate
The full phrase would be "provides a rough estimate for computing an appropriate memory limit", which doesn't sound like a correct use of the noun "estimate" to me since the "estimate" here is a table, not a number plugged in to a formula. Maybe you'd prefer "The following table provides numbers that can be used to compute a rough estimate of memory usage"?
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@62
PS1, Line 62: limit
> approximate memory requirements
N/A b/c whole sentence was changed.
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@66
PS1, Line 66: Scaling
> Is scaling the right word here?
I think it's an appropriate word, since the values in this column describe how a measure of size multiplies into a measure of resources used, but maybe it's not "le mot juste". I'll try out another :)
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@68
PS1, Line 68: /
> Here and below, i mentally read this as "divided by" when you mean "per". I
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@68
PS1, Line 68: Data on disk
> "Memory required per TB of data on disk" ?
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@95
PS1, Line 95: Verifying a Memory Limit
> Verifying if the memory limit is sufficient?
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@129
PS1, Line 129: | File cache | 40% of process maximum | Percentage of maximum allowed open fds reserved for use by
> can we indicate how this can be tuned?
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@133
PS1, Line 133: /
> per
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@150
PS1, Line 150: / cold replica
> how about: * 1600 cold replicas
Done
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@151
PS1, Line 151: | 200 hot replicas | 2 / segment * 10 segments/hot replica * 200 hot replicas + 1 / index * 10 indices / hot replica * 200 hot replicas = 6000 fds
> having a hard time parsing this expression; consider writing it like (2 fds
I thought we chatted about this and the conclusion was that there's more or less 1 index / segment.
http://gerrit.cloudera.org:8080/#/c/8842/1/docs/scaling.adoc@183
PS1, Line 183: /
> per
I prefer the / when doing a calculation.
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 1
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Thu, 21 Dec 2017 16:11:41 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 2:
(2 comments)
http://gerrit.cloudera.org:8080/#/c/8842/2/docs/scaling_guide.adoc
File docs/scaling_guide.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/2/docs/scaling_guide.adoc@22
PS2, Line 22: The recommendations and conclusions here are only approximations. Appropriate numbers depend on use
: case. There is no substitute for measurement and monitoring of resources used during a
: representative workload.
> is there some adoc syntax we can use to make this show up with a big warnin
Done
http://gerrit.cloudera.org:8080/#/c/8842/2/docs/scaling_guide.adoc@88
PS2, Line 88: | Total | 38.5GB
> maybe make two separate rows here -- one for "expected memory usage" and on
Done
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 2
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Mon, 05 Feb 2018 18:07:51 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 2:
New rendering at https://github.com/wdberkeley/kudu/blob/scalingdoc/docs/scaling_guide.adoc
Note the "Warning" box shows up as a big exclamation mark when rendered on the Kudu website, e.g. http://kudu.apache.org/docs/administration.html#_collecting_metrics_to_a_log.
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 2
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Mon, 05 Feb 2018 18:08:55 +0000
Gerrit-HasComments: No
[kudu-CR] [docs] Add scaling guide
Posted by "Todd Lipcon (Code Review)" <ge...@cloudera.org>.
Todd Lipcon has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 2:
(2 comments)
http://gerrit.cloudera.org:8080/#/c/8842/2/docs/scaling_guide.adoc
File docs/scaling_guide.adoc:
http://gerrit.cloudera.org:8080/#/c/8842/2/docs/scaling_guide.adoc@22
PS2, Line 22: The recommendations and conclusions here are only approximations. Appropriate numbers depend on use
: case. There is no substitute for measurement and monitoring of resources used during a
: representative workload.
is there some adoc syntax we can use to make this show up with a big warning exclamation point?
http://gerrit.cloudera.org:8080/#/c/8842/2/docs/scaling_guide.adoc@88
PS2, Line 88: | Total | 38.5GB
maybe make two separate rows here -- one for "expected memory usage" and one for "recommmended hard limit" so that the expected memory is only 75% of the recommmendation, per the paragraph below?
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 2
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Thu, 04 Jan 2018 21:53:44 +0000
Gerrit-HasComments: Yes
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Hello Alex Rodoni, Mike Percy, Jean-Daniel Cryans, Kudu Jenkins, Todd Lipcon,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/8842
to look at the new patch set (#4).
Change subject: [docs] Add scaling guide
......................................................................
[docs] Add scaling guide
This adds some more detailed information on how Kudu scales w.r.t
several resources and provides some background on the scale limits
and how to plan capacity for a Kudu deployment.
Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
---
A docs/scaling_guide.adoc
1 file changed, 182 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/42/8842/4
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 4
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Alex Rodoni <ar...@cloudera.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
[kudu-CR] [docs] Add scaling guide
Posted by "Mike Percy (Code Review)" <ge...@cloudera.org>.
Mike Percy has removed a vote on this change.
Change subject: [docs] Add scaling guide
......................................................................
Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 4
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Alex Rodoni <ar...@cloudera.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Todd Lipcon <to...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
[kudu-CR] [docs] Add scaling guide
Posted by "Will Berkeley (Code Review)" <ge...@cloudera.org>.
Will Berkeley has posted comments on this change. ( http://gerrit.cloudera.org:8080/8842 )
Change subject: [docs] Add scaling guide
......................................................................
Patch Set 1:
Mike also suggested this could be a blog post, in case it doesn't fit well as docs because it could become stale too quickly or some other reason.
--
To view, visit http://gerrit.cloudera.org:8080/8842
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I38d8999addc41fe0b726342a27dbba199ddf7dd2
Gerrit-Change-Number: 8842
Gerrit-PatchSet: 1
Gerrit-Owner: Will Berkeley <wd...@gmail.com>
Gerrit-Reviewer: Jean-Daniel Cryans <jd...@apache.org>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>
Gerrit-Comment-Date: Thu, 14 Dec 2017 19:14:57 +0000
Gerrit-HasComments: No