You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kudu.apache.org by mp...@apache.org on 2016/08/10 01:22:33 UTC
kudu-site git commit: Publish commit(s) from site source repo:
8a22002 www: Add Kudu talks to Community page e8ac68b Simple typo fix in faq:
'arge' => 'large'
Repository: kudu-site
Updated Branches:
refs/heads/asf-site 52755c93b -> 99b1911b1
Publish commit(s) from site source repo:
8a22002 www: Add Kudu talks to Community page
e8ac68b Simple typo fix in faq: 'arge' => 'large'
Site-Repo-Commit: 8a220027d2e5806b9232deb39fe233e689ee40a5
Project: http://git-wip-us.apache.org/repos/asf/kudu-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu-site/commit/99b1911b
Tree: http://git-wip-us.apache.org/repos/asf/kudu-site/tree/99b1911b
Diff: http://git-wip-us.apache.org/repos/asf/kudu-site/diff/99b1911b
Branch: refs/heads/asf-site
Commit: 99b1911b1f2e9241283005a5d7b9a5c7cca1d67e
Parents: 52755c9
Author: Mike Percy <mp...@cloudera.com>
Authored: Tue Aug 9 18:21:58 2016 -0700
Committer: Mike Percy <mp...@cloudera.com>
Committed: Tue Aug 9 18:21:58 2016 -0700
----------------------------------------------------------------------
2016/04/26/ycsb.html | 20 +++++++++++++-------
blog/page/2/index.html | 2 +-
blog/page/3/index.html | 2 +-
blog/page/4/index.html | 2 +-
blog/page/6/index.html | 12 ++++++------
community.html | 12 +++++++++---
faq.html | 2 +-
feed.xml | 4 ++--
8 files changed, 34 insertions(+), 22 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/2016/04/26/ycsb.html
----------------------------------------------------------------------
diff --git a/2016/04/26/ycsb.html b/2016/04/26/ycsb.html
index 73fb5d8..ddfd9e5 100644
--- a/2016/04/26/ycsb.html
+++ b/2016/04/26/ycsb.html
@@ -171,16 +171,22 @@
<p>Also note that the 99th percentile latency seems to alternate between close to zero and a value near 500ms. This bimodal distribution led me to grep in the Java source for the magic number 500. Sure enough, I found:</p>
-<pre><code class="language-java">public static final int SLEEP_TIME = 500;
-</code></pre>
+<div class="highlighter-coderay"><div class="CodeRay">
+ <div class="code"><pre><span class="line-numbers"><a href="#n1" name="n1">1</a></span><span style="color:#088;font-weight:bold">public</span> <span style="color:#088;font-weight:bold">static</span> <span style="color:#088;font-weight:bold">final</span> <span style="color:#339;font-weight:bold">int</span> SLEEP_TIME = <span style="color:#00D">500</span>;
+</pre></div>
+</div>
+</div>
<p>Used in this backoff calculation method (slightly paraphrased here):</p>
-<pre><code class="language-java"> long getSleepTimeForRpc(KuduRpc<?> rpc) {
- // TODO backoffs? Sleep in increments of 500 ms, plus some random time up to 50
- return (attemptCount * SLEEP_TIME) + sleepRandomizer.nextInt(50);
- }
-</code></pre>
+<div class="highlighter-coderay"><div class="CodeRay">
+ <div class="code"><pre><span class="line-numbers"><a href="#n1" name="n1">1</a></span> <span style="color:#339;font-weight:bold">long</span> getSleepTimeForRpc(KuduRpc<?> rpc) {
+<span class="line-numbers"><a href="#n2" name="n2">2</a></span> <span style="color:#777">// TODO backoffs? Sleep in increments of 500 ms, plus some random time up to 50</span>
+<span class="line-numbers"><a href="#n3" name="n3">3</a></span> <span style="color:#080;font-weight:bold">return</span> (attemptCount * SLEEP_TIME) + sleepRandomizer.nextInt(<span style="color:#00D">50</span>);
+<span class="line-numbers"><a href="#n4" name="n4">4</a></span> }
+</pre></div>
+</div>
+</div>
<p>One reason that a client will back off and retry is a <code>SERVER_TOO_BUSY</code> response from the server. This response is used in a number of overload situations. In a write-mostly workload, the most likely situation is that the server is low on memory and thus asking clients to back off while it flushes. Sure enough, when we graph the heap usage over time, as well as the rate of writes rejected due to low-memory, we see that this is the case:</p>
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/blog/page/2/index.html
----------------------------------------------------------------------
diff --git a/blog/page/2/index.html b/blog/page/2/index.html
index d93e5b6..ab1851f 100644
--- a/blog/page/2/index.html
+++ b/blog/page/2/index.html
@@ -167,7 +167,7 @@ covers ongoing development and news in the Apache Kudu (incubating) project.</p>
<div class="entry-content">
<p>This blog post describes how the 1.0 release of Apache Kudu (incubating) will
-support fault tolerance for the Kudu master, finally eliminating Kudu’s last
+support fault tolerance for the Kudu master, finally eliminating Kudu\u2019s last
single point of failure.</p>
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/blog/page/3/index.html
----------------------------------------------------------------------
diff --git a/blog/page/3/index.html b/blog/page/3/index.html
index ac6b2f3..cf9b5b8 100644
--- a/blog/page/3/index.html
+++ b/blog/page/3/index.html
@@ -141,7 +141,7 @@ covers ongoing development and news in the Apache Kudu (incubating) project.</p>
0.9.0!</p>
<p>This latest version adds basic UPSERT functionality and an improved Apache Spark Data Source
-that doesn’t rely on the MapReduce I/O formats. It also improves Tablet Server
+that doesn\u2019t rely on the MapReduce I/O formats. It also improves Tablet Server
restart time as well as write performance under high load. Finally, Kudu now enforces
the specification of a partitioning scheme for new tables.</p>
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/blog/page/4/index.html
----------------------------------------------------------------------
diff --git a/blog/page/4/index.html b/blog/page/4/index.html
index 64bcb7e..04fb8de 100644
--- a/blog/page/4/index.html
+++ b/blog/page/4/index.html
@@ -200,7 +200,7 @@ covers ongoing development and news in the Apache Kudu (incubating) project.</p>
</header>
<div class="entry-content">
- <p>Recently, I wanted to stress-test and benchmark some changes to the Kudu RPC server, and decided to use YCSB as a way to generate reasonable load. While running YCSB, I noticed interesting results, and what started as an unrelated testing exercise eventually yielded some new insights into Kudu’s behavior. These insights will motivate changes to default Kudu settings and code in upcoming versions. This post details the benchmark setup, analysis, and conclusions.</p>
+ <p>Recently, I wanted to stress-test and benchmark some changes to the Kudu RPC server, and decided to use YCSB as a way to generate reasonable load. While running YCSB, I noticed interesting results, and what started as an unrelated testing exercise eventually yielded some new insights into Kudu\u2019s behavior. These insights will motivate changes to default Kudu settings and code in upcoming versions. This post details the benchmark setup, analysis, and conclusions.</p>
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/blog/page/6/index.html
----------------------------------------------------------------------
diff --git a/blog/page/6/index.html b/blog/page/6/index.html
index ba12bc9..779133e 100644
--- a/blog/page/6/index.html
+++ b/blog/page/6/index.html
@@ -158,8 +158,8 @@ covers ongoing development and news in the Apache Kudu (incubating) project.</p>
</header>
<div class="entry-content">
- <p>Welcome to the second edition of the Kudu Weekly Update. As with last week’s
-inaugural post, we’ll cover ongoing development and news in the Apache Kudu
+ <p>Welcome to the second edition of the Kudu Weekly Update. As with last week\u2019s
+inaugural post, we\u2019ll cover ongoing development and news in the Apache Kudu
project on a weekly basis.</p>
@@ -180,13 +180,13 @@ project on a weekly basis.</p>
</header>
<div class="entry-content">
- <p>Kudu is a fast-moving young open source project, and we’ve heard from a few
-members of the community that it can be difficult to keep track of what’s
+ <p>Kudu is a fast-moving young open source project, and we\u2019ve heard from a few
+members of the community that it can be difficult to keep track of what\u2019s
going on day-to-day. A typical month comprises 80-100 individual patches
committed and hundreds of code review and discussion
emails. So, inspired by similar weekly newsletters like
-<a href="http://llvmweekly.org/">LLVM Weekly</a> and <a href="http://lwn.net/Kernel/">LWN’s weekly kernel coverage</a>
-we’re going to experiment with our own weekly newsletter covering
+<a href="http://llvmweekly.org/">LLVM Weekly</a> and <a href="http://lwn.net/Kernel/">LWN\u2019s weekly kernel coverage</a>
+we\u2019re going to experiment with our own weekly newsletter covering
recent development and Kudu-related news.</p>
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/community.html
----------------------------------------------------------------------
diff --git a/community.html b/community.html
index 98e5a8c..0d17d99 100644
--- a/community.html
+++ b/community.html
@@ -229,8 +229,14 @@ so that we can feature them.</p>
<p><strong>Presentations about Kudu are planned or have taken place at the following events:</strong></p>
<ol>
- <li>Wed, May 25, 2016. <a href="http://www.meetup.com/DFW-Cloudera-User-Group/events/230547045/">Dallas/Fort Worth Cloudera User Group</a>.
- <em>Apache Kudu: New Apache Hadoop Storage for Fast Analytics on Fast Data</em>. Presented by Ryan Bosshart.</li>
+ <li>Thu, Aug 18, 2016. <a href="http://www.meetup.com/Boulder-Denver-Big-Data/events/232056701/">Boulder/Denver Big Data Meetup</a>. Broomfield, CO, USA.<br />
+<em>Apache Kudu: New Apache Hadoop Storage for Fast Analytics on Fast Data</em>. Presented by Mike Percy.</li>
+ <li>Wed, Aug 17, 2016. <a href="http://www.meetup.com/Denver-Cloudera-User-Group/events/232782782/">Denver Cloudera User Group</a>. Greenwood Village, CO, USA.<br />
+<em>Apache Kudu: New Apache Hadoop Storage for Fast Analytics on Fast Data</em>. Presented by Mike Percy.</li>
+ <li>Thu, July 21, 2016. <a href="http://www.meetup.com/SVBigData/events/230427069/">Silicon Valley Big Data Meetup</a>. Palo Alto, CA, USA.<br />
+<em>Apache Kudu (incubating): New Apache Hadoop Storage for Fast Analytics on Fast Data</em>. Presented by Mike Percy.</li>
+ <li>Wed, May 25, 2016. <a href="http://www.meetup.com/DFW-Cloudera-User-Group/events/230547045/">Dallas/Fort Worth Cloudera User Group</a>. Dallas, TX, USA.<br />
+<em>Apache Kudu: New Apache Hadoop Storage for Fast Analytics on Fast Data</em>. Presented by Ryan Bosshart.</li>
<li>Thu, May 12, 2016. <a href="http://www.meetup.com/Vancouver-Spark/events/229692936/">Vancouver Spark Meetup</a>. Vancouver, BC, Canada.<br />
<em>Kudu and Spark for fast analytics on streaming data</em>. Presented by Mike Percy and Dan Burkert.</li>
<li>Tue, May 10, 2016. <a href="http://apachebigdata2016.sched.org/event/6M1k/using-kafka-and-kudu-for-fast-low-latency-sql-analytics-on-streaming-data-mike-percy-ashish-singh-cloudera">Apache: Big Data 2016</a>. Vancouver, BC, Canada.<br />
@@ -240,7 +246,7 @@ so that we can feature them.</p>
<li>Wed, May 4, 2016. <a href="http://www.meetup.com/Cloudera-Tech-Meetup/events/230169394">Cloudera Tech Meetup</a>. Budapest, Hungary.<br />
<em>Apache Kudu (incubating): New Apache Hadoop Storage for Fast Analytics on Fast Data</em>. Presented by Adar Dembo.</li>
<li>Fri, Apr 8, 2016. <a href="http://www.dataengconf.com/hadoop-vs-kudu">DataEngConf</a>. San Francisco, CA, USA.<br />
- <em>Resolving Transactional Access/Analytic Performance Trade-offs in Apache Hadoop with Apache Kudu</em>.</li>
+<em>Resolving Transactional Access/Analytic Performance Trade-offs in Apache Hadoop with Apache Kudu</em>.</li>
<li>Thu, Mar 31, 2016. <a href="http://conferences.oreilly.com/strata/hadoop-big-data-ca/public/schedule/detail/47055">Strata Hadoop World</a>. San Jose, CA, USA.<br />
<em>Fast data made easy with Apache Kafka and Apache Kudu (incubating)</em>. Presented by Ted Malaska and Jeff Holoman.</li>
<li>Sat, Mar 19, 2016. <a href="http://chinahadoop.com/archives/1313">China Hadoop Summit 2016</a>. Beijing, China.<br />
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/faq.html
----------------------------------------------------------------------
diff --git a/faq.html b/faq.html
index e5110be..e69d9a1 100644
--- a/faq.html
+++ b/faq.html
@@ -270,7 +270,7 @@ share the same partitions as existing HDFS datanodes.</p>
<p>By default, HBase uses range based distribution. Range based partitioning stores
ordered values that fit within a specified range of a provided key contiguously
-on disk. Range based partitioning is efficient when there are arge numbers of
+on disk. Range based partitioning is efficient when there are large numbers of
concurrent small queries, as only servers in the cluster that have values within
the range specified by the query will be recruited to process that query. Range
partitioning is susceptible to hotspots, either because the key(s) used to
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/99b1911b/feed.xml
----------------------------------------------------------------------
diff --git a/feed.xml b/feed.xml
index cc8f82e..e74de9a 100644
--- a/feed.xml
+++ b/feed.xml
@@ -1,4 +1,4 @@
-<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom"><generator uri="http://jekyllrb.com" version="2.5.3">Jekyll</generator><link href="/feed.xml" rel="self" type="application/atom+xml" /><link href="/" rel="alternate" type="text/html" /><updated>2016-08-08T15:39:31-07:00</updated><id>/</id><entry><title>Apache Kudu Weekly Update August 8th, 2016</title><link href="/2016/08/08/weekly-update.html" rel="alternate" type="text/html" title="Apache Kudu Weekly Update August 8th, 2016" /><published>2016-08-08T00:00:00-07:00</published><updated>2016-08-08T00:00:00-07:00</updated><id>/2016/08/08/weekly-update</id><content type="html" xml:base="/2016/08/08/weekly-update.html"><p>Welcome to the nineteenth edition of the Kudu Weekly Update. This weekly blog post
+<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom"><generator uri="http://jekyllrb.com" version="2.5.3">Jekyll</generator><link href="/feed.xml" rel="self" type="application/atom+xml" /><link href="/" rel="alternate" type="text/html" /><updated>2016-08-09T18:21:56-07:00</updated><id>/</id><entry><title>Apache Kudu Weekly Update August 8th, 2016</title><link href="/2016/08/08/weekly-update.html" rel="alternate" type="text/html" title="Apache Kudu Weekly Update August 8th, 2016" /><published>2016-08-08T00:00:00-07:00</published><updated>2016-08-08T00:00:00-07:00</updated><id>/2016/08/08/weekly-update</id><content type="html" xml:base="/2016/08/08/weekly-update.html"><p>Welcome to the nineteenth edition of the Kudu Weekly Update. This weekly blog post
covers ongoing development and news in the Apache Kudu project.</p>
<!--more-->
@@ -519,7 +519,7 @@ three-node (or five-node) deployment.</li>
<a href="https://issues.apache.org/jira/browse/KUDU-1474">KUDU-1474</a>, and there\u2019s been
<a href="http://gerrit.cloudera.org:8080/3393">some discussion</a> around a design, but
nothing has been implemented yet. Stay tuned!</p></content><author><name>Adar Dembo</name></author><summary>This blog post describes how the 1.0 release of Apache Kudu (incubating) will
-support fault tolerance for the Kudu master, finally eliminating Kudu&#8217;s last
+support fault tolerance for the Kudu master, finally eliminating Kudu\u2019s last
single point of failure.</summary></entry><entry><title>Apache Kudu (incubating) Weekly Update June 21, 2016</title><link href="/2016/06/21/weekly-update.html" rel="alternate" type="text/html" title="Apache Kudu (incubating) Weekly Update June 21, 2016" /><published>2016-06-21T00:00:00-07:00</published><updated>2016-06-21T00:00:00-07:00</updated><id>/2016/06/21/weekly-update</id><content type="html" xml:base="/2016/06/21/weekly-update.html"><p>Welcome to the fourteenth edition of the Kudu Weekly Update. This weekly blog post
covers ongoing development and news in the Apache Kudu (incubating) project.</p>