You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kafka.apache.org by jk...@apache.org on 2013/06/28 02:33:04 UTC
svn commit: r1497623 - in /kafka/site: ./ 07/ 07/includes/ 08/ 08/includes/
images/ includes/
Author: jkreps
Date: Fri Jun 28 00:33:03 2013
New Revision: 1497623
URL: http://svn.apache.org/r1497623
Log:
Misc cleanup of site for the 0.8 beta release--fixed up quickstart, cleaned up styles, fixed the hierarchy of 0.7 and 0.8 pages, etc.
Added:
kafka/site/08/migration.html
kafka/site/committers.html
kafka/site/images/
kafka/site/images/apache_feather.gif (with props)
Removed:
kafka/site/07/includes/
kafka/site/08/includes/
Modified:
kafka/site/07/configuration.html
kafka/site/07/design.html
kafka/site/07/performance.html
kafka/site/07/quickstart.html
kafka/site/08/api.html
kafka/site/08/configuration.html
kafka/site/08/design.html
kafka/site/08/quickstart.html
kafka/site/08/tools.html
kafka/site/contributing.html
kafka/site/downloads.html
kafka/site/includes/header.html
kafka/site/index.html
kafka/site/styles.css
Modified: kafka/site/07/configuration.html
URL: http://svn.apache.org/viewvc/kafka/site/07/configuration.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/07/configuration.html (original)
+++ kafka/site/07/configuration.html Fri Jun 28 00:33:03 2013
@@ -1,4 +1,4 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h2> Configuration </h2>
@@ -352,4 +352,4 @@ the size of those queues</td>
</table>
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Modified: kafka/site/07/design.html
URL: http://svn.apache.org/viewvc/kafka/site/07/design.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/07/design.html (original)
+++ kafka/site/07/design.html Fri Jun 28 00:33:03 2013
@@ -1,4 +1,4 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h2>Why we built this</h2>
@@ -615,4 +615,4 @@ When rebalancing is triggered at one con
</h2>
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Modified: kafka/site/07/performance.html
URL: http://svn.apache.org/viewvc/kafka/site/07/performance.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/07/performance.html (original)
+++ kafka/site/07/performance.html Fri Jun 28 00:33:03 2013
@@ -1,4 +1,4 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h2>Performance Results</h2>
<p>The following tests give some basic information on Kafka throughput as the number of topics, consumers and producers and overall data size varies. Since Kafka nodes are independent, these tests are run with a single producer, consumer, and broker machine. Results can be extrapolated for a larger cluster.
@@ -80,4 +80,4 @@ The below graph is an experiment where w
<p>The charts similar to above graphs can be plotted with report.html automatically.</p>
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Modified: kafka/site/07/quickstart.html
URL: http://svn.apache.org/viewvc/kafka/site/07/quickstart.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/07/quickstart.html (original)
+++ kafka/site/07/quickstart.html Fri Jun 28 00:33:03 2013
@@ -1,4 +1,4 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h2>Quick Start</h3>
@@ -306,5 +306,4 @@ while (true) {
}
</pre>
-<!--#include virtual="includes/footer.html" -->
-
+<!--#include virtual="../includes/footer.html" -->
\ No newline at end of file
Modified: kafka/site/08/api.html
URL: http://svn.apache.org/viewvc/kafka/site/08/api.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/08/api.html (original)
+++ kafka/site/08/api.html Fri Jun 28 00:33:03 2013
@@ -1,4 +1,4 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h3>Producer Api</h3>
<pre>
@@ -152,4 +152,4 @@ Providing a horizontally scalable soluti
Usage information on the hadoop consumer can be found <a href="https://github.com/linkedin/camus/tree/camus-kafka-0.8/">here</a>.
</p>
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Modified: kafka/site/08/configuration.html
URL: http://svn.apache.org/viewvc/kafka/site/08/configuration.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/08/configuration.html (original)
+++ kafka/site/08/configuration.html Fri Jun 28 00:33:03 2013
@@ -1,16 +1,21 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
-<h2> Configuration </h2>
+<h2>Configuration </h2>
+<ul>
+ <li><a href="#broker">Broker Configs</a>
+ <li><a href="#consumer">Consumer Configs</a>
+ <li><a href="#producer">Producer Configs</a>
+</ul>
-<h3> Important configuration properties for Kafka broker are: </h3>
+<h3><a id="broker">Broker Configs</a></h3>
+
+The essential configurations are the following:
<ul>
<li><code>broker.id</code>
<li><code>log.dirs</code>
<li><code>zookeeper.connect</code>
</ul>
-<p>More details about server configuration can be found in the scala class <code>kafka.server.KafkaConfig</code>.</p>
-
<table class="data-table">
<tbody><tr>
<th>Property</th>
@@ -269,15 +274,16 @@
</tr>
</tbody></table>
+<p>More details about broker configuration can be found in the scala class <code>kafka.server.KafkaConfig</code>.</p>
-<h3> Important configuration properties for the high-level consumer are: </h3>
+<h3><a id="consumer">Consumer Configs</a></h3>
+
+The essential consumer configurations are the following:
<ul>
<li><code>group.id</code>
<li><code>zookeeper.connect</code>
</ul>
-<p>More details about consumer configuration can be found in the scala class <code>kafka.consumer.ConsumerConfig</code>.</p>
-
<table class="data-table">
<tbody><tr>
<th>Property</th>
@@ -388,10 +394,15 @@
<td colspan="1">2000</td>
<td>How far a ZK follower can be behind a ZK leader</td>
</tr>
-</tbody></table>
+</tbody>
+</table>
-<h3> Important configuration properties for the producer are: </h3>
+<p>More details about consumer configuration can be found in the scala class <code>kafka.consumer.ConsumerConfig</code>.</p>
+
+<h3><a id="producer">Producer Configs</a></h3>
+
+Essential configuration properties for the producer include:
<ul>
<li><code>metadata.broker.list</code>
<li><code>request.required.acks</code>
@@ -399,8 +410,6 @@
<li><code>serializer.class</code>
</ul>
-<p>More details about producer configuration can be found in the scala class <code>kafka.producer.ProducerConfig</code>.</p>
-
<table class="data-table">
<tbody><tr>
<th>Property</th>
@@ -516,11 +525,10 @@
<td>The ack timeout of the producer requests. Value must be non-negative and non-zero</td>
</tr>
</tbody></table>
-
-
- </div>
+<p>More details about producer configuration can be found in the scala class <code>kafka.producer.ProducerConfig</code>.</p>
+</div>
</div></body></html>
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Modified: kafka/site/08/design.html
URL: http://svn.apache.org/viewvc/kafka/site/08/design.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/08/design.html (original)
+++ kafka/site/08/design.html Fri Jun 28 00:33:03 2013
@@ -1,4 +1,4 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h3> General design</h3>
The motivation of Kafka and the general design can be found in the <a href="http://kafka.apache.org/07/design.html">design doc of 0.7</a>.
@@ -6,5 +6,5 @@ The motivation of Kafka and the general
<h3> Replication design</h3>
The design of intra-cluster replication can be found in the <a href="http://www.slideshare.net/junrao/kafka-replication-apachecon2013">presentation</a> at ApacheCon 2013.
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Added: kafka/site/08/migration.html
URL: http://svn.apache.org/viewvc/kafka/site/08/migration.html?rev=1497623&view=auto
==============================================================================
--- kafka/site/08/migration.html (added)
+++ kafka/site/08/migration.html Fri Jun 28 00:33:03 2013
@@ -0,0 +1,17 @@
+<!--#include virtual="../includes/header.html" -->
+<h2>Migrating from 0.7.x to 0.8</h2>
+
+0.8 is our first (and hopefully last) release with a non-backwards-compatible wire protocol, zookeeper layout, and on-disk data format. This was a chance for us to clean up a lot of cruft and start fresh. This means performing a no-downtime upgrade is more painful than normal—you cannot just swap in the new code in-place.
+
+<h3>Migration Steps</h3>
+
+<ol>
+ <li>Setup a new cluster running 0.8.
+ <li>Use the 0.7 to 0.8 <a href="tools.html">migration tool</a> to mirror data from the 0.7 cluster into the 0.8 cluster.
+ <li>When the 0.8 cluster is fully caught up, redeploy all data <i>consumers</i> running the 0.8 client and reading from the 0.8 cluster.
+ <li>Finally migrate all 0.7 producers to 0.8 client publishing data to the 0.8 cluster.
+ <li>Decomission the 0.7 cluster.
+ <li>Drink.
+</ol>
+
+<!--#include virtual="../includes/footer.html" -->
\ No newline at end of file
Modified: kafka/site/08/quickstart.html
URL: http://svn.apache.org/viewvc/kafka/site/08/quickstart.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/08/quickstart.html (original)
+++ kafka/site/08/quickstart.html Fri Jun 28 00:33:03 2013
@@ -1,13 +1,10 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
<h2>Quick Start</h3>
-
-<h3> Step 0: Clean up 0.7 data, if exists </h3>
-Since 0.8 is not backward compatible with 0.7.x, if you had an 0.7 installation already, you will need to delete all existing Zookeeper data and Kafka log data (if the data is not critical). Alternatively, you can use a different Zookeeper namespace and a new Kafka log directory. If you have an 0.7 cluster in production, see the <a href="tools.html" title="tools">tools</a> section on how to migrate your data from 0.7 to 0.8 online.
<h3> Step 1: Download the code </h3>
-<a href="../downloads.html" title="Kafka downloads">Download</a> a recent stable release.
+<a href="../downloads.html" title="Kafka downloads">Download</a> the 0.8 release.
<pre>
<b>> tar xzf kafka-<VERSION>.tgz</b>
@@ -17,10 +14,12 @@ Since 0.8 is not backward compatible wit
<b>> ./sbt assembly-package-dependency</b>
</pre>
+This tutorial assumes you are starting on a fresh zookeeper instance with no pre-existing data. If you want to migrate from an existing 0.7 installation you will need to follow the migration instructions.
+
<h3>Step 2: Start the server</h3>
<p>
-First start the zookeeper server. You can use the convenience script packaged with kafka to get a quick-and-dirty single-node zookeeper instance.
+Kafka uses zookeeper so you need to first start a zookeeper server if you don't already have one. You can use the convenience script packaged with kafka to get a quick-and-dirty single-node zookeeper instance.
<pre>
<b>> bin/zookeeper-server-start.sh config/zookeeper.properties</b>
@@ -36,17 +35,34 @@ Now start the Kafka server:
...
</pre>
-<h3>Step 3: Send some messages</h3>
+<h3>Step 3: Create a topic</h3>
-Kafka comes with a command line client that will take input from standard in and send it out as messages to the Kafka cluster. By default each line will be sent as a separate message. The topic <i>test</i> is created automatically when messages are sent to it. Omitting logging you should see something like this:
+Let's create a topic named "test" with a single partition and only one replica:
+<pre>
+> <b>bin/kafka-create-topic.sh --zookeeper localhost:2181 --replica 1 --partition 1 --topic test</b>
+</pre>
+We can now see that topic if we run the list topic command:
+<pre>
+> <b>bin/kafka-create-topic.sh --zookeeper localhost:2181 --replica 1 --partition 1 --topic test</b>
+</pre>
+You can configure your brokers to auto-create topics when a non-existent topic is published to as well.
+
+<h3>Step 4: Send some messages</h3>
+
+Kafka comes with a command line client that will take input from a file or standard in and send it out as messages to the Kafka cluster. By default each line will be sent as a separate message. The topic <i>test</i> is created automatically when messages are sent to it. Omitting logging you should see something like this:
+
+<pre>
+> <b>bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test</b>
+</pre>
+Now you can type some messages to send them to the broker:
<pre>
> <b>bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test</b>
This is a message
This is another message
</pre>
-<h3>Step 4: Start a consumer</h3>
+<h3>Step 5: Start a consumer</h3>
Kafka also has a command line consumer that will dump out messages to standard out.
@@ -59,18 +75,98 @@ This is another message
If you have each of the above commands running in a different terminal then you should now be able to type messages into the producer terminal and see them appear in the consumer terminal.
</p>
<p>
-Both of these command line tools have additional options. Running the command with no arguments will display usage information documenting them in more detail.
+All the command line tools have additional options; running the command with no arguments will display usage information documenting them in more detail.
</p>
+<h3>Step 6: Setting up a multi-broker cluster</h3>
-<h3>Setting up replication</h3>
-If you want to set up replication on more than one broker, you can follow
-<a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.8+Quick+Start" title="Kafka 0.8 replication quickstart">this</a>.
+So far we have been running against a single broker, but that's no fun. For Kafka, a single broker is just a cluster of size one, so nothing much changes other than starting a few more broker instances. But just to get feel for it, let's expand our cluster to three nodes (still all on our local machine).
+<p>
+First we make a config file for each of the brokers:
+<pre>
+<b>> cp config/server.properties config/server-1.properties
+> cp config/server.properties config/server-2.properties</b>
+</pre>
-<h3>Build a release zip or tar file</h3>
+Now edit these new files and set the following properties:
<pre>
-<b>> ./sbt release-zip</b>
-<b>> ./sbt release-tar</b>
+
+config/server-1.properties:
+ broker.id=1
+ port=9093
+ log.dir=/tmp/kafka-logs-1
+
+config/server-2.properties:
+ broker.id=2
+ port=9094
+ log.dir=/tmp/kafka-logs-2
</pre>
+The <code>broker.id</code> property is the unique and permanent name of each node in the cluster. We have to override the port and log directory only because we are running these all on the same machine and we want to keep the brokers from trying to all register on the same port or overwrite each others data.
+<p>
+We already have Zookeeper and our single node started, so we just need to start the two new nodes. However, this time we have to override the JMX port used by java too to avoid clashes with the running node:
+<pre>
+<b>> JMX_PORT=9997 bin/kafka-server-start.sh config/server-1.properties &</b>
+...
+<b>> JMX_PORT=9998 bin/kafka-server-start.sh config/server-2.properties &</b>
+...
+</pre>
+
+Now create a new topic with a replication factor of three:
+<pre>
+> <b>bin/kafka-create-topic.sh --zookeeper localhost:2181 --replica 3 --partition 1 --topic my-replicated-topic</b>
+</pre>
+
+Okay but now that we have a cluster how can we know which broker is doing what? To see that run the "list topics" command:
+<pre>
+> <b>bin/kafka-list-topic.sh --zookeeper localhost:2181</b>
+topic: my-replicated-topic partition: 0 leader: 1 replicas: 1,2,0 isr: 1,2,0
+topic: test partition: 0 leader: 0 replicas: 0 isr: 0
+</pre>
+Here is an explanation of output:
+<ul>
+ <li>"leader" is the node responsible for all reads and writes for the given partition. Each node would be the leader for a randomly selected portion of the partitions.
+ <li>"replicas" is the list of nodes that are supposed to server the log for this partition regardless of whether they are currently alive.
+ <li>"isr" is the set of "in-sync" replicas. This is the subset of the replicas list that is currently alive and caught-up to the leader.
+</ul>
+Note that both topics we created have only a single partition (partition 0). The original topic has no replicas and so it is only present on the leader (node 0), the replicated topic is present on all three nodes with node 1 currently acting as leader and all replicas in sync.
+<p>
+As before let's publish a few messages message:
+<pre>
+> <b>bin/kafka-console-producer.sh --broker-list localhost:9092 --topic my-replicated-topic</b>
+...
+<b>my test message 1</b>
+<b>my test message 2</b>
+<b>^C</b>
+</pre>
+Now consume this message:
+<pre>
+<b>> bin/kafka-console-consumer.sh --zookeeper localhost:2181 --from-beginning --topic my-replicated-topic</b>
+...
+my test message 1
+my test message 2
+<b>^C</b>
+</pre>
+
+Now let's test out fault-tolerance. Kill the broker acting as leader for this topic's only partition:
+<pre>
+> <b>pkill -9 -f server-1.properties</b>
+</pre>
+Leadership should switch to one of the slaves:
+<pre>
+> <b>bin/kafka-list-topic.sh --zookeeper localhost:2181</b>
+...
+topic: my-replicated-topic partition: 0 leader: 2 replicas: 1,2,0 isr: 2
+topic: test partition: 0 leader: 0 replicas: 0 isr: 0
+</pre>
+And the messages should still be available for consumption even though the leader that took the writes originally is down:
+<pre>
+<b>> bin/kafka-console-consumer.sh --zookeeper localhost:2181 --from-beginning --topic my-replicated-topic</b>
+...
+my test message 1
+my test message 2
+<b>^C</b>
+</pre>
+
+And that is all there is to it.
-<!--#include virtual="includes/footer.html" -->
+<!--#include virtual="../includes/footer.html" -->
Modified: kafka/site/08/tools.html
URL: http://svn.apache.org/viewvc/kafka/site/08/tools.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/08/tools.html (original)
+++ kafka/site/08/tools.html Fri Jun 28 00:33:03 2013
@@ -1,10 +1,14 @@
-<!--#include virtual="includes/header.html" -->
+<!--#include virtual="../includes/header.html" -->
+<h3>Mirroring data between clusters</h3>
+We have a tool that runs a continuous copy between two clusters. The clusters are completely independent and the topology need not match (you can have a different number of brokers and a different number of partitions). Offsets and partitioning are currently not preserved by this tool as it is meant for geographical replication rather than backup.
-<h3> Migrating data from 0.7 to 0.8</h3>
-Since 0.8 is not backward compatible with 0.7.x, we provide a tool for migrating data in an 0.7 cluster to an 0.8 cluster. Details of the tool can be found <a href="https://cwiki.apache.org/confluence/display/KAFKA/Migrating+from+0.7+to+0.8">here</a>.
+Documentation <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+mirroring+%28MirrorMaker%29">here</a>.
-<h3> Administrative tools for 0.8</h3>
+<h3> Administrative tools</h3>
A set of tools for managing an 0.8 cluster is described in <a href="https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools">here</a>.
-<!--#include virtual="includes/footer.html" -->
+<h3>Migrating data from a 0.7 cluster to a 0.8 cluster</h3>
+Since 0.8 is not backward compatible with 0.7.x, we provide a tool for migrating data in an 0.7 cluster to an 0.8 cluster. Details of the tool can be found <a href="https://cwiki.apache.org/confluence/display/KAFKA/Migrating+from+0.7+to+0.8">here</a>.
+
+<!--#include virtual="../includes/footer.html" -->
Added: kafka/site/committers.html
URL: http://svn.apache.org/viewvc/kafka/site/committers.html?rev=1497623&view=auto
==============================================================================
--- kafka/site/committers.html (added)
+++ kafka/site/committers.html Fri Jun 28 00:33:03 2013
@@ -0,0 +1,30 @@
+<!--#include virtual="includes/header.html" -->
+
+<h2>The Committers</h3>
+
+<h3>Jun Rao</h3>
+<a href="http://www.linkedin.com/in/junrao"><img src="http://m.c.lnkd.licdn.com/mpr/mpr/shrink_200_200/p/2/000/01b/284/3099192.jpg"></a> Jun is a blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+<h3>Neha Narkhede</h3>
+<a href="http://www.linkedin.com/in/nehanarkhede"><img src="http://m.c.lnkd.licdn.com/media/p/1/000/04b/318/34462d7.jpg"></a> blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+<h3>Joe Stein</h3>
+<a href="http://www.linkedin.com/in/charmalloc"><img src="http://m.c.lnkd.licdn.com/mpr/mpr/shrink_200_200/p/4/000/17f/013/0fcc43c.jpg"></a> blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+<h3>Jay Kreps</h3>
+<a href="http://www.linkedin.com/in/jaykreps"><img src="http://m.c.lnkd.licdn.com/media/p/4/000/14a/166/0ec9b5f.jpg"></a> blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+<h3>Joel Koshy</h3>
+<a href="http://www.linkedin.com/in/jjkoshy"><img src="http://m.c.lnkd.licdn.com/mpr/mpr/shrink_200_200/p/4/000/161/1c7/014dad4.jpg"></a> blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+<h3>Prashanth Menon</h3>
+<a href="http://ca.linkedin.com/in/prasmenon"><img src="http://m.c.lnkd.licdn.com/mpr/mpr/shrink_200_200/p/3/000/096/3a6/08859a0.jpg"></a> blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+<h3>Jakob Homan</h3>
+<a href="http://www.linkedin.com/in/jghoman">
+ <img src="http://m.c.lnkd.licdn.com/mpr/mpr/shrink_200_200/p/3/000/093/065/27c14b4.jpg">
+</a>
+Jakob is a blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah.
+
+
+<!--#include virtual="includes/footer.html" -->
\ No newline at end of file
Modified: kafka/site/contributing.html
URL: http://svn.apache.org/viewvc/kafka/site/contributing.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/contributing.html (original)
+++ kafka/site/contributing.html Fri Jun 28 00:33:03 2013
@@ -12,4 +12,6 @@ We are always very happy to have code co
<li>It is our job to follow up on patches in a timely fashion. <a href="mailto: dev@kafka.apache.org">Nag us</a> if we aren't doing our job (sometimes we drop things).</li>
</ul>
+You can find some help using git to contribute, rebase, and create patches <a href="https://cwiki.apache.org/confluence/display/KAFKA/Git+Workflow">here</a>.
+
<!--#include virtual="includes/footer.html" -->
\ No newline at end of file
Modified: kafka/site/downloads.html
URL: http://svn.apache.org/viewvc/kafka/site/downloads.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/downloads.html (original)
+++ kafka/site/downloads.html Fri Jun 28 00:33:03 2013
@@ -1,8 +1,10 @@
<!--#include virtual="includes/header.html" -->
-<h2>Downloads</h2>
+<h2>Releases</h2>
-The current stable version is 0.7.2-incubating. You can verify your download by following these <a href="http://www.apache.org/info/verification.html">procedures</a> and using these <a href="http://svn.apache.org/repos/asf/kafka/KEYS">KEYS</a>.
+The current stable version is 0.7.2. However we have released a beta version of 0.8 which is being actively used at large-scale, and though it still has some rough edges, we feel it is production-ready and is a better starting point for new users.
+<p>
+You can verify your download by following these <a href="http://www.apache.org/info/verification.html">procedures</a> and using these <a href="http://svn.apache.org/repos/asf/kafka/KEYS">KEYS</a>.
<h3>0.8.0 Beta1 Release</h3>
<ul>
@@ -19,12 +21,13 @@ The current stable version is 0.7.2-incu
<h3>0.7.2 Release</h3>
<ul>
<li>
- <a href="http://www.apache.org/dist/incubator/kafka/kafka-0.7.2-incubating/RELEASE-NOTES.html">Release Notes</a>
+ <a href="http://www.apache.org/dist/incubator/kafka/kafka-0.8.0/RELEASE-NOTES.html">Release Notes</a>
</li>
<li>
- Download: <a href="https://www.apache.org/dyn/closer.cgi/incubator/kafka/kafka-0.7.2-incubating/kafka-0.7.2-incubating-src.tgz">kafka-0.7.2-incubating-src.tgz</a> (<a href="http://www.apache.org/dist/incubator/kafka/kafka-0.7.2-incubating/kafka-0.7.2-incubating-src.tgz.asc">asc</a>), <a href="http://www.apache.org/dist/incubator/kafka/kafka-0.7.2-incubating/kafka-0.7.2-incubating-src.tgz.md5">md5</a>)
+ Download: <a href="https://www.apache.org/dyn/closer.cgi/incubator/kafka/kafka-0.8.0/kafka-0.8.0-src.tgz">kafka-0.8.0-src.tgz</a> (<a href="http://www.apache.org/dist/incubator/kafka/kafka-0.8.0/kafka-0.8.0-src.tgz.asc">asc</a>), <a href="http://www.apache.org/dist/incubator/kafka/kafka-0.8.0/kafka-0.8.0-src.tgz.md5">md5</a>)
</li>
</ul>
+
<h3>Older Releases</h3>
<h4>0.7.1 Release</h4>
<ul>
Added: kafka/site/images/apache_feather.gif
URL: http://svn.apache.org/viewvc/kafka/site/images/apache_feather.gif?rev=1497623&view=auto
==============================================================================
Binary file - no diff available.
Propchange: kafka/site/images/apache_feather.gif
------------------------------------------------------------------------------
svn:mime-type = application/octet-stream
Modified: kafka/site/includes/header.html
URL: http://svn.apache.org/viewvc/kafka/site/includes/header.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/includes/header.html (original)
+++ kafka/site/includes/header.html Fri Jun 28 00:33:03 2013
@@ -2,9 +2,12 @@
<html xmlns:og="http://ogp.me/ns#">
<head>
<title>Apache Kafka</title>
- <link rel='stylesheet' href='styles.css' type='text/css'>
- <link rel="icon" type="image/png" href="http://path/to/favicon.png"><meta name="keywords" content="keywords!">
- <meta name="description" content="A high-throughput, distributed, publish-subscribe messaging system.">
+ <link rel='stylesheet' href='/styles.css' type='text/css'>
+ <link rel="icon" type="image/gif" href="/images/apache_feather.gif">
+ <meta name="robots" content="index,follow" />
+ <meta name="language" content="en" />
+ <meta name="keywords" content="apache kafka messaging queuing distributed stream processing">
+ <meta name="description" content="Apache Kafka: A high-throughput, distributed, publish-subscribe messaging system.">
<meta http-equiv='Content-Type' content='text/html;charset=utf-8' />
<meta property="og:title" value="Kafka" />
<meta property="og:image" value="" />
@@ -14,38 +17,51 @@
</head>
<body>
<div>
- <div id="header" style="overflow: hidden">
- <div>
+ <div id="header">
<a href="http://www.apache.org">
- <img style="float: right; margin: 5px" src="http://www.apache.org/images/feather-small.png"/>
+ <img class="feather" src="http://www.apache.org/images/feather-small.png"/>
</a>
- <div class="title"><a href="index.html">Apache Kafka</a></div>
+ <div class="title"><a href="/index.html">Apache Kafka</a></div>
<div class="subtitle">A high-throughput distributed messaging system.</div>
- </div>
</div>
<div class="lsidebar">
<ul>
- <li><a href="downloads.html">download</a></li>
- <li>releases
- <ul>
- <li><a href="07/quickstart.html">0.7</a></li>
- <li><a href="08/quickstart.html">0.8</a></li>
+ <li><a href="/downloads.html">download</a></li>
+ <li>0.8 beta
+ <ul>
+ <li><a href="/08/quickstart.html">quickstart</a></li>
+ <li><a href="/08/design.html">design</a></li>
+ <li><a href="/08/api.html">api docs</a></li>
+ <li><a href="/08/configuration.html">configuration</a></li>
+ <li><a href="/08/tools.html">tools</a></li>
+ <li><a href="/08/migration.html">migration
+ </ul>
+ </li>
+ <li>0.7
+ <ul>
+ <li><a href="/07/quickstart.html">quickstart</a></li>
+ <li><a href="/07/design.html">design</a></li>
+ <li><a href="http://people.apache.org/~joestein/kafka-0.7.1-incubating-docs">api docs</a></li>
+ <li><a href="/07/configuration.html">configuration</a></li>
+ <li><a href="/07/performance.html">performance</a></li>
</ul>
- </li>
+ </li>
+ <li><a href="https://cwiki.apache.org/confluence/display/KAFKA/Clients">clients</a></li>
<li><a href="https://cwiki.apache.org/confluence/display/KAFKA/Operations">operations</a></li>
- <li><a href="faq.html">faq</a></li>
+ <li><a href="/faq.html">faq</a></li>
<li><a href="https://cwiki.apache.org/confluence/display/KAFKA">wiki</li>
<li><a href="https://issues.apache.org/jira/browse/KAFKA">bugs</a></li>
- <li><a href="contact.html">mailing lists</a></li>
+ <li><a href="/contact.html">mailing lists</a></li>
+ <!--<li><a href="/committers.html">committers</a></li>-->
<li><a href="https://cwiki.apache.org/confluence/display/KAFKA/Powered+By">powered by</a></li>
<li><a href="https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem">ecosystem</a></li>
<li><a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations">papers & talks</a></li>
<li>developers
<ul>
- <li><a href="code.html">code</a></li>
- <li><a href="projects.html">projects</a></li>
- <li><a href="contributing.html">contributing</a></li>
- <li><a href="coding-guide.html">coding guide</a></li>
+ <li><a href="/code.html">code</a></li>
+ <li><a href="/projects.html">projects</a></li>
+ <li><a href="/contributing.html">contributing</a></li>
+ <li><a href="/coding-guide.html">coding guide</a></li>
<li><a href="https://builds.apache.org">unit tests</a></li>
</ul>
</li>
Modified: kafka/site/index.html
URL: http://svn.apache.org/viewvc/kafka/site/index.html?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/index.html (original)
+++ kafka/site/index.html Fri Jun 28 00:33:03 2013
@@ -1,20 +1,21 @@
<!--#include virtual="includes/header.html" -->
-<h2>Apache Kafka is a distributed publish-subscribe messaging system</h2>
-<p>
-Apache Kafka is a distributed publish-subscribe messaging system. It is designed to support the following
-<ul>
- <li>Persistent messaging with O(1) disk structures that provide constant time performance even with many TB of stored messages.</li>
- <li>High-throughput: even with very modest hardware Kafka can support hundreds of thousands of messages per second.</li>
- <li>Explicit support for partitioning messages over Kafka servers and distributing consumption over a cluster of consumer machines while maintaining per-partition ordering semantics.</li>
- <li>Support for parallel data load into Hadoop.</li>
-</ul>
-
-Kafka provides a publish-subscribe solution that can handle all activity stream data and processing on a consumer-scale web site. This kind of activity (page views, searches, and other user actions) are a key ingredient in many of the social feature on the modern web. This data is typically handled by "logging" and ad hoc log aggregation solutions due to the throughput requirements. This kind of ad hoc solution is a viable solution to providing logging data to an offline analysis system like Hadoop, but is very limiting for building real-time processing. Kafka aims to unify offline and online processing by providing a mechanism for parallel load into Hadoop as well as the ability to partition real-time consumption over a cluster of machines.
-</p>
-
-<p>
-The use for activity stream processing makes Kafka comparable to <a href="https://github.com/facebook/scribe">Facebook's Scribe</a> or <a href="http://flume.apache.org">Apache Flume</a> (incubating), though the architecture and primitives are very different for these systems and make Kafka more comparable to a traditional messaging system.
-</p>
+Apache Kafka is publish-subscribe messaging rethought as a distributed commit log.
+
+<div class="buzzword">Fast</div>
+
+A single Kafka broker can handle hundreds of megabytes of reads and writes per second from thousands of clients.
+
+<div class="buzzword">Scalable</div>
+
+Kafka is designed to allow a single cluster to serve as the central data backbone for a large organization. It can be elastically and transparently expanded without downtime. Data streams are partitioned and spread over a cluster of machines to allow data streams larger than the capability of any single machine and to allow clusters of co-ordinated consumers
+
+<div class="buzzword">Durable</div>
+
+Messages are persisted on disk and replicated within the cluster to prevent data loss. Each broker can handle terabytes of messages without performance impact.
+
+<div class="buzzword">Distributed by Design</div>
+
+Kafka has a modern cluster-centric design that offers strong durability and fault-tolerance guarantees.
<!--#include virtual="includes/footer.html" -->
Modified: kafka/site/styles.css
URL: http://svn.apache.org/viewvc/kafka/site/styles.css?rev=1497623&r1=1497622&r2=1497623&view=diff
==============================================================================
--- kafka/site/styles.css (original)
+++ kafka/site/styles.css Fri Jun 28 00:33:03 2013
@@ -1,11 +1,11 @@
html, body{
- font-family:Arial,sans-serif;
+ font-family:Helvetica,sans-serif;
margin: 0px;
padding: 0px;
background-color: #fff;
color: #222;
- line-height: 150%;
- font-size: 11pt;
+ line-height: 175%;
+ font-size: 12pt;
}
code, pre {
font: 1em/normal "courier new", courier, monospace;
@@ -18,28 +18,28 @@ a {
text-decoration: none;
}
#header {
- xmargin: 2em -2em 1em 0;
- padding: 1.0em 0 1.0em 3.0em;
- border-width: 0px;
+ margin: 0px;
+ padding: 20px;
background-color: #2e4a8e;
- xwidth: 80%;
- min-width: 900px;
+ min-width: 1000px;
+ overflow: hidden
}
#header a {
color: white;
text-decoration: none;
}
-.title {
+.title, .subtitle {
color: white;
- font-size: 24pt;
- margin: 2px;
+ font-size: 40pt;
+ margin: 15px;
}
-.subtitle, .projects, .projects a {
- color: white;
- font-size: 14pt;
+.subtitle {
+ font-size: 16pt;
font-style: italic;
- margin: 2px;
- line-height: 1.5;
+}
+.feather {
+ float: right;
+ margin: 5px
}
.projects, .projects a {
font-style: normal;
@@ -47,9 +47,10 @@ a {
}
.lsidebar {
float: left;
- font-size: 12pt;
+ font-size: 13pt;
color: #2e4a8e;
- width: 150px;
+ width: 250px;
+ line-height: 120%;
}
.lsidebar li {
list-style-type: none;
@@ -62,10 +63,12 @@ a {
list-style-type: circle;
}
.content {
- width: 700px;
- margin-left: 200px;
+ min-width: 750px;
+ max-width: 900px;
+ margin-left: 250px;
xpadding: 10px;
min-height: 800px;
+ padding: 10px;
}
.numeric {
text-align: right;
@@ -85,4 +88,9 @@ a {
.advert-message {
border: 3px solid #2e4a8e;
padding: 15px;
+}
+.buzzword {
+ font-style: italic;
+ font-size: 18pt;
+ line-height: 200%;
}
\ No newline at end of file