You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kudu.apache.org by gr...@apache.org on 2019/07/12 18:59:21 UTC

[kudu] branch master updated (8973a28 -> c1d1685)

This is an automated email from the ASF dual-hosted git repository.

granthenke pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/kudu.git.


    from 8973a28  KUDU-2855 Lazy-create DeltaMemStore on first update
     new f8d11f2  Separate benchmark to single test
     new 99d1bc8  Autogenerate the release index.md file
     new c1d1685  [docs] Fix quickstart IP one liner

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/quickstart.adoc                   |  2 +-
 docs/support/scripts/index_template.md | 56 ++++++++++++++++++++++++++++++++++
 docs/support/scripts/make_site.sh      | 10 ++----
 src/kudu/common/CMakeLists.txt         |  2 +-
 src/kudu/common/wire_protocol-test.cc  | 26 ++++++++--------
 5 files changed, 74 insertions(+), 22 deletions(-)
 create mode 100644 docs/support/scripts/index_template.md


[kudu] 01/03: Separate benchmark to single test

Posted by gr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

granthenke pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kudu.git

commit f8d11f22be66b3b7a241bfcdc4778eff7daa6a89
Author: triplesheep <tr...@gmail.com>
AuthorDate: Wed Jul 10 11:18:22 2019 +0000

    Separate benchmark to single test
    
    Separate the total benchmark to single test with paraments so
    they all can be run in test time limit.
    
    Change-Id: I980234bcdf76a7d2978f49ed59dff21184abf892
    Reviewed-on: http://gerrit.cloudera.org:8080/13832
    Reviewed-by: Adar Dembo <ad...@cloudera.com>
    Tested-by: Kudu Jenkins
    Reviewed-by: Todd Lipcon <to...@apache.org>
---
 src/kudu/common/CMakeLists.txt        |  2 +-
 src/kudu/common/wire_protocol-test.cc | 26 +++++++++++++-------------
 2 files changed, 14 insertions(+), 14 deletions(-)

diff --git a/src/kudu/common/CMakeLists.txt b/src/kudu/common/CMakeLists.txt
index fa5c105..8121aef 100644
--- a/src/kudu/common/CMakeLists.txt
+++ b/src/kudu/common/CMakeLists.txt
@@ -96,4 +96,4 @@ ADD_KUDU_TEST(scan_spec-test)
 ADD_KUDU_TEST(schema-test)
 ADD_KUDU_TEST(table_util-test)
 ADD_KUDU_TEST(types-test)
-ADD_KUDU_TEST(wire_protocol-test)
+ADD_KUDU_TEST(wire_protocol-test NUM_SHARDS 4)
diff --git a/src/kudu/common/wire_protocol-test.cc b/src/kudu/common/wire_protocol-test.cc
index f09fa5d..d2ad3cb 100644
--- a/src/kudu/common/wire_protocol-test.cc
+++ b/src/kudu/common/wire_protocol-test.cc
@@ -53,13 +53,17 @@
 #include "kudu/util/test_util.h"
 
 using std::string;
+using std::tuple;
 using std::unique_ptr;
 using std::vector;
 using strings::Substitute;
 
 namespace kudu {
 
-class WireProtocolTest : public KuduTest {
+class WireProtocolTest : public KuduTest,
+                         // Used for benchmark, int corresponds to the number of columns,
+                         // double corresponds to the selection rate.
+                         public testing::WithParamInterface<tuple<int, double>> {
  public:
   WireProtocolTest()
       : schema_({ ColumnSchema("col1", STRING),
@@ -420,19 +424,15 @@ TEST_F(WireProtocolTest, TestColumnarRowBlockToPBWithPadding) {
   }
 }
 
-#ifdef NDEBUG
-TEST_F(WireProtocolTest, TestColumnarRowBlockToPBBenchmark) {
-  // Can set column_counts = {3, 30, 300} together with
-  // select_rates = {1.0, 0.8, 0.5, 0.2} for benchmark.
-  vector<int> column_counts = {3};
-  vector<double> select_rates = {1.0};
-  for (auto column_count : column_counts) {
-    for (auto select_rate : select_rates) {
-      RunBenchmark(column_count, select_rate);
-    }
-  }
+TEST_P(WireProtocolTest, TestColumnarRowBlockToPBBenchmark) {
+  int column_count = std::get<0>(GetParam());
+  double select_rate = std::get<1>(GetParam());
+  RunBenchmark(column_count, select_rate);
 }
-#endif
+
+INSTANTIATE_TEST_CASE_P(ColumnarRowBlockToPBBenchmarkParams, WireProtocolTest,
+                        testing::Combine(testing::Values(3, 30, 300),
+                                         testing::Values(1.0, 0.8, 0.5, 0.2)));
 
 // Test that trying to extract rows from an invalid block correctly returns
 // Corruption statuses.


[kudu] 02/03: Autogenerate the release index.md file

Posted by gr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

granthenke pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kudu.git

commit 99d1bc82034698b5fc7d74e4bd2117a2ce9fc96b
Author: Grant Henke <gr...@apache.org>
AuthorDate: Thu Jul 11 08:16:00 2019 -0500

    Autogenerate the release index.md file
    
    When building the docs for a release, this patch
    also builds the index.md file.
    
    Change-Id: If93fe00aa0dd855d8f8fafa22c786747d2ae50ed
    Reviewed-on: http://gerrit.cloudera.org:8080/13844
    Reviewed-by: Alexey Serbin <as...@cloudera.com>
    Tested-by: Kudu Jenkins
---
 docs/support/scripts/index_template.md | 56 ++++++++++++++++++++++++++++++++++
 docs/support/scripts/make_site.sh      | 10 ++----
 2 files changed, 59 insertions(+), 7 deletions(-)

diff --git a/docs/support/scripts/index_template.md b/docs/support/scripts/index_template.md
new file mode 100644
index 0000000..c1886b3
--- /dev/null
+++ b/docs/support/scripts/index_template.md
@@ -0,0 +1,56 @@
+---
+title: Apache Kudu release @@KUDU_VERSION@@
+layout: single_col
+active_nav: download
+single_col_extra_classes: releases
+---
+
+<!--
+
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+-->
+
+## Apache Kudu release @@KUDU_VERSION@@
+
+See the [Kudu @@KUDU_VERSION@@ Release Notes](docs/release_notes.html).
+
+Downloads of Kudu @@KUDU_VERSION@@ are available in the following formats:
+
+* [Kudu @@KUDU_VERSION@@ source tarball](http://www.apache.org/dyn/closer.cgi?path=kudu/@@KUDU_VERSION@@/apache-kudu-@@KUDU_VERSION@@.tar.gz)
+  ([SHA512](https://www.apache.org/dist/kudu/@@KUDU_VERSION@@/apache-kudu-@@KUDU_VERSION@@.tar.gz.sha512),
+  [Signature](https://www.apache.org/dist/kudu/@@KUDU_VERSION@@/apache-kudu-@@KUDU_VERSION@@.tar.gz.asc))
+
+You can use the [KEYS file](https://www.apache.org/dist/kudu/KEYS) to verify the included GPG signature.
+
+To verify the integrity of the release, check the following:
+
+* Verify the checksum by downloading the release and the `.sha512` file, and
+  running the following command:
+    * On Linux: `sha512sum -c apache-kudu-@@KUDU_VERSION@@.tar.gz.sha512`
+    * On MacOS: `shasum -a 512 -c apache-kudu-@@KUDU_VERSION@@.tar.gz.sha512`
+* Verify the signature by downloading the release and the `.asc` file, and
+  doing the following:
+    * Import the KEYS file to the GPG keychain by running `gpg --import KEYS`
+    * Run `gpg --verify apache-kudu-@@KUDU_VERSION@@.tar.gz.asc apache-kudu-@@KUDU_VERSION@@.tar.gz`
+
+Additional links:
+
+* [Kudu @@KUDU_VERSION@@ Documentation](docs/)
+* [Kudu @@KUDU_VERSION@@ Java API docs](apidocs/)
+* [Kudu @@KUDU_VERSION@@ C++ API docs](cpp-client-api/)
\ No newline at end of file
diff --git a/docs/support/scripts/make_site.sh b/docs/support/scripts/make_site.sh
index 0d7d738..1a76e05 100755
--- a/docs/support/scripts/make_site.sh
+++ b/docs/support/scripts/make_site.sh
@@ -161,13 +161,9 @@ if [ -n "$OPT_DOXYGEN" ]; then
   fi
 fi
 
-SITE_SUBDIRS="docs"
-if [ -n "$OPT_JAVADOC" ]; then
-  SITE_SUBDIRS="$SITE_SUBDIRS $JAVADOC_SUBDIR"
-fi
-if [ -n "$OPT_DOXYGEN" ]; then
-  SITE_SUBDIRS="$SITE_SUBDIRS $CPP_CLIENT_API_SUBDIR"
-fi
+# Generate the release index file.
+sed "s/@@KUDU_VERSION@@/$VERSION/g" "$SOURCE_ROOT/docs/support/scripts/index_template.md" > \
+  "$RELEASE_OUTPUT_DIR/index.md"
 
 cd "$SITE_OUTPUT_DIR"
 SITE_ARCHIVE="$SITE_OUTPUT_DIR/website_archive.zip"


[kudu] 03/03: [docs] Fix quickstart IP one liner

Posted by gr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

granthenke pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kudu.git

commit c1d16856bd4b3bb4b6242fa098d600b6ef321e6a
Author: Grant Henke <gr...@apache.org>
AuthorDate: Thu Jul 11 16:16:29 2019 -0500

    [docs] Fix quickstart IP one liner
    
    It was reported that on Linux an extra whitespace could
    be included breaking the one liner. This uses `awk` instead
    so exact spaces don't matter.
    
    Change-Id: Ie401578da12157b802752ff62885c4b4dc6b3a29
    Reviewed-on: http://gerrit.cloudera.org:8080/13848
    Tested-by: Grant Henke <gr...@apache.org>
    Reviewed-by: Andrew Wong <aw...@cloudera.com>
---
 docs/quickstart.adoc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/quickstart.adoc b/docs/quickstart.adoc
index 9ccaafd..3f775a8 100644
--- a/docs/quickstart.adoc
+++ b/docs/quickstart.adoc
@@ -60,7 +60,7 @@ Set the `KUDU_QUICKSTART_IP` environment variable to your ip address:
 
 [source,bash]
 ----
-$ export KUDU_QUICKSTART_IP=$(ifconfig | grep "inet " | grep -Fv 127.0.0.1 | cut -d" " -f2 | tail -1)
+$ export KUDU_QUICKSTART_IP=$(ifconfig | grep "inet " | grep -Fv 127.0.0.1 |  awk '{print $2}' | tail -1)
 ----
 
 === Bring up the Cluster