You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by vi...@apache.org on 2020/01/13 04:58:53 UTC

[incubator-hudi] branch asf-site updated: [HUDI-524] Generate site content based on docs (#1215)

This is an automated email from the ASF dual-hosted git repository.

vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new eb5136b  [HUDI-524] Generate site content based on docs (#1215)
eb5136b is described below

commit eb5136b58dd418c7d0397921e207eace4b963ae8
Author: lamber-ken <la...@163.com>
AuthorDate: Mon Jan 13 12:58:46 2020 +0800

    [HUDI-524] Generate site content based on docs (#1215)
---
 content/404.html                                   |  560 +-
 content/Dockerfile                                 |   33 +-
 content/Gemfile                                    |   11 -
 content/Gemfile.lock                               |   71 -
 content/README.md                                  |   46 -
 content/{newsite-content => }/activity.html        |   41 +-
 content/admin_guide.html                           |  834 ---
 content/{newsite-content/blog => }/asf.html        |   30 +-
 content/assets/css/main.css                        |    2 +-
 content/assets/js/lunr/lunr-store.js               |   86 +-
 content/{newsite-content => }/build_docs.sh        |    0
 content/cn/404.html                                |  422 --
 .../{newsite-content/404.html => cn/activity.html} |  110 +-
 content/cn/admin_guide.html                        |  827 ---
 content/cn/community.html                          |  551 +-
 content/cn/comparison.html                         |  462 --
 content/cn/contributing.html                       |  588 +-
 content/cn/docker_demo.html                        | 1363 -----
 .../{newsite-content => cn}/docs/admin_guide.html  |  278 +-
 content/cn/docs/comparison.html                    |  431 ++
 content/cn/{ => docs}/concepts.html                |  601 +-
 content/cn/{ => docs}/configurations.html          |  819 ++-
 .../{newsite-content => cn}/docs/docker_demo.html  |   65 +-
 .../docs/docs-versions.html                        |   91 +-
 .../{newsite-content => cn}/docs/gcs_hoodie.html   |   65 +-
 .../docs/migration_guide.html                      |   67 +-
 .../{newsite-content => cn}/docs/performance.html  |  116 +-
 .../{newsite-content => cn}/docs/powered_by.html   |  108 +-
 content/{newsite-content => cn}/docs/privacy.html  |   65 +-
 content/cn/docs/querying_data.html                 |  624 +++
 .../docs/quick-start-guide.html                    |  188 +-
 .../{newsite-content => cn}/docs/s3_hoodie.html    |   88 +-
 content/cn/docs/use_cases.html                     |  450 ++
 .../{newsite-content => cn}/docs/writing_data.html |  206 +-
 content/cn/events/2016-12-30-strata-talk-2017.html |  424 --
 content/cn/events/2019-01-18-asf-incubation.html   |  423 --
 content/cn/gcs_hoodie.html                         |  480 --
 content/cn/index.html                              |  438 --
 content/cn/migration_guide.html                    |  461 --
 content/cn/news.html                               |  355 --
 content/cn/news_archive.html                       |  418 --
 content/cn/performance.html                        |  475 --
 content/cn/powered_by.html                         |  460 --
 content/cn/privacy.html                            |  439 --
 content/cn/querying_data.html                      |  636 ---
 content/cn/quickstart.html                         |  568 --
 content/cn/releases.html                           |  532 +-
 content/cn/s3_hoodie.html                          |  491 --
 content/cn/use_cases.html                          |  475 --
 content/cn/writing_data.html                       |  638 ---
 content/community.html                             |  552 +-
 content/comparison.html                            |  470 --
 content/concepts.html                              |  652 ---
 content/configurations.html                        |  845 ---
 content/contributing.html                          |  580 +-
 content/css/bootstrap.min.css                      |    5 -
 content/css/customstyles.css                       | 1221 ----
 content/css/font-awesome.min.css                   |    4 -
 content/css/fonts/FontAwesome.otf                  |  Bin 93888 -> 0 bytes
 content/css/fonts/fontawesome-webfont.eot          |  Bin 60767 -> 0 bytes
 content/css/fonts/fontawesome-webfont.svg          |  565 --
 content/css/fonts/fontawesome-webfont.ttf          |  Bin 122092 -> 0 bytes
 content/css/fonts/fontawesome-webfont.woff         |  Bin 71508 -> 0 bytes
 content/css/fonts/fontawesome-webfont.woff2        |  Bin 56780 -> 0 bytes
 content/css/lavish-bootstrap.css                   | 5912 --------------------
 content/css/modern-business.css                    |   93 -
 content/css/printstyles.css                        |  160 -
 content/css/syntax.css                             |   60 -
 content/css/theme-blue.css                         |  104 -
 content/css/theme-green.css                        |   99 -
 content/docker_demo.html                           | 1539 -----
 .../{newsite-content => }/docs/admin_guide.html    |   57 +-
 content/{newsite-content => }/docs/comparison.html |   57 +-
 content/{newsite-content => }/docs/concepts.html   |   57 +-
 .../{newsite-content => }/docs/configurations.html |  239 +-
 .../{newsite-content => }/docs/docker_demo.html    |   57 +-
 .../{newsite-content => }/docs/docs-versions.html  |   77 +-
 content/{newsite-content => }/docs/gcs_hoodie.html |   57 +-
 .../docs/migration_guide.html                      |   59 +-
 .../{newsite-content => }/docs/performance.html    |   57 +-
 content/{newsite-content => }/docs/powered_by.html |   57 +-
 content/{newsite-content => }/docs/privacy.html    |   57 +-
 .../{newsite-content => }/docs/querying_data.html  |   83 +-
 .../docs/quick-start-guide.html                    |   75 +-
 content/{newsite-content => }/docs/s3_hoodie.html  |   80 +-
 content/{newsite-content => }/docs/structure.html  |   57 +-
 content/{newsite-content => }/docs/use_cases.html  |   57 +-
 .../{newsite-content => }/docs/writing_data.html   |   67 +-
 content/events/2016-12-30-strata-talk-2017.html    |  425 --
 content/events/2019-01-18-asf-incubation.html      |  424 --
 content/feed.xml                                   |   13 -
 content/fonts/FontAwesome.otf                      |  Bin 85908 -> 0 bytes
 content/fonts/fontawesome-webfont.eot              |  Bin 56006 -> 0 bytes
 content/fonts/fontawesome-webfont.svg              |  520 --
 content/fonts/fontawesome-webfont.ttf              |  Bin 112160 -> 0 bytes
 content/fonts/fontawesome-webfont.woff             |  Bin 65452 -> 0 bytes
 content/fonts/glyphicons-halflings-regular.eot     |  Bin 20127 -> 0 bytes
 content/fonts/glyphicons-halflings-regular.svg     |  288 -
 content/fonts/glyphicons-halflings-regular.ttf     |  Bin 45404 -> 0 bytes
 content/fonts/glyphicons-halflings-regular.woff    |  Bin 23424 -> 0 bytes
 content/fonts/glyphicons-halflings-regular.woff2   |  Bin 18028 -> 0 bytes
 content/gcs_hoodie.html                            |  481 --
 content/images/asf_logo.svg                        |  210 -
 content/images/async_compac_1.png                  |  Bin 60344 -> 0 bytes
 content/images/async_compac_2.png                  |  Bin 54164 -> 0 bytes
 content/images/async_compac_3.png                  |  Bin 70516 -> 0 bytes
 content/images/async_compac_4.png                  |  Bin 66932 -> 0 bytes
 content/images/favicon.ico                         |  Bin 1150 -> 0 bytes
 content/images/hudi_commit_duration.png            |  Bin 869144 -> 0 bytes
 content/images/hudi_cow.png                        |  Bin 48994 -> 0 bytes
 content/images/hudi_intro_1.png                    |  Bin 27890 -> 0 bytes
 content/images/hudi_log_format_v2.png              |  Bin 223676 -> 0 bytes
 content/images/hudi_mor.png                        |  Bin 92073 -> 0 bytes
 content/images/hudi_query_perf_hive.png            |  Bin 158481 -> 0 bytes
 content/images/hudi_query_perf_presto.png          |  Bin 33727 -> 0 bytes
 content/images/hudi_query_perf_spark.png           |  Bin 29384 -> 0 bytes
 content/images/hudi_site_logo.png                  |  Bin 13170 -> 0 bytes
 content/images/hudi_timeline.png                   |  Bin 23093 -> 0 bytes
 content/images/hudi_upsert_dag.png                 |  Bin 503771 -> 0 bytes
 content/images/hudi_upsert_perf1.png               |  Bin 15984 -> 0 bytes
 content/images/hudi_upsert_perf2.png               |  Bin 18954 -> 0 bytes
 content/images/workflowarrow.png                   |  Bin 3595 -> 0 bytes
 content/index.html                                 |  596 +-
 content/js/customscripts.js                        |   55 -
 content/js/jekyll-search.js                        |    1 -
 content/js/jquery.ba-throttle-debounce.min.js      |    9 -
 content/js/jquery.localScroll.min.js               |    7 -
 content/js/jquery.navgoco.min.js                   |    8 -
 content/js/jquery.scrollTo.min.js                  |    7 -
 content/js/jquery.shuffle.min.js                   | 1588 ------
 content/js/mydoc_scroll.html                       |  653 ---
 content/js/toc.js                                  |   82 -
 content/licenses/LICENSE                           |   21 -
 content/licenses/LICENSE-BSD-NAVGOCO.txt           |   27 -
 content/migration_guide.html                       |  462 --
 content/news.html                                  |  356 --
 content/news_archive.html                          |  418 --
 content/newsite-content/Dockerfile                 |   27 -
 .../assets/css/font-awesome.min.css                |    4 -
 content/newsite-content/assets/css/main.css        |    1 -
 .../newsite-content/assets/fonts/FontAwesome.otf   |  Bin 134808 -> 0 bytes
 .../assets/fonts/fontawesome-webfont.eot           |  Bin 165742 -> 0 bytes
 .../assets/fonts/fontawesome-webfont.svg           | 2671 ---------
 .../assets/fonts/fontawesome-webfont.ttf           |  Bin 165548 -> 0 bytes
 .../assets/fonts/fontawesome-webfont.woff          |  Bin 98024 -> 0 bytes
 .../assets/fonts/fontawesome-webfont.woff2         |  Bin 77160 -> 0 bytes
 content/newsite-content/assets/images/asf_logo.svg |  210 -
 .../assets/images/async_compac_1.png               |  Bin 60344 -> 0 bytes
 .../assets/images/async_compac_2.png               |  Bin 54164 -> 0 bytes
 .../assets/images/async_compac_3.png               |  Bin 70516 -> 0 bytes
 .../assets/images/async_compac_4.png               |  Bin 66932 -> 0 bytes
 content/newsite-content/assets/images/favicon.ico  |  Bin 1150 -> 0 bytes
 .../newsite-content/assets/images/hudi-lake.png    |  Bin 44413 -> 0 bytes
 content/newsite-content/assets/images/hudi.png     |  Bin 3463 -> 0 bytes
 .../assets/images/hudi_commit_duration.png         |  Bin 252950 -> 0 bytes
 content/newsite-content/assets/images/hudi_cow.png |  Bin 48994 -> 0 bytes
 .../newsite-content/assets/images/hudi_intro_1.png |  Bin 53386 -> 0 bytes
 .../assets/images/hudi_intro_big.png               |  Bin 53397 -> 0 bytes
 .../assets/images/hudi_log_format_v2.png           |  Bin 223676 -> 0 bytes
 content/newsite-content/assets/images/hudi_mor.png |  Bin 92073 -> 0 bytes
 .../assets/images/hudi_query_perf_hive.png         |  Bin 158481 -> 0 bytes
 .../assets/images/hudi_query_perf_presto.png       |  Bin 33727 -> 0 bytes
 .../assets/images/hudi_query_perf_spark.png        |  Bin 29384 -> 0 bytes
 .../assets/images/hudi_site_logo.png               |  Bin 13170 -> 0 bytes
 .../assets/images/hudi_timeline.png                |  Bin 23093 -> 0 bytes
 .../assets/images/hudi_upsert_dag.png              |  Bin 496203 -> 0 bytes
 .../assets/images/hudi_upsert_perf1.png            |  Bin 15984 -> 0 bytes
 .../assets/images/hudi_upsert_perf2.png            |  Bin 18954 -> 0 bytes
 .../newsite-content/assets/images/logo-big-2.png   |  Bin 66543 -> 0 bytes
 .../newsite-content/assets/images/logo-big-bak.png |  Bin 7238 -> 0 bytes
 content/newsite-content/assets/images/logo-big.png |  Bin 7238 -> 0 bytes
 .../assets/images/powers/alibaba.png               |  Bin 7247 -> 0 bytes
 .../newsite-content/assets/images/powers/aws.jpg   |  Bin 6937 -> 0 bytes
 .../newsite-content/assets/images/powers/bmw.png   |  Bin 29210 -> 0 bytes
 .../newsite-content/assets/images/powers/emis.jpg  |  Bin 7113 -> 0 bytes
 .../assets/images/powers/kyligence.png             |  Bin 1379 -> 0 bytes
 .../assets/images/powers/lingyue.png               |  Bin 2953 -> 0 bytes
 .../newsite-content/assets/images/powers/qq.png    |  Bin 3532 -> 0 bytes
 .../assets/images/powers/shunfeng.png              |  Bin 5871 -> 0 bytes
 .../assets/images/powers/tathastu.png              |  Bin 7771 -> 0 bytes
 .../assets/images/powers/tongcheng.png             |  Bin 4207 -> 0 bytes
 .../newsite-content/assets/images/powers/uber.png  |  Bin 7034 -> 0 bytes
 .../newsite-content/assets/images/powers/yield.png |  Bin 823 -> 0 bytes
 .../newsite-content/assets/images/powers/yotpo.png |  Bin 1697 -> 0 bytes
 content/newsite-content/assets/images/roadmap.png  |  Bin 146918 -> 0 bytes
 .../assets/images/workflowarrow.png                |  Bin 3595 -> 0 bytes
 content/newsite-content/assets/js/lunr/lunr-en.js  |   69 -
 content/newsite-content/assets/js/lunr/lunr-gr.js  |  522 --
 .../newsite-content/assets/js/lunr/lunr-store.js   |   96 -
 content/newsite-content/assets/js/lunr/lunr.js     | 3484 ------------
 content/newsite-content/assets/js/lunr/lunr.min.js |    1 -
 content/newsite-content/assets/js/main.min.js      |    7 -
 content/newsite-content/community.html             |  431 --
 content/newsite-content/contributing.html          |  459 --
 content/newsite-content/doc-tmp.txt                |   21 -
 content/newsite-content/docker-compose.yml         |   13 -
 content/newsite-content/index.html                 |  241 -
 content/newsite-content/releases.html              |  300 -
 content/newsite-content/sitemap.xml                |  102 -
 content/performance.html                           |  479 --
 content/powered_by.html                            |  476 --
 content/privacy.html                               |  440 --
 content/querying_data.html                         |  637 ---
 content/quickstart.html                            |  572 --
 content/releases.html                              |  519 +-
 content/{newsite-content => }/roadmap.html         |   28 +-
 content/{newsite-content => }/robots.txt           |    0
 content/s3_hoodie.html                             |  491 --
 content/search.json                                |  533 --
 content/sitemap.xml                                |  479 +-
 content/{newsite-content/blog => }/strata.html     |   30 +-
 content/use_cases.html                             |  479 --
 content/writing_data.html                          |  634 ---
 213 files changed, 5556 insertions(+), 47674 deletions(-)

diff --git a/content/404.html b/content/404.html
index a6bf7cb..6fd85f8 100644
--- a/content/404.html
+++ b/content/404.html
@@ -1,423 +1,241 @@
-<!DOCTYPE html>
-<head>
+<!doctype html>
+<html lang="en" class="no-js">
+  <head>
     <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="">
-<meta name="keywords" content="">
-<title>Page Not Found | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
 
+<!-- begin _includes/seo.html --><title>Page Not Found - Apache Hudi</title>
+<meta name="description" content="Page not found. Your pixels are in another canvas.">
 
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
+<meta property="og:type" content="website">
+<meta property="og:locale" content="en_US">
+<meta property="og:site_name" content="">
+<meta property="og:title" content="Page Not Found">
+<meta property="og:url" content="https://hudi.apache.org/404.html">
 
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
 
+  <meta property="og:description" content="Page not found. Your pixels are in another canvas.">
 
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
 
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
 
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
 
-</script>
 
-<link rel="shortcut icon" href="/images/favicon.ico">
+  <meta property="article:modified_time" content="2019-12-30T14:59:57-05:00">
+
+
 
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
 
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
 
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">Releases</a></li>
-                
-                
-                
-                <li><a href="community.html">Community</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">Code</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">Developers<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">Contributing</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">Wiki/Designs</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">Issues</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">Blog</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">Team</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the Page Not Found page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <!-- link to the Chinese home page when current is blog page -->
-                    <a href="/cn/404.html">中文版</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="search...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="Page Not Found">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
 
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
 
+<!-- end _includes/seo.html -->
 
 
+<!--<link href="/feed.xml" type="application/atom+xml" rel="alternate" title=" Feed">-->
 
+<!-- https://t.co/dKP3o1e -->
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
 
+<script>
+  document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js ';
+</script>
+
+<!-- For all browsers -->
+<link rel="stylesheet" href="/assets/css/main.css">
+
+<!--[if IE]>
+  <style>
+    /* old IE unsupported flexbox fixes */
+    .greedy-nav .site-title {
+      padding-right: 3em;
+    }
+    .greedy-nav button {
+      position: absolute;
+      top: 0;
+      right: 0;
+      height: 100%;
+    }
+  </style>
+<![endif]-->
 
 
 
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
+<link rel="icon" type="image/x-icon" href="/assets/images/favicon.ico">
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+  </head>
+
+  <body class="layout--single">
+    <!--[if lt IE 9]>
+<div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
+<![endif]-->
+
+    <div class="masthead">
+  <div class="masthead__inner-wrap" id="masthead__inner-wrap">
+    <div class="masthead__menu">
+      <nav id="site-nav" class="greedy-nav">
+        
+          <a class="site-logo" href="/">
+              <div style="width: 150px; height: 40px">
+
+              </div>
+<!--            <img src="" alt="">-->
+<!--            -->
+<!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
+<!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
+<!--            </span>-->
+<!--            -->
+          </a>
+        
+        <a class="site-title" href="/">
+          
+        </a>
+        <ul class="visible-links"><li class="masthead__menu-item">
+              <a href="/docs/quick-start-guide.html" target="_self" >Documentation</a>
+            </li><li class="masthead__menu-item">
+              <a href="/community.html" target="_self" >Community</a>
+            </li><li class="masthead__menu-item">
+              <a href="/activity.html" target="_self" >Activities</a>
+            </li><li class="masthead__menu-item">
+              <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
+            </li><li class="masthead__menu-item">
+              <a href="/releases.html" target="_self" >Releases</a>
+            </li></ul>
+        <button class="greedy-nav__toggle hidden" type="button">
+          <span class="visually-hidden">Toggle menu</span>
+          <div class="navicon"></div>
+        </button>
+        <ul class="hidden-links hidden"></ul>
+      </nav>
+    </div>
+  </div>
+</div>
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
+  Click <a href="/"> here</a> back to old site.</p>
+-->
+
+    <div class="initial-content">
+      <div id="main" role="main">
+  
+
+  <div class="sidebar sticky">
+
+  
+    <div itemscope itemtype="https://schema.org/Person">
+
+  <div class="author__content">
     
+      <h3 class="author__name" itemprop="name">Quick Links</h3>
     
     
-    <li>
-        <a href="#">Getting Started</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">Quickstart</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">Use Cases</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">Talks & Powered By</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">Comparison</a></li>
-            
-            
-            
-            
-        </ul>
+      <div class="author__bio" itemprop="description">
+        <p>Hudi <em>ingests</em> &amp; <em>manages</em> storage of large analytical datasets over DFS.</p>
+
+      </div>
+    
+  </div>
+
+  <div class="author__urls-wrapper">
+    <ul class="author__urls social-icons">
+      
         
+          <li><a href="/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
+
+          
         
-    
-    <li>
-        <a href="#">Documentation</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">Concepts</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">Writing Data</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">Querying Data</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">Configuration</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">Performance</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">Administering</a></li>
-            
-            
-            
-            
-        </ul>
+          <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-wikipedia-w" aria-hidden="true"></i> Technical Wiki</a></li>
+
+          
         
+          <li><a href="/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
+
+          
         
+          <li><a href="https://join.slack.com/t/apache-hudi/shared_invite/enQtODYyNDAxNzc5MTg2LTE5OTBlYmVhYjM0N2ZhOTJjOWM4YzBmMWU2MjZjMGE4NDc5ZDFiOGQ2N2VkYTVkNzU3ZDQ4OTI1NmFmYWQ0NzE" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-slack" aria-hidden="true"></i> Join on Slack</a></li>
+
+          
         
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
-
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
-
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">Page Not Found</h1>
-</div>
+          <li><a href="https://github.com/apache/incubator-hudi" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-github" aria-hidden="true"></i> Fork on GitHub</a></li>
 
+          
+        
+          <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-navicon" aria-hidden="true"></i> Report Issues</a></li>
 
+          
+        
+      
+    </ul>
+  </div>
+</div>
 
-<div class="post-content">
+  
 
-   
+  
+  </div>
 
-    
 
-  <p>Sorry, but the page you were trying to view does not exist. Try searching for it or looking at the URL to see if it looks correct.</p>
+  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
 
+    <div class="page__inner-wrap">
+      
+        <header>
+          <h1 id="page-title" class="page__title" itemprop="headline">Page Not Found
+</h1>
+        </header>
+      
 
-    <div class="tags">
+      <section class="page__content" itemprop="text">
         
-    </div>
+          <style>
+            .page {
+              padding-right: 0 !important;
+            }
+          </style>
+        
+        <p>Sorry, the page you were trying to view does not exist.</p>
 
-    
+      </section>
 
-</div>
+      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
 
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
 
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
+      
 
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
+    </div>
 
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
+  </article>
 
-<div id="toc"></div>
+</div>
 
-            
-        </div>
-    <!-- /.row -->
     </div>
-<!-- /.container -->
+
+    <div class="page__footer">
+      <footer>
+        
+<div class="row">
+  <div class="col-lg-12 footer">
+    <p>
+      <a class="footer-link-img" href="https://apache.org">
+        <img width="250px" src="/assets/images/asf_logo.svg" alt="The Apache Software Foundation">
+      </a>
+    </p>
+    <p>
+      Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>, Licensed under the Apache License, Version 2.0.
+      Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation. <a href="/docs/privacy">Privacy Policy</a>
+      <br>
+      Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
+      Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
+      stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
+      reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+    </p>
+  </div>
 </div>
+      </footer>
+    </div>
+
+    
+<script src="/assets/js/main.min.js"></script>
 
-</body>
 
+  </body>
 </html>
\ No newline at end of file
diff --git a/content/Dockerfile b/content/Dockerfile
index 89cc254..f0730d3 100644
--- a/content/Dockerfile
+++ b/content/Dockerfile
@@ -1,26 +1,23 @@
-FROM ruby:2.6
-
-RUN apt-get clean \
-  && mv /var/lib/apt/lists /var/lib/apt/lists.broke \
-  && mkdir -p /var/lib/apt/lists/partial
-
-RUN apt-get update
-
-RUN apt-get install -y \
-    nodejs \
-    python-pygments \
-  && apt-get clean \
-  && rm -rf /var/lib/apt/lists/
+FROM jekyll/jekyll:3.8
 
 WORKDIR /tmp
 ADD Gemfile /tmp/
 ADD Gemfile.lock /tmp/
+RUN chmod a+w Gemfile.lock
+
+
+## pick up speed in china
+#RUN gem sources -l \
+# && gem sources --add https://gems.ruby-china.com/ --remove https://rubygems.org/ \
+# && gem sources -u \
+# && bundle config mirror.https://rubygems.org https://gems.ruby-china.com \
+# && bundle config --delete 'mirror.https://rubygems.org/' \
+# && sed -i "s/rubygems.org/gems.ruby-china.com/" Gemfile \
+# && sed -i "s/rubygems.org/gems.ruby-china.com/" Gemfile.lock
+
 
-RUN gem install bundler
-RUN gem install jekyll
-RUN bundle install
-RUN bundle update --bundler
- 
+RUN bundle install \
+ && bundle update --bundler
 
 VOLUME /src
 EXPOSE 4000
diff --git a/content/Gemfile b/content/Gemfile
deleted file mode 100644
index 23bd76e..0000000
--- a/content/Gemfile
+++ /dev/null
@@ -1,11 +0,0 @@
-source 'https://rubygems.org'
-
-gem 'jekyll', '3.7.2'
-gem 'addressable', '2.4.0'
-gem 'json', '2.0.4'
-gem 'jekyll-multiple-languages', '2.0.3'
-gem 'jekyll-paginate', '1.1.0'
-
-group :jekyll_plugins do
-  gem "jekyll-feed", "0.12.1"
-end
diff --git a/content/Gemfile.lock b/content/Gemfile.lock
deleted file mode 100644
index fb82966..0000000
--- a/content/Gemfile.lock
+++ /dev/null
@@ -1,71 +0,0 @@
-GEM
-  remote: https://rubygems.org/
-  specs:
-    addressable (2.4.0)
-    colorator (1.1.0)
-    concurrent-ruby (1.0.5)
-    em-websocket (0.5.1)
-      eventmachine (>= 0.12.9)
-      http_parser.rb (~> 0.6.0)
-    eventmachine (1.2.5)
-    ffi (1.9.18)
-    forwardable-extended (2.6.0)
-    http_parser.rb (0.6.0)
-    i18n (0.9.3)
-      concurrent-ruby (~> 1.0)
-    jekyll (3.7.2)
-      addressable (~> 2.4)
-      colorator (~> 1.0)
-      em-websocket (~> 0.5)
-      i18n (~> 0.7)
-      jekyll-sass-converter (~> 1.0)
-      jekyll-watch (~> 2.0)
-      kramdown (~> 1.14)
-      liquid (~> 4.0)
-      mercenary (~> 0.3.3)
-      pathutil (~> 0.9)
-      rouge (>= 1.7, < 4)
-      safe_yaml (~> 1.0)
-    jekyll-feed (0.12.1)
-      jekyll (>= 3.7, < 5.0)
-    jekyll-multiple-languages (2.0.3)
-    jekyll-paginate (1.1.0)
-    jekyll-sass-converter (1.5.1)
-      sass (~> 3.4)
-    jekyll-watch (2.0.0)
-      listen (~> 3.0)
-    json (2.0.4)
-    kramdown (1.16.2)
-    liquid (4.0.0)
-    listen (3.1.5)
-      rb-fsevent (~> 0.9, >= 0.9.4)
-      rb-inotify (~> 0.9, >= 0.9.7)
-      ruby_dep (~> 1.2)
-    mercenary (0.3.6)
-    pathutil (0.16.1)
-      forwardable-extended (~> 2.6)
-    rb-fsevent (0.10.2)
-    rb-inotify (0.9.10)
-      ffi (>= 0.5.0, < 2)
-    rouge (3.1.1)
-    ruby_dep (1.5.0)
-    safe_yaml (1.0.4)
-    sass (3.5.5)
-      sass-listen (~> 4.0.0)
-    sass-listen (4.0.0)
-      rb-fsevent (~> 0.9, >= 0.9.4)
-      rb-inotify (~> 0.9, >= 0.9.7)
-
-PLATFORMS
-  ruby
-
-DEPENDENCIES
-  addressable (= 2.4.0)
-  jekyll (= 3.7.2)
-  jekyll-feed (= 0.12.1)
-  jekyll-multiple-languages (= 2.0.3)
-  jekyll-paginate (= 1.1.0)
-  json (= 2.0.4)
-
-BUNDLED WITH
-   2.0.2
diff --git a/content/README.md b/content/README.md
deleted file mode 100644
index 74c78e1..0000000
--- a/content/README.md
+++ /dev/null
@@ -1,46 +0,0 @@
-## Site Documentation
-
-This folder contains resources that build the [Apache Hudi website](https://hudi.apache.org)
-
-
-### Building docs
-
-The site is based on a [Jekyll](https://jekyllrb.com/) theme hosted [here](https://idratherbewriting.com/documentation-theme-jekyll/) with detailed instructions.
-
-#### Docker
-
-Simply run `docker-compose build --no-cache && docker-compose up` from the `docs` folder and the site should be up & running at `http://localhost:4000`
-
-To see edits reflect on the site, you may have to bounce the container
-
- - Stop existing container by `ctrl+c` the docker-compose program
- - (or) alternatively via `docker stop docs_server_1`
- - Bring up container again using `docker-compose up`
-
-#### Host OS
-
-To build directly on host OS (\*nix), first you need to install
-
-- gem, ruby (using apt-get/brew)
-- bundler (`gem install bundler`)
-- jekyll (`gem install jekyll`)
-- Update bundler `bundle update --bundler`
-
-and then run the following commands from `docs` folder to install dependencies
-
-`bundle install`
-
-and serve a local site
-
-`bundle exec jekyll serve`
-
-### Submitting changes
-
-To submit changes to the docs, please make the changes on the `asf-site` branch, build the site locally, test it out and submit a pull request with the changes to .md and theme files under `docs`
-
-### Updating site
-
-At a regular cadence, one of the Hudi committers will regenerate the site. In order to do this, first build it locally, test and then move the generated site from `_site` locally to `docs/../content`. Submit changes as a PR.
-
-### Automation
-Coming soon.
diff --git a/content/newsite-content/activity.html b/content/activity.html
similarity index 86%
rename from content/newsite-content/activity.html
rename to content/activity.html
index 0762b62..aac6c15 100644
--- a/content/newsite-content/activity.html
+++ b/content/activity.html
@@ -67,9 +67,7 @@
 <div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
 <![endif]-->
 
-    
-
-<div class="masthead">
+    <div class="masthead">
   <div class="masthead__inner-wrap" id="masthead__inner-wrap">
     <div class="masthead__menu">
       <nav id="site-nav" class="greedy-nav">
@@ -78,7 +76,7 @@
               <div style="width: 150px; height: 40px">
 
               </div>
-<!--            <img src="/assets/images/hudi.png" alt="">-->
+<!--            <img src="" alt="">-->
 <!--            -->
 <!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
 <!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
@@ -90,15 +88,15 @@
           
         </a>
         <ul class="visible-links"><li class="masthead__menu-item">
-              <a href="/newsite-content/docs/quick-start-guide.html" target="_self" >Documentation</a>
+              <a href="/docs/quick-start-guide.html" target="_self" >Documentation</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/community.html" target="_self" >Community</a>
+              <a href="/community.html" target="_self" >Community</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/activity.html" target="_self" >Activities</a>
+              <a href="/activity.html" target="_self" >Activities</a>
             </li><li class="masthead__menu-item">
               <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/releases.html" target="_self" >Releases</a>
+              <a href="/releases.html" target="_self" >Releases</a>
             </li></ul>
         <button class="greedy-nav__toggle hidden" type="button">
           <span class="visually-hidden">Toggle menu</span>
@@ -109,23 +107,19 @@
     </div>
   </div>
 </div>
-<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://issues.apache.org/jira/projects/HUDI/summary">file a jira</a>.
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
   Click <a href="/"> here</a> back to old site.</p>
+-->
 
     <div class="initial-content">
-      
-
-
-
-<div id="main" role="main">
+      <div id="main" role="main">
   
+
   <div class="sidebar sticky">
 
   
-    
-
-
-<div itemscope itemtype="https://schema.org/Person">
+    <div itemscope itemtype="https://schema.org/Person">
 
   <div class="author__content">
     
@@ -143,7 +137,7 @@
     <ul class="author__urls social-icons">
       
         
-          <li><a href="/newsite-content/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
+          <li><a href="/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
 
           
         
@@ -151,7 +145,7 @@
 
           
         
-          <li><a href="/newsite-content/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
+          <li><a href="/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
 
           
         
@@ -179,9 +173,8 @@
 
 
   <div class="archive">
-    
     <h1 id="page-title" class="page__title">Activities</h1>
-    
+
     
     
     <section id="2019" class="taxonomy__section">
@@ -197,7 +190,7 @@
     
     <h2 class="archive__item-title" itemprop="headline">
       
-        <a href="/newsite-content/blog/asf.html">Hudi entered Apache Incubator
+        <a href="/asf.html">Hudi entered Apache Incubator
 </a>
       
     </h2>
@@ -223,7 +216,7 @@
     
     <h2 class="archive__item-title" itemprop="headline">
       
-        <a href="/newsite-content/blog/strata.html">Connect with us at Strata San Jose March 2017
+        <a href="/strata.html">Connect with us at Strata San Jose March 2017
 </a>
       
     </h2>
diff --git a/content/admin_guide.html b/content/admin_guide.html
deleted file mode 100644
index fe03e57..0000000
--- a/content/admin_guide.html
+++ /dev/null
@@ -1,834 +0,0 @@
-<!DOCTYPE html>
-<head>
-    <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="This section offers an overview of tools available to operate an ecosystem of Hudi datasets">
-<meta name="keywords" content="hudi, administration, operation, devops">
-<title>Administering Hudi Pipelines | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
-
-
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
-
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
-
-
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
-
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
-
-</script>
-
-<link rel="shortcut icon" href="/images/favicon.ico">
-
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
-
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
-
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">Releases</a></li>
-                
-                
-                
-                <li><a href="community.html">Community</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">Code</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">Developers<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">Contributing</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">Wiki/Designs</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">Issues</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">Blog</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">Team</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the Administering Hudi Pipelines page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <!-- link to the Chinese home page when current is blog page -->
-                    <a href="/cn/admin_guide.html">中文版</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="search...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="Administering Hudi Pipelines">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
-
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
-
-
-
-
-
-
-
-
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
-    
-    <li>
-        <a href="#">Getting Started</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">Quickstart</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">Use Cases</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">Talks & Powered By</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">Comparison</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-    
-    <li>
-        <a href="#">Documentation</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">Concepts</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">Writing Data</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">Querying Data</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">Configuration</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">Performance</a></li>
-            
-            
-            
-            
-            
-            
-            <li class="active"><a href="admin_guide.html">Administering</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-        
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
-
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
-
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">Administering Hudi Pipelines</h1>
-</div>
-
-
-
-<div class="post-content">
-
-   
-    <div class="summary">This section offers an overview of tools available to operate an ecosystem of Hudi datasets</div>
-   
-
-    
-
-  <p>Admins/ops can gain visibility into Hudi datasets/pipelines in the following ways</p>
-
-<ul>
-  <li><a href="#admin-cli">Administering via the Admin CLI</a></li>
-  <li><a href="#metrics">Graphite metrics</a></li>
-  <li><a href="#spark-ui">Spark UI of the Hudi Application</a></li>
-</ul>
-
-<p>This section provides a glimpse into each of these, with some general guidance on <a href="#troubleshooting">troubleshooting</a></p>
-
-<h2 id="admin-cli">Admin CLI</h2>
-
-<p>Once hudi has been built, the shell can be fired by via  <code class="highlighter-rouge">cd hudi-cli &amp;&amp; ./hudi-cli.sh</code>.
-A hudi dataset resides on DFS, in a location referred to as the <strong>basePath</strong> and we would need this location in order to connect to a Hudi dataset.
-Hudi library effectively manages this dataset internally, using .hoodie subfolder to track all metadata</p>
-
-<p>To initialize a hudi table, use the following command.</p>
-
-<pre><code class="language-Java">18/09/06 15:56:52 INFO annotation.AutowiredAnnotationBeanPostProcessor: JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
-============================================
-*                                          *
-*     _    _           _   _               *
-*    | |  | |         | | (_)              *
-*    | |__| |       __| |  -               *
-*    |  __  ||   | / _` | ||               *
-*    | |  | ||   || (_| | ||               *
-*    |_|  |_|\___/ \____/ ||               *
-*                                          *
-============================================
-
-Welcome to Hoodie CLI. Please type help if you are looking for help.
-hudi-&gt;create --path /user/hive/warehouse/table1 --tableName hoodie_table_1 --tableType COPY_ON_WRITE
-.....
-18/09/06 15:57:15 INFO table.HoodieTableMetaClient: Finished Loading Table of type COPY_ON_WRITE from ...
-</code></pre>
-
-<p>To see the description of hudi table, use the command:</p>
-
-<pre><code class="language-Java">hoodie:hoodie_table_1-&gt;desc
-18/09/06 15:57:19 INFO timeline.HoodieActiveTimeline: Loaded instants []
-    _________________________________________________________
-    | Property                | Value                        |
-    |========================================================|
-    | basePath                | ...                          |
-    | metaPath                | ...                          |
-    | fileSystem              | hdfs                         |
-    | hoodie.table.name       | hoodie_table_1               |
-    | hoodie.table.type       | COPY_ON_WRITE                |
-    | hoodie.archivelog.folder|                              |
-</code></pre>
-
-<p>Following is a sample command to connect to a Hudi dataset contains uber trips.</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;connect --path /app/uber/trips
-
-16/10/05 23:20:37 INFO model.HoodieTableMetadata: Attempting to load the commits under /app/uber/trips/.hoodie with suffix .commit
-16/10/05 23:20:37 INFO model.HoodieTableMetadata: Attempting to load the commits under /app/uber/trips/.hoodie with suffix .inflight
-16/10/05 23:20:37 INFO model.HoodieTableMetadata: All commits :HoodieCommits{commitList=[20161002045850, 20161002052915, 20161002055918, 20161002065317, 20161002075932, 20161002082904, 20161002085949, 20161002092936, 20161002105903, 20161002112938, 20161002123005, 20161002133002, 20161002155940, 20161002165924, 20161002172907, 20161002175905, 20161002190016, 20161002192954, 20161002195925, 20161002205935, 20161002215928, 20161002222938, 20161002225915, 20161002232906, 20161003003028, 201 [...]
-Metadata for table trips loaded
-hoodie:trips-&gt;
-</code></pre>
-
-<p>Once connected to the dataset, a lot of other commands become available. The shell has contextual autocomplete help (press TAB) and below is a list of all commands, few of which are reviewed in this section
-are reviewed</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;help
-* ! - Allows execution of operating system (OS) commands
-* // - Inline comment markers (start of line only)
-* ; - Inline comment markers (start of line only)
-* addpartitionmeta - Add partition metadata to a dataset, if not present
-* clear - Clears the console
-* cls - Clears the console
-* commit rollback - Rollback a commit
-* commits compare - Compare commits with another Hoodie dataset
-* commit showfiles - Show file level details of a commit
-* commit showpartitions - Show partition level details of a commit
-* commits refresh - Refresh the commits
-* commits show - Show the commits
-* commits sync - Compare commits with another Hoodie dataset
-* connect - Connect to a hoodie dataset
-* date - Displays the local date and time
-* exit - Exits the shell
-* help - List all commands usage
-* quit - Exits the shell
-* records deduplicate - De-duplicate a partition path contains duplicates &amp; produce repaired files to replace with
-* script - Parses the specified resource file and executes its commands
-* stats filesizes - File Sizes. Display summary stats on sizes of files
-* stats wa - Write Amplification. Ratio of how many records were upserted to how many records were actually written
-* sync validate - Validate the sync by counting the number of records
-* system properties - Shows the shell's properties
-* utils loadClass - Load a class
-* version - Displays shell version
-
-hoodie:trips-&gt;
-</code></pre>
-
-<h4 id="inspecting-commits">Inspecting Commits</h4>
-
-<p>The task of upserting or inserting a batch of incoming records is known as a <strong>commit</strong> in Hudi. A commit provides basic atomicity guarantees such that only commited data is available for querying.
-Each commit has a monotonically increasing string/number called the <strong>commit number</strong>. Typically, this is the time at which we started the commit.</p>
-
-<p>To view some basic information about the last 10 commits,</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;commits show --sortBy "Total Bytes Written" --desc true --limit 10
-    ________________________________________________________________________________________________________________________________________________________________________
-    | CommitTime    | Total Bytes Written| Total Files Added| Total Files Updated| Total Partitions Written| Total Records Written| Total Update Records Written| Total Errors|
-    |=======================================================================================================================================================================|
-    ....
-    ....
-    ....
-hoodie:trips-&gt;
-</code></pre>
-
-<p>At the start of each write, Hudi also writes a .inflight commit to the .hoodie folder. You can use the timestamp there to estimate how long the commit has been inflight</p>
-
-<pre><code class="language-Java">$ hdfs dfs -ls /app/uber/trips/.hoodie/*.inflight
--rw-r--r--   3 vinoth supergroup     321984 2016-10-05 23:18 /app/uber/trips/.hoodie/20161005225920.inflight
-</code></pre>
-
-<h4 id="drilling-down-to-a-specific-commit">Drilling Down to a specific Commit</h4>
-
-<p>To understand how the writes spread across specific partiions,</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;commit showpartitions --commit 20161005165855 --sortBy "Total Bytes Written" --desc true --limit 10
-    __________________________________________________________________________________________________________________________________________
-    | Partition Path| Total Files Added| Total Files Updated| Total Records Inserted| Total Records Updated| Total Bytes Written| Total Errors|
-    |=========================================================================================================================================|
-     ....
-     ....
-</code></pre>
-
-<p>If you need file level granularity , we can do the following</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;commit showfiles --commit 20161005165855 --sortBy "Partition Path"
-    ________________________________________________________________________________________________________________________________________________________
-    | Partition Path| File ID                             | Previous Commit| Total Records Updated| Total Records Written| Total Bytes Written| Total Errors|
-    |=======================================================================================================================================================|
-    ....
-    ....
-</code></pre>
-
-<h4 id="filesystem-view">FileSystem View</h4>
-
-<p>Hudi views each partition as a collection of file-groups with each file-group containing a list of file-slices in commit
-order (See Concepts). The below commands allow users to view the file-slices for a data-set.</p>
-
-<pre><code class="language-Java"> hoodie:stock_ticks_mor-&gt;show fsview all
- ....
-  _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
- | Partition | FileId | Base-Instant | Data-File | Data-File Size| Num Delta Files| Total Delta File Size| Delta Files |
- |==============================================================================================================================================================================================================================================================================================================================================================================================================|
- | 2018/08/31| 111415c3-f26d-4639-86c8-f9956f245ac3| 20181002180759| hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/111415c3-f26d-4639-86c8-f9956f245ac3_0_20181002180759.parquet| 432.5 KB | 1 | 20.8 KB | [HoodieLogFile {hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/.111415c3-f26d-4639-86c8-f9956f245ac3_20181002180759.log.1}]|
-
-
-
- hoodie:stock_ticks_mor-&gt;show fsview latest --partitionPath "2018/08/31"
- ......
- ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ [...]
- | Partition | FileId | Base-Instant | Data-File | Data-File Size| Num Delta Files| Total Delta Size| Delta Size - compaction scheduled| Delta Size - compaction unscheduled| Delta To Base Ratio - compaction scheduled| Delta To Base Ratio - compaction unscheduled| Delta Files - compaction scheduled | Delta Files - compaction unscheduled|
- |========================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================== [...]
- | 2018/08/31| 111415c3-f26d-4639-86c8-f9956f245ac3| 20181002180759| hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/111415c3-f26d-4639-86c8-f9956f245ac3_0_20181002180759.parquet| 432.5 KB | 1 | 20.8 KB | 20.8 KB | 0.0 B | 0.0 B | 0.0 B | [HoodieLogFile {hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/.111415c3-f26d-4639-86c8-f9956f245ac3_20181002180759.log.1}]| [] |
-
- hoodie:stock_ticks_mor-&gt;
-</code></pre>
-
-<h4 id="statistics">Statistics</h4>
-
-<p>Since Hudi directly manages file sizes for DFS dataset, it might be good to get an overall picture</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;stats filesizes --partitionPath 2016/09/01 --sortBy "95th" --desc true --limit 10
-    ________________________________________________________________________________________________
-    | CommitTime    | Min     | 10th    | 50th    | avg     | 95th    | Max     | NumFiles| StdDev  |
-    |===============================================================================================|
-    | &lt;COMMIT_ID&gt;   | 93.9 MB | 93.9 MB | 93.9 MB | 93.9 MB | 93.9 MB | 93.9 MB | 2       | 2.3 KB  |
-    ....
-    ....
-</code></pre>
-
-<p>In case of Hudi write taking much longer, it might be good to see the write amplification for any sudden increases</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;stats wa
-    __________________________________________________________________________
-    | CommitTime    | Total Upserted| Total Written| Write Amplifiation Factor|
-    |=========================================================================|
-    ....
-    ....
-</code></pre>
-
-<h4 id="archived-commits">Archived Commits</h4>
-
-<p>In order to limit the amount of growth of .commit files on DFS, Hudi archives older .commit files (with due respect to the cleaner policy) into a commits.archived file.
-This is a sequence file that contains a mapping from commitNumber =&gt; json with raw information about the commit (same that is nicely rolled up above).</p>
-
-<h4 id="compactions">Compactions</h4>
-
-<p>To get an idea of the lag between compaction and writer applications, use the below command to list down all
-pending compactions.</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compactions show all
-     ___________________________________________________________________
-    | Compaction Instant Time| State    | Total FileIds to be Compacted|
-    |==================================================================|
-    | &lt;INSTANT_1&gt;            | REQUESTED| 35                           |
-    | &lt;INSTANT_2&gt;            | INFLIGHT | 27                           |
-</code></pre>
-
-<p>To inspect a specific compaction plan, use</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compaction show --instant &lt;INSTANT_1&gt;
-    _________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
-    | Partition Path| File Id | Base Instant  | Data File Path                                    | Total Delta Files| getMetrics                                                                                                                    |
-    |================================================================================================================================================================================================================================================
-    | 2018/07/17    | &lt;UUID&gt;  | &lt;INSTANT_1&gt;   | viewfs://ns-default/.../../UUID_&lt;INSTANT&gt;.parquet | 1                | {TOTAL_LOG_FILES=1.0, TOTAL_IO_READ_MB=1230.0, TOTAL_LOG_FILES_SIZE=2.51255751E8, TOTAL_IO_WRITE_MB=991.0, TOTAL_IO_MB=2221.0}|
-
-</code></pre>
-
-<p>To manually schedule or run a compaction, use the below command. This command uses spark launcher to perform compaction
-operations. NOTE : Make sure no other application is scheduling compaction for this dataset concurrently</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;help compaction schedule
-Keyword:                   compaction schedule
-Description:               Schedule Compaction
- Keyword:                  sparkMemory
-   Help:                   Spark executor memory
-   Mandatory:              false
-   Default if specified:   '__NULL__'
-   Default if unspecified: '1G'
-
-* compaction schedule - Schedule Compaction
-</code></pre>
-
-<pre><code class="language-Java">hoodie:trips-&gt;help compaction run
-Keyword:                   compaction run
-Description:               Run Compaction for given instant time
- Keyword:                  tableName
-   Help:                   Table name
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  parallelism
-   Help:                   Parallelism for hoodie compaction
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  schemaFilePath
-   Help:                   Path for Avro schema file
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  sparkMemory
-   Help:                   Spark executor memory
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  retry
-   Help:                   Number of retries
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  compactionInstant
-   Help:                   Base path for the target hoodie dataset
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
-* compaction run - Run Compaction for given instant time
-</code></pre>
-
-<h5 id="validate-compaction">Validate Compaction</h5>
-
-<p>Validating a compaction plan : Check if all the files necessary for compactions are present and are valid</p>
-
-<pre><code class="language-Java">hoodie:stock_ticks_mor-&gt;compaction validate --instant 20181005222611
-...
-
-   COMPACTION PLAN VALID
-
-    ___________________________________________________________________________________________________________________________________________________________________________________________________________________________
-    | File Id                             | Base Instant Time| Base Data File                                                                                                                   | Num Delta Files| Valid| Error|
-    |==========================================================================================================================================================================================================================|
-    | 05320e98-9a57-4c38-b809-a6beaaeb36bd| 20181005222445   | hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/05320e98-9a57-4c38-b809-a6beaaeb36bd_0_20181005222445.parquet| 1              | true |      |
-
-
-
-hoodie:stock_ticks_mor-&gt;compaction validate --instant 20181005222601
-
-   COMPACTION PLAN INVALID
-
-    _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
-    | File Id                             | Base Instant Time| Base Data File                                                                                                                   | Num Delta Files| Valid| Error                                                                           |
-    |=====================================================================================================================================================================================================================================================================================================|
-    | 05320e98-9a57-4c38-b809-a6beaaeb36bd| 20181005222445   | hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/05320e98-9a57-4c38-b809-a6beaaeb36bd_0_20181005222445.parquet| 1              | false| All log files specified in compaction operation is not present. Missing ....    |
-</code></pre>
-
-<h5 id="note">NOTE</h5>
-
-<p>The following commands must be executed without any other writer/ingestion application running.</p>
-
-<p>Sometimes, it becomes necessary to remove a fileId from a compaction-plan inorder to speed-up or unblock compaction
-operation. Any new log-files that happened on this file after the compaction got scheduled will be safely renamed
-so that are preserved. Hudi provides the following CLI to support it</p>
-
-<h5 id="unscheduling-compaction">UnScheduling Compaction</h5>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compaction unscheduleFileId --fileId &lt;FileUUID&gt;
-....
-No File renames needed to unschedule file from pending compaction. Operation successful.
-</code></pre>
-
-<p>In other cases, an entire compaction plan needs to be reverted. This is supported by the following CLI</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compaction unschedule --compactionInstant &lt;compactionInstant&gt;
-.....
-No File renames needed to unschedule pending compaction. Operation successful.
-</code></pre>
-
-<h5 id="repair-compaction">Repair Compaction</h5>
-
-<p>The above compaction unscheduling operations could sometimes fail partially (e:g -&gt; DFS temporarily unavailable). With
-partial failures, the compaction operation could become inconsistent with the state of file-slices. When you run
-<code class="highlighter-rouge">compaction validate</code>, you can notice invalid compaction operations if there is one.  In these cases, the repair
-command comes to the rescue, it will rearrange the file-slices so that there is no loss and the file-slices are
-consistent with the compaction plan</p>
-
-<pre><code class="language-Java">hoodie:stock_ticks_mor-&gt;compaction repair --instant 20181005222611
-......
-Compaction successfully repaired
-.....
-</code></pre>
-
-<h2 id="metrics">Metrics</h2>
-
-<p>Once the Hudi Client is configured with the right datasetname and environment for metrics, it produces the following graphite metrics, that aid in debugging hudi datasets</p>
-
-<ul>
-  <li><strong>Commit Duration</strong> - This is amount of time it took to successfully commit a batch of records</li>
-  <li><strong>Rollback Duration</strong> - Similarly, amount of time taken to undo partial data left over by a failed commit (happens everytime automatically after a failing write)</li>
-  <li><strong>File Level metrics</strong> - Shows the amount of new files added, versions, deleted (cleaned) in each commit</li>
-  <li><strong>Record Level Metrics</strong> - Total records inserted/updated etc per commit</li>
-  <li><strong>Partition Level metrics</strong> - number of partitions upserted (super useful to understand sudden spikes in commit duration)</li>
-</ul>
-
-<p>These metrics can then be plotted on a standard tool like grafana. Below is a sample commit duration chart.</p>
-
-<figure>
-    <img class="docimage" src="/images/hudi_commit_duration.png" alt="hudi_commit_duration.png" style="max-width: 100%" />
-</figure>
-
-<h2 id="troubleshooting">Troubleshooting Failures</h2>
-
-<p>Section below generally aids in debugging Hudi failures. Off the bat, the following metadata is added to every record to help triage  issues easily using standard Hadoop SQL engines (Hive/Presto/Spark)</p>
-
-<ul>
-  <li><strong>_hoodie_record_key</strong> - Treated as a primary key within each DFS partition, basis of all updates/inserts</li>
-  <li><strong>_hoodie_commit_time</strong> - Last commit that touched this record</li>
-  <li><strong>_hoodie_file_name</strong> - Actual file name containing the record (super useful to triage duplicates)</li>
-  <li><strong>_hoodie_partition_path</strong> - Path from basePath that identifies the partition containing this record</li>
-</ul>
-
-<p>Note that as of now, Hudi assumes the application passes in the same deterministic partitionpath for a given recordKey. i.e the uniqueness of record key is only enforced within each partition</p>
-
-<h4 id="missing-records">Missing records</h4>
-
-<p>Please check if there were any write errors using the admin commands above, during the window at which the record could have been written.
-If you do find errors, then the record was not actually written by Hudi, but handed back to the application to decide what to do with it.</p>
-
-<h4 id="duplicates">Duplicates</h4>
-
-<p>First of all, please confirm if you do indeed have duplicates <strong>AFTER</strong> ensuring the query is accessing the Hudi datasets <a href="sql_queries.html">properly</a> .</p>
-
-<ul>
-  <li>If confirmed, please use the metadata fields above, to identify the physical files &amp; partition files containing the records .</li>
-  <li>If duplicates span files across partitionpath, then this means your application is generating different partitionPaths for same recordKey, Please fix your app</li>
-  <li>if duplicates span multiple files within the same partitionpath, please engage with mailing list. This should not happen. You can use the <code class="highlighter-rouge">records deduplicate</code> command to fix your data.</li>
-</ul>
-
-<h4 id="spark-ui">Spark failures</h4>
-
-<p>Typical upsert() DAG looks like below. Note that Hudi client also caches intermediate RDDs to intelligently profile workload and size files and spark parallelism.
-Also Spark UI shows sortByKey twice due to the probe job also being shown, nonetheless its just a single sort.</p>
-
-<figure>
-    <img class="docimage" src="/images/hudi_upsert_dag.png" alt="hudi_upsert_dag.png" style="max-width: 100%" />
-</figure>
-
-<p>At a high level, there are two steps</p>
-
-<p><strong>Index Lookup to identify files to be changed</strong></p>
-
-<ul>
-  <li>Job 1 : Triggers the input data read, converts to HoodieRecord object and then stops at obtaining a spread of input records to target partition paths</li>
-  <li>Job 2 : Load the set of file names which we need check against</li>
-  <li>Job 3  &amp; 4 : Actual lookup after smart sizing of spark join parallelism, by joining RDDs in 1 &amp; 2 above</li>
-  <li>Job 5 : Have a tagged RDD of recordKeys with locations</li>
-</ul>
-
-<p><strong>Performing the actual writing of data</strong></p>
-
-<ul>
-  <li>Job 6 : Lazy join of incoming records against recordKey, location to provide a final set of HoodieRecord which now contain the information about which file/partitionpath they are found at (or null if insert). Then also profile the workload again to determine sizing of files</li>
-  <li>Job 7 : Actual writing of data (update + insert + insert turned to updates to maintain file size)</li>
-</ul>
-
-<p>Depending on the exception source (Hudi/Spark), the above knowledge of the DAG can be used to pinpoint the actual issue. The most often encountered failures result from YARN/DFS temporary failures.
-In the future, a more sophisticated debug/management UI would be added to the project, that can help automate some of this debugging.</p>
-
-
-    <div class="tags">
-        
-    </div>
-
-    
-
-</div>
-
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
-
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
-
-<div id="toc"></div>
-
-            
-        </div>
-    <!-- /.row -->
-    </div>
-<!-- /.container -->
-</div>
-
-</body>
-
-</html>
\ No newline at end of file
diff --git a/content/newsite-content/blog/asf.html b/content/asf.html
similarity index 86%
rename from content/newsite-content/blog/asf.html
rename to content/asf.html
index 2614fdd..7071519 100644
--- a/content/newsite-content/blog/asf.html
+++ b/content/asf.html
@@ -10,7 +10,7 @@
 <meta property="og:locale" content="en_US">
 <meta property="og:site_name" content="">
 <meta property="og:title" content="Hudi entered Apache Incubator">
-<meta property="og:url" content="https://hudi.apache.org/blog/asf.html">
+<meta property="og:url" content="https://hudi.apache.org/asf.html">
 
 
   <meta property="og:description" content="In the coming weeks, we will be moving in our new home on the Apache Incubator.">
@@ -67,9 +67,7 @@
 <div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
 <![endif]-->
 
-    
-
-<div class="masthead">
+    <div class="masthead">
   <div class="masthead__inner-wrap" id="masthead__inner-wrap">
     <div class="masthead__menu">
       <nav id="site-nav" class="greedy-nav">
@@ -78,7 +76,7 @@
               <div style="width: 150px; height: 40px">
 
               </div>
-<!--            <img src="/assets/images/hudi.png" alt="">-->
+<!--            <img src="" alt="">-->
 <!--            -->
 <!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
 <!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
@@ -90,15 +88,15 @@
           
         </a>
         <ul class="visible-links"><li class="masthead__menu-item">
-              <a href="/newsite-content/docs/quick-start-guide.html" target="_self" >Documentation</a>
+              <a href="/docs/quick-start-guide.html" target="_self" >Documentation</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/community.html" target="_self" >Community</a>
+              <a href="/community.html" target="_self" >Community</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/activity.html" target="_self" >Activities</a>
+              <a href="/activity.html" target="_self" >Activities</a>
             </li><li class="masthead__menu-item">
               <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/releases.html" target="_self" >Releases</a>
+              <a href="/releases.html" target="_self" >Releases</a>
             </li></ul>
         <button class="greedy-nav__toggle hidden" type="button">
           <span class="visually-hidden">Toggle menu</span>
@@ -109,19 +107,19 @@
     </div>
   </div>
 </div>
-<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://issues.apache.org/jira/projects/HUDI/summary">file a jira</a>.
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
   Click <a href="/"> here</a> back to old site.</p>
+-->
 
     <div class="initial-content">
       <div id="main" role="main">
   
+
   <div class="sidebar sticky">
 
   
-    
-
-
-<div itemscope itemtype="https://schema.org/Person">
+    <div itemscope itemtype="https://schema.org/Person">
 
   <div class="author__content">
     
@@ -139,7 +137,7 @@
     <ul class="author__urls social-icons">
       
         
-          <li><a href="/newsite-content/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
+          <li><a href="/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
 
           
         
@@ -147,7 +145,7 @@
 
           
         
-          <li><a href="/newsite-content/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
+          <li><a href="/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
 
           
         
diff --git a/content/assets/css/main.css b/content/assets/css/main.css
index a637744..1f8c5a0 100644
--- a/content/assets/css/main.css
+++ b/content/assets/css/main.css
@@ -1 +1 @@
-table{border-color:#1ab7ea !important}.page a{color:#3b9cba !important}.page__content{font-size:18px}.page__content.releases{font-size:18px}.page__footer{font-size:15px !important}.page__footer a{color:#3b9cba !important}.page__content .notice,.page__content .notice--primary,.page__content .notice--info,.page__content .notice--warning,.page__content .notice--success,.page__content .notice--danger{font-size:0.8em !important}.page__content table{font-size:0.8em !important}.page__content ta [...]
+table{border-color:#1ab7ea !important}.page a{color:#3b9cba !important}.page__content{font-size:17px}.page__content.releases{font-size:17px}.page__footer{font-size:15px !important}.page__footer a{color:#3b9cba !important}.page__content .notice,.page__content .notice--primary,.page__content .notice--info,.page__content .notice--warning,.page__content .notice--success,.page__content .notice--danger{font-size:0.8em !important}.page__content table{font-size:0.8em !important}.page__content ta [...]
diff --git a/content/assets/js/lunr/lunr-store.js b/content/assets/js/lunr/lunr-store.js
index 4974520..45e3608 100644
--- a/content/assets/js/lunr/lunr-store.js
+++ b/content/assets/js/lunr/lunr-store.js
@@ -2,24 +2,49 @@ var store = [{
         "title": "S3 Filesystem",
         "excerpt":"In this page, we explain how to get your Hudi spark job to store into AWS S3. AWS configs There are two configurations required for Hudi-S3 compatibility: Adding AWS Credentials for Hudi Adding required Jars to classpath AWS Credentials Simplest way to use Hudi with S3, is to configure your...","categories": [],
         "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/s3_hoodie.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "S3 Filesystem",
+        "excerpt":"In this page, we explain how to get your Hudi spark job to store into AWS S3. AWS configs There are two configurations required for Hudi-S3 compatibility: Adding AWS Credentials for Hudi Adding required Jars to classpath AWS Credentials Simplest way to use Hudi with S3, is to configure your...","categories": [],
+        "tags": [],
         "url": "http://0.0.0.0:4000/docs/s3_hoodie.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "GCS Filesystem",
         "excerpt":"For Hudi storage on GCS, regional buckets provide an DFS API with strong consistency. GCS Configs There are two configurations required for Hudi GCS compatibility: Adding GCS Credentials for Hudi Adding required jars to classpath GCS Credentials Add the required configs in your core-site.xml from where Hudi can fetch them....","categories": [],
         "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/gcs_hoodie.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "GCS Filesystem",
+        "excerpt":"For Hudi storage on GCS, regional buckets provide an DFS API with strong consistency. GCS Configs There are two configurations required for Hudi GCS compatibility: Adding GCS Credentials for Hudi Adding required jars to classpath GCS Credentials Add the required configs in your core-site.xml from where Hudi can fetch them....","categories": [],
+        "tags": [],
         "url": "http://0.0.0.0:4000/docs/gcs_hoodie.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Migration Guide",
         "excerpt":"Hudi maintains metadata such as commit timeline and indexes to manage a dataset. The commit timelines helps to understand the actions happening on a dataset as well as the current state of a dataset. Indexes are used by Hudi to maintain a record key to file id mapping to efficiently...","categories": [],
         "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/migration_guide.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "Migration Guide",
+        "excerpt":"Hudi maintains metadata such as commit timeline and indexes to manage a dataset. The commit timelines helps to understand the actions happening on a dataset as well as the current state of a dataset. Indexes are used by Hudi to maintain a record key to file id mapping to efficiently...","categories": [],
+        "tags": [],
         "url": "http://0.0.0.0:4000/docs/migration_guide.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Docker Demo",
         "excerpt":"A Demo using docker containers Lets use a real world example to see how hudi works end to end. For this purpose, a self contained data infrastructure is brought up in a local docker cluster within your computer. The steps have been tested on a Mac laptop Prerequisites Docker Setup...","categories": [],
         "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/docker_demo.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "Docker Demo",
+        "excerpt":"A Demo using docker containers Lets use a real world example to see how hudi works end to end. For this purpose, a self contained data infrastructure is brought up in a local docker cluster within your computer. The steps have been tested on a Mac laptop Prerequisites Docker Setup...","categories": [],
+        "tags": [],
         "url": "http://0.0.0.0:4000/docs/docker_demo.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Quick-Start Guide",
+        "excerpt":"本指南通过使用spark-shell简要介绍了Hudi功能。使用Spark数据源,我们将通过代码段展示如何插入和更新的Hudi默认存储类型数据集: 写时复制。每次写操作之后,我们还将展示如何读取快照和增量读取数据。 设置spark-shell Hudi适用于Spark-2.x版本。您可以按照此处的说明设置spark。 在提取的目录中,使用spark-shell运行Hudi: bin/spark-shell --packages org.apache.hudi:hudi-spark-bundle:0.5.0-incubating --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' 设置表名、基本路径和数据生成器来为本指南生成记录。 import org.apache.hudi.QuickstartUtils._ import scala.collection.JavaConversions._ import org.apache.spark.sql. [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/quick-start-guide.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "Quick-Start Guide",
         "excerpt":"This guide provides a quick peek at Hudi’s capabilities using spark-shell. Using Spark datasources, we will walk through code snippets that allows you to insert and update a Hudi dataset of default storage type: Copy on Write. After each write operation we will also show how to read the data...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/quick-start-guide.html",
@@ -29,46 +54,91 @@ var store = [{
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/structure.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "使用案例",
+        "excerpt":"以下是一些使用Hudi的示例,说明了加快处理速度和提高效率的好处 近实时摄取 将外部源(如事件日志、数据库、外部源)的数据摄取到Hadoop数据湖是一个众所周知的问题。 尽管这些数据对整个组织来说是最有价值的,但不幸的是,在大多数(如果不是全部)Hadoop部署中都使用零散的方式解决,即使用多个不同的摄取工具。 对于RDBMS摄取,Hudi提供 通过更新插入达到更快加载,而不是昂贵且低效的批量加载。例如,您可以读取MySQL BIN日志或Sqoop增量导入并将其应用于 DFS上的等效Hudi表。这比批量合并任务及复杂的手工合并工作流更快/更有效率。 对于NoSQL数据存储,如Cassandra / Voldemort / HBase,即使是中等规模大小也会存储数十亿行。 毫无疑问, 全量加载不可行,如果摄取需要跟上较高的更新量,那么则需要更有效的方法。 即使对于像Kafka�
 �样的不可变数据源,Hudi也可以 强制在HDFS上使用最小文件大小, 这采取了综合方式解决HDFS小文件问题来改善NameNode的健康状况。这对事件流来说更为 [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/use_cases.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Use Cases",
         "excerpt":"Near Real-Time Ingestion Ingesting data from external sources like (event logs, databases, external sources) into a Hadoop Data Lake is a well known problem. In most (if not all) Hadoop deployments, it is unfortunately solved in a piecemeal fashion, using a medley of ingestion tools, even though this data is...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/use_cases.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "演讲 & Hudi 用户",
+        "excerpt":"已使用 Uber Hudi最初由Uber开发,用于实现低延迟、高效率的数据库摄取。 Hudi自2016年8月开始在生产环境上线,在Hadoop上驱动约100个非常关键的业务表,支撑约几百TB的数据规模(前10名包括行程、乘客、司机)。 Hudi还支持几个增量的Hive ETL管道,并且目前已集成到Uber的数据分发系统中。 EMIS Health EMIS Health是英国最大的初级保健IT软件提供商,其数据集包括超过5000亿的医疗保健记录。HUDI用于管理生产中的分析数据集,并使其与上游源保持同步。Presto用于查询以HUDI格式写入的数据。 Yields.io Yields.io是第一个使用AI在企业范围内进行自动模型验证和实时监控的金融科技平台。他们的数据湖由Hudi管理,他们还积极使用Hudi为增量式、跨语言/平台机器学习构建基础架构。 Yotpo Hudi在Yotpo有不少用途。首先,在他们的开源ETL框架中集成了Hudi作为CDC�
 �道的输出写入程序,即从数据库binlog生成的事件流到Kafka然后再写入S3。 演 [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/powered_by.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Talks & Powered By",
         "excerpt":"Adoption Uber Apache Hudi was originally developed at Uber, to achieve low latency database ingestion, with high efficiency. It has been in production since Aug 2016, powering the massive 100PB data lake, including highly business critical tables like core trips,riders,partners. It also powers several incremental Hive ETL pipelines and being...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/powered_by.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "对比",
+        "excerpt":"Apache Hudi填补了在DFS上处理数据的巨大空白,并可以和这些技术很好地共存。然而, 通过将Hudi与一些相关系统进行对比,来了解Hudi如何适应当前的大数据生态系统,并知晓这些系统在设计中做的不同权衡仍将非常有用。   Kudu   Apache Kudu是一个与Hudi具有相似目标的存储系统,该系统通过对upserts支持来对PB级数据进行实时分析。 一个关键的区别是Kudu还试图充当OLTP工作负载的数据存储,而Hudi并不希望这样做。 因此,Kudu不支持增量拉取(截至2017年初),而Hudi支持以便进行增量处理。   Kudu与分布式文件系统抽象和HDFS完全不同,它自己的一组存储服务器通过RAFT相互通信。 与之不同的是,Hudi旨在与底层Hadoop兼容的文件系统(HDFS,S3或Ceph)一起使用,并且没有自己的存储服务器群,而是依靠Apache Spark来完成繁重的工作。 因此,Hudi可以像其他S
 park作业一样轻松扩展,而Kudu则需要硬件和运营支持,特别是HBase或Vertica等数据存储系统。 [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/comparison.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Comparison",
         "excerpt":"Apache Hudi fills a big void for processing data on top of DFS, and thus mostly co-exists nicely with these technologies. However, it would be useful to understand how Hudi fits into the current big data ecosystem, contrasting it with a few related systems and bring out the different tradeoffs...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/comparison.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "概念",
+        "excerpt":"Apache Hudi(发音为“Hudi”)在DFS的数据集上提供以下流原语 插入更新 (如何改变数据集?) 增量拉取 (如何获取变更的数据?) 在本节中,我们将讨论重要的概念和术语,这些概念和术语有助于理解并有效使用这些原语。 时间轴 在它的核心,Hudi维护一条包含在不同的即时时间所有对数据集操作的时间轴,从而提供,从不同时间点出发得到不同的视图下的数据集。Hudi即时包含以下组件 操作类型 : 对数据集执行的操作类型 即时时间 : 即时时间通常是一个时间戳(例如:20190117010349),该时间戳按操作开始时间的顺序单调增加。 状态 : 即时的状态 Hudi保证在时间轴上执行的操作的原子性和基于即时时间的时间轴一致性。 执行的关键操作包括 COMMITS - 一次提交表示将一组记录原子写入到数据集中。 CLEANS - 删除数据集中不再需要的旧文件版本的后台
 活动。 DELTA_COMMIT - 增量提交是指将一批记录原子写入到MergeOnRead存储类型的数据集中,其中一些/所有数据都可以只写到增量日志中。 COMPA [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/concepts.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Concepts",
         "excerpt":"Apache Hudi (pronounced “Hudi”) provides the following streaming primitives over datasets on DFS Upsert (how do I change the dataset?) Incremental pull (how do I fetch data that changed?) In this section, we will discuss key concepts &amp; terminologies that are important to understand, to be able to effectively use...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/concepts.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "写入 Hudi 数据集",
+        "excerpt":"这一节我们将介绍使用DeltaStreamer工具从外部源甚至其他Hudi数据集摄取新更改的方法, 以及通过使用Hudi数据源的upserts加快大型Spark作业的方法。 对于此类数据集,我们可以使用各种查询引擎查询它们。 写操作 在此之前,了解Hudi数据源及delta streamer工具提供的三种不同的写操作以及如何最佳利用它们可能会有所帮助。 这些操作可以在针对数据集发出的每个提交/增量提交中进行选择/更改。 UPSERT(插入更新) :这是默认操作,在该操作中,通过查找索引,首先将输入记录标记为插入或更新。 在运行启发式方法以确定如何最好地将这些记录放到存储上,如优化文件大小之类后,这些记录最终会被写入。 对于诸如数据库更改捕获之类的用例,建议该操作,因为输入几乎肯定包含更新。 INSERT(插入) :就使用启发式方法确定文件大小�
 �言,此操作与插入更新(UPSERT)非常相似,但此操作完全跳过了索引查找步骤。 因此,对于日志重复数据删除等用例(结合下面提到的过滤重复项的选项),它可以比插入更新快得多。 插入也适用于这种用 [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/writing_data.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Writing Hudi Datasets",
         "excerpt":"In this section, we will cover ways to ingest new changes from external sources or even other Hudi datasets using the DeltaStreamer tool, as well as speeding up large Spark jobs via upserts using the Hudi datasource. Such datasets can then be queried using various query engines. Write Operations Before...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/writing_data.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "查询 Hudi 数据集",
+        "excerpt":"从概念上讲,Hudi物理存储一次数据到DFS上,同时在其上提供三个逻辑视图,如之前所述。 数据集同步到Hive Metastore后,它将提供由Hudi的自定义输入格式支持的Hive外部表。一旦提供了适当的Hudi捆绑包, 就可以通过Hive、Spark和Presto之类的常用查询引擎来查询数据集。 具体来说,在写入过程中传递了两个由table name命名的Hive表。 例如,如果table name = hudi_tbl,我们得到 hudi_tbl 实现了由 HoodieParquetInputFormat 支持的数据集的读优化视图,从而提供了纯列式数据。 hudi_tbl_rt 实现了由 HoodieParquetRealtimeInputFormat 支持的数据集的实时视图,从而提供了基础数据和日志数据的合并视图。 如概念部分所述,增量处理所需要的 一个关键原语是增量拉取(以从数据集中获取更改流/日志)。您可以增量提取Hudi数据集,这意味着自指定的即时时间起, 您可�
 �只获得全部更新和新行。 这与插入更新一起使用,对于构建某 [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/querying_data.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Querying Hudi Datasets",
         "excerpt":"Conceptually, Hudi stores data physically once on DFS, while providing 3 logical views on top, as explained before. Once the dataset is synced to the Hive metastore, it provides external Hive tables backed by Hudi’s custom inputformats. Once the proper hudi bundle has been provided, the dataset can be queried...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/querying_data.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "配置",
+        "excerpt":"该页面介绍了几种配置写入或读取Hudi数据集的作业的方法。 简而言之,您可以在几个级别上控制行为。 Spark数据源配置 : 这些配置控制Hudi Spark数据源,提供如下功能: 定义键和分区、选择写操作、指定如何合并记录或选择要读取的视图类型。 WriteClient 配置 : 在内部,Hudi数据源使用基于RDD的HoodieWriteClient API 真正执行对存储的写入。 这些配置可对文件大小、压缩(compression)、并行度、压缩(compaction)、写入模式、清理等底层方面进行完全控制。 尽管Hudi提供了合理的默认设置,但在不同情形下,可能需要对这些配置进行调整以针对特定的工作负载进行优化。 RecordPayload 配置 : 这是Hudi提供的最底层的定制。 RecordPayload定义了如何根据传入的新记录和存储的旧记录来产生新值以进行插入更新。 Hudi提供了诸如OverwriteWithLatestAvroPayload的
 默认实现,该实现仅使用最新或最后写入的记录来更新存储。 在数据源和Wr [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/configurations.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Configurations",
         "excerpt":"This page covers the different ways of configuring your job to write/read Hudi datasets. At a high level, you can control behaviour at few levels. Spark Datasource Configs : These configs control the Hudi Spark Datasource, providing ability to define keys/partitioning, pick out the write operation, specify how to merge...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/configurations.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "性能",
+        "excerpt":"在本节中,我们将介绍一些有关Hudi插入更新、增量提取的实际性能数据,并将其与实现这些任务的其它传统工具进行比较。   插入更新   下面显示了从NoSQL数据库摄取获得的速度提升,这些速度提升数据是通过在写入时复制存储上的Hudi数据集上插入更新而获得的, 数据集包括5个从小到大的表(相对于批量加载表)。           由于Hudi可以通过增量构建数据集,它也为更频繁地调度摄取提供了可能性,从而减少了延迟,并显著节省了总体计算成本。           Hudi插入更新在t1表的一次提交中就进行了高达4TB的压力测试。 有关一些调优技巧,请参见这里。   索引   为了有效地插入更新数据,Hudi需要将要写入的批量数据中的记录分类为插入和更新(并标记它所属的文件组)。 为了加快此操作的速度,Hudi采用了可插拔索引机制,该机制存储
 了recordKey和它所属的文件组ID之间的映射。 默认情况下,Hudi使用内置索引,该索引使用文件范围和布隆过滤器来完成此任务,相比于Spark Join,其速度最高可提高10倍。   当您将r [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/performance.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Performance",
         "excerpt":"In this section, we go over some real world performance numbers for Hudi upserts, incremental pull and compare them against the conventional alternatives for achieving these tasks. Upserts Following shows the speed up obtained for NoSQL database ingestion, from incrementally upserting on a Hudi dataset on the copy-on-write storage, on...","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/performance.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "管理 Hudi Pipelines",
+        "excerpt":"管理员/运维人员可以通过以下方式了解Hudi数据集/管道 通过Admin CLI进行管理 Graphite指标 Hudi应用程序的Spark UI 本节简要介绍了每一种方法,并提供了有关故障排除的一些常规指南 Admin CLI 一旦构建了hudi,就可以通过cd hudi-cli &amp;&amp; ./hudi-cli.sh启动shell。 一个hudi数据集位于DFS上的basePath位置,我们需要该位置才能连接到Hudi数据集。 Hudi库使用.hoodie子文件夹跟踪所有元数据,从而有效地在内部管理该数据集。 初始化hudi表,可使用如下命令。 18/09/06 15:56:52 INFO annotation.AutowiredAnnotationBeanPostProcessor: JSR-330 'javax.inject.Inject' annotation found and supported for autowiring ========================================== [...]
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/admin_guide.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Administering Hudi Pipelines",
         "excerpt":"Admins/ops can gain visibility into Hudi datasets/pipelines in the following ways Administering via the Admin CLI Graphite metrics Spark UI of the Hudi Application This section provides a glimpse into each of these, with some general guidance on troubleshooting Admin CLI Once hudi has been built, the shell can be...","categories": [],
         "tags": [],
@@ -77,20 +147,30 @@ var store = [{
         "title": "Privacy Policy",
         "excerpt":"Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following: The IP address from which you access the website; The type of browser and operating system you use to access our site; The date and time...","categories": [],
         "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/privacy.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "Privacy Policy",
+        "excerpt":"Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following: The IP address from which you access the website; The type of browser and operating system you use to access our site; The date and time...","categories": [],
+        "tags": [],
         "url": "http://0.0.0.0:4000/docs/privacy.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
+        "title": "文档版本",
+        "excerpt":"                                  latest             英文版             中文版                       ","categories": [],
+        "tags": [],
+        "url": "http://0.0.0.0:4000/cn/docs/docs-versions.html",
+        "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Docs Versions",
-        "excerpt":"        latest     ","categories": [],
+        "excerpt":"                                  latest             English Version             Chinese Version                       ","categories": [],
         "tags": [],
         "url": "http://0.0.0.0:4000/docs/docs-versions.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Connect with us at Strata San Jose March 2017",
         "excerpt":"We will be presenting Hudi &amp; general concepts around how incremental processing works at Uber. Catch our talk “Incremental Processing on Hadoop At Uber”   ","categories": [],
         "tags": [],
-        "url": "http://0.0.0.0:4000/blog/strata.html",
+        "url": "http://0.0.0.0:4000/strata.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},{
         "title": "Hudi entered Apache Incubator",
         "excerpt":"In the coming weeks, we will be moving in our new home on the Apache Incubator.   ","categories": [],
         "tags": [],
-        "url": "http://0.0.0.0:4000/blog/asf.html",
+        "url": "http://0.0.0.0:4000/asf.html",
         "teaser":"http://0.0.0.0:4000/assets/images/500x300.png"},]
diff --git a/content/newsite-content/build_docs.sh b/content/build_docs.sh
similarity index 100%
rename from content/newsite-content/build_docs.sh
rename to content/build_docs.sh
diff --git a/content/cn/404.html b/content/cn/404.html
deleted file mode 100644
index 906b681..0000000
--- a/content/cn/404.html
+++ /dev/null
@@ -1,422 +0,0 @@
-<!DOCTYPE html>
-<head>
-    <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="">
-<meta name="keywords" content="">
-<title>页面不存在 | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
-
-
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
-
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
-
-
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
-
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
-
-</script>
-
-<link rel="shortcut icon" href="/images/favicon.ico">
-
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
-
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
-
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the 页面不存在 page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/404.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="页面不存在">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
-
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
-
-
-
-
-
-
-
-
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
-    
-    <li>
-        <a href="#">入门指南</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">快速开始</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">使用案例</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">对比</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-    
-    <li>
-        <a href="#">文档</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">概念</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">写入数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">查询数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">配置</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">性能</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">管理</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-        
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
-
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
-
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">页面不存在</h1>
-</div>
-
-
-
-<div class="post-content">
-
-   
-
-    
-
-  <p>抱歉,您试图查看的页面不存在。尝试搜索它或查看URL以检验它是否正确。</p>
-
-
-    <div class="tags">
-        
-    </div>
-
-    
-
-</div>
-
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
-
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
-
-<div id="toc"></div>
-
-            
-        </div>
-    <!-- /.row -->
-    </div>
-<!-- /.container -->
-</div>
-
-</body>
-
-</html>
\ No newline at end of file
diff --git a/content/newsite-content/404.html b/content/cn/activity.html
similarity index 68%
rename from content/newsite-content/404.html
rename to content/cn/activity.html
index 5d55f87..b5a16fb 100644
--- a/content/newsite-content/404.html
+++ b/content/cn/activity.html
@@ -3,18 +3,16 @@
   <head>
     <meta charset="utf-8">
 
-<!-- begin _includes/seo.html --><title>Page Not Found - Apache Hudi</title>
-<meta name="description" content="Page not found. Your pixels are in another canvas.">
+<!-- begin _includes/seo.html --><title>Activities - Apache Hudi</title>
+<meta name="description" content="Apache Hudi ingests &amp; manages storage of large analytical datasets over DFS (HDFS or cloud stores).">
 
 <meta property="og:type" content="website">
 <meta property="og:locale" content="en_US">
 <meta property="og:site_name" content="">
-<meta property="og:title" content="Page Not Found">
-<meta property="og:url" content="https://hudi.apache.org/404.html">
+<meta property="og:title" content="Activities">
+<meta property="og:url" content="https://hudi.apache.org/cn/activity">
 
 
-  <meta property="og:description" content="Page not found. Your pixels are in another canvas.">
-
 
 
 
@@ -64,14 +62,12 @@
 
   </head>
 
-  <body class="layout--single">
+  <body class="layout--posts">
     <!--[if lt IE 9]>
 <div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
 <![endif]-->
 
-    
-
-<div class="masthead">
+    <div class="masthead">
   <div class="masthead__inner-wrap" id="masthead__inner-wrap">
     <div class="masthead__menu">
       <nav id="site-nav" class="greedy-nav">
@@ -80,7 +76,7 @@
               <div style="width: 150px; height: 40px">
 
               </div>
-<!--            <img src="/assets/images/hudi.png" alt="">-->
+<!--            <img src="" alt="">-->
 <!--            -->
 <!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
 <!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
@@ -92,15 +88,15 @@
           
         </a>
         <ul class="visible-links"><li class="masthead__menu-item">
-              <a href="/newsite-content/docs/quick-start-guide.html" target="_self" >Documentation</a>
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/community.html" target="_self" >Community</a>
+              <a href="/cn/community.html" target="_self" >社区</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/activity.html" target="_self" >Activities</a>
+              <a href="/cn/activity.html" target="_self" >动态</a>
             </li><li class="masthead__menu-item">
               <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/releases.html" target="_self" >Releases</a>
+              <a href="/cn/releases.html" target="_self" >发布</a>
             </li></ul>
         <button class="greedy-nav__toggle hidden" type="button">
           <span class="visually-hidden">Toggle menu</span>
@@ -111,19 +107,19 @@
     </div>
   </div>
 </div>
-<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://issues.apache.org/jira/projects/HUDI/summary">file a jira</a>.
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
   Click <a href="/"> here</a> back to old site.</p>
+-->
 
     <div class="initial-content">
       <div id="main" role="main">
   
+
   <div class="sidebar sticky">
 
   
-    
-
-
-<div itemscope itemtype="https://schema.org/Person">
+    <div itemscope itemtype="https://schema.org/Person">
 
   <div class="author__content">
     
@@ -141,7 +137,7 @@
     <ul class="author__urls social-icons">
       
         
-          <li><a href="/newsite-content/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
+          <li><a href="/cn/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
 
           
         
@@ -149,7 +145,7 @@
 
           
         
-          <li><a href="/newsite-content/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
+          <li><a href="/cn/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
 
           
         
@@ -176,39 +172,71 @@
   </div>
 
 
-  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
+  <div class="archive">
+    <h1 id="page-title" class="page__title">Activities</h1>
 
-    <div class="page__inner-wrap">
+    
+    
+    <section id="2019" class="taxonomy__section">
+      <h2 class="archive__subtitle">2019</h2>
+      <div class="entries-list">
+        
+        
+
+
+
+<div class="list__item">
+  <article class="archive__item" itemscope itemtype="https://schema.org/CreativeWork">
+    
+    <h2 class="archive__item-title" itemprop="headline">
       
-        <header>
-          <h1 id="page-title" class="page__title" itemprop="headline">Page Not Found
-</h1>
-        </header>
+        <a href="/asf.html">Hudi entered Apache Incubator
+</a>
       
+    </h2>
+    <p class="archive__item-excerpt" itemprop="description">In the coming weeks, we will be moving in our new home on the Apache Incubator.
+</p>
+  </article>
+</div>
 
-      <section class="page__content" itemprop="text">
         
-          <style>
-            .page {
-              padding-right: 0 !important;
-            }
-          </style>
+      </div>
+    </section>
+    
+    <section id="2016" class="taxonomy__section">
+      <h2 class="archive__subtitle">2016</h2>
+      <div class="entries-list">
+        
         
-        <p>Sorry, the page you were trying to view does not exist.</p>
-
-      </section>
 
-      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
 
 
+<div class="list__item">
+  <article class="archive__item" itemscope itemtype="https://schema.org/CreativeWork">
+    
+    <h2 class="archive__item-title" itemprop="headline">
       
-
-    </div>
-
+        <a href="/strata.html">Connect with us at Strata San Jose March 2017
+</a>
+      
+    </h2>
+    <p class="archive__item-excerpt" itemprop="description">We will be presenting Hudi &amp; general concepts around how incremental processing works at Uber.
+Catch our talk “Incremental Processing on Hadoop At Uber”
+</p>
   </article>
+</div>
 
+        
+      </div>
+    </section>
+    
+    <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
+  </div>
 </div>
 
+
+
+
     </div>
 
     <div class="page__footer">
diff --git a/content/cn/admin_guide.html b/content/cn/admin_guide.html
deleted file mode 100644
index bb30def..0000000
--- a/content/cn/admin_guide.html
+++ /dev/null
@@ -1,827 +0,0 @@
-<!DOCTYPE html>
-<head>
-    <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="本节概述了可用于操作Hudi数据集生态系统的工具">
-<meta name="keywords" content="hudi, administration, operation, devops">
-<title>管理 Hudi Pipelines | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
-
-
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
-
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
-
-
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
-
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
-
-</script>
-
-<link rel="shortcut icon" href="/images/favicon.ico">
-
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
-
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
-
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the 管理 Hudi Pipelines page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/admin_guide.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="管理 Hudi Pipelines">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
-
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
-
-
-
-
-
-
-
-
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
-    
-    <li>
-        <a href="#">入门指南</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">快速开始</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">使用案例</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">对比</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-    
-    <li>
-        <a href="#">文档</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">概念</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">写入数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">查询数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">配置</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">性能</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">管理</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-        
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
-
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
-
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">管理 Hudi Pipelines</h1>
-</div>
-
-
-
-<div class="post-content">
-
-   
-    <div class="summary">本节概述了可用于操作Hudi数据集生态系统的工具</div>
-   
-
-    
-
-  <p>管理员/运维人员可以通过以下方式了解Hudi数据集/管道</p>
-
-<ul>
-  <li><a href="#admin-cli">通过Admin CLI进行管理</a></li>
-  <li><a href="#metrics">Graphite指标</a></li>
-  <li><a href="#spark-ui">Hudi应用程序的Spark UI</a></li>
-</ul>
-
-<p>本节简要介绍了每一种方法,并提供了有关<a href="#troubleshooting">故障排除</a>的一些常规指南</p>
-
-<h2 id="admin-cli">Admin CLI</h2>
-
-<p>一旦构建了hudi,就可以通过<code class="highlighter-rouge">cd hudi-cli &amp;&amp; ./hudi-cli.sh</code>启动shell。
-一个hudi数据集位于DFS上的<strong>basePath</strong>位置,我们需要该位置才能连接到Hudi数据集。
-Hudi库使用.hoodie子文件夹跟踪所有元数据,从而有效地在内部管理该数据集。</p>
-
-<p>初始化hudi表,可使用如下命令。</p>
-
-<pre><code class="language-Java">18/09/06 15:56:52 INFO annotation.AutowiredAnnotationBeanPostProcessor: JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
-============================================
-*                                          *
-*     _    _           _   _               *
-*    | |  | |         | | (_)              *
-*    | |__| |       __| |  -               *
-*    |  __  ||   | / _` | ||               *
-*    | |  | ||   || (_| | ||               *
-*    |_|  |_|\___/ \____/ ||               *
-*                                          *
-============================================
-
-Welcome to Hoodie CLI. Please type help if you are looking for help.
-hudi-&gt;create --path /user/hive/warehouse/table1 --tableName hoodie_table_1 --tableType COPY_ON_WRITE
-.....
-18/09/06 15:57:15 INFO table.HoodieTableMetaClient: Finished Loading Table of type COPY_ON_WRITE from ...
-</code></pre>
-
-<p>使用desc命令可以查看hudi表的描述信息:</p>
-
-<pre><code class="language-Java">hoodie:hoodie_table_1-&gt;desc
-18/09/06 15:57:19 INFO timeline.HoodieActiveTimeline: Loaded instants []
-    _________________________________________________________
-    | Property                | Value                        |
-    |========================================================|
-    | basePath                | ...                          |
-    | metaPath                | ...                          |
-    | fileSystem              | hdfs                         |
-    | hoodie.table.name       | hoodie_table_1               |
-    | hoodie.table.type       | COPY_ON_WRITE                |
-    | hoodie.archivelog.folder|                              |
-</code></pre>
-
-<p>以下是连接到包含uber trips的Hudi数据集的示例命令。</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;connect --path /app/uber/trips
-
-16/10/05 23:20:37 INFO model.HoodieTableMetadata: Attempting to load the commits under /app/uber/trips/.hoodie with suffix .commit
-16/10/05 23:20:37 INFO model.HoodieTableMetadata: Attempting to load the commits under /app/uber/trips/.hoodie with suffix .inflight
-16/10/05 23:20:37 INFO model.HoodieTableMetadata: All commits :HoodieCommits{commitList=[20161002045850, 20161002052915, 20161002055918, 20161002065317, 20161002075932, 20161002082904, 20161002085949, 20161002092936, 20161002105903, 20161002112938, 20161002123005, 20161002133002, 20161002155940, 20161002165924, 20161002172907, 20161002175905, 20161002190016, 20161002192954, 20161002195925, 20161002205935, 20161002215928, 20161002222938, 20161002225915, 20161002232906, 20161003003028, 201 [...]
-Metadata for table trips loaded
-hoodie:trips-&gt;
-</code></pre>
-
-<p>连接到数据集后,便可使用许多其他命令。该shell程序具有上下文自动完成帮助(按TAB键),下面是所有命令的列表,本节中对其中的一些命令进行了详细示例。</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;help
-* ! - Allows execution of operating system (OS) commands
-* // - Inline comment markers (start of line only)
-* ; - Inline comment markers (start of line only)
-* addpartitionmeta - Add partition metadata to a dataset, if not present
-* clear - Clears the console
-* cls - Clears the console
-* commit rollback - Rollback a commit
-* commits compare - Compare commits with another Hoodie dataset
-* commit showfiles - Show file level details of a commit
-* commit showpartitions - Show partition level details of a commit
-* commits refresh - Refresh the commits
-* commits show - Show the commits
-* commits sync - Compare commits with another Hoodie dataset
-* connect - Connect to a hoodie dataset
-* date - Displays the local date and time
-* exit - Exits the shell
-* help - List all commands usage
-* quit - Exits the shell
-* records deduplicate - De-duplicate a partition path contains duplicates &amp; produce repaired files to replace with
-* script - Parses the specified resource file and executes its commands
-* stats filesizes - File Sizes. Display summary stats on sizes of files
-* stats wa - Write Amplification. Ratio of how many records were upserted to how many records were actually written
-* sync validate - Validate the sync by counting the number of records
-* system properties - Shows the shell's properties
-* utils loadClass - Load a class
-* version - Displays shell version
-
-hoodie:trips-&gt;
-</code></pre>
-
-<h4 id="检查提交">检查提交</h4>
-
-<p>在Hudi中,更新或插入一批记录的任务被称为<strong>提交</strong>。提交可提供基本的原子性保证,即只有提交的数据可用于查询。
-每个提交都有一个单调递增的字符串/数字,称为<strong>提交编号</strong>。通常,这是我们开始提交的时间。</p>
-
-<p>查看有关最近10次提交的一些基本信息,</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;commits show --sortBy "Total Bytes Written" --desc true --limit 10
-    ________________________________________________________________________________________________________________________________________________________________________
-    | CommitTime    | Total Bytes Written| Total Files Added| Total Files Updated| Total Partitions Written| Total Records Written| Total Update Records Written| Total Errors|
-    |=======================================================================================================================================================================|
-    ....
-    ....
-    ....
-hoodie:trips-&gt;
-</code></pre>
-
-<p>在每次写入开始时,Hudi还将.inflight提交写入.hoodie文件夹。您可以使用那里的时间戳来估计正在进行的提交已经花费的时间</p>
-
-<pre><code class="language-Java">$ hdfs dfs -ls /app/uber/trips/.hoodie/*.inflight
--rw-r--r--   3 vinoth supergroup     321984 2016-10-05 23:18 /app/uber/trips/.hoodie/20161005225920.inflight
-</code></pre>
-
-<h4 id="深入到特定的提交">深入到特定的提交</h4>
-
-<p>了解写入如何分散到特定分区,</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;commit showpartitions --commit 20161005165855 --sortBy "Total Bytes Written" --desc true --limit 10
-    __________________________________________________________________________________________________________________________________________
-    | Partition Path| Total Files Added| Total Files Updated| Total Records Inserted| Total Records Updated| Total Bytes Written| Total Errors|
-    |=========================================================================================================================================|
-     ....
-     ....
-</code></pre>
-
-<p>如果您需要文件级粒度,我们可以执行以下操作</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;commit showfiles --commit 20161005165855 --sortBy "Partition Path"
-    ________________________________________________________________________________________________________________________________________________________
-    | Partition Path| File ID                             | Previous Commit| Total Records Updated| Total Records Written| Total Bytes Written| Total Errors|
-    |=======================================================================================================================================================|
-    ....
-    ....
-</code></pre>
-
-<h4 id="文件系统视图">文件系统视图</h4>
-
-<p>Hudi将每个分区视为文件组的集合,每个文件组包含按提交顺序排列的文件切片列表(请参阅概念)。以下命令允许用户查看数据集的文件切片。</p>
-
-<pre><code class="language-Java"> hoodie:stock_ticks_mor-&gt;show fsview all
- ....
-  _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
- | Partition | FileId | Base-Instant | Data-File | Data-File Size| Num Delta Files| Total Delta File Size| Delta Files |
- |==============================================================================================================================================================================================================================================================================================================================================================================================================|
- | 2018/08/31| 111415c3-f26d-4639-86c8-f9956f245ac3| 20181002180759| hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/111415c3-f26d-4639-86c8-f9956f245ac3_0_20181002180759.parquet| 432.5 KB | 1 | 20.8 KB | [HoodieLogFile {hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/.111415c3-f26d-4639-86c8-f9956f245ac3_20181002180759.log.1}]|
-
-
-
- hoodie:stock_ticks_mor-&gt;show fsview latest --partitionPath "2018/08/31"
- ......
- ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ [...]
- | Partition | FileId | Base-Instant | Data-File | Data-File Size| Num Delta Files| Total Delta Size| Delta Size - compaction scheduled| Delta Size - compaction unscheduled| Delta To Base Ratio - compaction scheduled| Delta To Base Ratio - compaction unscheduled| Delta Files - compaction scheduled | Delta Files - compaction unscheduled|
- |========================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================== [...]
- | 2018/08/31| 111415c3-f26d-4639-86c8-f9956f245ac3| 20181002180759| hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/111415c3-f26d-4639-86c8-f9956f245ac3_0_20181002180759.parquet| 432.5 KB | 1 | 20.8 KB | 20.8 KB | 0.0 B | 0.0 B | 0.0 B | [HoodieLogFile {hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/.111415c3-f26d-4639-86c8-f9956f245ac3_20181002180759.log.1}]| [] |
-
- hoodie:stock_ticks_mor-&gt;
-</code></pre>
-
-<h4 id="统计信息">统计信息</h4>
-
-<p>由于Hudi直接管理DFS数据集的文件大小,这些信息会帮助你全面了解Hudi的运行状况</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;stats filesizes --partitionPath 2016/09/01 --sortBy "95th" --desc true --limit 10
-    ________________________________________________________________________________________________
-    | CommitTime    | Min     | 10th    | 50th    | avg     | 95th    | Max     | NumFiles| StdDev  |
-    |===============================================================================================|
-    | &lt;COMMIT_ID&gt;   | 93.9 MB | 93.9 MB | 93.9 MB | 93.9 MB | 93.9 MB | 93.9 MB | 2       | 2.3 KB  |
-    ....
-    ....
-</code></pre>
-
-<p>如果Hudi写入花费的时间更长,那么可以通过观察写放大指标来发现任何异常</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;stats wa
-    __________________________________________________________________________
-    | CommitTime    | Total Upserted| Total Written| Write Amplifiation Factor|
-    |=========================================================================|
-    ....
-    ....
-</code></pre>
-
-<h4 id="归档的提交">归档的提交</h4>
-
-<p>为了限制DFS上.commit文件的增长量,Hudi将较旧的.commit文件(适当考虑清理策略)归档到commits.archived文件中。
-这是一个序列文件,其包含commitNumber =&gt; json的映射,及有关提交的原始信息(上面已很好地汇总了相同的信息)。</p>
-
-<h4 id="压缩">压缩</h4>
-
-<p>要了解压缩和写程序之间的时滞,请使用以下命令列出所有待处理的压缩。</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compactions show all
-     ___________________________________________________________________
-    | Compaction Instant Time| State    | Total FileIds to be Compacted|
-    |==================================================================|
-    | &lt;INSTANT_1&gt;            | REQUESTED| 35                           |
-    | &lt;INSTANT_2&gt;            | INFLIGHT | 27                           |
-</code></pre>
-
-<p>要检查特定的压缩计划,请使用</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compaction show --instant &lt;INSTANT_1&gt;
-    _________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
-    | Partition Path| File Id | Base Instant  | Data File Path                                    | Total Delta Files| getMetrics                                                                                                                    |
-    |================================================================================================================================================================================================================================================
-    | 2018/07/17    | &lt;UUID&gt;  | &lt;INSTANT_1&gt;   | viewfs://ns-default/.../../UUID_&lt;INSTANT&gt;.parquet | 1                | {TOTAL_LOG_FILES=1.0, TOTAL_IO_READ_MB=1230.0, TOTAL_LOG_FILES_SIZE=2.51255751E8, TOTAL_IO_WRITE_MB=991.0, TOTAL_IO_MB=2221.0}|
-
-</code></pre>
-
-<p>要手动调度或运行压缩,请使用以下命令。该命令使用spark启动器执行压缩操作。
-注意:确保没有其他应用程序正在同时调度此数据集的压缩</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;help compaction schedule
-Keyword:                   compaction schedule
-Description:               Schedule Compaction
- Keyword:                  sparkMemory
-   Help:                   Spark executor memory
-   Mandatory:              false
-   Default if specified:   '__NULL__'
-   Default if unspecified: '1G'
-
-* compaction schedule - Schedule Compaction
-</code></pre>
-
-<pre><code class="language-Java">hoodie:trips-&gt;help compaction run
-Keyword:                   compaction run
-Description:               Run Compaction for given instant time
- Keyword:                  tableName
-   Help:                   Table name
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  parallelism
-   Help:                   Parallelism for hoodie compaction
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  schemaFilePath
-   Help:                   Path for Avro schema file
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  sparkMemory
-   Help:                   Spark executor memory
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  retry
-   Help:                   Number of retries
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
- Keyword:                  compactionInstant
-   Help:                   Base path for the target hoodie dataset
-   Mandatory:              true
-   Default if specified:   '__NULL__'
-   Default if unspecified: '__NULL__'
-
-* compaction run - Run Compaction for given instant time
-</code></pre>
-
-<h5 id="验证压缩">验证压缩</h5>
-
-<p>验证压缩计划:检查压缩所需的所有文件是否都存在且有效</p>
-
-<pre><code class="language-Java">hoodie:stock_ticks_mor-&gt;compaction validate --instant 20181005222611
-...
-
-   COMPACTION PLAN VALID
-
-    ___________________________________________________________________________________________________________________________________________________________________________________________________________________________
-    | File Id                             | Base Instant Time| Base Data File                                                                                                                   | Num Delta Files| Valid| Error|
-    |==========================================================================================================================================================================================================================|
-    | 05320e98-9a57-4c38-b809-a6beaaeb36bd| 20181005222445   | hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/05320e98-9a57-4c38-b809-a6beaaeb36bd_0_20181005222445.parquet| 1              | true |      |
-
-
-
-hoodie:stock_ticks_mor-&gt;compaction validate --instant 20181005222601
-
-   COMPACTION PLAN INVALID
-
-    _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
-    | File Id                             | Base Instant Time| Base Data File                                                                                                                   | Num Delta Files| Valid| Error                                                                           |
-    |=====================================================================================================================================================================================================================================================================================================|
-    | 05320e98-9a57-4c38-b809-a6beaaeb36bd| 20181005222445   | hdfs://namenode:8020/user/hive/warehouse/stock_ticks_mor/2018/08/31/05320e98-9a57-4c38-b809-a6beaaeb36bd_0_20181005222445.parquet| 1              | false| All log files specified in compaction operation is not present. Missing ....    |
-</code></pre>
-
-<h5 id="注意">注意</h5>
-
-<p>必须在其他写入/摄取程序没有运行的情况下执行以下命令。</p>
-
-<p>有时,有必要从压缩计划中删除fileId以便加快或取消压缩操作。
-压缩计划之后在此文件上发生的所有新日志文件都将被安全地重命名以便进行保留。Hudi提供以下CLI来支持</p>
-
-<h5 id="取消调度压缩">取消调度压缩</h5>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compaction unscheduleFileId --fileId &lt;FileUUID&gt;
-....
-No File renames needed to unschedule file from pending compaction. Operation successful.
-</code></pre>
-
-<p>在其他情况下,需要撤销整个压缩计划。以下CLI支持此功能</p>
-
-<pre><code class="language-Java">hoodie:trips-&gt;compaction unschedule --compactionInstant &lt;compactionInstant&gt;
-.....
-No File renames needed to unschedule pending compaction. Operation successful.
-</code></pre>
-
-<h5 id="修复压缩">修复压缩</h5>
-
-<p>上面的压缩取消调度操作有时可能会部分失败(例如:DFS暂时不可用)。
-如果发生部分故障,则压缩操作可能与文件切片的状态不一致。
-当您运行<code class="highlighter-rouge">压缩验证</code>时,您会注意到无效的压缩操作(如果有的话)。
-在这种情况下,修复命令将立即执行,它将重新排列文件切片,以使文件不丢失,并且文件切片与压缩计划一致</p>
-
-<pre><code class="language-Java">hoodie:stock_ticks_mor-&gt;compaction repair --instant 20181005222611
-......
-Compaction successfully repaired
-.....
-</code></pre>
-
-<h2 id="metrics">指标</h2>
-
-<p>为Hudi Client配置正确的数据集名称和指标环境后,它将生成以下graphite指标,以帮助调试hudi数据集</p>
-
-<ul>
-  <li><strong>提交持续时间</strong> - 这是成功提交一批记录所花费的时间</li>
-  <li><strong>回滚持续时间</strong> - 同样,撤消失败的提交所剩余的部分数据所花费的时间(每次写入失败后都会自动发生)</li>
-  <li><strong>文件级别指标</strong> - 显示每次提交中新增、版本、删除(清除)的文件数量</li>
-  <li><strong>记录级别指标</strong> - 每次提交插入/更新的记录总数</li>
-  <li><strong>分区级别指标</strong> - 更新的分区数量(对于了解提交持续时间的突然峰值非常有用)</li>
-</ul>
-
-<p>然后可以将这些指标绘制在grafana等标准工具上。以下是提交持续时间图表示例。</p>
-
-<figure>
-    <img class="docimage" src="/images/hudi_commit_duration.png" alt="hudi_commit_duration.png" style="max-width: 100%" />
-</figure>
-
-<h2 id="troubleshooting">故障排除</h2>
-
-<p>以下部分通常有助于调试Hudi故障。以下元数据已被添加到每条记录中,可以通过标准Hadoop SQL引擎(Hive/Presto/Spark)检索,来更容易地诊断问题的严重性。</p>
-
-<ul>
-  <li><strong>_hoodie_record_key</strong> - 作为每个DFS分区内的主键,是所有更新/插入的基础</li>
-  <li><strong>_hoodie_commit_time</strong> - 该记录上次的提交</li>
-  <li><strong>_hoodie_file_name</strong> - 包含记录的实际文件名(对检查重复非常有用)</li>
-  <li><strong>_hoodie_partition_path</strong> - basePath的路径,该路径标识包含此记录的分区</li>
-</ul>
-
-<p>请注意,到目前为止,Hudi假定应用程序为给定的recordKey传递相同的确定性分区路径。即仅在每个分区内保证recordKey(主键)的唯一性。</p>
-
-<h4 id="缺失记录">缺失记录</h4>
-
-<p>请在可能写入记录的窗口中,使用上面的admin命令检查是否存在任何写入错误。
-如果确实发现错误,那么记录实际上不是由Hudi写入的,而是交还给应用程序来决定如何处理。</p>
-
-<h4 id="重复">重复</h4>
-
-<p>首先,请确保访问Hudi数据集的查询是<a href="sql_queries.html">没有问题的</a>,并之后确认的确有重复。</p>
-
-<ul>
-  <li>如果确认,请使用上面的元数据字段来标识包含记录的物理文件和分区文件。</li>
-  <li>如果重复的记录存在于不同分区路径下的文件,则意味着您的应用程序正在为同一recordKey生成不同的分区路径,请修复您的应用程序.</li>
-  <li>如果重复的记录存在于同一分区路径下的多个文件,请使用邮件列表汇报这个问题。这不应该发生。您可以使用<code class="highlighter-rouge">records deduplicate</code>命令修复数据。</li>
-</ul>
-
-<h4 id="spark-ui">Spark故障</h4>
-
-<p>典型的upsert() DAG如下所示。请注意,Hudi客户端会缓存中间的RDD,以智能地并调整文件大小和Spark并行度。
-另外,由于还显示了探针作业,Spark UI显示了两次sortByKey,但它只是一个排序。</p>
-<figure>
-    <img class="docimage" src="/images/hudi_upsert_dag.png" alt="hudi_upsert_dag.png" style="max-width: 100%" />
-</figure>
-
-<p>概括地说,有两个步骤</p>
-
-<p><strong>索引查找以标识要更改的文件</strong></p>
-
-<ul>
-  <li>Job 1 : 触发输入数据读取,转换为HoodieRecord对象,然后根据输入记录拿到目标分区路径。</li>
-  <li>Job 2 : 加载我们需要检查的文件名集。</li>
-  <li>Job 3  &amp; 4 : 通过联合上面1和2中的RDD,智能调整spark join并行度,然后进行实际查找。</li>
-  <li>Job 5 : 生成带有位置的recordKeys作为标记的RDD。</li>
-</ul>
-
-<p><strong>执行数据的实际写入</strong></p>
-
-<ul>
-  <li>Job 6 : 将记录与recordKey(位置)进行懒惰连接,以提供最终的HoodieRecord集,现在它包含每条记录的文件/分区路径信息(如果插入,则为null)。然后还要再次分析工作负载以确定文件的大小。</li>
-  <li>Job 7 : 实际写入数据(更新 + 插入 + 插入转为更新以保持文件大小)</li>
-</ul>
-
-<p>根据异常源(Hudi/Spark),上述关于DAG的信息可用于查明实际问题。最常遇到的故障是由YARN/DFS临时故障引起的。
-将来,将在项目中添加更复杂的调试/管理UI,以帮助自动进行某些调试。</p>
-
-
-    <div class="tags">
-        
-    </div>
-
-    
-
-</div>
-
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
-
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
-
-<div id="toc"></div>
-
-            
-        </div>
-    <!-- /.row -->
-    </div>
-<!-- /.container -->
-</div>
-
-</body>
-
-</html>
\ No newline at end of file
diff --git a/content/cn/community.html b/content/cn/community.html
index d198c34..8ac88d8 100644
--- a/content/cn/community.html
+++ b/content/cn/community.html
@@ -1,346 +1,207 @@
-<!DOCTYPE html>
-<head>
+<!doctype html>
+<html lang="en" class="no-js">
+  <head>
     <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="">
-<meta name="keywords" content="hudi, use cases, big data, apache">
-<title>Community | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
 
+<!-- begin _includes/seo.html --><title>Community - Apache Hudi</title>
+<meta name="description" content="Apache Hudi ingests &amp; manages storage of large analytical datasets over DFS (HDFS or cloud stores).">
 
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
+<meta property="og:type" content="website">
+<meta property="og:locale" content="en_US">
+<meta property="og:site_name" content="">
+<meta property="og:title" content="Community">
+<meta property="og:url" content="https://hudi.apache.org/cn/community">
 
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
 
 
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
 
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
 
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
 
-</script>
+  <meta property="article:modified_time" content="2019-12-30T14:59:57-05:00">
 
-<link rel="shortcut icon" href="/images/favicon.ico">
 
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
 
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
 
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li class="active"><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the Community page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/community.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="Community">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
 
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
+
+
+<!-- end _includes/seo.html -->
+
+
+<!--<link href="/feed.xml" type="application/atom+xml" rel="alternate" title=" Feed">-->
+
+<!-- https://t.co/dKP3o1e -->
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+
+<script>
+  document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js ';
+</script>
+
+<!-- For all browsers -->
+<link rel="stylesheet" href="/assets/css/main.css">
+
+<!--[if IE]>
+  <style>
+    /* old IE unsupported flexbox fixes */
+    .greedy-nav .site-title {
+      padding-right: 3em;
+    }
+    .greedy-nav button {
+      position: absolute;
+      top: 0;
+      right: 0;
+      height: 100%;
+    }
+  </style>
+<![endif]-->
 
 
 
+<link rel="icon" type="image/x-icon" href="/assets/images/favicon.ico">
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
 
+  </head>
+
+  <body class="layout--single">
+    <!--[if lt IE 9]>
+<div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
+<![endif]-->
+
+    <div class="masthead">
+  <div class="masthead__inner-wrap" id="masthead__inner-wrap">
+    <div class="masthead__menu">
+      <nav id="site-nav" class="greedy-nav">
+        
+          <a class="site-logo" href="/">
+              <div style="width: 150px; height: 40px">
+
+              </div>
+<!--            <img src="" alt="">-->
+<!--            -->
+<!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
+<!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
+<!--            </span>-->
+<!--            -->
+          </a>
+        
+        <a class="site-title" href="/">
+          
+        </a>
+        <ul class="visible-links"><li class="masthead__menu-item">
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/community.html" target="_self" >社区</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/activity.html" target="_self" >动态</a>
+            </li><li class="masthead__menu-item">
+              <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/releases.html" target="_self" >发布</a>
+            </li></ul>
+        <button class="greedy-nav__toggle hidden" type="button">
+          <span class="visually-hidden">Toggle menu</span>
+          <div class="navicon"></div>
+        </button>
+        <ul class="hidden-links hidden"></ul>
+      </nav>
+    </div>
+  </div>
+</div>
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
+  Click <a href="/"> here</a> back to old site.</p>
+-->
 
+    <div class="initial-content">
+      <div id="main" role="main">
+  
 
+  <div class="sidebar sticky">
 
+  
+    <div itemscope itemtype="https://schema.org/Person">
 
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
+  <div class="author__content">
     
+      <h3 class="author__name" itemprop="name">Quick Links</h3>
     
     
-    <li>
-        <a href="#">入门指南</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">快速开始</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">使用案例</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">对比</a></li>
-            
-            
-            
-            
-        </ul>
+      <div class="author__bio" itemprop="description">
+        <p>Hudi <em>ingests</em> &amp; <em>manages</em> storage of large analytical datasets over DFS.</p>
+
+      </div>
+    
+  </div>
+
+  <div class="author__urls-wrapper">
+    <ul class="author__urls social-icons">
+      
         
+          <li><a href="/cn/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
+
+          
         
-    
-    <li>
-        <a href="#">文档</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">概念</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">写入数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">查询数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">配置</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">性能</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">管理</a></li>
-            
-            
-            
-            
-        </ul>
+          <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-wikipedia-w" aria-hidden="true"></i> Technical Wiki</a></li>
+
+          
         
+          <li><a href="/cn/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
+
+          
         
+          <li><a href="https://join.slack.com/t/apache-hudi/shared_invite/enQtODYyNDAxNzc5MTg2LTE5OTBlYmVhYjM0N2ZhOTJjOWM4YzBmMWU2MjZjMGE4NDc5ZDFiOGQ2N2VkYTVkNzU3ZDQ4OTI1NmFmYWQ0NzE" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-slack" aria-hidden="true"></i> Join on Slack</a></li>
+
+          
         
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
+          <li><a href="https://github.com/apache/incubator-hudi" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-github" aria-hidden="true"></i> Fork on GitHub</a></li>
 
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
+          
+        
+          <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-navicon" aria-hidden="true"></i> Report Issues</a></li>
 
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">Community</h1>
+          
+        
+      
+    </ul>
+  </div>
 </div>
 
+  
 
+  
+  </div>
 
-<div class="post-content">
 
-   
+  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
 
-    
+    <div class="page__inner-wrap">
+      
+        <header>
+          <h1 id="page-title" class="page__title" itemprop="headline">Community
+</h1>
+        </header>
+      
 
-  <h2 id="engage-with-us">Engage with us</h2>
+      <section class="page__content" itemprop="text">
+        
+        <aside class="sidebar__right sticky">
+          <nav class="toc">
+            <header><h4 class="nav__title"><i class="fas fa-file-alt"></i> In this page</h4></header>
+            <ul class="toc__menu">
+  <li><a href="#engage-with-us">Engage with us</a></li>
+  <li><a href="#contributing">Contributing</a></li>
+  <li><a href="#become-a-committer">Become a Committer</a>
+    <ul>
+      <li><a href="#the-committers">The Committers</a></li>
+    </ul>
+  </li>
+  <li><a href="#code-contributions">Code Contributions</a></li>
+  <li><a href="#accounts">Accounts</a></li>
+</ul>
+          </nav>
+        </aside>
+        
+        <h2 id="engage-with-us">Engage with us</h2>
 
 <p>There are several ways to get in touch with the Hudi community.</p>
 
@@ -506,9 +367,9 @@ Committers are chosen by a majority vote of the Apache Hudi <a href="https://www
   </tbody>
 </table>
 
-<h3 id="code-contributions">Code Contributions</h3>
+<h2 id="code-contributions">Code Contributions</h2>
 
-<p>Useful resources for contributing can be found under the “Developers” top menu.
+<p>Useful resources for contributing can be found under the “Quick Links” left menu.
 Specifically, please refer to the detailed <a href="contributing.html">contribution guide</a>.</p>
 
 <h2 id="accounts">Accounts</h2>
@@ -521,58 +382,48 @@ Specifically, please refer to the detailed <a href="contributing.html">contribut
   <li>Sign-up/in to the Apache <a href="https://cwiki.apache.org/confluence/signup.action">cWiki</a>, to be able to contribute to the wiki pages/RFCs.</li>
 </ul>
 
+      </section>
+
+      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
+
+
+      
 
-    <div class="tags">
-        
     </div>
 
-    
+  </article>
 
 </div>
 
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-        </div>
-    <!-- /.row -->
     </div>
-<!-- /.container -->
+
+    <div class="page__footer">
+      <footer>
+        
+<div class="row">
+  <div class="col-lg-12 footer">
+    <p>
+      <a class="footer-link-img" href="https://apache.org">
+        <img width="250px" src="/assets/images/asf_logo.svg" alt="The Apache Software Foundation">
+      </a>
+    </p>
+    <p>
+      Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>, Licensed under the Apache License, Version 2.0.
+      Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation. <a href="/docs/privacy">Privacy Policy</a>
+      <br>
+      Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
+      Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
+      stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
+      reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+    </p>
+  </div>
 </div>
+      </footer>
+    </div>
+
+    
+<script src="/assets/js/main.min.js"></script>
 
-</body>
 
+  </body>
 </html>
\ No newline at end of file
diff --git a/content/cn/comparison.html b/content/cn/comparison.html
deleted file mode 100644
index 283e972..0000000
--- a/content/cn/comparison.html
+++ /dev/null
@@ -1,462 +0,0 @@
-<!DOCTYPE html>
-<head>
-    <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="">
-<meta name="keywords" content="apache, hudi, kafka, kudu, hive, hbase, stream processing">
-<title>对比 | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
-
-
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
-
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
-
-
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
-
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
-
-</script>
-
-<link rel="shortcut icon" href="/images/favicon.ico">
-
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
-
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
-
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the 对比 page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/comparison.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="对比">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
-
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
-
-
-
-
-
-
-
-
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
-    
-    <li>
-        <a href="#">入门指南</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">快速开始</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">使用案例</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">对比</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-    
-    <li>
-        <a href="#">文档</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">概念</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">写入数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">查询数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">配置</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">性能</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">管理</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-        
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
-
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
-
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">对比</h1>
-</div>
-
-
-
-<div class="post-content">
-
-   
-
-    
-
-  <p>Apache Hudi填补了在DFS上处理数据的巨大空白,并可以和这些技术很好地共存。然而,
-通过将Hudi与一些相关系统进行对比,来了解Hudi如何适应当前的大数据生态系统,并知晓这些系统在设计中做的不同权衡仍将非常有用。</p>
-
-<h2 id="kudu">Kudu</h2>
-
-<p><a href="https://kudu.apache.org">Apache Kudu</a>是一个与Hudi具有相似目标的存储系统,该系统通过对<code class="highlighter-rouge">upserts</code>支持来对PB级数据进行实时分析。
-一个关键的区别是Kudu还试图充当OLTP工作负载的数据存储,而Hudi并不希望这样做。
-因此,Kudu不支持增量拉取(截至2017年初),而Hudi支持以便进行增量处理。</p>
-
-<p>Kudu与分布式文件系统抽象和HDFS完全不同,它自己的一组存储服务器通过RAFT相互通信。
-与之不同的是,Hudi旨在与底层Hadoop兼容的文件系统(HDFS,S3或Ceph)一起使用,并且没有自己的存储服务器群,而是依靠Apache Spark来完成繁重的工作。
-因此,Hudi可以像其他Spark作业一样轻松扩展,而Kudu则需要硬件和运营支持,特别是HBase或Vertica等数据存储系统。
-到目前为止,我们还没有做任何直接的基准测试来比较Kudu和Hudi(鉴于RTTable正在进行中)。
-但是,如果我们要使用<a href="https://db-blog.web.cern.ch/blog/zbigniew-baranowski/2017-01-performance-comparison-different-file-formats-and-storage-engines">CERN</a>,
-我们预期Hudi在摄取parquet上有更卓越的性能。</p>
-
-<h2 id="hive事务">Hive事务</h2>
-
-<p><a href="https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions">Hive事务/ACID</a>是另一项类似的工作,它试图实现在ORC文件格式之上的存储<code class="highlighter-rouge">读取时合并</code>。
-可以理解,此功能与Hive以及<a href="https://cwiki.apache.org/confluence/display/Hive/LLAP">LLAP</a>之类的其他工作紧密相关。
-Hive事务不提供Hudi提供的读取优化存储选项或增量拉取。
-在实现选择方面,Hudi充分利用了类似Spark的处理框架的功能,而Hive事务特性则在用户或Hive Metastore启动的Hive任务/查询的下实现。
-根据我们的生产经验,与其他方法相比,将Hudi作为库嵌入到现有的Spark管道中要容易得多,并且操作不会太繁琐。
-Hudi还设计用于与Presto/Spark等非Hive引擎合作,并计划引入除parquet以外的文件格式。</p>
-
-<h2 id="hbase">HBase</h2>
-
-<p>尽管<a href="https://hbase.apache.org">HBase</a>最终是OLTP工作负载的键值存储层,但由于与Hadoop的相似性,用户通常倾向于将HBase与分析相关联。
-鉴于HBase经过严格的写优化,它支持开箱即用的亚秒级更新,Hive-on-HBase允许用户查询该数据。 但是,就分析工作负载的实际性能而言,Parquet/ORC之类的混合列式存储格式可以轻松击败HBase,因为这些工作负载主要是读取繁重的工作。
-Hudi弥补了更快的数据与分析存储格式之间的差距。从运营的角度来看,与管理分析使用的HBase region服务器集群相比,为用户提供可更快给出数据的库更具可扩展性。
-最终,HBase不像Hudi这样重点支持<code class="highlighter-rouge">提交时间</code>、<code class="highlighter-rouge">增量拉取</code>之类的增量处理原语。</p>
-
-<h2 id="流式处理">流式处理</h2>
-
-<p>一个普遍的问题:”Hudi与流处理系统有何关系?”,我们将在这里尝试回答。简而言之,Hudi可以与当今的批处理(<code class="highlighter-rouge">写时复制存储</code>)和流处理(<code class="highlighter-rouge">读时合并存储</code>)作业集成,以将计算结果存储在Hadoop中。
-对于Spark应用程序,这可以通过将Hudi库与Spark/Spark流式DAG直接集成来实现。在非Spark处理系统(例如Flink、Hive)情况下,可以在相应的系统中进行处理,然后通过Kafka主题/DFS中间文件将其发送到Hudi表中。从概念上讲,数据处理
-管道仅由三个部分组成:<code class="highlighter-rouge">输入</code>,<code class="highlighter-rouge">处理</code>,<code class="highlighter-rouge">输出</code>,用户最终针对输出运行查询以便使用管道的结果。Hudi可以充当将数据存储在DFS上的输入或输出。Hudi在给定流处理管道上的适用性最终归结为你的查询在Presto/SparkSQL/Hive的适用性。</p>
-
-<p>更高级的用例围绕<a href="https://www.oreilly.com/ideas/ubers-case-for-incremental-processing-on-hadoop">增量处理</a>的概念展开,
-甚至在<code class="highlighter-rouge">处理</code>引擎内部也使用Hudi来加速典型的批处理管道。例如:Hudi可用作DAG内的状态存储(类似Flink使用的[rocksDB(https://ci.apache.org/projects/flink/flink-docs-release-1.2/ops/state_backends.html#the-rocksdbstatebackend))。
-这是路线图上的一个项目并将最终以<a href="https://issues.apache.org/jira/browse/HUDI-60">Beam Runner</a>的形式呈现。</p>
-
-
-    <div class="tags">
-        
-    </div>
-
-    
-
-</div>
-
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
-
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
-
-<div id="toc"></div>
-
-            
-        </div>
-    <!-- /.row -->
-    </div>
-<!-- /.container -->
-</div>
-
-</body>
-
-</html>
\ No newline at end of file
diff --git a/content/cn/contributing.html b/content/cn/contributing.html
index 8ef0c7b..f8913c7 100644
--- a/content/cn/contributing.html
+++ b/content/cn/contributing.html
@@ -1,346 +1,214 @@
-<!DOCTYPE html>
-<head>
+<!doctype html>
+<html lang="en" class="no-js">
+  <head>
     <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="">
-<meta name="keywords" content="hudi, ide, developer, setup">
-<title>Developer Setup | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
 
+<!-- begin _includes/seo.html --><title>Developer Setup - Apache Hudi</title>
+<meta name="description" content="Apache Hudi ingests &amp; manages storage of large analytical datasets over DFS (HDFS or cloud stores).">
 
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
+<meta property="og:type" content="website">
+<meta property="og:locale" content="en_US">
+<meta property="og:site_name" content="">
+<meta property="og:title" content="Developer Setup">
+<meta property="og:url" content="https://hudi.apache.org/cn/contributing">
 
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
 
 
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
 
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
 
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
 
-</script>
+  <meta property="article:modified_time" content="2019-12-30T14:59:57-05:00">
 
-<link rel="shortcut icon" href="/images/favicon.ico">
 
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
 
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
 
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li class="dropdownActive"><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the Developer Setup page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/contributing.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="Developer Setup">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
 
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
 
 
+<!-- end _includes/seo.html -->
+
+
+<!--<link href="/feed.xml" type="application/atom+xml" rel="alternate" title=" Feed">-->
+
+<!-- https://t.co/dKP3o1e -->
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+
+<script>
+  document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js ';
+</script>
+
+<!-- For all browsers -->
+<link rel="stylesheet" href="/assets/css/main.css">
+
+<!--[if IE]>
+  <style>
+    /* old IE unsupported flexbox fixes */
+    .greedy-nav .site-title {
+      padding-right: 3em;
+    }
+    .greedy-nav button {
+      position: absolute;
+      top: 0;
+      right: 0;
+      height: 100%;
+    }
+  </style>
+<![endif]-->
+
+
+
+<link rel="icon" type="image/x-icon" href="/assets/images/favicon.ico">
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+  </head>
 
+  <body class="layout--single">
+    <!--[if lt IE 9]>
+<div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
+<![endif]-->
 
+    <div class="masthead">
+  <div class="masthead__inner-wrap" id="masthead__inner-wrap">
+    <div class="masthead__menu">
+      <nav id="site-nav" class="greedy-nav">
+        
+          <a class="site-logo" href="/">
+              <div style="width: 150px; height: 40px">
+
+              </div>
+<!--            <img src="" alt="">-->
+<!--            -->
+<!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
+<!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
+<!--            </span>-->
+<!--            -->
+          </a>
+        
+        <a class="site-title" href="/">
+          
+        </a>
+        <ul class="visible-links"><li class="masthead__menu-item">
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/community.html" target="_self" >社区</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/activity.html" target="_self" >动态</a>
+            </li><li class="masthead__menu-item">
+              <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/releases.html" target="_self" >发布</a>
+            </li></ul>
+        <button class="greedy-nav__toggle hidden" type="button">
+          <span class="visually-hidden">Toggle menu</span>
+          <div class="navicon"></div>
+        </button>
+        <ul class="hidden-links hidden"></ul>
+      </nav>
+    </div>
+  </div>
+</div>
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
+  Click <a href="/"> here</a> back to old site.</p>
+-->
 
+    <div class="initial-content">
+      <div id="main" role="main">
+  
 
+  <div class="sidebar sticky">
 
+  
+    <div itemscope itemtype="https://schema.org/Person">
 
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
+  <div class="author__content">
+    
+      <h3 class="author__name" itemprop="name">Quick Links</h3>
     
     
+      <div class="author__bio" itemprop="description">
+        <p>Hudi <em>ingests</em> &amp; <em>manages</em> storage of large analytical datasets over DFS.</p>
+
+      </div>
     
-    <li>
-        <a href="#">入门指南</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">快速开始</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">使用案例</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">对比</a></li>
-            
-            
-            
-            
-        </ul>
+  </div>
+
+  <div class="author__urls-wrapper">
+    <ul class="author__urls social-icons">
+      
         
+          <li><a href="/cn/docs/quick-start-guide" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-book" aria-hidden="true"></i> Documentation</a></li>
+
+          
         
-    
-    <li>
-        <a href="#">文档</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">概念</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">写入数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">查询数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">配置</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">性能</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">管理</a></li>
-            
-            
-            
-            
-        </ul>
+          <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-wikipedia-w" aria-hidden="true"></i> Technical Wiki</a></li>
+
+          
         
+          <li><a href="/cn/contributing" target="_self" rel="nofollow noopener noreferrer"><i class="fa fa-thumbs-o-up" aria-hidden="true"></i> Contribution Guide</a></li>
+
+          
         
+          <li><a href="https://join.slack.com/t/apache-hudi/shared_invite/enQtODYyNDAxNzc5MTg2LTE5OTBlYmVhYjM0N2ZhOTJjOWM4YzBmMWU2MjZjMGE4NDc5ZDFiOGQ2N2VkYTVkNzU3ZDQ4OTI1NmFmYWQ0NzE" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-slack" aria-hidden="true"></i> Join on Slack</a></li>
+
+          
         
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
+          <li><a href="https://github.com/apache/incubator-hudi" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-github" aria-hidden="true"></i> Fork on GitHub</a></li>
 
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
+          
+        
+          <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank" rel="nofollow noopener noreferrer"><i class="fa fa-navicon" aria-hidden="true"></i> Report Issues</a></li>
 
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">Developer Setup</h1>
+          
+        
+      
+    </ul>
+  </div>
 </div>
 
+  
 
+  
+  </div>
 
-<div class="post-content">
 
-   
+  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
 
-    
+    <div class="page__inner-wrap">
+      
+        <header>
+          <h1 id="page-title" class="page__title" itemprop="headline">Developer Setup
+</h1>
+        </header>
+      
 
-  <h2 id="pre-requisites">Pre-requisites</h2>
+      <section class="page__content" itemprop="text">
+        
+        <aside class="sidebar__right sticky">
+          <nav class="toc">
+            <header><h4 class="nav__title"><i class="fas fa-file-alt"></i> In this page</h4></header>
+            <ul class="toc__menu">
+  <li><a href="#pre-requisites">Pre-requisites</a></li>
+  <li><a href="#ide-setup">IDE Setup</a></li>
+  <li><a href="#accounts-and-permissions">Accounts and Permissions</a></li>
+  <li><a href="#life-of-a-contributor">Life of a Contributor</a>
+    <ul>
+      <li><a href="#filing-jiras">Filing JIRAs</a></li>
+      <li><a href="#claiming-jiras">Claiming JIRAs</a></li>
+      <li><a href="#contributing-code">Contributing Code</a></li>
+      <li><a href="#reviewing-coderfcs">Reviewing Code/RFCs</a></li>
+      <li><a href="#suggest-changes">Suggest Changes</a></li>
+    </ul>
+  </li>
+  <li><a href="#releases">Releases</a></li>
+  <li><a href="#communication">Communication</a></li>
+  <li><a href="#code--project-structure">Code &amp; Project Structure</a></li>
+  <li><a href="#website">Website</a></li>
+</ul>
+          </nav>
+        </aside>
+        
+        <h2 id="pre-requisites">Pre-requisites</h2>
 
 <p>To contribute code, you need</p>
 
@@ -357,10 +225,15 @@ Software Foundation (ASF).</li>
 
 <h2 id="ide-setup">IDE Setup</h2>
 
-<p>To contribute, you would need to fork the Hudi code on Github &amp; then clone your own fork locally. Once cloned, we recommend building as per instructions on <a href="quickstart.html">quickstart</a></p>
+<p>To contribute, you would need to do the following</p>
 
-<p>We have embraced the code style largely based on <a href="https://google.github.io/styleguide/javaguide.html">google format</a>. Please setup your IDE with style files from <a href="https://github.com/apache/incubator-hudi/tree/master/style">here</a>.
-These instructions have been tested on IntelliJ. We also recommend setting up the <a href="https://plugins.jetbrains.com/plugin/7642-save-actions">Save Action Plugin</a> to auto format &amp; organize imports on save. The Maven Compilation life-cycle will fail if there are checkstyle violations.</p>
+<ul>
+  <li>Fork the Hudi code on Github &amp; then clone your own fork locally. Once cloned, we recommend building as per instructions on <a href="/docs/quick-start-guide.html">quickstart</a></li>
+  <li>[Recommended] We have embraced the code style largely based on <a href="https://google.github.io/styleguide/javaguide.html">google format</a>. Please setup your IDE with style files from <a href="https://github.com/apache/incubator-hudi/tree/master/style">here</a>.
+These instructions have been tested on IntelliJ.</li>
+  <li>[Recommended] Set up the <a href="https://plugins.jetbrains.com/plugin/7642-save-actions">Save Action Plugin</a> to auto format &amp; organize imports on save. The Maven Compilation life-cycle will fail if there are checkstyle violations.</li>
+  <li>[Optional] If needed, add spark jars to the classpath of your module in Intellij by following the steps from <a href="https://stackoverflow.com/questions/1051640/correct-way-to-add-external-jars-lib-jar-to-an-intellij-idea-project">here</a>.</li>
+</ul>
 
 <h2 id="accounts-and-permissions">Accounts and Permissions</h2>
 
@@ -390,7 +263,7 @@ Only Hudi PMC members should mark their votes as binding.</p>
 
 <p>This document details processes and procedures we follow to make contributions to the project and take it forward. 
 If you are looking to ramp up into the project as a contributor, we highly encourage you to read this guide in full, familiarize yourself with the workflow 
-and more importantly also try to improve the process along the way as well. </p>
+and more importantly also try to improve the process along the way as well.</p>
 
 <h3 id="filing-jiras">Filing JIRAs</h3>
 
@@ -537,81 +410,48 @@ Discussion about contributing code to Hudi happens on the <a href="community.htm
 <p><a href="https://hudi.apache.org">Apache Hudi site</a> is hosted on a special <code class="highlighter-rouge">asf-site</code> branch. Please follow the <code class="highlighter-rouge">README</code> file under <code class="highlighter-rouge">docs</code> on that branch for
 instructions on making changes to the website.</p>
 
+      </section>
 
-    <div class="tags">
-        
-    </div>
+      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
 
-    
 
-</div>
+      
 
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
+    </div>
 
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
+  </article>
 
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
-
-<div id="toc"></div>
+</div>
 
-            
-        </div>
-    <!-- /.row -->
     </div>
-<!-- /.container -->
+
+    <div class="page__footer">
+      <footer>
+        
+<div class="row">
+  <div class="col-lg-12 footer">
+    <p>
+      <a class="footer-link-img" href="https://apache.org">
+        <img width="250px" src="/assets/images/asf_logo.svg" alt="The Apache Software Foundation">
+      </a>
+    </p>
+    <p>
+      Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>, Licensed under the Apache License, Version 2.0.
+      Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation. <a href="/docs/privacy">Privacy Policy</a>
+      <br>
+      Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
+      Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
+      stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
+      reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+    </p>
+  </div>
 </div>
+      </footer>
+    </div>
+
+    
+<script src="/assets/js/main.min.js"></script>
 
-</body>
 
+  </body>
 </html>
\ No newline at end of file
diff --git a/content/cn/docker_demo.html b/content/cn/docker_demo.html
deleted file mode 100644
index 892ea33..0000000
--- a/content/cn/docker_demo.html
+++ /dev/null
@@ -1,1363 +0,0 @@
-<!DOCTYPE html>
-<head>
-    <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="">
-<meta name="keywords" content="hudi, docker, demo">
-<title>Docker Demo | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
-
-
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
-
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
-
-
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
-
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
-
-</script>
-
-<link rel="shortcut icon" href="/images/favicon.ico">
-
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
-<![endif]-->
-
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
-
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the Docker Demo page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/docker_demo.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="Docker Demo">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
-
-    </div>
-        <!-- /.container -->
-</nav>
-
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
-          
-
-
-
-
-
-
-
-
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
-    
-    <li>
-        <a href="#">入门指南</a>
-        <ul>
-            
-            
-            
-            <li><a href="quickstart.html">快速开始</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="use_cases.html">使用案例</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="comparison.html">对比</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-    
-    <li>
-        <a href="#">文档</a>
-        <ul>
-            
-            
-            
-            <li><a href="concepts.html">概念</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="writing_data.html">写入数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="querying_data.html">查询数据</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="configurations.html">配置</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="performance.html">性能</a></li>
-            
-            
-            
-            
-            
-            
-            <li><a href="admin_guide.html">管理</a></li>
-            
-            
-            
-            
-        </ul>
-        
-        
-        
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
-
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
-
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">Docker Demo</h1>
-</div>
-
-
-
-<div class="post-content">
-
-   
-
-    
-
-  <h2 id="a-demo-using-docker-containers">A Demo using docker containers</h2>
-
-<p>Lets use a real world example to see how hudi works end to end. For this purpose, a self contained
-data infrastructure is brought up in a local docker cluster within your computer.</p>
-
-<p>The steps have been tested on a Mac laptop</p>
-
-<h3 id="prerequisites">Prerequisites</h3>
-
-<ul>
-  <li>Docker Setup :  For Mac, Please follow the steps as defined in [https://docs.docker.com/v17.12/docker-for-mac/install/]. For running Spark-SQL queries, please ensure atleast 6 GB and 4 CPUs are allocated to Docker (See Docker -&gt; Preferences -&gt; Advanced). Otherwise, spark-SQL queries could be killed because of memory issues.</li>
-  <li>kafkacat : A command-line utility to publish/consume from kafka topics. Use <code class="highlighter-rouge">brew install kafkacat</code> to install kafkacat</li>
-  <li>/etc/hosts : The demo references many services running in container by the hostname. Add the following settings to /etc/hosts</li>
-</ul>
-
-<pre><code class="language-Java">   127.0.0.1 adhoc-1
-   127.0.0.1 adhoc-2
-   127.0.0.1 namenode
-   127.0.0.1 datanode1
-   127.0.0.1 hiveserver
-   127.0.0.1 hivemetastore
-   127.0.0.1 kafkabroker
-   127.0.0.1 sparkmaster
-   127.0.0.1 zookeeper
-</code></pre>
-
-<p>Also, this has not been tested on some environments like Docker on Windows.</p>
-
-<h3 id="setting-up-docker-cluster">Setting up Docker Cluster</h3>
-
-<h4 id="build-hudi">Build Hudi</h4>
-
-<p>The first step is to build hudi</p>
-<pre><code class="language-Java">cd &lt;HUDI_WORKSPACE&gt;
-mvn package -DskipTests
-</code></pre>
-
-<h4 id="bringing-up-demo-cluster">Bringing up Demo Cluster</h4>
-
-<p>The next step is to run the docker compose script and setup configs for bringing up the cluster.
-This should pull the docker images from docker hub and setup docker cluster.</p>
-
-<pre><code class="language-Java">cd docker
-./setup_demo.sh
-....
-....
-....
-Stopping spark-worker-1            ... done
-Stopping hiveserver                ... done
-Stopping hivemetastore             ... done
-Stopping historyserver             ... done
-.......
-......
-Creating network "hudi_demo" with the default driver
-Creating hive-metastore-postgresql ... done
-Creating namenode                  ... done
-Creating zookeeper                 ... done
-Creating kafkabroker               ... done
-Creating hivemetastore             ... done
-Creating historyserver             ... done
-Creating hiveserver                ... done
-Creating datanode1                 ... done
-Creating sparkmaster               ... done
-Creating adhoc-1                   ... done
-Creating adhoc-2                   ... done
-Creating spark-worker-1            ... done
-Copying spark default config and setting up configs
-Copying spark default config and setting up configs
-Copying spark default config and setting up configs
-varadarb-C02SG7Q3G8WP:docker varadarb$ docker ps
-</code></pre>
-
-<p>At this point, the docker cluster will be up and running. The demo cluster brings up the following services</p>
-
-<ul>
-  <li>HDFS Services (NameNode, DataNode)</li>
-  <li>Spark Master and Worker</li>
-  <li>Hive Services (Metastore, HiveServer2 along with PostgresDB)</li>
-  <li>Kafka Broker and a Zookeeper Node (Kakfa will be used as upstream source for the demo)</li>
-  <li>Adhoc containers to run Hudi/Hive CLI commands</li>
-</ul>
-
-<h3 id="demo">Demo</h3>
-
-<p>Stock Tracker data will be used to showcase both different Hudi Views and the effects of Compaction.</p>
-
-<p>Take a look at the directory <code class="highlighter-rouge">docker/demo/data</code>. There are 2 batches of stock data - each at 1 minute granularity.
-The first batch contains stocker tracker data for some stock symbols during the first hour of trading window
-(9:30 a.m to 10:30 a.m). The second batch contains tracker data for next 30 mins (10:30 - 11 a.m). Hudi will
-be used to ingest these batches to a dataset which will contain the latest stock tracker data at hour level granularity.
-The batches are windowed intentionally so that the second batch contains updates to some of the rows in the first batch.</p>
-
-<h4 id="step-1--publish-the-first-batch-to-kafka">Step 1 : Publish the first batch to Kafka</h4>
-
-<p>Upload the first batch to Kafka topic ‘stock ticks’</p>
-
-<pre><code class="language-Java">cat docker/demo/data/batch_1.json | kafkacat -b kafkabroker -t stock_ticks -P
-
-To check if the new topic shows up, use
-kafkacat -b kafkabroker -L -J | jq .
-{
-  "originating_broker": {
-    "id": 1001,
-    "name": "kafkabroker:9092/1001"
-  },
-  "query": {
-    "topic": "*"
-  },
-  "brokers": [
-    {
-      "id": 1001,
-      "name": "kafkabroker:9092"
-    }
-  ],
-  "topics": [
-    {
-      "topic": "stock_ticks",
-      "partitions": [
-        {
-          "partition": 0,
-          "leader": 1001,
-          "replicas": [
-            {
-              "id": 1001
-            }
-          ],
-          "isrs": [
-            {
-              "id": 1001
-            }
-          ]
-        }
-      ]
-    }
-  ]
-}
-
-</code></pre>
-
-<h4 id="step-2-incrementally-ingest-data-from-kafka-topic">Step 2: Incrementally ingest data from Kafka topic</h4>
-
-<p>Hudi comes with a tool named DeltaStreamer. This tool can connect to variety of data sources (including Kafka) to
-pull changes and apply to Hudi dataset using upsert/insert primitives. Here, we will use the tool to download
-json data from kafka topic and ingest to both COW and MOR tables we initialized in the previous step. This tool
-automatically initializes the datasets in the file-system if they do not exist yet.</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-
-# Run the following spark-submit command to execute the delta-streamer and ingest to stock_ticks_cow dataset in HDFS
-spark-submit --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer $HUDI_UTILITIES_BUNDLE --storage-type COPY_ON_WRITE --source-class org.apache.hudi.utilities.sources.JsonKafkaSource --source-ordering-field ts  --target-base-path /user/hive/warehouse/stock_ticks_cow --target-table stock_ticks_cow --props /var/demo/config/kafka-source.properties --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider
-....
-....
-2018-09-24 22:20:00 INFO  OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:54 - OutputCommitCoordinator stopped!
-2018-09-24 22:20:00 INFO  SparkContext:54 - Successfully stopped SparkContext
-
-
-
-# Run the following spark-submit command to execute the delta-streamer and ingest to stock_ticks_mor dataset in HDFS
-spark-submit --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer $HUDI_UTILITIES_BUNDLE --storage-type MERGE_ON_READ --source-class org.apache.hudi.utilities.sources.JsonKafkaSource --source-ordering-field ts  --target-base-path /user/hive/warehouse/stock_ticks_mor --target-table stock_ticks_mor --props /var/demo/config/kafka-source.properties --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider --disable-compaction
-....
-2018-09-24 22:22:01 INFO  OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:54 - OutputCommitCoordinator stopped!
-2018-09-24 22:22:01 INFO  SparkContext:54 - Successfully stopped SparkContext
-....
-
-# As part of the setup (Look at setup_demo.sh), the configs needed for DeltaStreamer is uploaded to HDFS. The configs
-# contain mostly Kafa connectivity settings, the avro-schema to be used for ingesting along with key and partitioning fields.
-
-exit
-</code></pre>
-
-<p>You can use HDFS web-browser to look at the datasets
-<code class="highlighter-rouge">http://namenode:50070/explorer.html#/user/hive/warehouse/stock_ticks_cow</code>.</p>
-
-<p>You can explore the new partition folder created in the dataset along with a “deltacommit”
-file under .hoodie which signals a successful commit.</p>
-
-<p>There will be a similar setup when you browse the MOR dataset
-<code class="highlighter-rouge">http://namenode:50070/explorer.html#/user/hive/warehouse/stock_ticks_mor</code></p>
-
-<h4 id="step-3-sync-with-hive">Step 3: Sync with Hive</h4>
-
-<p>At this step, the datasets are available in HDFS. We need to sync with Hive to create new Hive tables and add partitions
-inorder to run Hive queries against those datasets.</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-
-# THis command takes in HIveServer URL and COW Hudi Dataset location in HDFS and sync the HDFS state to Hive
-/var/hoodie/ws/hudi-hive/run_sync_tool.sh  --jdbc-url jdbc:hive2://hiveserver:10000 --user hive --pass hive --partitioned-by dt --base-path /user/hive/warehouse/stock_ticks_cow --database default --table stock_ticks_cow
-.....
-2018-09-24 22:22:45,568 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(112)) - Sync complete for stock_ticks_cow
-.....
-
-# Now run hive-sync for the second data-set in HDFS using Merge-On-Read (MOR storage)
-/var/hoodie/ws/hudi-hive/run_sync_tool.sh  --jdbc-url jdbc:hive2://hiveserver:10000 --user hive --pass hive --partitioned-by dt --base-path /user/hive/warehouse/stock_ticks_mor --database default --table stock_ticks_mor
-...
-2018-09-24 22:23:09,171 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(112)) - Sync complete for stock_ticks_mor
-...
-2018-09-24 22:23:09,559 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(112)) - Sync complete for stock_ticks_mor_rt
-....
-exit
-</code></pre>
-<p>After executing the above command, you will notice</p>
-
-<ol>
-  <li>A hive table named <code class="highlighter-rouge">stock_ticks_cow</code> created which provides Read-Optimized view for the Copy On Write dataset.</li>
-  <li>Two new tables <code class="highlighter-rouge">stock_ticks_mor</code> and <code class="highlighter-rouge">stock_ticks_mor_rt</code> created for the Merge On Read dataset. The former
-provides the ReadOptimized view for the Hudi dataset and the later provides the realtime-view for the dataset.</li>
-</ol>
-
-<h4 id="step-4-a-run-hive-queries">Step 4 (a): Run Hive Queries</h4>
-
-<p>Run a hive query to find the latest timestamp ingested for stock symbol ‘GOOG’. You will notice that both read-optimized
-(for both COW and MOR dataset)and realtime views (for MOR dataset)give the same value “10:29 a.m” as Hudi create a
-parquet file for the first batch of data.</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-beeline -u jdbc:hive2://hiveserver:10000 --hiveconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat --hiveconf hive.stats.autogather=false
-# List Tables
-0: jdbc:hive2://hiveserver:10000&gt; show tables;
-+---------------------+--+
-|      tab_name       |
-+---------------------+--+
-| stock_ticks_cow     |
-| stock_ticks_mor     |
-| stock_ticks_mor_rt  |
-+---------------------+--+
-2 rows selected (0.801 seconds)
-0: jdbc:hive2://hiveserver:10000&gt;
-
-
-# Look at partitions that were added
-0: jdbc:hive2://hiveserver:10000&gt; show partitions stock_ticks_mor_rt;
-+----------------+--+
-|   partition    |
-+----------------+--+
-| dt=2018-08-31  |
-+----------------+--+
-1 row selected (0.24 seconds)
-
-
-# COPY-ON-WRITE Queries:
-=========================
-
-
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_cow group by symbol HAVING symbol = 'GOOG';
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:29:00  |
-+---------+----------------------+--+
-
-Now, run a projection query:
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924221953       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924221953       | GOOG    | 2018-08-31 10:29:00  | 3391    | 1230.1899  | 1230.085  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-
-# Merge-On-Read Queries:
-==========================
-
-Lets run similar queries against M-O-R dataset. Lets look at both
-ReadOptimized and Realtime views supported by M-O-R dataset
-
-# Run against ReadOptimized View. Notice that the latest timestamp is 10:29
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:29:00  |
-+---------+----------------------+--+
-1 row selected (6.326 seconds)
-
-
-# Run against Realtime View. Notice that the latest timestamp is again 10:29
-
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:29:00  |
-+---------+----------------------+--+
-1 row selected (1.606 seconds)
-
-
-# Run projection query against Read Optimized and Realtime tables
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924222155       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924222155       | GOOG    | 2018-08-31 10:29:00  | 3391    | 1230.1899  | 1230.085  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924222155       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924222155       | GOOG    | 2018-08-31 10:29:00  | 3391    | 1230.1899  | 1230.085  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-exit
-exit
-</code></pre>
-
-<h4 id="step-4-b-run-spark-sql-queries">Step 4 (b): Run Spark-SQL Queries</h4>
-<p>Hudi support Spark as query processor just like Hive. Here are the same hive queries
-running in spark-sql</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-1 /bin/bash
-$SPARK_INSTALL/bin/spark-shell --jars $HUDI_SPARK_BUNDLE --master local[2] --driver-class-path $HADOOP_CONF_DIR --conf spark.sql.hive.convertMetastoreParquet=false --deploy-mode client  --driver-memory 1G --executor-memory 3G --num-executors 1  --packages com.databricks:spark-avro_2.11:4.0.0
-...
-
-Welcome to
-      ____              __
-     / __/__  ___ _____/ /__
-    _\ \/ _ \/ _ `/ __/  '_/
-   /___/ .__/\_,_/_/ /_/\_\   version 2.3.1
-      /_/
-
-Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_181)
-Type in expressions to have them evaluated.
-Type :help for more information.
-
-scala&gt;
-scala&gt; spark.sql("show tables").show(100, false)
-+--------+------------------+-----------+
-|database|tableName         |isTemporary|
-+--------+------------------+-----------+
-|default |stock_ticks_cow   |false      |
-|default |stock_ticks_mor   |false      |
-|default |stock_ticks_mor_rt|false      |
-+--------+------------------+-----------+
-
-# Copy-On-Write Table
-
-## Run max timestamp query against COW table
-
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_cow group by symbol HAVING symbol = 'GOOG'").show(100, false)
-[Stage 0:&gt;                                                          (0 + 1) / 1]SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
-SLF4J: Defaulting to no-operation (NOP) logger implementation
-SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
-+------+-------------------+
-|symbol|max(ts)            |
-+------+-------------------+
-|GOOG  |2018-08-31 10:29:00|
-+------+-------------------+
-
-## Projection Query
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow where  symbol = 'GOOG'").show(100, false)
-+-------------------+------+-------------------+------+---------+--------+
-|_hoodie_commit_time|symbol|ts                 |volume|open     |close   |
-+-------------------+------+-------------------+------+---------+--------+
-|20180924221953     |GOOG  |2018-08-31 09:59:00|6330  |1230.5   |1230.02 |
-|20180924221953     |GOOG  |2018-08-31 10:29:00|3391  |1230.1899|1230.085|
-+-------------------+------+-------------------+------+---------+--------+
-
-# Merge-On-Read Queries:
-==========================
-
-Lets run similar queries against M-O-R dataset. Lets look at both
-ReadOptimized and Realtime views supported by M-O-R dataset
-
-# Run against ReadOptimized View. Notice that the latest timestamp is 10:29
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+------+-------------------+
-|symbol|max(ts)            |
-+------+-------------------+
-|GOOG  |2018-08-31 10:29:00|
-+------+-------------------+
-
-
-# Run against Realtime View. Notice that the latest timestamp is again 10:29
-
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+------+-------------------+
-|symbol|max(ts)            |
-+------+-------------------+
-|GOOG  |2018-08-31 10:29:00|
-+------+-------------------+
-
-# Run projection query against Read Optimized and Realtime tables
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG'").show(100, false)
-+-------------------+------+-------------------+------+---------+--------+
-|_hoodie_commit_time|symbol|ts                 |volume|open     |close   |
-+-------------------+------+-------------------+------+---------+--------+
-|20180924222155     |GOOG  |2018-08-31 09:59:00|6330  |1230.5   |1230.02 |
-|20180924222155     |GOOG  |2018-08-31 10:29:00|3391  |1230.1899|1230.085|
-+-------------------+------+-------------------+------+---------+--------+
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG'").show(100, false)
-+-------------------+------+-------------------+------+---------+--------+
-|_hoodie_commit_time|symbol|ts                 |volume|open     |close   |
-+-------------------+------+-------------------+------+---------+--------+
-|20180924222155     |GOOG  |2018-08-31 09:59:00|6330  |1230.5   |1230.02 |
-|20180924222155     |GOOG  |2018-08-31 10:29:00|3391  |1230.1899|1230.085|
-+-------------------+------+-------------------+------+---------+--------+
-
-</code></pre>
-
-<h4 id="step-5-upload-second-batch-to-kafka-and-run-deltastreamer-to-ingest">Step 5: Upload second batch to Kafka and run DeltaStreamer to ingest</h4>
-
-<p>Upload the second batch of data and ingest this batch using delta-streamer. As this batch does not bring in any new
-partitions, there is no need to run hive-sync</p>
-
-<pre><code class="language-Java">cat docker/demo/data/batch_2.json | kafkacat -b kafkabroker -t stock_ticks -P
-
-# Within Docker container, run the ingestion command
-docker exec -it adhoc-2 /bin/bash
-
-# Run the following spark-submit command to execute the delta-streamer and ingest to stock_ticks_cow dataset in HDFS
-spark-submit --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer $HUDI_UTILITIES_BUNDLE --storage-type COPY_ON_WRITE --source-class org.apache.hudi.utilities.sources.JsonKafkaSource --source-ordering-field ts  --target-base-path /user/hive/warehouse/stock_ticks_cow --target-table stock_ticks_cow --props /var/demo/config/kafka-source.properties --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider
-
-
-# Run the following spark-submit command to execute the delta-streamer and ingest to stock_ticks_mor dataset in HDFS
-spark-submit --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer $HUDI_UTILITIES_BUNDLE --storage-type MERGE_ON_READ --source-class org.apache.hudi.utilities.sources.JsonKafkaSource --source-ordering-field ts  --target-base-path /user/hive/warehouse/stock_ticks_mor --target-table stock_ticks_mor --props /var/demo/config/kafka-source.properties --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider --disable-compaction
-
-exit
-</code></pre>
-
-<p>With Copy-On-Write table, the second ingestion by DeltaStreamer resulted in a new version of Parquet file getting created.
-See <code class="highlighter-rouge">http://namenode:50070/explorer.html#/user/hive/warehouse/stock_ticks_cow/2018/08/31</code></p>
-
-<p>With Merge-On-Read table, the second ingestion merely appended the batch to an unmerged delta (log) file.
-Take a look at the HDFS filesystem to get an idea: <code class="highlighter-rouge">http://namenode:50070/explorer.html#/user/hive/warehouse/stock_ticks_mor/2018/08/31</code></p>
-
-<h4 id="step-6a-run-hive-queries">Step 6(a): Run Hive Queries</h4>
-
-<p>With Copy-On-Write table, the read-optimized view immediately sees the changes as part of second batch once the batch
-got committed as each ingestion creates newer versions of parquet files.</p>
-
-<p>With Merge-On-Read table, the second ingestion merely appended the batch to an unmerged delta (log) file.
-This is the time, when ReadOptimized and Realtime views will provide different results. ReadOptimized view will still
-return “10:29 am” as it will only read from the Parquet file. Realtime View will do on-the-fly merge and return
-latest committed data which is “10:59 a.m”.</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-beeline -u jdbc:hive2://hiveserver:10000 --hiveconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat --hiveconf hive.stats.autogather=false
-
-# Copy On Write Table:
-
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_cow group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-1 row selected (1.932 seconds)
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924221953       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924224524       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-As you can notice, the above queries now reflect the changes that came as part of ingesting second batch.
-
-
-# Merge On Read Table:
-
-# Read Optimized View
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:29:00  |
-+---------+----------------------+--+
-1 row selected (1.6 seconds)
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924222155       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924222155       | GOOG    | 2018-08-31 10:29:00  | 3391    | 1230.1899  | 1230.085  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-# Realtime View
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924222155       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924224537       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-exit
-exit
-</code></pre>
-
-<h4 id="step-6b-run-spark-sql-queries">Step 6(b): Run Spark SQL Queries</h4>
-
-<p>Running the same queries in Spark-SQL:</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-1 /bin/bash
-bash-4.4# $SPARK_INSTALL/bin/spark-shell --jars $HUDI_SPARK_BUNDLE --driver-class-path $HADOOP_CONF_DIR --conf spark.sql.hive.convertMetastoreParquet=false --deploy-mode client  --driver-memory 1G --master local[2] --executor-memory 3G --num-executors 1  --packages com.databricks:spark-avro_2.11:4.0.0
-
-# Copy On Write Table:
-
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_cow group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+------+-------------------+
-|symbol|max(ts)            |
-+------+-------------------+
-|GOOG  |2018-08-31 10:59:00|
-+------+-------------------+
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow where  symbol = 'GOOG'").show(100, false)
-
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924221953       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924224524       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-As you can notice, the above queries now reflect the changes that came as part of ingesting second batch.
-
-
-# Merge On Read Table:
-
-# Read Optimized View
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:29:00  |
-+---------+----------------------+--+
-1 row selected (1.6 seconds)
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG'").show(100, false)
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924222155       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924222155       | GOOG    | 2018-08-31 10:29:00  | 3391    | 1230.1899  | 1230.085  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-# Realtime View
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG'").show(100, false)
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924222155       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924224537       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-exit
-exit
-</code></pre>
-
-<h4 id="step-7--incremental-query-for-copy-on-write-table">Step 7 : Incremental Query for COPY-ON-WRITE Table</h4>
-
-<p>With 2 batches of data ingested, lets showcase the support for incremental queries in Hudi Copy-On-Write datasets</p>
-
-<p>Lets take the same projection query example</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-beeline -u jdbc:hive2://hiveserver:10000 --hiveconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat --hiveconf hive.stats.autogather=false
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924064621       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924065039       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-</code></pre>
-
-<p>As you notice from the above queries, there are 2 commits - 20180924064621 and 20180924065039 in timeline order.
-When you follow the steps, you will be getting different timestamps for commits. Substitute them
-in place of the above timestamps.</p>
-
-<p>To show the effects of incremental-query, let us assume that a reader has already seen the changes as part of
-ingesting first batch. Now, for the reader to see effect of the second batch, he/she has to keep the start timestamp to
-the commit time of the first batch (20180924064621) and run incremental query</p>
-
-<p>Hudi incremental mode provides efficient scanning for incremental queries by filtering out files that do not have any
-candidate rows using hudi-managed metadata.</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-beeline -u jdbc:hive2://hiveserver:10000 --hiveconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat --hiveconf hive.stats.autogather=false
-0: jdbc:hive2://hiveserver:10000&gt; set hoodie.stock_ticks_cow.consume.mode=INCREMENTAL;
-No rows affected (0.009 seconds)
-0: jdbc:hive2://hiveserver:10000&gt;  set hoodie.stock_ticks_cow.consume.max.commits=3;
-No rows affected (0.009 seconds)
-0: jdbc:hive2://hiveserver:10000&gt; set hoodie.stock_ticks_cow.consume.start.timestamp=20180924064621;
-</code></pre>
-
-<p>With the above setting, file-ids that do not have any updates from the commit 20180924065039 is filtered out without scanning.
-Here is the incremental query :</p>
-
-<pre><code class="language-Java">0: jdbc:hive2://hiveserver:10000&gt;
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow where  symbol = 'GOOG' and `_hoodie_commit_time` &gt; '20180924064621';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924065039       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-1 row selected (0.83 seconds)
-0: jdbc:hive2://hiveserver:10000&gt;
-</code></pre>
-
-<h5 id="incremental-query-with-spark-sql">Incremental Query with Spark SQL:</h5>
-<pre><code class="language-Java">docker exec -it adhoc-1 /bin/bash
-bash-4.4# $SPARK_INSTALL/bin/spark-shell --jars $HUDI_SPARK_BUNDLE --driver-class-path $HADOOP_CONF_DIR --conf spark.sql.hive.convertMetastoreParquet=false --deploy-mode client  --driver-memory 1G --master local[2] --executor-memory 3G --num-executors 1  --packages com.databricks:spark-avro_2.11:4.0.0
-Welcome to
-      ____              __
-     / __/__  ___ _____/ /__
-    _\ \/ _ \/ _ `/ __/  '_/
-   /___/ .__/\_,_/_/ /_/\_\   version 2.3.1
-      /_/
-
-Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_181)
-Type in expressions to have them evaluated.
-Type :help for more information.
-
-scala&gt; import org.apache.hudi.DataSourceReadOptions
-import org.apache.hudi.DataSourceReadOptions
-
-# In the below query, 20180925045257 is the first commit's timestamp
-scala&gt; val hoodieIncViewDF =  spark.read.format("org.apache.hudi").option(DataSourceReadOptions.VIEW_TYPE_OPT_KEY, DataSourceReadOptions.VIEW_TYPE_INCREMENTAL_OPT_VAL).option(DataSourceReadOptions.BEGIN_INSTANTTIME_OPT_KEY, "20180924064621").load("/user/hive/warehouse/stock_ticks_cow")
-SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
-SLF4J: Defaulting to no-operation (NOP) logger implementation
-SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
-hoodieIncViewDF: org.apache.spark.sql.DataFrame = [_hoodie_commit_time: string, _hoodie_commit_seqno: string ... 15 more fields]
-
-scala&gt; hoodieIncViewDF.registerTempTable("stock_ticks_cow_incr_tmp1")
-warning: there was one deprecation warning; re-run with -deprecation for details
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_cow_incr_tmp1 where  symbol = 'GOOG'").show(100, false);
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924065039       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-</code></pre>
-
-<h4 id="step-8-schedule-and-run-compaction-for-merge-on-read-dataset">Step 8: Schedule and Run Compaction for Merge-On-Read dataset</h4>
-
-<p>Lets schedule and run a compaction to create a new version of columnar  file so that read-optimized readers will see fresher data.
-Again, You can use Hudi CLI to manually schedule and run compaction</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-1 /bin/bash
-root@adhoc-1:/opt#   /var/hoodie/ws/hudi-cli/hudi-cli.sh
-============================================
-*                                          *
-*     _    _           _   _               *
-*    | |  | |         | | (_)              *
-*    | |__| |       __| |  -               *
-*    |  __  ||   | / _` | ||               *
-*    | |  | ||   || (_| | ||               *
-*    |_|  |_|\___/ \____/ ||               *
-*                                          *
-============================================
-
-Welcome to Hoodie CLI. Please type help if you are looking for help.
-hudi-&gt;connect --path /user/hive/warehouse/stock_ticks_mor
-18/09/24 06:59:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
-18/09/24 06:59:35 INFO table.HoodieTableMetaClient: Loading HoodieTableMetaClient from /user/hive/warehouse/stock_ticks_mor
-18/09/24 06:59:35 INFO util.FSUtils: Hadoop Configuration: fs.defaultFS: [hdfs://namenode:8020], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml], FileSystem: [DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1261652683_11, ugi=root (auth:SIMPLE)]]]
-18/09/24 06:59:35 INFO table.HoodieTableConfig: Loading dataset properties from /user/hive/warehouse/stock_ticks_mor/.hoodie/hoodie.properties
-18/09/24 06:59:36 INFO table.HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ from /user/hive/warehouse/stock_ticks_mor
-Metadata for table stock_ticks_mor loaded
-
-# Ensure no compactions are present
-
-hoodie:stock_ticks_mor-&gt;compactions show all
-18/09/24 06:59:54 INFO timeline.HoodieActiveTimeline: Loaded instants [[20180924064636__clean__COMPLETED], [20180924064636__deltacommit__COMPLETED], [20180924065057__clean__COMPLETED], [20180924065057__deltacommit__COMPLETED]]
-    ___________________________________________________________________
-    | Compaction Instant Time| State    | Total FileIds to be Compacted|
-    |==================================================================|
-
-
-
-
-# Schedule a compaction. This will use Spark Launcher to schedule compaction
-hoodie:stock_ticks_mor-&gt;compaction schedule
-....
-Compaction successfully completed for 20180924070031
-
-# Now refresh and check again. You will see that there is a new compaction requested
-
-hoodie:stock_ticks-&gt;connect --path /user/hive/warehouse/stock_ticks_mor
-18/09/24 07:01:16 INFO table.HoodieTableMetaClient: Loading HoodieTableMetaClient from /user/hive/warehouse/stock_ticks_mor
-18/09/24 07:01:16 INFO util.FSUtils: Hadoop Configuration: fs.defaultFS: [hdfs://namenode:8020], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml], FileSystem: [DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1261652683_11, ugi=root (auth:SIMPLE)]]]
-18/09/24 07:01:16 INFO table.HoodieTableConfig: Loading dataset properties from /user/hive/warehouse/stock_ticks_mor/.hoodie/hoodie.properties
-18/09/24 07:01:16 INFO table.HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ from /user/hive/warehouse/stock_ticks_mor
-Metadata for table stock_ticks_mor loaded
-
-
-
-hoodie:stock_ticks_mor-&gt;compactions show all
-18/09/24 06:34:12 INFO timeline.HoodieActiveTimeline: Loaded instants [[20180924041125__clean__COMPLETED], [20180924041125__deltacommit__COMPLETED], [20180924042735__clean__COMPLETED], [20180924042735__deltacommit__COMPLETED], [==&gt;20180924063245__compaction__REQUESTED]]
-    ___________________________________________________________________
-    | Compaction Instant Time| State    | Total FileIds to be Compacted|
-    |==================================================================|
-    | 20180924070031         | REQUESTED| 1                            |
-
-
-
-
-# Execute the compaction. The compaction instant value passed below must be the one displayed in the above "compactions show all" query
-hoodie:stock_ticks_mor-&gt;compaction run --compactionInstant  20180924070031 --parallelism 2 --sparkMemory 1G  --schemaFilePath /var/demo/config/schema.avsc --retry 1  
-....
-Compaction successfully completed for 20180924070031
-
-
-## Now check if compaction is completed
-
-hoodie:stock_ticks_mor-&gt;connect --path /user/hive/warehouse/stock_ticks_mor
-18/09/24 07:03:00 INFO table.HoodieTableMetaClient: Loading HoodieTableMetaClient from /user/hive/warehouse/stock_ticks_mor
-18/09/24 07:03:00 INFO util.FSUtils: Hadoop Configuration: fs.defaultFS: [hdfs://namenode:8020], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml], FileSystem: [DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1261652683_11, ugi=root (auth:SIMPLE)]]]
-18/09/24 07:03:00 INFO table.HoodieTableConfig: Loading dataset properties from /user/hive/warehouse/stock_ticks_mor/.hoodie/hoodie.properties
-18/09/24 07:03:00 INFO table.HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ from /user/hive/warehouse/stock_ticks_mor
-Metadata for table stock_ticks_mor loaded
-
-
-
-hoodie:stock_ticks-&gt;compactions show all
-18/09/24 07:03:15 INFO timeline.HoodieActiveTimeline: Loaded instants [[20180924064636__clean__COMPLETED], [20180924064636__deltacommit__COMPLETED], [20180924065057__clean__COMPLETED], [20180924065057__deltacommit__COMPLETED], [20180924070031__commit__COMPLETED]]
-    ___________________________________________________________________
-    | Compaction Instant Time| State    | Total FileIds to be Compacted|
-    |==================================================================|
-    | 20180924070031         | COMPLETED| 1                            |
-
-</code></pre>
-
-<h4 id="step-9-run-hive-queries-including-incremental-queries">Step 9: Run Hive Queries including incremental queries</h4>
-
-<p>You will see that both ReadOptimized and Realtime Views will show the latest committed data.
-Lets also run the incremental query for MOR table.
-From looking at the below query output, it will be clear that the fist commit time for the MOR table is 20180924064636
-and the second commit time is 20180924070031</p>
-
-<pre><code class="language-Java">docker exec -it adhoc-2 /bin/bash
-beeline -u jdbc:hive2://hiveserver:10000 --hiveconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat --hiveconf hive.stats.autogather=false
-
-# Read Optimized View
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-1 row selected (1.6 seconds)
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924064636       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924070031       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-# Realtime View
-0: jdbc:hive2://hiveserver:10000&gt; select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG';
-WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924064636       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924070031       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-# Incremental View:
-
-0: jdbc:hive2://hiveserver:10000&gt; set hoodie.stock_ticks_mor.consume.mode=INCREMENTAL;
-No rows affected (0.008 seconds)
-# Max-Commits covers both second batch and compaction commit
-0: jdbc:hive2://hiveserver:10000&gt; set hoodie.stock_ticks_mor.consume.max.commits=3;
-No rows affected (0.007 seconds)
-0: jdbc:hive2://hiveserver:10000&gt; set hoodie.stock_ticks_mor.consume.start.timestamp=20180924064636;
-No rows affected (0.013 seconds)
-# Query:
-0: jdbc:hive2://hiveserver:10000&gt; select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG' and `_hoodie_commit_time` &gt; '20180924064636';
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924070031       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-exit
-exit
-</code></pre>
-
-<h5 id="read-optimized-and-realtime-views-for-mor-with-spark-sql-after-compaction">Read Optimized and Realtime Views for MOR with Spark-SQL after compaction</h5>
-
-<pre><code class="language-Java">docker exec -it adhoc-1 /bin/bash
-bash-4.4# $SPARK_INSTALL/bin/spark-shell --jars $HUDI_SPARK_BUNDLE --driver-class-path $HADOOP_CONF_DIR --conf spark.sql.hive.convertMetastoreParquet=false --deploy-mode client  --driver-memory 1G --master local[2] --executor-memory 3G --num-executors 1  --packages com.databricks:spark-avro_2.11:4.0.0
-
-# Read Optimized View
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-1 row selected (1.6 seconds)
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG'").show(100, false)
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924064636       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924070031       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-
-# Realtime View
-scala&gt; spark.sql("select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG'").show(100, false)
-+---------+----------------------+--+
-| symbol  |         _c1          |
-+---------+----------------------+--+
-| GOOG    | 2018-08-31 10:59:00  |
-+---------+----------------------+--+
-
-scala&gt; spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG'").show(100, false)
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-| 20180924064636       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
-| 20180924070031       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
-+----------------------+---------+----------------------+---------+------------+-----------+--+
-</code></pre>
-
-<p>This brings the demo to an end.</p>
-
-<h2 id="testing-hudi-in-local-docker-environment">Testing Hudi in Local Docker environment</h2>
-
-<p>You can bring up a hadoop docker environment containing Hadoop, Hive and Spark services with support for hudi.</p>
-<pre><code class="language-Java">$ mvn pre-integration-test -DskipTests
-</code></pre>
-<p>The above command builds docker images for all the services with
-current Hudi source installed at /var/hoodie/ws and also brings up the services using a compose file. We
-currently use Hadoop (v2.8.4), Hive (v2.3.3) and Spark (v2.3.1) in docker images.</p>
-
-<p>To bring down the containers</p>
-<pre><code class="language-Java">$ cd hudi-integ-test
-$ mvn docker-compose:down
-</code></pre>
-
-<p>If you want to bring up the docker containers, use</p>
-<pre><code class="language-Java">$ cd hudi-integ-test
-$  mvn docker-compose:up -DdetachedMode=true
-</code></pre>
-
-<p>Hudi is a library that is operated in a broader data analytics/ingestion environment
-involving Hadoop, Hive and Spark. Interoperability with all these systems is a key objective for us. We are
-actively adding integration-tests under <strong>hudi-integ-test/src/test/java</strong> that makes use of this
-docker environment (See <strong>hudi-integ-test/src/test/java/org/apache/hudi/integ/ITTestHoodieSanity.java</strong> )</p>
-
-<h4 id="building-local-docker-containers">Building Local Docker Containers:</h4>
-
-<p>The docker images required for demo and running integration test are already in docker-hub. The docker images
-and compose scripts are carefully implemented so that they serve dual-purpose</p>
-
-<ol>
-  <li>The docker images have inbuilt hudi jar files with environment variable pointing to those jars (HUDI_HADOOP_BUNDLE, …)</li>
-  <li>For running integration-tests, we need the jars generated locally to be used for running services within docker. The
-docker-compose scripts (see <code class="highlighter-rouge">docker/compose/docker-compose_hadoop284_hive233_spark231.yml</code>) ensures local jars override
-inbuilt jars by mounting local HUDI workspace over the docker location</li>
-</ol>
-
-<p>This helps avoid maintaining separate docker images and avoids the costly step of building HUDI docker images locally.
-But if users want to test hudi from locations with lower network bandwidth, they can still build local images
-run the script
-<code class="highlighter-rouge">docker/build_local_docker_images.sh</code> to build local docker images before running <code class="highlighter-rouge">docker/setup_demo.sh</code></p>
-
-<p>Here are the commands:</p>
-
-<pre><code class="language-Java">cd docker
-./build_local_docker_images.sh
-.....
-
-[INFO] Reactor Summary:
-[INFO]
-[INFO] hoodie ............................................. SUCCESS [  1.709 s]
-[INFO] hudi-common ...................................... SUCCESS [  9.015 s]
-[INFO] hudi-hadoop-mr ................................... SUCCESS [  1.108 s]
-[INFO] hudi-client ...................................... SUCCESS [  4.409 s]
-[INFO] hudi-hive ........................................ SUCCESS [  0.976 s]
-[INFO] hudi-spark ....................................... SUCCESS [ 26.522 s]
-[INFO] hudi-utilities ................................... SUCCESS [ 16.256 s]
-[INFO] hudi-cli ......................................... SUCCESS [ 11.341 s]
-[INFO] hudi-hadoop-mr-bundle ............................ SUCCESS [  1.893 s]
-[INFO] hudi-hive-bundle ................................. SUCCESS [ 14.099 s]
-[INFO] hudi-spark-bundle ................................ SUCCESS [ 58.252 s]
-[INFO] hudi-hadoop-docker ............................... SUCCESS [  0.612 s]
-[INFO] hudi-hadoop-base-docker .......................... SUCCESS [04:04 min]
-[INFO] hudi-hadoop-namenode-docker ...................... SUCCESS [  6.142 s]
-[INFO] hudi-hadoop-datanode-docker ...................... SUCCESS [  7.763 s]
-[INFO] hudi-hadoop-history-docker ....................... SUCCESS [  5.922 s]
-[INFO] hudi-hadoop-hive-docker .......................... SUCCESS [ 56.152 s]
-[INFO] hudi-hadoop-sparkbase-docker ..................... SUCCESS [01:18 min]
-[INFO] hudi-hadoop-sparkmaster-docker ................... SUCCESS [  2.964 s]
-[INFO] hudi-hadoop-sparkworker-docker ................... SUCCESS [  3.032 s]
-[INFO] hudi-hadoop-sparkadhoc-docker .................... SUCCESS [  2.764 s]
-[INFO] hudi-integ-test .................................. SUCCESS [  1.785 s]
-[INFO] ------------------------------------------------------------------------
-[INFO] BUILD SUCCESS
-[INFO] ------------------------------------------------------------------------
-[INFO] Total time: 09:15 min
-[INFO] Finished at: 2018-09-10T17:47:37-07:00
-[INFO] Final Memory: 236M/1848M
-[INFO] ------------------------------------------------------------------------
-</code></pre>
-
-
-    <div class="tags">
-        
-    </div>
-
-    
-
-</div>
-
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
-
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
-
-<div id="toc"></div>
-
-            
-        </div>
-    <!-- /.row -->
-    </div>
-<!-- /.container -->
-</div>
-
-</body>
-
-</html>
\ No newline at end of file
diff --git a/content/newsite-content/docs/admin_guide.html b/content/cn/docs/admin_guide.html
similarity index 83%
copy from content/newsite-content/docs/admin_guide.html
copy to content/cn/docs/admin_guide.html
index 71c29ca..a3a1e19 100644
--- a/content/newsite-content/docs/admin_guide.html
+++ b/content/cn/docs/admin_guide.html
@@ -3,17 +3,17 @@
   <head>
     <meta charset="utf-8">
 
-<!-- begin _includes/seo.html --><title>Administering Hudi Pipelines - Apache Hudi</title>
-<meta name="description" content="Admins/ops can gain visibility into Hudi datasets/pipelines in the following ways">
+<!-- begin _includes/seo.html --><title>管理 Hudi Pipelines - Apache Hudi</title>
+<meta name="description" content="管理员/运维人员可以通过以下方式了解Hudi数据集/管道">
 
 <meta property="og:type" content="article">
 <meta property="og:locale" content="en_US">
 <meta property="og:site_name" content="">
-<meta property="og:title" content="Administering Hudi Pipelines">
-<meta property="og:url" content="https://hudi.apache.org/docs/admin_guide.html">
+<meta property="og:title" content="管理 Hudi Pipelines">
+<meta property="og:url" content="https://hudi.apache.org/cn/docs/admin_guide.html">
 
 
-  <meta property="og:description" content="Admins/ops can gain visibility into Hudi datasets/pipelines in the following ways">
+  <meta property="og:description" content="管理员/运维人员可以通过以下方式了解Hudi数据集/管道">
 
 
 
@@ -69,9 +69,7 @@
 <div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
 <![endif]-->
 
-    
-
-<div class="masthead">
+    <div class="masthead">
   <div class="masthead__inner-wrap" id="masthead__inner-wrap">
     <div class="masthead__menu">
       <nav id="site-nav" class="greedy-nav">
@@ -80,7 +78,7 @@
               <div style="width: 150px; height: 40px">
 
               </div>
-<!--            <img src="/assets/images/hudi.png" alt="">-->
+<!--            <img src="" alt="">-->
 <!--            -->
 <!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
 <!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
@@ -92,15 +90,15 @@
           
         </a>
         <ul class="visible-links"><li class="masthead__menu-item">
-              <a href="/newsite-content/docs/quick-start-guide.html" target="_self" >Documentation</a>
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/community.html" target="_self" >Community</a>
+              <a href="/cn/community.html" target="_self" >社区</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/activity.html" target="_self" >Activities</a>
+              <a href="/cn/activity.html" target="_self" >动态</a>
             </li><li class="masthead__menu-item">
               <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
             </li><li class="masthead__menu-item">
-              <a href="/newsite-content/releases.html" target="_self" >Releases</a>
+              <a href="/cn/releases.html" target="_self" >发布</a>
             </li></ul>
         <button class="greedy-nav__toggle hidden" type="button">
           <span class="visually-hidden">Toggle menu</span>
@@ -111,37 +109,37 @@
     </div>
   </div>
 </div>
-<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://issues.apache.org/jira/projects/HUDI/summary">file a jira</a>.
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
   Click <a href="/"> here</a> back to old site.</p>
+-->
 
     <div class="initial-content">
       <div id="main" role="main">
   
+
   <div class="sidebar sticky">
 
   
 
   
+
     
       
-      
-      
-      
-    
 
 
-    
-      
+
+
 
 <nav class="nav__list">
   
   <input id="ac-toc" name="accordion-toc" type="checkbox" />
-  <label for="ac-toc">Toggle menu</label>
+  <label for="ac-toc">文档菜单</label>
   <ul class="nav__items">
     
       <li>
         
-          <span class="nav__sub-title">Getting Started</span>
+          <span class="nav__sub-title">入门指南</span>
         
 
         
@@ -154,7 +152,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/quick-start-guide.html" class="">Quick Start</a></li>
+              <li><a href="/cn/docs/quick-start-guide.html" class="">快速开始</a></li>
             
 
           
@@ -165,7 +163,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/use_cases.html" class="">Use Cases</a></li>
+              <li><a href="/cn/docs/use_cases.html" class="">使用案例</a></li>
             
 
           
@@ -176,7 +174,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/powered_by.html" class="">Talks & Powered By</a></li>
+              <li><a href="/cn/docs/powered_by.html" class="">演讲 & hudi 用户</a></li>
             
 
           
@@ -187,7 +185,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/comparison.html" class="">Comparison</a></li>
+              <li><a href="/cn/docs/comparison.html" class="">对比</a></li>
             
 
           
@@ -198,7 +196,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/docker_demo.html" class="">Docker Demo</a></li>
+              <li><a href="/cn/docs/docker_demo.html" class="">Docker 示例</a></li>
             
 
           
@@ -208,7 +206,7 @@
     
       <li>
         
-          <span class="nav__sub-title">Documentation</span>
+          <span class="nav__sub-title">帮助文档</span>
         
 
         
@@ -221,7 +219,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/concepts.html" class="">Concepts</a></li>
+              <li><a href="/cn/docs/concepts.html" class="">概念</a></li>
             
 
           
@@ -232,7 +230,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/writing_data.html" class="">Writing Data</a></li>
+              <li><a href="/cn/docs/writing_data.html" class="">写入数据</a></li>
             
 
           
@@ -243,7 +241,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/querying_data.html" class="">Querying Data</a></li>
+              <li><a href="/cn/docs/querying_data.html" class="">查询数据</a></li>
             
 
           
@@ -254,7 +252,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/configurations.html" class="">Configuration</a></li>
+              <li><a href="/cn/docs/configurations.html" class="">配置</a></li>
             
 
           
@@ -265,7 +263,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/performance.html" class="">Performance</a></li>
+              <li><a href="/cn/docs/performance.html" class="">性能</a></li>
             
 
           
@@ -276,7 +274,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/admin_guide.html" class="">Administering</a></li>
+              <li><a href="/cn/docs/admin_guide.html" class="active">管理</a></li>
             
 
           
@@ -286,7 +284,7 @@
     
       <li>
         
-          <span class="nav__sub-title">INFO</span>
+          <span class="nav__sub-title">其他信息</span>
         
 
         
@@ -299,7 +297,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/docs-versions.html" class="">Docs Versions</a></li>
+              <li><a href="/cn/docs/docs-versions.html" class="">文档版本</a></li>
             
 
           
@@ -310,7 +308,7 @@
             
 
             
-              <li><a href="/newsite-content/docs/privacy.html" class="">Privacy Policy</a></li>
+              <li><a href="/cn/docs/privacy.html" class="">版权信息</a></li>
             
 
           
@@ -321,6 +319,7 @@
   </ul>
 </nav>
     
+
   
   </div>
 
@@ -330,7 +329,7 @@
     <div class="page__inner-wrap">
       
         <header>
-          <h1 id="page-title" class="page__title" itemprop="headline">Administering Hudi Pipelines
+          <h1 id="page-title" class="page__title" itemprop="headline">管理 Hudi Pipelines
 </h1>
         </header>
       
@@ -343,46 +342,47 @@
             <ul class="toc__menu">
   <li><a href="#admin-cli">Admin CLI</a>
     <ul>
-      <li><a href="#inspecting-commits">Inspecting Commits</a></li>
-      <li><a href="#drilling-down-to-a-specific-commit">Drilling Down to a specific Commit</a></li>
-      <li><a href="#filesystem-view">FileSystem View</a></li>
-      <li><a href="#statistics">Statistics</a></li>
-      <li><a href="#archived-commits">Archived Commits</a></li>
-      <li><a href="#compactions">Compactions</a></li>
-      <li><a href="#validate-compaction">Validate Compaction</a></li>
-      <li><a href="#unscheduling-compaction">UnScheduling Compaction</a></li>
-      <li><a href="#repair-compaction">Repair Compaction</a></li>
+      <li><a href="#检查提交">检查提交</a></li>
+      <li><a href="#深入到特定的提交">深入到特定的提交</a></li>
+      <li><a href="#文件系统视图">文件系统视图</a></li>
+      <li><a href="#统计信息">统计信息</a></li>
+      <li><a href="#归档的提交">归档的提交</a></li>
+      <li><a href="#压缩">压缩</a></li>
+      <li><a href="#验证压缩">验证压缩</a></li>
+      <li><a href="#注意">注意</a></li>
+      <li><a href="#取消调度压缩">取消调度压缩</a></li>
+      <li><a href="#修复压缩">修复压缩</a></li>
     </ul>
   </li>
-  <li><a href="#metrics">Metrics</a></li>
-  <li><a href="#troubleshooting">Troubleshooting Failures</a>
+  <li><a href="#metrics">指标</a></li>
+  <li><a href="#troubleshooting">故障排除</a>
     <ul>
-      <li><a href="#missing-records">Missing records</a></li>
-      <li><a href="#duplicates">Duplicates</a></li>
-      <li><a href="#spark-ui">Spark failures</a></li>
+      <li><a href="#缺失记录">缺失记录</a></li>
+      <li><a href="#重复">重复</a></li>
+      <li><a href="#spark-ui">Spark故障</a></li>
     </ul>
   </li>
 </ul>
           </nav>
         </aside>
         
-        <p>Admins/ops can gain visibility into Hudi datasets/pipelines in the following ways</p>
+        <p>管理员/运维人员可以通过以下方式了解Hudi数据集/管道</p>
 
 <ul>
-  <li><a href="#admin-cli">Administering via the Admin CLI</a></li>
-  <li><a href="#metrics">Graphite metrics</a></li>
-  <li><a href="#spark-ui">Spark UI of the Hudi Application</a></li>
+  <li><a href="#admin-cli">通过Admin CLI进行管理</a></li>
+  <li><a href="#metrics">Graphite指标</a></li>
+  <li><a href="#spark-ui">Hudi应用程序的Spark UI</a></li>
 </ul>
 
-<p>This section provides a glimpse into each of these, with some general guidance on <a href="#troubleshooting">troubleshooting</a></p>
+<p>本节简要介绍了每一种方法,并提供了有关<a href="#troubleshooting">故障排除</a>的一些常规指南</p>
 
 <h2 id="admin-cli">Admin CLI</h2>
 
-<p>Once hudi has been built, the shell can be fired by via  <code class="highlighter-rouge">cd hudi-cli &amp;&amp; ./hudi-cli.sh</code>.
-A hudi dataset resides on DFS, in a location referred to as the <strong>basePath</strong> and we would need this location in order to connect to a Hudi dataset.
-Hudi library effectively manages this dataset internally, using .hoodie subfolder to track all metadata</p>
+<p>一旦构建了hudi,就可以通过<code class="highlighter-rouge">cd hudi-cli &amp;&amp; ./hudi-cli.sh</code>启动shell。
+一个hudi数据集位于DFS上的<strong>basePath</strong>位置,我们需要该位置才能连接到Hudi数据集。
+Hudi库使用.hoodie子文件夹跟踪所有元数据,从而有效地在内部管理该数据集。</p>
 
-<p>To initialize a hudi table, use the following command.</p>
+<p>初始化hudi表,可使用如下命令。</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="mi">18</span><span class="o">/</span><span class="mi">09</span><span class="o">/</span><span class="mo">06</span> <span class="mi">15</span><span class="o">:</span><span class="mi">56</span><span class="o">:</span><span class="mi">52</span> <span class="no">INFO</span> <span class="n">annotation</span><span class="o">.</span><span class="na">AutowiredAnnotationBeanPostProcessor</ [...]
 <span class="o">============================================</span>
@@ -402,7 +402,7 @@ Hudi library effectively manages this dataset internally, using .hoodie subfolde
 <span class="mi">18</span><span class="o">/</span><span class="mi">09</span><span class="o">/</span><span class="mo">06</span> <span class="mi">15</span><span class="o">:</span><span class="mi">57</span><span class="o">:</span><span class="mi">15</span> <span class="no">INFO</span> <span class="n">table</span><span class="o">.</span><span class="na">HoodieTableMetaClient</span><span class="o">:</span> <span class="nc">Finished</span> <span class="nc">Loading</span> <span class="nc">Table [...]
 </code></pre></div></div>
 
-<p>To see the description of hudi table, use the command:</p>
+<p>使用desc命令可以查看hudi表的描述信息:</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">hoodie_table_1</span><span class="o">-&gt;</span><span class="n">desc</span>
 <span class="mi">18</span><span class="o">/</span><span class="mi">09</span><span class="o">/</span><span class="mo">06</span> <span class="mi">15</span><span class="o">:</span><span class="mi">57</span><span class="o">:</span><span class="mi">19</span> <span class="no">INFO</span> <span class="n">timeline</span><span class="o">.</span><span class="na">HoodieActiveTimeline</span><span class="o">:</span> <span class="nc">Loaded</span> <span class="n">instants</span> <span class="o">[]</span>
@@ -417,7 +417,7 @@ Hudi library effectively manages this dataset internally, using .hoodie subfolde
     <span class="o">|</span> <span class="n">hoodie</span><span class="o">.</span><span class="na">archivelog</span><span class="o">.</span><span class="na">folder</span><span class="o">|</span>                              <span class="o">|</span>
 </code></pre></div></div>
 
-<p>Following is a sample command to connect to a Hudi dataset contains uber trips.</p>
+<p>以下是连接到包含uber trips的Hudi数据集的示例命令。</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">connect</span> <span class="o">--</span><span class="n">path</span> <span class="o">/</span><span class="n">app</span><span class="o">/</span><span class="n">uber</span><span class="o">/</span><span class="n">trips</span>
 
@@ -428,8 +428,7 @@ Hudi library effectively manages this dataset internally, using .hoodie subfolde
 <span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span>
 </code></pre></div></div>
 
-<p>Once connected to the dataset, a lot of other commands become available. The shell has contextual autocomplete help (press TAB) and below is a list of all commands, few of which are reviewed in this section
-are reviewed</p>
+<p>连接到数据集后,便可使用许多其他命令。该shell程序具有上下文自动完成帮助(按TAB键),下面是所有命令的列表,本节中对其中的一些命令进行了详细示例。</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">help</span>
 <span class="o">*</span> <span class="o">!</span> <span class="o">-</span> <span class="nc">Allows</span> <span class="n">execution</span> <span class="n">of</span> <span class="n">operating</span> <span class="nf">system</span> <span class="o">(</span><span class="no">OS</span><span class="o">)</span> <span class="n">commands</span>
@@ -462,12 +461,12 @@ are reviewed</p>
 <span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span>
 </code></pre></div></div>
 
-<h3 id="inspecting-commits">Inspecting Commits</h3>
+<h3 id="检查提交">检查提交</h3>
 
-<p>The task of upserting or inserting a batch of incoming records is known as a <strong>commit</strong> in Hudi. A commit provides basic atomicity guarantees such that only commited data is available for querying.
-Each commit has a monotonically increasing string/number called the <strong>commit number</strong>. Typically, this is the time at which we started the commit.</p>
+<p>在Hudi中,更新或插入一批记录的任务被称为<strong>提交</strong>。提交可提供基本的原子性保证,即只有提交的数据可用于查询。
+每个提交都有一个单调递增的字符串/数字,称为<strong>提交编号</strong>。通常,这是我们开始提交的时间。</p>
 
-<p>To view some basic information about the last 10 commits,</p>
+<p>查看有关最近10次提交的一些基本信息,</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">commits</span> <span class="n">show</span> <span class="o">--</span><span class="n">sortBy</span> <span class="s">"Total Bytes Written"</span> <span class="o">--</span><span class="n">desc</span> <span class="kc">true</span> <span class="o">--</span><span class="n">limit</span> <span class=" [...]
     <span class="n">________________________________________________________________________________________________________________________________________________________________________</span>
@@ -479,15 +478,15 @@ Each commit has a monotonically increasing string/number called the <strong>comm
 <span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span>
 </code></pre></div></div>
 
-<p>At the start of each write, Hudi also writes a .inflight commit to the .hoodie folder. You can use the timestamp there to estimate how long the commit has been inflight</p>
+<p>在每次写入开始时,Hudi还将.inflight提交写入.hoodie文件夹。您可以使用那里的时间戳来估计正在进行的提交已经花费的时间</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="err">$</span> <span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">ls</span> <span class="o">/</span><span class="n">app</span><span class="o">/</span><span class="n">uber</span><span class="o">/</span><span class="n">trips</span><span class="o">/.</span><span class="na">hoodie</span><span class="o">/*.</span><span class="na">inflight</span>
 <span class="o">-</span><span class="n">rw</span><span class="o">-</span><span class="n">r</span><span class="o">--</span><span class="n">r</span><span class="o">--</span>   <span class="mi">3</span> <span class="n">vinoth</span> <span class="n">supergroup</span>     <span class="mi">321984</span> <span class="mi">2016</span><span class="o">-</span><span class="mi">10</span><span class="o">-</span><span class="mo">05</span> <span class="mi">23</span><span class="o">:</span><span class="m [...]
 </code></pre></div></div>
 
-<h3 id="drilling-down-to-a-specific-commit">Drilling Down to a specific Commit</h3>
+<h3 id="深入到特定的提交">深入到特定的提交</h3>
 
-<p>To understand how the writes spread across specific partiions,</p>
+<p>了解写入如何分散到特定分区,</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">commit</span> <span class="n">showpartitions</span> <span class="o">--</span><span class="n">commit</span> <span class="mi">20161005165855</span> <span class="o">--</span><span class="n">sortBy</span> <span class="s">"Total Bytes Written"</span> <span class="o">--</span><span class="n">desc< [...]
     <span class="n">__________________________________________________________________________________________________________________________________________</span>
@@ -497,7 +496,7 @@ Each commit has a monotonically increasing string/number called the <strong>comm
      <span class="o">....</span>
 </code></pre></div></div>
 
-<p>If you need file level granularity , we can do the following</p>
+<p>如果您需要文件级粒度,我们可以执行以下操作</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">commit</span> <span class="n">showfiles</span> <span class="o">--</span><span class="n">commit</span> <span class="mi">20161005165855</span> <span class="o">--</span><span class="n">sortBy</span> <span class="s">"Partition Path"</span>
     <span class="n">________________________________________________________________________________________________________________________________________________________</span>
@@ -507,10 +506,9 @@ Each commit has a monotonically increasing string/number called the <strong>comm
     <span class="o">....</span>
 </code></pre></div></div>
 
-<h3 id="filesystem-view">FileSystem View</h3>
+<h3 id="文件系统视图">文件系统视图</h3>
 
-<p>Hudi views each partition as a collection of file-groups with each file-group containing a list of file-slices in commit
-order (See Concepts). The below commands allow users to view the file-slices for a data-set.</p>
+<p>Hudi将每个分区视为文件组的集合,每个文件组包含按提交顺序排列的文件切片列表(请参阅概念)。以下命令允许用户查看数据集的文件切片。</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code> <span class="nl">hoodie:</span><span class="n">stock_ticks_mor</span><span class="o">-&gt;</span><span class="n">show</span> <span class="n">fsview</span> <span class="n">all</span>
  <span class="o">....</span>
@@ -531,9 +529,9 @@ order (See Concepts). The below commands allow users to view the file-slices for
  <span class="nl">hoodie:</span><span class="n">stock_ticks_mor</span><span class="o">-&gt;</span>
 </code></pre></div></div>
 
-<h3 id="statistics">Statistics</h3>
+<h3 id="统计信息">统计信息</h3>
 
-<p>Since Hudi directly manages file sizes for DFS dataset, it might be good to get an overall picture</p>
+<p>由于Hudi直接管理DFS数据集的文件大小,这些信息会帮助你全面了解Hudi的运行状况</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">stats</span> <span class="n">filesizes</span> <span class="o">--</span><span class="n">partitionPath</span> <span class="mi">2016</span><span class="o">/</span><span class="mi">09</span><span class="o">/</span><span class="mo">01</span> <span class="o">--</span><span class="n">sortBy</span>  [...]
     <span class="n">________________________________________________________________________________________________</span>
@@ -544,7 +542,7 @@ order (See Concepts). The below commands allow users to view the file-slices for
     <span class="o">....</span>
 </code></pre></div></div>
 
-<p>In case of Hudi write taking much longer, it might be good to see the write amplification for any sudden increases</p>
+<p>如果Hudi写入花费的时间更长,那么可以通过观察写放大指标来发现任何异常</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">stats</span> <span class="n">wa</span>
     <span class="n">__________________________________________________________________________</span>
@@ -554,15 +552,14 @@ order (See Concepts). The below commands allow users to view the file-slices for
     <span class="o">....</span>
 </code></pre></div></div>
 
-<h3 id="archived-commits">Archived Commits</h3>
+<h3 id="归档的提交">归档的提交</h3>
 
-<p>In order to limit the amount of growth of .commit files on DFS, Hudi archives older .commit files (with due respect to the cleaner policy) into a commits.archived file.
-This is a sequence file that contains a mapping from commitNumber =&gt; json with raw information about the commit (same that is nicely rolled up above).</p>
+<p>为了限制DFS上.commit文件的增长量,Hudi将较旧的.commit文件(适当考虑清理策略)归档到commits.archived文件中。
+这是一个序列文件,其包含commitNumber =&gt; json的映射,及有关提交的原始信息(上面已很好地汇总了相同的信息)。</p>
 
-<h3 id="compactions">Compactions</h3>
+<h3 id="压缩">压缩</h3>
 
-<p>To get an idea of the lag between compaction and writer applications, use the below command to list down all
-pending compactions.</p>
+<p>要了解压缩和写程序之间的时滞,请使用以下命令列出所有待处理的压缩。</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">compactions</span> <span class="n">show</span> <span class="n">all</span>
      <span class="n">___________________________________________________________________</span>
@@ -572,7 +569,7 @@ pending compactions.</p>
     <span class="o">|</span> <span class="o">&lt;</span><span class="no">INSTANT_2</span><span class="o">&gt;</span>            <span class="o">|</span> <span class="no">INFLIGHT</span> <span class="o">|</span> <span class="mi">27</span>                           <span class="o">|</span>
 </code></pre></div></div>
 
-<p>To inspect a specific compaction plan, use</p>
+<p>要检查特定的压缩计划,请使用</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">compaction</span> <span class="n">show</span> <span class="o">--</span><span class="n">instant</span> <span class="o">&lt;</span><span class="no">INSTANT_1</span><span class="o">&gt;</span>
     <span class="n">_________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________</span>
@@ -582,10 +579,8 @@ pending compactions.</p>
 
 </code></pre></div></div>
 
-<p>To manually schedule or run a compaction, use the below command. This command uses spark launcher to perform compaction
-operations.</p>
-
-<p class="notice--info"><strong>NOTE:</strong> Make sure no other application is scheduling compaction for this dataset concurrently</p>
+<p>要手动调度或运行压缩,请使用以下命令。该命令使用spark启动器执行压缩操作。
+注意:确保没有其他应用程序正在同时调度此数据集的压缩</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">help</span> <span class="n">compaction</span> <span class="n">schedule</span>
 <span class="nl">Keyword:</span>                   <span class="n">compaction</span> <span class="n">schedule</span>
@@ -641,9 +636,9 @@ operations.</p>
 <span class="o">*</span> <span class="n">compaction</span> <span class="n">run</span> <span class="o">-</span> <span class="nc">Run</span> <span class="nc">Compaction</span> <span class="k">for</span> <span class="n">given</span> <span class="n">instant</span> <span class="n">time</span>
 </code></pre></div></div>
 
-<h3 id="validate-compaction">Validate Compaction</h3>
+<h3 id="验证压缩">验证压缩</h3>
 
-<p>Validating a compaction plan : Check if all the files necessary for compactions are present and are valid</p>
+<p>验证压缩计划:检查压缩所需的所有文件是否都存在且有效</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">stock_ticks_mor</span><span class="o">-&gt;</span><span class="n">compaction</span> <span class="n">validate</span> <span class="o">--</span><span class="n">instant</span> <span class="mi">20181005222611</span>
 <span class="o">...</span>
@@ -667,33 +662,33 @@ operations.</p>
     <span class="o">|</span> <span class="mo">05320</span><span class="n">e98</span><span class="o">-</span><span class="mi">9</span><span class="n">a57</span><span class="o">-</span><span class="mi">4</span><span class="n">c38</span><span class="o">-</span><span class="n">b809</span><span class="o">-</span><span class="n">a6beaaeb36bd</span><span class="o">|</span> <span class="mi">20181005222445</span>   <span class="o">|</span> <span class="nl">hdfs:</span><span class="c1">//namenode: [...]
 </code></pre></div></div>
 
-<p class="notice--warning"><strong>NOTE:</strong> The following commands must be executed without any other writer/ingestion application running.</p>
+<h3 id="注意">注意</h3>
 
-<p>Sometimes, it becomes necessary to remove a fileId from a compaction-plan inorder to speed-up or unblock compaction
-operation. Any new log-files that happened on this file after the compaction got scheduled will be safely renamed
-so that are preserved. Hudi provides the following CLI to support it</p>
+<p>必须在其他写入/摄取程序没有运行的情况下执行以下命令。</p>
 
-<h3 id="unscheduling-compaction">UnScheduling Compaction</h3>
+<p>有时,有必要从压缩计划中删除fileId以便加快或取消压缩操作。
+压缩计划之后在此文件上发生的所有新日志文件都将被安全地重命名以便进行保留。Hudi提供以下CLI来支持</p>
+
+<h3 id="取消调度压缩">取消调度压缩</h3>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">compaction</span> <span class="n">unscheduleFileId</span> <span class="o">--</span><span class="n">fileId</span> <span class="o">&lt;</span><span class="nc">FileUUID</span><span class="o">&gt;</span>
 <span class="o">....</span>
 <span class="nc">No</span> <span class="nc">File</span> <span class="n">renames</span> <span class="n">needed</span> <span class="n">to</span> <span class="n">unschedule</span> <span class="n">file</span> <span class="n">from</span> <span class="n">pending</span> <span class="n">compaction</span><span class="o">.</span> <span class="nc">Operation</span> <span class="n">successful</span><span class="o">.</span>
 </code></pre></div></div>
 
-<p>In other cases, an entire compaction plan needs to be reverted. This is supported by the following CLI</p>
+<p>在其他情况下,需要撤销整个压缩计划。以下CLI支持此功能</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">trips</span><span class="o">-&gt;</span><span class="n">compaction</span> <span class="n">unschedule</span> <span class="o">--</span><span class="n">compactionInstant</span> <span class="o">&lt;</span><span class="n">compactionInstant</span><span class="o">&gt;</span>
 <span class="o">.....</span>
 <span class="nc">No</span> <span class="nc">File</span> <span class="n">renames</span> <span class="n">needed</span> <span class="n">to</span> <span class="n">unschedule</span> <span class="n">pending</span> <span class="n">compaction</span><span class="o">.</span> <span class="nc">Operation</span> <span class="n">successful</span><span class="o">.</span>
 </code></pre></div></div>
 
-<h3 id="repair-compaction">Repair Compaction</h3>
+<h3 id="修复压缩">修复压缩</h3>
 
-<p>The above compaction unscheduling operations could sometimes fail partially (e:g -&gt; DFS temporarily unavailable). With
-partial failures, the compaction operation could become inconsistent with the state of file-slices. When you run
-<code class="highlighter-rouge">compaction validate</code>, you can notice invalid compaction operations if there is one.  In these cases, the repair
-command comes to the rescue, it will rearrange the file-slices so that there is no loss and the file-slices are
-consistent with the compaction plan</p>
+<p>上面的压缩取消调度操作有时可能会部分失败(例如:DFS暂时不可用)。
+如果发生部分故障,则压缩操作可能与文件切片的状态不一致。
+当您运行<code class="highlighter-rouge">压缩验证</code>时,您会注意到无效的压缩操作(如果有的话)。
+在这种情况下,修复命令将立即执行,它将重新排列文件切片,以使文件不丢失,并且文件切片与压缩计划一致</p>
 
 <div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nl">hoodie:</span><span class="n">stock_ticks_mor</span><span class="o">-&gt;</span><span class="n">compaction</span> <span class="n">repair</span> <span class="o">--</span><span class="n">instant</span> <span class="mi">20181005222611</span>
 <span class="o">......</span>
@@ -701,81 +696,80 @@ consistent with the compaction plan</p>
 <span class="o">.....</span>
 </code></pre></div></div>
 
-<h2 id="metrics">Metrics</h2>
+<h2 id="metrics">指标</h2>
 
-<p>Once the Hudi Client is configured with the right datasetname and environment for metrics, it produces the following graphite metrics, that aid in debugging hudi datasets</p>
+<p>为Hudi Client配置正确的数据集名称和指标环境后,它将生成以下graphite指标,以帮助调试hudi数据集</p>
 
 <ul>
-  <li><strong>Commit Duration</strong> - This is amount of time it took to successfully commit a batch of records</li>
-  <li><strong>Rollback Duration</strong> - Similarly, amount of time taken to undo partial data left over by a failed commit (happens everytime automatically after a failing write)</li>
-  <li><strong>File Level metrics</strong> - Shows the amount of new files added, versions, deleted (cleaned) in each commit</li>
-  <li><strong>Record Level Metrics</strong> - Total records inserted/updated etc per commit</li>
-  <li><strong>Partition Level metrics</strong> - number of partitions upserted (super useful to understand sudden spikes in commit duration)</li>
+  <li><strong>提交持续时间</strong> - 这是成功提交一批记录所花费的时间</li>
+  <li><strong>回滚持续时间</strong> - 同样,撤消失败的提交所剩余的部分数据所花费的时间(每次写入失败后都会自动发生)</li>
+  <li><strong>文件级别指标</strong> - 显示每次提交中新增、版本、删除(清除)的文件数量</li>
+  <li><strong>记录级别指标</strong> - 每次提交插入/更新的记录总数</li>
+  <li><strong>分区级别指标</strong> - 更新的分区数量(对于了解提交持续时间的突然峰值非常有用)</li>
 </ul>
 
-<p>These metrics can then be plotted on a standard tool like grafana. Below is a sample commit duration chart.</p>
+<p>然后可以将这些指标绘制在grafana等标准工具上。以下是提交持续时间图表示例。</p>
 
 <figure>
     <img class="docimage" src="/assets/images/hudi_commit_duration.png" alt="hudi_commit_duration.png" style="max-width: 100%" />
 </figure>
 
-<h2 id="troubleshooting">Troubleshooting Failures</h2>
+<h2 id="troubleshooting">故障排除</h2>
 
-<p>Section below generally aids in debugging Hudi failures. Off the bat, the following metadata is added to every record to help triage  issues easily using standard Hadoop SQL engines (Hive/Presto/Spark)</p>
+<p>以下部分通常有助于调试Hudi故障。以下元数据已被添加到每条记录中,可以通过标准Hadoop SQL引擎(Hive/Presto/Spark)检索,来更容易地诊断问题的严重性。</p>
 
 <ul>
-  <li><strong>_hoodie_record_key</strong> - Treated as a primary key within each DFS partition, basis of all updates/inserts</li>
-  <li><strong>_hoodie_commit_time</strong> - Last commit that touched this record</li>
-  <li><strong>_hoodie_file_name</strong> - Actual file name containing the record (super useful to triage duplicates)</li>
-  <li><strong>_hoodie_partition_path</strong> - Path from basePath that identifies the partition containing this record</li>
+  <li><strong>_hoodie_record_key</strong> - 作为每个DFS分区内的主键,是所有更新/插入的基础</li>
+  <li><strong>_hoodie_commit_time</strong> - 该记录上次的提交</li>
+  <li><strong>_hoodie_file_name</strong> - 包含记录的实际文件名(对检查重复非常有用)</li>
+  <li><strong>_hoodie_partition_path</strong> - basePath的路径,该路径标识包含此记录的分区</li>
 </ul>
 
-<p class="notice--info"><strong>NOTE:</strong> As of now, Hudi assumes the application passes in the same deterministic partitionpath for a given recordKey. i.e the uniqueness of record key is only enforced within each partition.</p>
+<p>请注意,到目前为止,Hudi假定应用程序为给定的recordKey传递相同的确定性分区路径。即仅在每个分区内保证recordKey(主键)的唯一性。</p>
 
-<h3 id="missing-records">Missing records</h3>
+<h3 id="缺失记录">缺失记录</h3>
 
-<p>Please check if there were any write errors using the admin commands above, during the window at which the record could have been written.
-If you do find errors, then the record was not actually written by Hudi, but handed back to the application to decide what to do with it.</p>
+<p>请在可能写入记录的窗口中,使用上面的admin命令检查是否存在任何写入错误。
+如果确实发现错误,那么记录实际上不是由Hudi写入的,而是交还给应用程序来决定如何处理。</p>
 
-<h3 id="duplicates">Duplicates</h3>
+<h3 id="重复">重复</h3>
 
-<p>First of all, please confirm if you do indeed have duplicates <strong>AFTER</strong> ensuring the query is accessing the Hudi datasets <a href="sql_queries.html">properly</a> .</p>
+<p>首先,请确保访问Hudi数据集的查询是<a href="sql_queries.html">没有问题的</a>,并之后确认的确有重复。</p>
 
 <ul>
-  <li>If confirmed, please use the metadata fields above, to identify the physical files &amp; partition files containing the records .</li>
-  <li>If duplicates span files across partitionpath, then this means your application is generating different partitionPaths for same recordKey, Please fix your app</li>
-  <li>if duplicates span multiple files within the same partitionpath, please engage with mailing list. This should not happen. You can use the <code class="highlighter-rouge">records deduplicate</code> command to fix your data.</li>
+  <li>如果确认,请使用上面的元数据字段来标识包含记录的物理文件和分区文件。</li>
+  <li>如果重复的记录存在于不同分区路径下的文件,则意味着您的应用程序正在为同一recordKey生成不同的分区路径,请修复您的应用程序.</li>
+  <li>如果重复的记录存在于同一分区路径下的多个文件,请使用邮件列表汇报这个问题。这不应该发生。您可以使用<code class="highlighter-rouge">records deduplicate</code>命令修复数据。</li>
 </ul>
 
-<h3 id="spark-ui">Spark failures</h3>
-
-<p>Typical upsert() DAG looks like below. Note that Hudi client also caches intermediate RDDs to intelligently profile workload and size files and spark parallelism.
-Also Spark UI shows sortByKey twice due to the probe job also being shown, nonetheless its just a single sort.</p>
+<h3 id="spark-ui">Spark故障</h3>
 
+<p>典型的upsert() DAG如下所示。请注意,Hudi客户端会缓存中间的RDD,以智能地并调整文件大小和Spark并行度。
+另外,由于还显示了探针作业,Spark UI显示了两次sortByKey,但它只是一个排序。</p>
 <figure>
     <img class="docimage" src="/assets/images/hudi_upsert_dag.png" alt="hudi_upsert_dag.png" style="max-width: 100%" />
 </figure>
 
-<p>At a high level, there are two steps</p>
+<p>概括地说,有两个步骤</p>
 
-<p><strong>Index Lookup to identify files to be changed</strong></p>
+<p><strong>索引查找以标识要更改的文件</strong></p>
 
 <ul>
-  <li>Job 1 : Triggers the input data read, converts to HoodieRecord object and then stops at obtaining a spread of input records to target partition paths</li>
-  <li>Job 2 : Load the set of file names which we need check against</li>
-  <li>Job 3  &amp; 4 : Actual lookup after smart sizing of spark join parallelism, by joining RDDs in 1 &amp; 2 above</li>
-  <li>Job 5 : Have a tagged RDD of recordKeys with locations</li>
+  <li>Job 1 : 触发输入数据读取,转换为HoodieRecord对象,然后根据输入记录拿到目标分区路径。</li>
+  <li>Job 2 : 加载我们需要检查的文件名集。</li>
+  <li>Job 3  &amp; 4 : 通过联合上面1和2中的RDD,智能调整spark join并行度,然后进行实际查找。</li>
+  <li>Job 5 : 生成带有位置的recordKeys作为标记的RDD。</li>
 </ul>
 
-<p><strong>Performing the actual writing of data</strong></p>
+<p><strong>执行数据的实际写入</strong></p>
 
 <ul>
-  <li>Job 6 : Lazy join of incoming records against recordKey, location to provide a final set of HoodieRecord which now contain the information about which file/partitionpath they are found at (or null if insert). Then also profile the workload again to determine sizing of files</li>
-  <li>Job 7 : Actual writing of data (update + insert + insert turned to updates to maintain file size)</li>
+  <li>Job 6 : 将记录与recordKey(位置)进行懒惰连接,以提供最终的HoodieRecord集,现在它包含每条记录的文件/分区路径信息(如果插入,则为null)。然后还要再次分析工作负载以确定文件的大小。</li>
+  <li>Job 7 : 实际写入数据(更新 + 插入 + 插入转为更新以保持文件大小)</li>
 </ul>
 
-<p>Depending on the exception source (Hudi/Spark), the above knowledge of the DAG can be used to pinpoint the actual issue. The most often encountered failures result from YARN/DFS temporary failures.
-In the future, a more sophisticated debug/management UI would be added to the project, that can help automate some of this debugging.</p>
+<p>根据异常源(Hudi/Spark),上述关于DAG的信息可用于查明实际问题。最常遇到的故障是由YARN/DFS临时故障引起的。
+将来,将在项目中添加更复杂的调试/管理UI,以帮助自动进行某些调试。</p>
 
       </section>
 
diff --git a/content/cn/docs/comparison.html b/content/cn/docs/comparison.html
new file mode 100644
index 0000000..e31422a
--- /dev/null
+++ b/content/cn/docs/comparison.html
@@ -0,0 +1,431 @@
+<!doctype html>
+<html lang="en" class="no-js">
+  <head>
+    <meta charset="utf-8">
+
+<!-- begin _includes/seo.html --><title>对比 - Apache Hudi</title>
+<meta name="description" content="Apache Hudi填补了在DFS上处理数据的巨大空白,并可以和这些技术很好地共存。然而,通过将Hudi与一些相关系统进行对比,来了解Hudi如何适应当前的大数据生态系统,并知晓这些系统在设计中做的不同权衡仍将非常有用。">
+
+<meta property="og:type" content="article">
+<meta property="og:locale" content="en_US">
+<meta property="og:site_name" content="">
+<meta property="og:title" content="对比">
+<meta property="og:url" content="https://hudi.apache.org/cn/docs/comparison.html">
+
+
+  <meta property="og:description" content="Apache Hudi填补了在DFS上处理数据的巨大空白,并可以和这些技术很好地共存。然而,通过将Hudi与一些相关系统进行对比,来了解Hudi如何适应当前的大数据生态系统,并知晓这些系统在设计中做的不同权衡仍将非常有用。">
+
+
+
+
+
+  <meta property="article:modified_time" content="2019-12-30T14:59:57-05:00">
+
+
+
+
+
+
+
+<!-- end _includes/seo.html -->
+
+
+<!--<link href="/feed.xml" type="application/atom+xml" rel="alternate" title=" Feed">-->
+
+<!-- https://t.co/dKP3o1e -->
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+
+<script>
+  document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js ';
+</script>
+
+<!-- For all browsers -->
+<link rel="stylesheet" href="/assets/css/main.css">
+
+<!--[if IE]>
+  <style>
+    /* old IE unsupported flexbox fixes */
+    .greedy-nav .site-title {
+      padding-right: 3em;
+    }
+    .greedy-nav button {
+      position: absolute;
+      top: 0;
+      right: 0;
+      height: 100%;
+    }
+  </style>
+<![endif]-->
+
+
+
+<link rel="icon" type="image/x-icon" href="/assets/images/favicon.ico">
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+  </head>
+
+  <body class="layout--single">
+    <!--[if lt IE 9]>
+<div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
+<![endif]-->
+
+    <div class="masthead">
+  <div class="masthead__inner-wrap" id="masthead__inner-wrap">
+    <div class="masthead__menu">
+      <nav id="site-nav" class="greedy-nav">
+        
+          <a class="site-logo" href="/">
+              <div style="width: 150px; height: 40px">
+
+              </div>
+<!--            <img src="" alt="">-->
+<!--            -->
+<!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
+<!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
+<!--            </span>-->
+<!--            -->
+          </a>
+        
+        <a class="site-title" href="/">
+          
+        </a>
+        <ul class="visible-links"><li class="masthead__menu-item">
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/community.html" target="_self" >社区</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/activity.html" target="_self" >动态</a>
+            </li><li class="masthead__menu-item">
+              <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/releases.html" target="_self" >发布</a>
+            </li></ul>
+        <button class="greedy-nav__toggle hidden" type="button">
+          <span class="visually-hidden">Toggle menu</span>
+          <div class="navicon"></div>
+        </button>
+        <ul class="hidden-links hidden"></ul>
+      </nav>
+    </div>
+  </div>
+</div>
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
+  Click <a href="/"> here</a> back to old site.</p>
+-->
+
+    <div class="initial-content">
+      <div id="main" role="main">
+  
+
+  <div class="sidebar sticky">
+
+  
+
+  
+
+    
+      
+
+
+
+
+
+<nav class="nav__list">
+  
+  <input id="ac-toc" name="accordion-toc" type="checkbox" />
+  <label for="ac-toc">文档菜单</label>
+  <ul class="nav__items">
+    
+      <li>
+        
+          <span class="nav__sub-title">入门指南</span>
+        
+
+        
+        <ul>
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/quick-start-guide.html" class="">快速开始</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/use_cases.html" class="">使用案例</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/powered_by.html" class="">演讲 & hudi 用户</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/comparison.html" class="active">对比</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/docker_demo.html" class="">Docker 示例</a></li>
+            
+
+          
+        </ul>
+        
+      </li>
+    
+      <li>
+        
+          <span class="nav__sub-title">帮助文档</span>
+        
+
+        
+        <ul>
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/concepts.html" class="">概念</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/writing_data.html" class="">写入数据</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/querying_data.html" class="">查询数据</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/configurations.html" class="">配置</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/performance.html" class="">性能</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/admin_guide.html" class="">管理</a></li>
+            
+
+          
+        </ul>
+        
+      </li>
+    
+      <li>
+        
+          <span class="nav__sub-title">其他信息</span>
+        
+
+        
+        <ul>
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/docs-versions.html" class="">文档版本</a></li>
+            
+
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/privacy.html" class="">版权信息</a></li>
+            
+
+          
+        </ul>
+        
+      </li>
+    
+  </ul>
+</nav>
+    
+
+  
+  </div>
+
+
+  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
+
+    <div class="page__inner-wrap">
+      
+        <header>
+          <h1 id="page-title" class="page__title" itemprop="headline">对比
+</h1>
+        </header>
+      
+
+      <section class="page__content" itemprop="text">
+        
+          <style>
+            .page {
+              padding-right: 0 !important;
+            }
+          </style>
+        
+        <p>Apache Hudi填补了在DFS上处理数据的巨大空白,并可以和这些技术很好地共存。然而,
+通过将Hudi与一些相关系统进行对比,来了解Hudi如何适应当前的大数据生态系统,并知晓这些系统在设计中做的不同权衡仍将非常有用。</p>
+
+<h2 id="kudu">Kudu</h2>
+
+<p><a href="https://kudu.apache.org">Apache Kudu</a>是一个与Hudi具有相似目标的存储系统,该系统通过对<code class="highlighter-rouge">upserts</code>支持来对PB级数据进行实时分析。
+一个关键的区别是Kudu还试图充当OLTP工作负载的数据存储,而Hudi并不希望这样做。
+因此,Kudu不支持增量拉取(截至2017年初),而Hudi支持以便进行增量处理。</p>
+
+<p>Kudu与分布式文件系统抽象和HDFS完全不同,它自己的一组存储服务器通过RAFT相互通信。
+与之不同的是,Hudi旨在与底层Hadoop兼容的文件系统(HDFS,S3或Ceph)一起使用,并且没有自己的存储服务器群,而是依靠Apache Spark来完成繁重的工作。
+因此,Hudi可以像其他Spark作业一样轻松扩展,而Kudu则需要硬件和运营支持,特别是HBase或Vertica等数据存储系统。
+到目前为止,我们还没有做任何直接的基准测试来比较Kudu和Hudi(鉴于RTTable正在进行中)。
+但是,如果我们要使用<a href="https://db-blog.web.cern.ch/blog/zbigniew-baranowski/2017-01-performance-comparison-different-file-formats-and-storage-engines">CERN</a>,
+我们预期Hudi在摄取parquet上有更卓越的性能。</p>
+
+<h2 id="hive事务">Hive事务</h2>
+
+<p><a href="https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions">Hive事务/ACID</a>是另一项类似的工作,它试图实现在ORC文件格式之上的存储<code class="highlighter-rouge">读取时合并</code>。
+可以理解,此功能与Hive以及<a href="https://cwiki.apache.org/confluence/display/Hive/LLAP">LLAP</a>之类的其他工作紧密相关。
+Hive事务不提供Hudi提供的读取优化存储选项或增量拉取。
+在实现选择方面,Hudi充分利用了类似Spark的处理框架的功能,而Hive事务特性则在用户或Hive Metastore启动的Hive任务/查询的下实现。
+根据我们的生产经验,与其他方法相比,将Hudi作为库嵌入到现有的Spark管道中要容易得多,并且操作不会太繁琐。
+Hudi还设计用于与Presto/Spark等非Hive引擎合作,并计划引入除parquet以外的文件格式。</p>
+
+<h2 id="hbase">HBase</h2>
+
+<p>尽管<a href="https://hbase.apache.org">HBase</a>最终是OLTP工作负载的键值存储层,但由于与Hadoop的相似性,用户通常倾向于将HBase与分析相关联。
+鉴于HBase经过严格的写优化,它支持开箱即用的亚秒级更新,Hive-on-HBase允许用户查询该数据。 但是,就分析工作负载的实际性能而言,Parquet/ORC之类的混合列式存储格式可以轻松击败HBase,因为这些工作负载主要是读取繁重的工作。
+Hudi弥补了更快的数据与分析存储格式之间的差距。从运营的角度来看,与管理分析使用的HBase region服务器集群相比,为用户提供可更快给出数据的库更具可扩展性。
+最终,HBase不像Hudi这样重点支持<code class="highlighter-rouge">提交时间</code>、<code class="highlighter-rouge">增量拉取</code>之类的增量处理原语。</p>
+
+<h2 id="流式处理">流式处理</h2>
+
+<p>一个普遍的问题:”Hudi与流处理系统有何关系?”,我们将在这里尝试回答。简而言之,Hudi可以与当今的批处理(<code class="highlighter-rouge">写时复制存储</code>)和流处理(<code class="highlighter-rouge">读时合并存储</code>)作业集成,以将计算结果存储在Hadoop中。
+对于Spark应用程序,这可以通过将Hudi库与Spark/Spark流式DAG直接集成来实现。在非Spark处理系统(例如Flink、Hive)情况下,可以在相应的系统中进行处理,然后通过Kafka主题/DFS中间文件将其发送到Hudi表中。从概念上讲,数据处理
+管道仅由三个部分组成:<code class="highlighter-rouge">输入</code>,<code class="highlighter-rouge">处理</code>,<code class="highlighter-rouge">输出</code>,用户最终针对输出运行查询以便使用管道的结果。Hudi可以充当将数据存储在DFS上的输入或输出。Hudi在给定流处理管道上的适用性最终归结为你的查询在Presto/SparkSQL/Hive的适用性。</p>
+
+<p>更高级的用例围绕<a href="https://www.oreilly.com/ideas/ubers-case-for-incremental-processing-on-hadoop">增量处理</a>的概念展开,
+甚至在<code class="highlighter-rouge">处理</code>引擎内部也使用Hudi来加速典型的批处理管道。例如:Hudi可用作DAG内的状态存储(类似Flink使用的[rocksDB(https://ci.apache.org/projects/flink/flink-docs-release-1.2/ops/state_backends.html#the-rocksdbstatebackend))。
+这是路线图上的一个项目并将最终以<a href="https://issues.apache.org/jira/browse/HUDI-60">Beam Runner</a>的形式呈现。</p>
+
+      </section>
+
+      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
+
+
+      
+
+    </div>
+
+  </article>
+
+</div>
+
+    </div>
+
+    <div class="page__footer">
+      <footer>
+        
+<div class="row">
+  <div class="col-lg-12 footer">
+    <p>
+      <a class="footer-link-img" href="https://apache.org">
+        <img width="250px" src="/assets/images/asf_logo.svg" alt="The Apache Software Foundation">
+      </a>
+    </p>
+    <p>
+      Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>, Licensed under the Apache License, Version 2.0.
+      Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation. <a href="/docs/privacy">Privacy Policy</a>
+      <br>
+      Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
+      Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
+      stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
+      reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+    </p>
+  </div>
+</div>
+      </footer>
+    </div>
+
+    
+<script src="/assets/js/main.min.js"></script>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/content/cn/concepts.html b/content/cn/docs/concepts.html
similarity index 50%
rename from content/cn/concepts.html
rename to content/cn/docs/concepts.html
index 9b9efea..ad98033 100644
--- a/content/cn/concepts.html
+++ b/content/cn/docs/concepts.html
@@ -1,348 +1,360 @@
-<!DOCTYPE html>
-<head>
+<!doctype html>
+<html lang="en" class="no-js">
+  <head>
     <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="这里我们将介绍Hudi的一些基本概念并提供关于Hudi的技术概述">
-<meta name="keywords" content="hudi, design, storage, views, timeline">
-<title>概念 | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
 
+<!-- begin _includes/seo.html --><title>概念 - Apache Hudi</title>
+<meta name="description" content="Apache Hudi(发音为“Hudi”)在DFS的数据集上提供以下流原语">
 
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
+<meta property="og:type" content="article">
+<meta property="og:locale" content="en_US">
+<meta property="og:site_name" content="">
+<meta property="og:title" content="概念">
+<meta property="og:url" content="https://hudi.apache.org/cn/docs/concepts.html">
 
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
 
+  <meta property="og:description" content="Apache Hudi(发音为“Hudi”)在DFS的数据集上提供以下流原语">
 
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
 
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
 
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
 
-</script>
 
-<link rel="shortcut icon" href="/images/favicon.ico">
+  <meta property="article:modified_time" content="2019-12-30T14:59:57-05:00">
+
+
+
+
+
+
+
+<!-- end _includes/seo.html -->
+
 
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
+<!--<link href="/feed.xml" type="application/atom+xml" rel="alternate" title=" Feed">-->
+
+<!-- https://t.co/dKP3o1e -->
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+
+<script>
+  document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js ';
+</script>
+
+<!-- For all browsers -->
+<link rel="stylesheet" href="/assets/css/main.css">
+
+<!--[if IE]>
+  <style>
+    /* old IE unsupported flexbox fixes */
+    .greedy-nav .site-title {
+      padding-right: 3em;
+    }
+    .greedy-nav button {
+      position: absolute;
+      top: 0;
+      right: 0;
+      height: 100%;
+    }
+  </style>
 <![endif]-->
 
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
 
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the 概念 page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/concepts.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="概念">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
 
-    </div>
-        <!-- /.container -->
-</nav>
+<link rel="icon" type="image/x-icon" href="/assets/images/favicon.ico">
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+  </head>
 
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
+  <body class="layout--single">
+    <!--[if lt IE 9]>
+<div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
+<![endif]-->
+
+    <div class="masthead">
+  <div class="masthead__inner-wrap" id="masthead__inner-wrap">
+    <div class="masthead__menu">
+      <nav id="site-nav" class="greedy-nav">
+        
+          <a class="site-logo" href="/">
+              <div style="width: 150px; height: 40px">
+
+              </div>
+<!--            <img src="" alt="">-->
+<!--            -->
+<!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
+<!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
+<!--            </span>-->
+<!--            -->
+          </a>
+        
+        <a class="site-title" href="/">
           
+        </a>
+        <ul class="visible-links"><li class="masthead__menu-item">
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/community.html" target="_self" >社区</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/activity.html" target="_self" >动态</a>
+            </li><li class="masthead__menu-item">
+              <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/releases.html" target="_self" >发布</a>
+            </li></ul>
+        <button class="greedy-nav__toggle hidden" type="button">
+          <span class="visually-hidden">Toggle menu</span>
+          <div class="navicon"></div>
+        </button>
+        <ul class="hidden-links hidden"></ul>
+      </nav>
+    </div>
+  </div>
+</div>
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
+  Click <a href="/"> here</a> back to old site.</p>
+-->
+
+    <div class="initial-content">
+      <div id="main" role="main">
+  
+
+  <div class="sidebar sticky">
 
+  
 
+  
 
+    
+      
 
 
 
 
 
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
+<nav class="nav__list">
+  
+  <input id="ac-toc" name="accordion-toc" type="checkbox" />
+  <label for="ac-toc">文档菜单</label>
+  <ul class="nav__items">
     
-    <li>
-        <a href="#">入门指南</a>
+      <li>
+        
+          <span class="nav__sub-title">入门指南</span>
+        
+
+        
         <ul>
+          
+            
+            
+
+            
+            
+
+            
+              <li><a href="/cn/docs/quick-start-guide.html" class="">快速开始</a></li>
             
+
+          
             
             
-            <li><a href="quickstart.html">快速开始</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/use_cases.html" class="">使用案例</a></li>
             
+
+          
             
             
-            <li><a href="use_cases.html">使用案例</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/powered_by.html" class="">演讲 & hudi 用户</a></li>
             
+
+          
             
             
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/comparison.html" class="">对比</a></li>
             
+
+          
             
             
-            <li><a href="comparison.html">对比</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/docker_demo.html" class="">Docker 示例</a></li>
             
+
+          
         </ul>
         
-        
+      </li>
     
-    <li>
-        <a href="#">文档</a>
+      <li>
+        
+          <span class="nav__sub-title">帮助文档</span>
+        
+
+        
         <ul>
+          
             
             
-            
-            <li><a href="concepts.html">概念</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/concepts.html" class="active">概念</a></li>
             
+
+          
             
             
-            <li><a href="writing_data.html">写入数据</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/writing_data.html" class="">写入数据</a></li>
             
+
+          
             
             
-            <li><a href="querying_data.html">查询数据</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/querying_data.html" class="">查询数据</a></li>
             
+
+          
             
             
-            <li><a href="configurations.html">配置</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/configurations.html" class="">配置</a></li>
             
+
+          
             
             
-            <li><a href="performance.html">性能</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/performance.html" class="">性能</a></li>
             
+
+          
             
             
-            <li><a href="admin_guide.html">管理</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/admin_guide.html" class="">管理</a></li>
             
+
+          
         </ul>
         
+      </li>
+    
+      <li>
         
+          <span class="nav__sub-title">其他信息</span>
         
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
 
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
+        
+        <ul>
+          
+            
+            
 
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">概念</h1>
-</div>
+            
+            
 
+            
+              <li><a href="/cn/docs/docs-versions.html" class="">文档版本</a></li>
+            
 
+          
+            
+            
 
-<div class="post-content">
+            
+            
 
-   
-    <div class="summary">这里我们将介绍Hudi的一些基本概念并提供关于Hudi的技术概述</div>
-   
+            
+              <li><a href="/cn/docs/privacy.html" class="">版权信息</a></li>
+            
 
+          
+        </ul>
+        
+      </li>
+    
+  </ul>
+</nav>
     
 
-  <p>Apache Hudi(发音为“Hudi”)在DFS的数据集上提供以下流原语</p>
+  
+  </div>
+
+
+  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
+
+    <div class="page__inner-wrap">
+      
+        <header>
+          <h1 id="page-title" class="page__title" itemprop="headline">概念
+</h1>
+        </header>
+      
+
+      <section class="page__content" itemprop="text">
+        
+        <aside class="sidebar__right sticky">
+          <nav class="toc">
+            <header><h4 class="nav__title"><i class="fas fa-file-alt"></i> In this page</h4></header>
+            <ul class="toc__menu">
+  <li><a href="#时间轴">时间轴</a></li>
+  <li><a href="#文件组织">文件组织</a></li>
+  <li><a href="#存储类型和视图">存储类型和视图</a>
+    <ul>
+      <li><a href="#存储类型">存储类型</a></li>
+      <li><a href="#视图">视图</a></li>
+    </ul>
+  </li>
+  <li><a href="#copy-on-write-storage">写时复制存储</a></li>
+  <li><a href="#merge-on-read-storage">读时合并存储</a></li>
+</ul>
+          </nav>
+        </aside>
+        
+        <p>Apache Hudi(发音为“Hudi”)在DFS的数据集上提供以下流原语</p>
 
 <ul>
   <li>插入更新           (如何改变数据集?)</li>
@@ -382,7 +394,7 @@
 </ul>
 
 <figure>
-    <img class="docimage" src="/images/hudi_timeline.png" alt="hudi_timeline.png" />
+    <img class="docimage" src="/assets/images/hudi_timeline.png" alt="hudi_timeline.png" />
 </figure>
 
 <p>上面的示例显示了在Hudi数据集上大约10:00到10:20之间发生的更新事件,大约每5分钟一次,将提交元数据以及其他后台清理/压缩保留在Hudi时间轴上。
@@ -505,7 +517,7 @@ Hudi采用MVCC设计,其中压缩操作将日志和基本文件合并以产生
   </tbody>
 </table>
 
-<h2 id="写时复制存储">写时复制存储</h2>
+<h2 id="copy-on-write-storage">写时复制存储</h2>
 
 <p>写时复制存储中的文件片仅包含基本/列文件,并且每次提交都会生成新版本的基本文件。
 换句话说,我们压缩每个提交,从而所有的数据都是以列数据的形式储存。在这种情况下,写入数据非常昂贵(我们需要重写整个列数据文件,即使只有一个字节的新数据被提交),而读取数据的成本则没有增加。
@@ -514,7 +526,7 @@ Hudi采用MVCC设计,其中压缩操作将日志和基本文件合并以产生
 <p>以下内容说明了将数据写入写时复制存储并在其上运行两个查询时,它是如何工作的。</p>
 
 <figure>
-    <img class="docimage" src="/images/hudi_cow.png" alt="hudi_cow.png" />
+    <img class="docimage" src="/assets/images/hudi_cow.png" alt="hudi_cow.png" />
 </figure>
 
 <p>随着数据的写入,对现有文件组的更新将为该文件组生成一个带有提交即时时间标记的新切片,而插入分配一个新文件组并写入该文件组的第一个切片。
@@ -530,7 +542,7 @@ Hudi采用MVCC设计,其中压缩操作将日志和基本文件合并以产生
   <li>严格控制文件大小来保持出色的查询性能(小的文件会严重损害查询性能)。</li>
 </ul>
 
-<h2 id="读时合并存储">读时合并存储</h2>
+<h2 id="merge-on-read-storage">读时合并存储</h2>
 
 <p>读时合并存储是写时复制的升级版,从某种意义上说,它仍然可以通过读优化表提供数据集的读取优化视图(写时复制的功能)。
 此外,它将每个文件组的更新插入存储到基于行的增量日志中,通过文件id,将增量日志和最新版本的基本文件进行合并,从而提供近实时的数据查询。因此,此存储类型智能地平衡了读和写的成本,以提供近乎实时的查询。
@@ -539,7 +551,7 @@ Hudi采用MVCC设计,其中压缩操作将日志和基本文件合并以产生
 <p>以下内容说明了存储的工作方式,并显示了对近实时表和读优化表的查询。</p>
 
 <figure>
-    <img class="docimage" src="/images/hudi_mor.png" alt="hudi_mor.png" style="max-width: 100%" />
+    <img class="docimage" src="/assets/images/hudi_mor.png" alt="hudi_mor.png" style="max-width: 100%" />
 </figure>
 
 <p>此示例中发生了很多有趣的事情,这些带出了该方法的微妙之处。</p>
@@ -559,81 +571,48 @@ Hudi采用MVCC设计,其中压缩操作将日志和基本文件合并以产生
 <p>读时合并存储上的目的是直接在DFS上启用近实时处理,而不是将数据复制到专用系统,后者可能无法处理大数据量。
 该存储还有一些其他方面的好处,例如通过避免数据的同步合并来减少写放大,即批量数据中每1字节数据需要的写入数据量。</p>
 
+      </section>
 
-    <div class="tags">
-        
-    </div>
+      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
 
-    
 
-</div>
+      
 
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
+    </div>
 
-  $(window).scrollTop(scroll_target - 130);
-  return false
-})
-  
-});
-</script>
+  </article>
 
-<div id="toc"></div>
+</div>
 
-            
-        </div>
-    <!-- /.row -->
     </div>
-<!-- /.container -->
+
+    <div class="page__footer">
+      <footer>
+        
+<div class="row">
+  <div class="col-lg-12 footer">
+    <p>
+      <a class="footer-link-img" href="https://apache.org">
+        <img width="250px" src="/assets/images/asf_logo.svg" alt="The Apache Software Foundation">
+      </a>
+    </p>
+    <p>
+      Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>, Licensed under the Apache License, Version 2.0.
+      Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation. <a href="/docs/privacy">Privacy Policy</a>
+      <br>
+      Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
+      Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
+      stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
+      reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+    </p>
+  </div>
 </div>
+      </footer>
+    </div>
+
+    
+<script src="/assets/js/main.min.js"></script>
 
-</body>
 
+  </body>
 </html>
\ No newline at end of file
diff --git a/content/cn/configurations.html b/content/cn/docs/configurations.html
similarity index 59%
rename from content/cn/configurations.html
rename to content/cn/docs/configurations.html
index cfcb0d6..5294812 100644
--- a/content/cn/configurations.html
+++ b/content/cn/docs/configurations.html
@@ -1,348 +1,366 @@
-<!DOCTYPE html>
-<head>
+<!doctype html>
+<html lang="en" class="no-js">
+  <head>
     <meta charset="utf-8">
-<meta http-equiv="X-UA-Compatible" content="IE=edge">
-<meta name="viewport" content="width=device-width, initial-scale=1">
-<meta name="description" content="在这里,我们列出了所有可能的配置及其含义。">
-<meta name="keywords" content="garbage collection, hudi, jvm, configs, tuning">
-<title>配置 | Hudi</title>
-<link rel="stylesheet" href="/css/syntax.css">
 
+<!-- begin _includes/seo.html --><title>配置 - Apache Hudi</title>
+<meta name="description" content="该页面介绍了几种配置写入或读取Hudi数据集的作业的方法。简而言之,您可以在几个级别上控制行为。">
 
-<link rel="stylesheet" type="text/css" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css">
-<!--<link rel="stylesheet" type="text/css" href="css/bootstrap.min.css">-->
-<link rel="stylesheet" href="/css/modern-business.css">
-<link rel="stylesheet" href="/css/lavish-bootstrap.css">
-<link rel="stylesheet" href="/css/customstyles.css">
-<link rel="stylesheet" href="/css/theme-blue.css">
+<meta property="og:type" content="article">
+<meta property="og:locale" content="en_US">
+<meta property="og:site_name" content="">
+<meta property="og:title" content="配置">
+<meta property="og:url" content="https://hudi.apache.org/cn/docs/configurations.html">
+
+
+  <meta property="og:description" content="该页面介绍了几种配置写入或读取Hudi数据集的作业的方法。简而言之,您可以在几个级别上控制行为。">
+
+
+
+
+
+  <meta property="article:modified_time" content="2019-12-30T14:59:57-05:00">
 
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-cookie/1.4.1/jquery.cookie.min.js"></script>
-<script src="/js/jquery.navgoco.min.js"></script>
 
 
-<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
-<script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/2.0.0/anchor.min.js"></script>
-<script src="/js/toc.js"></script>
-<script src="/js/customscripts.js"></script>
 
-<script>
-  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-  })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
 
-  ga('create', 'UA-93561550-1', 'auto');
-  ga('send', 'pageview');
 
-</script>
 
-<link rel="shortcut icon" href="/images/favicon.ico">
+<!-- end _includes/seo.html -->
 
-<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
-<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
-<!--[if lt IE 9]>
-<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
-<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
+
+<!--<link href="/feed.xml" type="application/atom+xml" rel="alternate" title=" Feed">-->
+
+<!-- https://t.co/dKP3o1e -->
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+
+<script>
+  document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js ';
+</script>
+
+<!-- For all browsers -->
+<link rel="stylesheet" href="/assets/css/main.css">
+
+<!--[if IE]>
+  <style>
+    /* old IE unsupported flexbox fixes */
+    .greedy-nav .site-title {
+      padding-right: 3em;
+    }
+    .greedy-nav button {
+      position: absolute;
+      top: 0;
+      right: 0;
+      height: 100%;
+    }
+  </style>
 <![endif]-->
 
-<link rel="alternate" type="application/rss+xml" title="" href="http://0.0.0.0:4000feed.xml">
-
-    <script>
-        $(document).ready(function() {
-            // Initialize navgoco with default options
-            $("#mysidebar").navgoco({
-                caretHtml: '',
-                accordion: true,
-                openClass: 'active', // open
-                save: false, // leave false or nav highlighting doesn't work right
-                cookie: {
-                    name: 'navgoco',
-                    expires: false,
-                    path: '/'
-                },
-                slide: {
-                    duration: 400,
-                    easing: 'swing'
-                }
-            });
-
-            $("#collapseAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', false);
-            });
-
-            $("#expandAll").click(function(e) {
-                e.preventDefault();
-                $("#mysidebar").navgoco('toggle', true);
-            });
-
-        });
-
-    </script>
-    <script>
-        $(function () {
-            $('[data-toggle="tooltip"]').tooltip()
-        })
-    </script>
-    
 
-</head>
-<body>
-<!-- Navigation -->
-
-<nav class="navbar navbar-inverse navbar-fixed-top">
-    <div class="container topnavlinks">
-        <div class="navbar-header">
-            <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
-                <span class="sr-only">Toggle navigation</span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-                <span class="icon-bar"></span>
-            </button>
-
-            <a class="fa fa-lg navbar-brand" href="index.html">&nbsp;<span class="projectTitle">
-              <img src="https://www.apache.org/img/hudi.png" alt="Hudi logo"/>
-              <!--Hudi-->
-            </span><br/>
-            <p class="navbar-incubate">(Incubating)</p></a>
-        </div>
-        <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
-            <ul class="nav navbar-nav navbar-right">
-                <!-- entries without drop-downs appear here -->
-                
-
-                
-                
-                
-                <li><a href="releases.html">发布</a></li>
-                
-                
-                
-                <li><a href="community.html">社区</a></li>
-                
-                
-                
-                <li><a href="https://github.com/apache/incubator-hudi" target="_blank">代码</a></li>
-                
-                
-                
-                <!-- entries with drop-downs appear here -->
-                <!-- conditional logic to control which topnav appears for the audience defined in the configuration file.-->
-                
-                
-                <li class="dropdown">
-                    <a href="#" class="dropdown-toggle" data-toggle="dropdown">开发者<b class="caret"></b></a>
-                    <ul class="dropdown-menu">
-                        
-                        
-                        <li><a href="contributing.html">贡献</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/display/HUDI" target="_blank">维基/设计</a></li>
-                        
-                        
-                        
-                        <li><a href="https://issues.apache.org/jira/projects/HUDI/summary" target="_blank">问题</a></li>
-                        
-                        
-                        
-                        <li><a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=HUDI" target="_blank">博客</a></li>
-                        
-                        
-                        
-                        <li><a href="https://projects.apache.org/project.html?incubator-hudi" target="_blank">团队</a></li>
-                        
-                        
-                    </ul>
-                </li>
-                
-                
-                
-			<li>
-
-
-
-  <a class="email" title="Submit feedback" href="#" onclick="javascript:window.location='mailto:dev@hudi.apache.org?subject=Hudi Documentation feedback&body=I have some feedback about the 配置 page: ' + window.location.href;"><i class="fa fa-envelope-o"></i> Feedback</a>
-
-<li>
-
-		
-                <li>
-                    
-                    <a href="/configurations.html">English</a>
-                    
-                </li>
-                <!--comment out this block if you want to hide search-->
-                <li>
-                    <!--start search-->
-                    <div id="search-demo-container">
-
-                        
-                        <input type="text" id="search-input" placeholder="搜索...">
-                        
-
-                        <ul id="results-container"></ul>
-                    </div>
-                    <script src="/js/jekyll-search.js" type="text/javascript"></script>
-                    <script type="text/javascript">
-                            SimpleJekyllSearch.init({
-                                searchInput: document.getElementById('search-input'),
-                                resultsContainer: document.getElementById('results-container'),
-                                dataSource: '/search.json',
-                                searchResultTemplate: '<li><a href="{url}" title="配置">{title}</a></li>',
-                    noResultsText: 'No results found.',
-                            limit: 10,
-                            fuzzy: true,
-                    })
-                    </script>
-                    <!--end search-->
-                </li>
-            </ul>
-        </div>
-        <p class="alert alert-warning"> <b>Hello:</b> Click <a href="/newsite-content"> here</a> to try our new site.</p>
 
-    </div>
-        <!-- /.container -->
-</nav>
+<link rel="icon" type="image/x-icon" href="/assets/images/favicon.ico">
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
 
-<!-- Page Content -->
-<div class="container">
-    <div class="col-lg-12">&nbsp;</div>
-    <!-- Content Row -->
-    <div class="row">
-        <!-- Sidebar Column -->
-        <div class="col-md-2">
+  </head>
+
+  <body class="layout--single">
+    <!--[if lt IE 9]>
+<div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="https://browsehappy.com/">upgrade your browser</a> to improve your experience.</div>
+<![endif]-->
+
+    <div class="masthead">
+  <div class="masthead__inner-wrap" id="masthead__inner-wrap">
+    <div class="masthead__menu">
+      <nav id="site-nav" class="greedy-nav">
+        
+          <a class="site-logo" href="/">
+              <div style="width: 150px; height: 40px">
+
+              </div>
+<!--            <img src="" alt="">-->
+<!--            -->
+<!--            <span class="site-subtitle" style="font-size: 0.8em !important;">-->
+<!--              &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Incubating-->
+<!--            </span>-->
+<!--            -->
+          </a>
+        
+        <a class="site-title" href="/">
           
+        </a>
+        <ul class="visible-links"><li class="masthead__menu-item">
+              <a href="/cn/docs/quick-start-guide.html" target="_self" >文档</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/community.html" target="_self" >社区</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/activity.html" target="_self" >动态</a>
+            </li><li class="masthead__menu-item">
+              <a href="https://cwiki.apache.org/confluence/display/HUDI/FAQ" target="_blank" >FAQ</a>
+            </li><li class="masthead__menu-item">
+              <a href="/cn/releases.html" target="_self" >发布</a>
+            </li></ul>
+        <button class="greedy-nav__toggle hidden" type="button">
+          <span class="visually-hidden">Toggle menu</span>
+          <div class="navicon"></div>
+        </button>
+        <ul class="hidden-links hidden"></ul>
+      </nav>
+    </div>
+  </div>
+</div>
+<!--
+<p class="notice--warning" style="margin: 0 !important; text-align: center !important;"><strong>Note:</strong> This site is work in progress, if you notice any issues, please <a target="_blank" href="https://github.com/apache/incubator-hudi/issues">Report on Issue</a>.
+  Click <a href="/"> here</a> back to old site.</p>
+-->
+
+    <div class="initial-content">
+      <div id="main" role="main">
+  
 
+  <div class="sidebar sticky">
 
+  
 
+  
 
+    
+      
 
 
 
 
-<ul id="mysidebar" class="nav">
-    <li class="sidebarTitle">Version (0.5.0-incubating)</li>
-    
-    
+
+<nav class="nav__list">
+  
+  <input id="ac-toc" name="accordion-toc" type="checkbox" />
+  <label for="ac-toc">文档菜单</label>
+  <ul class="nav__items">
     
-    <li>
-        <a href="#">入门指南</a>
+      <li>
+        
+          <span class="nav__sub-title">入门指南</span>
+        
+
+        
         <ul>
+          
+            
+            
+
+            
+            
+
             
+              <li><a href="/cn/docs/quick-start-guide.html" class="">快速开始</a></li>
             
+
+          
             
-            <li><a href="quickstart.html">快速开始</a></li>
             
+
             
             
+
             
+              <li><a href="/cn/docs/use_cases.html" class="">使用案例</a></li>
+            
+
+          
             
             
-            <li><a href="use_cases.html">使用案例</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/powered_by.html" class="">演讲 & hudi 用户</a></li>
             
+
+          
             
             
-            <li><a href="powered_by.html">演讲 & Hudi 用户</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/comparison.html" class="">对比</a></li>
             
+
+          
             
             
-            <li><a href="comparison.html">对比</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/docker_demo.html" class="">Docker 示例</a></li>
             
+
+          
         </ul>
         
-        
+      </li>
     
-    <li>
-        <a href="#">文档</a>
+      <li>
+        
+          <span class="nav__sub-title">帮助文档</span>
+        
+
+        
         <ul>
+          
             
             
-            
-            <li><a href="concepts.html">概念</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/concepts.html" class="">概念</a></li>
             
+
+          
             
             
-            <li><a href="writing_data.html">写入数据</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/writing_data.html" class="">写入数据</a></li>
             
+
+          
             
             
-            <li><a href="querying_data.html">查询数据</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/querying_data.html" class="">查询数据</a></li>
             
+
+          
             
             
-            <li><a href="configurations.html">配置</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/configurations.html" class="active">配置</a></li>
             
+
+          
             
             
-            <li><a href="performance.html">性能</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/performance.html" class="">性能</a></li>
             
+
+          
             
             
-            <li><a href="admin_guide.html">管理</a></li>
+
             
             
+
             
+              <li><a href="/cn/docs/admin_guide.html" class="">管理</a></li>
             
+
+          
         </ul>
         
+      </li>
+    
+      <li>
         
+          <span class="nav__sub-title">其他信息</span>
         
-        <!-- if you aren't using the accordion, uncomment this block:
-           <p class="external">
-               <a href="#" id="collapseAll">Collapse All</a> | <a href="#" id="expandAll">Expand All</a>
-           </p>
-           -->
-    </li>
-</ul>
 
-<!-- this highlights the active parent class in the navgoco sidebar. this is critical so that the parent expands when you're viewing a page. This must appear below the sidebar code above. Otherwise, if placed inside customscripts.js, the script runs before the sidebar code runs and the class never gets inserted.-->
-<script>$("li.active").parents('li').toggleClass("active");</script>
+        
+        <ul>
+          
+            
+            
 
-        </div>
-        <!-- Content Column -->
-        <div class="col-md-8">
-            <div class="post-header">
-   <h1 class="post-title-main">配置</h1>
-</div>
+            
+            
 
+            
+              <li><a href="/cn/docs/docs-versions.html" class="">文档版本</a></li>
+            
 
+          
+            
+            
 
-<div class="post-content">
+            
+            
 
-   
-    <div class="summary">在这里,我们列出了所有可能的配置及其含义。</div>
-   
+            
+              <li><a href="/cn/docs/privacy.html" class="">版权信息</a></li>
+            
 
+          
+        </ul>
+        
+      </li>
     
+  </ul>
+</nav>
+    
+
+  
+  </div>
+
 
-  <p>该页面介绍了几种配置写入或读取Hudi数据集的作业的方法。
+  <article class="page" itemscope itemtype="https://schema.org/CreativeWork">
+
+    <div class="page__inner-wrap">
+      
+        <header>
+          <h1 id="page-title" class="page__title" itemprop="headline">配置
+</h1>
+        </header>
+      
+
+      <section class="page__content" itemprop="text">
+        
+        <aside class="sidebar__right sticky">
+          <nav class="toc">
+            <header><h4 class="nav__title"><i class="fas fa-file-alt"></i> In this page</h4></header>
+            <ul class="toc__menu">
+  <li><a href="#与云存储连接">与云存储连接</a></li>
+  <li><a href="#spark-datasource">Spark数据源配置</a>
+    <ul>
+      <li><a href="#写选项">写选项</a></li>
+      <li><a href="#读选项">读选项</a></li>
+    </ul>
+  </li>
+  <li><a href="#writeclient-configs">WriteClient 配置</a>
+    <ul>
+      <li><a href="#索引配置">索引配置</a></li>
+      <li><a href="#存储选项">存储选项</a></li>
+      <li><a href="#压缩配置">压缩配置</a></li>
+      <li><a href="#指标配置">指标配置</a></li>
+      <li><a href="#内存配置">内存配置</a></li>
+    </ul>
+  </li>
+</ul>
+          </nav>
+        </aside>
+        
+        <p>该页面介绍了几种配置写入或读取Hudi数据集的作业的方法。
 简而言之,您可以在几个级别上控制行为。</p>
 
 <ul>
@@ -357,221 +375,221 @@
  在数据源和WriteClient级别,都可以将其重写为扩展<code class="highlighter-rouge">HoodieRecordPayload</code>类的自定义类。</li>
 </ul>
 
-<h3 id="与云存储连接">与云存储连接</h3>
+<h2 id="与云存储连接">与云存储连接</h2>
 
 <p>无论使用RDD/WriteClient API还是数据源,以下信息都有助于配置对云存储的访问。</p>
 
 <ul>
-  <li><a href="s3_hoodie.html">AWS S3</a> <br />
+  <li><a href="/cn/docs/s3_hoodie.html">AWS S3</a> <br />
 S3和Hudi协同工作所需的配置。</li>
-  <li><a href="gcs_hoodie.html">Google Cloud Storage</a> <br />
+  <li><a href="/cn/docs/gcs_hoodie.html">Google Cloud Storage</a> <br />
 GCS和Hudi协同工作所需的配置。</li>
 </ul>
 
-<h3 id="spark-datasource">Spark数据源配置</h3>
+<h2 id="spark-datasource">Spark数据源配置</h2>
 
 <p>可以通过将以下选项传递到<code class="highlighter-rouge">option(k,v)</code>方法中来配置使用数据源的Spark作业。
 实际的数据源级别配置在下面列出。</p>
 
-<h4 id="写选项">写选项</h4>
+<h3 id="写选项">写选项</h3>
 
 <p>另外,您可以使用<code class="highlighter-rouge">options()</code>或<code class="highlighter-rouge">option(k,v)</code>方法直接传递任何WriteClient级别的配置。</p>
 
-<pre><code class="language-Java">inputDF.write()
-.format("org.apache.hudi")
-.options(clientOpts) // 任何Hudi客户端选项都可以传入
-.option(DataSourceWriteOptions.RECORDKEY_FIELD_OPT_KEY(), "_row_key")
-.option(DataSourceWriteOptions.PARTITIONPATH_FIELD_OPT_KEY(), "partition")
-.option(DataSourceWriteOptions.PRECOMBINE_FIELD_OPT_KEY(), "timestamp")
-.option(HoodieWriteConfig.TABLE_NAME, tableName)
-.mode(SaveMode.Append)
-.save(basePath);
-</code></pre>
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="n">inputDF</span><span class="o">.</span><span class="na">write</span><span class="o">()</span>
+<span class="o">.</span><span class="na">format</span><span class="o">(</span><span class="s">"org.apache.hudi"</span><span class="o">)</span>
+<span class="o">.</span><span class="na">options</span><span class="o">(</span><span class="n">clientOpts</span><span class="o">)</span> <span class="c1">// 任何Hudi客户端选项都可以传入</span>
+<span class="o">.</span><span class="na">option</span><span class="o">(</span><span class="nc">DataSourceWriteOptions</span><span class="o">.</span><span class="na">RECORDKEY_FIELD_OPT_KEY</span><span class="o">(),</span> <span class="s">"_row_key"</span><span class="o">)</span>
+<span class="o">.</span><span class="na">option</span><span class="o">(</span><span class="nc">DataSourceWriteOptions</span><span class="o">.</span><span class="na">PARTITIONPATH_FIELD_OPT_KEY</span><span class="o">(),</span> <span class="s">"partition"</span><span class="o">)</span>
+<span class="o">.</span><span class="na">option</span><span class="o">(</span><span class="nc">DataSourceWriteOptions</span><span class="o">.</span><span class="na">PRECOMBINE_FIELD_OPT_KEY</span><span class="o">(),</span> <span class="s">"timestamp"</span><span class="o">)</span>
+<span class="o">.</span><span class="na">option</span><span class="o">(</span><span class="nc">HoodieWriteConfig</span><span class="o">.</span><span class="na">TABLE_NAME</span><span class="o">,</span> <span class="n">tableName</span><span class="o">)</span>
+<span class="o">.</span><span class="na">mode</span><span class="o">(</span><span class="nc">SaveMode</span><span class="o">.</span><span class="na">Append</span><span class="o">)</span>
+<span class="o">.</span><span class="na">save</span><span class="o">(</span><span class="n">basePath</span><span class="o">);</span>
+</code></pre></div></div>
 
 <p>用于通过<code class="highlighter-rouge">write.format.option(...)</code>写入数据集的选项</p>
 
-<h5 id="TABLE_NAME_OPT_KEY">TABLE_NAME_OPT_KEY</h5>
+<h4 id="TABLE_NAME_OPT_KEY">TABLE_NAME_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.table.name</code> [必须]<br />
   <span style="color:grey">Hive表名,用于将数据集注册到其中。</span></p>
 
-<h5 id="OPERATION_OPT_KEY">OPERATION_OPT_KEY</h5>
+<h4 id="OPERATION_OPT_KEY">OPERATION_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.operation</code>, 默认值:<code class="highlighter-rouge">upsert</code><br />
   <span style="color:grey">是否为写操作进行插入更新、插入或批量插入。使用<code class="highlighter-rouge">bulkinsert</code>将新数据加载到表中,之后使用<code class="highlighter-rouge">upsert</code>或<code class="highlighter-rouge">insert</code>。
   批量插入使用基于磁盘的写入路径来扩展以加载大量输入,而无需对其进行缓存。</span></p>
 
-<h5 id="STORAGE_TYPE_OPT_KEY">STORAGE_TYPE_OPT_KEY</h5>
+<h4 id="STORAGE_TYPE_OPT_KEY">STORAGE_TYPE_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.storage.type</code>, 默认值:<code class="highlighter-rouge">COPY_ON_WRITE</code> <br />
   <span style="color:grey">此写入的基础数据的存储类型。两次写入之间不能改变。</span></p>
 
-<h5 id="PRECOMBINE_FIELD_OPT_KEY">PRECOMBINE_FIELD_OPT_KEY</h5>
+<h4 id="PRECOMBINE_FIELD_OPT_KEY">PRECOMBINE_FIELD_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.precombine.field</code>, 默认值:<code class="highlighter-rouge">ts</code> <br />
   <span style="color:grey">实际写入之前在preCombining中使用的字段。
   当两个记录具有相同的键值时,我们将使用Object.compareTo(..)从precombine字段中选择一个值最大的记录。</span></p>
 
-<h5 id="PAYLOAD_CLASS_OPT_KEY">PAYLOAD_CLASS_OPT_KEY</h5>
+<h4 id="PAYLOAD_CLASS_OPT_KEY">PAYLOAD_CLASS_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.payload.class</code>, 默认值:<code class="highlighter-rouge">org.apache.hudi.OverwriteWithLatestAvroPayload</code> <br />
   <span style="color:grey">使用的有效载荷类。如果您想在插入更新或插入时使用自己的合并逻辑,请重写此方法。
   这将使得<code class="highlighter-rouge">PRECOMBINE_FIELD_OPT_VAL</code>设置的任何值无效</span></p>
 
-<h5 id="RECORDKEY_FIELD_OPT_KEY">RECORDKEY_FIELD_OPT_KEY</h5>
+<h4 id="RECORDKEY_FIELD_OPT_KEY">RECORDKEY_FIELD_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.recordkey.field</code>, 默认值:<code class="highlighter-rouge">uuid</code> <br />
   <span style="color:grey">记录键字段。用作<code class="highlighter-rouge">HoodieKey</code>中<code class="highlighter-rouge">recordKey</code>部分的值。
   实际值将通过在字段值上调用.toString()来获得。可以使用点符号指定嵌套字段,例如:<code class="highlighter-rouge">a.b.c</code></span></p>
 
-<h5 id="PARTITIONPATH_FIELD_OPT_KEY">PARTITIONPATH_FIELD_OPT_KEY</h5>
+<h4 id="PARTITIONPATH_FIELD_OPT_KEY">PARTITIONPATH_FIELD_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.partitionpath.field</code>, 默认值:<code class="highlighter-rouge">partitionpath</code> <br />
   <span style="color:grey">分区路径字段。用作<code class="highlighter-rouge">HoodieKey</code>中<code class="highlighter-rouge">partitionPath</code>部分的值。
   通过调用.toString()获得实际的值</span></p>
 
-<h5 id="KEYGENERATOR_CLASS_OPT_KEY">KEYGENERATOR_CLASS_OPT_KEY</h5>
+<h4 id="KEYGENERATOR_CLASS_OPT_KEY">KEYGENERATOR_CLASS_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.keygenerator.class</code>, 默认值:<code class="highlighter-rouge">org.apache.hudi.SimpleKeyGenerator</code> <br />
   <span style="color:grey">键生成器类,实现从输入的<code class="highlighter-rouge">Row</code>对象中提取键</span></p>
 
-<h5 id="COMMIT_METADATA_KEYPREFIX_OPT_KEY">COMMIT_METADATA_KEYPREFIX_OPT_KEY</h5>
+<h4 id="COMMIT_METADATA_KEYPREFIX_OPT_KEY">COMMIT_METADATA_KEYPREFIX_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.commitmeta.key.prefix</code>, 默认值:<code class="highlighter-rouge">_</code> <br />
   <span style="color:grey">以该前缀开头的选项键会自动添加到提交/增量提交的元数据中。
   这对于与hudi时间轴一致的方式存储检查点信息很有用</span></p>
 
-<h5 id="INSERT_DROP_DUPS_OPT_KEY">INSERT_DROP_DUPS_OPT_KEY</h5>
+<h4 id="INSERT_DROP_DUPS_OPT_KEY">INSERT_DROP_DUPS_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.write.insert.drop.duplicates</code>, 默认值:<code class="highlighter-rouge">false</code> <br />
   <span style="color:grey">如果设置为true,则在插入操作期间从传入DataFrame中过滤掉所有重复记录。</span></p>
 
-<h5 id="HIVE_SYNC_ENABLED_OPT_KEY">HIVE_SYNC_ENABLED_OPT_KEY</h5>
+<h4 id="HIVE_SYNC_ENABLED_OPT_KEY">HIVE_SYNC_ENABLED_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.enable</code>, 默认值:<code class="highlighter-rouge">false</code> <br />
   <span style="color:grey">设置为true时,将数据集注册并同步到Apache Hive Metastore</span></p>
 
-<h5 id="HIVE_DATABASE_OPT_KEY">HIVE_DATABASE_OPT_KEY</h5>
+<h4 id="HIVE_DATABASE_OPT_KEY">HIVE_DATABASE_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.database</code>, 默认值:<code class="highlighter-rouge">default</code> <br />
   <span style="color:grey">要同步到的数据库</span></p>
 
-<h5 id="HIVE_TABLE_OPT_KEY">HIVE_TABLE_OPT_KEY</h5>
+<h4 id="HIVE_TABLE_OPT_KEY">HIVE_TABLE_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.table</code>, [Required] <br />
   <span style="color:grey">要同步到的表</span></p>
 
-<h5 id="HIVE_USER_OPT_KEY">HIVE_USER_OPT_KEY</h5>
+<h4 id="HIVE_USER_OPT_KEY">HIVE_USER_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.username</code>, 默认值:<code class="highlighter-rouge">hive</code> <br />
   <span style="color:grey">要使用的Hive用户名</span></p>
 
-<h5 id="HIVE_PASS_OPT_KEY">HIVE_PASS_OPT_KEY</h5>
+<h4 id="HIVE_PASS_OPT_KEY">HIVE_PASS_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.password</code>, 默认值:<code class="highlighter-rouge">hive</code> <br />
   <span style="color:grey">要使用的Hive密码</span></p>
 
-<h5 id="HIVE_URL_OPT_KEY">HIVE_URL_OPT_KEY</h5>
+<h4 id="HIVE_URL_OPT_KEY">HIVE_URL_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.jdbcurl</code>, 默认值:<code class="highlighter-rouge">jdbc:hive2://localhost:10000</code> <br />
   <span style="color:grey">Hive metastore url</span></p>
 
-<h5 id="HIVE_PARTITION_FIELDS_OPT_KEY">HIVE_PARTITION_FIELDS_OPT_KEY</h5>
+<h4 id="HIVE_PARTITION_FIELDS_OPT_KEY">HIVE_PARTITION_FIELDS_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.partition_fields</code>, 默认值:<code class="highlighter-rouge"> </code> <br />
   <span style="color:grey">数据集中用于确定Hive分区的字段。</span></p>
 
-<h5 id="HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY">HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY</h5>
+<h4 id="HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY">HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.partition_extractor_class</code>, 默认值:<code class="highlighter-rouge">org.apache.hudi.hive.SlashEncodedDayPartitionValueExtractor</code> <br />
   <span style="color:grey">用于将分区字段值提取到Hive分区列中的类。</span></p>
 
-<h5 id="HIVE_ASSUME_DATE_PARTITION_OPT_KEY">HIVE_ASSUME_DATE_PARTITION_OPT_KEY</h5>
+<h4 id="HIVE_ASSUME_DATE_PARTITION_OPT_KEY">HIVE_ASSUME_DATE_PARTITION_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.hive_sync.assume_date_partitioning</code>, 默认值:<code class="highlighter-rouge">false</code> <br />
   <span style="color:grey">假设分区格式是yyyy/mm/dd</span></p>
 
-<h4 id="读选项">读选项</h4>
+<h3 id="读选项">读选项</h3>
 
 <p>用于通过<code class="highlighter-rouge">read.format.option(...)</code>读取数据集的选项</p>
 
-<h5 id="VIEW_TYPE_OPT_KEY">VIEW_TYPE_OPT_KEY</h5>
+<h4 id="VIEW_TYPE_OPT_KEY">VIEW_TYPE_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.view.type</code>, 默认值:<code class="highlighter-rouge">read_optimized</code> <br />
 <span style="color:grey">是否需要以某种模式读取数据,增量模式(自InstantTime以来的新数据)
 (或)读优化模式(基于列数据获取最新视图)
 (或)实时模式(基于行和列数据获取最新视图)</span></p>
 
-<h5 id="BEGIN_INSTANTTIME_OPT_KEY">BEGIN_INSTANTTIME_OPT_KEY</h5>
+<h4 id="BEGIN_INSTANTTIME_OPT_KEY">BEGIN_INSTANTTIME_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.read.begin.instanttime</code>, [在增量模式下必须] <br />
 <span style="color:grey">开始增量提取数据的即时时间。这里的instanttime不必一定与时间轴上的即时相对应。
 取出以<code class="highlighter-rouge">instant_time &gt; BEGIN_INSTANTTIME</code>写入的新数据。
 例如:’20170901080000’将获取2017年9月1日08:00 AM之后写入的所有新数据。</span></p>
 
-<h5 id="END_INSTANTTIME_OPT_KEY">END_INSTANTTIME_OPT_KEY</h5>
+<h4 id="END_INSTANTTIME_OPT_KEY">END_INSTANTTIME_OPT_KEY</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.datasource.read.end.instanttime</code>, 默认值:最新即时(即从开始即时获取所有新数据) <br />
 <span style="color:grey">限制增量提取的数据的即时时间。取出以<code class="highlighter-rouge">instant_time &lt;= END_INSTANTTIME</code>写入的新数据。</span></p>
 
-<h3 id="writeclient-configs">WriteClient 配置</h3>
+<h2 id="writeclient-configs">WriteClient 配置</h2>
 
 <p>直接使用RDD级别api进行编程的Jobs可以构建一个<code class="highlighter-rouge">HoodieWriteConfig</code>对象,并将其传递给<code class="highlighter-rouge">HoodieWriteClient</code>构造函数。
 HoodieWriteConfig可以使用以下构建器模式构建。</p>
 
-<pre><code class="language-Java">HoodieWriteConfig cfg = HoodieWriteConfig.newBuilder()
-        .withPath(basePath)
-        .forTable(tableName)
-        .withSchema(schemaStr)
-        .withProps(props) // 从属性文件传递原始k、v对。
-        .withCompactionConfig(HoodieCompactionConfig.newBuilder().withXXX(...).build())
-        .withIndexConfig(HoodieIndexConfig.newBuilder().withXXX(...).build())
-        ...
-        .build();
-</code></pre>
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nc">HoodieWriteConfig</span> <span class="n">cfg</span> <span class="o">=</span> <span class="nc">HoodieWriteConfig</span><span class="o">.</span><span class="na">newBuilder</span><span class="o">()</span>
+        <span class="o">.</span><span class="na">withPath</span><span class="o">(</span><span class="n">basePath</span><span class="o">)</span>
+        <span class="o">.</span><span class="na">forTable</span><span class="o">(</span><span class="n">tableName</span><span class="o">)</span>
+        <span class="o">.</span><span class="na">withSchema</span><span class="o">(</span><span class="n">schemaStr</span><span class="o">)</span>
+        <span class="o">.</span><span class="na">withProps</span><span class="o">(</span><span class="n">props</span><span class="o">)</span> <span class="c1">// 从属性文件传递原始k、v对。</span>
+        <span class="o">.</span><span class="na">withCompactionConfig</span><span class="o">(</span><span class="nc">HoodieCompactionConfig</span><span class="o">.</span><span class="na">newBuilder</span><span class="o">().</span><span class="na">withXXX</span><span class="o">(...).</span><span class="na">build</span><span class="o">())</span>
+        <span class="o">.</span><span class="na">withIndexConfig</span><span class="o">(</span><span class="nc">HoodieIndexConfig</span><span class="o">.</span><span class="na">newBuilder</span><span class="o">().</span><span class="na">withXXX</span><span class="o">(...).</span><span class="na">build</span><span class="o">())</span>
+        <span class="o">...</span>
+        <span class="o">.</span><span class="na">build</span><span class="o">();</span>
+</code></pre></div></div>
 
 <p>以下各节介绍了写配置的不同方面,并解释了最重要的配置及其属性名称和默认值。</p>
 
-<h5 id="withPath">withPath(hoodie_base_path)</h5>
+<h4 id="withPath">withPath(hoodie_base_path)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.base.path</code> [必须] <br />
 <span style="color:grey">创建所有数据分区所依据的基本DFS路径。
 始终在前缀中明确指明存储方式(例如hdfs://,s3://等)。
 Hudi将有关提交、保存点、清理审核日志等的所有主要元数据存储在基本目录下的.hoodie目录中。</span></p>
 
-<h5 id="withSchema">withSchema(schema_str)</h5>
+<h4 id="withSchema">withSchema(schema_str)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.avro.schema</code> [必须]<br />
 <span style="color:grey">这是数据集的当前读取器的avro模式(schema)。
 这是整个模式的字符串。HoodieWriteClient使用此模式传递到HoodieRecordPayload的实现,以从源格式转换为avro记录。
 在更新过程中重写记录时也使用此模式。</span></p>
 
-<h5 id="forTable">forTable(table_name)</h5>
+<h4 id="forTable">forTable(table_name)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.table.name</code> [必须] <br />
  <span style="color:grey">数据集的表名,将用于在Hive中注册。每次运行需要相同。</span></p>
 
-<h5 id="withBulkInsertParallelism">withBulkInsertParallelism(bulk_insert_parallelism = 1500)</h5>
+<h4 id="withBulkInsertParallelism">withBulkInsertParallelism(bulk_insert_parallelism = 1500)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bulkinsert.shuffle.parallelism</code><br />
 <span style="color:grey">批量插入旨在用于较大的初始导入,而此处的并行度决定了数据集中文件的初始数量。
 调整此值以达到在初始导入期间所需的最佳尺寸。</span></p>
 
-<h5 id="withParallelism">withParallelism(insert_shuffle_parallelism = 1500, upsert_shuffle_parallelism = 1500)</h5>
+<h4 id="withParallelism">withParallelism(insert_shuffle_parallelism = 1500, upsert_shuffle_parallelism = 1500)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.insert.shuffle.parallelism</code>, <code class="highlighter-rouge">hoodie.upsert.shuffle.parallelism</code><br />
 <span style="color:grey">最初导入数据后,此并行度将控制用于读取输入记录的初始并行度。
 确保此值足够高,例如:1个分区用于1 GB的输入数据</span></p>
 
-<h5 id="combineInput">combineInput(on_insert = false, on_update=true)</h5>
+<h4 id="combineInput">combineInput(on_insert = false, on_update=true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.combine.before.insert</code>, <code class="highlighter-rouge">hoodie.combine.before.upsert</code><br />
 <span style="color:grey">在DFS中插入或更新之前先组合输入RDD并将多个部分记录合并为单个记录的标志</span></p>
 
-<h5 id="withWriteStatusStorageLevel">withWriteStatusStorageLevel(level = MEMORY_AND_DISK_SER)</h5>
+<h4 id="withWriteStatusStorageLevel">withWriteStatusStorageLevel(level = MEMORY_AND_DISK_SER)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.write.status.storage.level</code><br />
 <span style="color:grey">HoodieWriteClient.insert和HoodieWriteClient.upsert返回一个持久的RDD[WriteStatus],
 这是因为客户端可以选择检查WriteStatus并根据失败选择是否提交。这是此RDD的存储级别的配置</span></p>
 
-<h5 id="withAutoCommit">withAutoCommit(autoCommit = true)</h5>
+<h4 id="withAutoCommit">withAutoCommit(autoCommit = true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.auto.commit</code><br />
 <span style="color:grey">插入和插入更新后,HoodieWriteClient是否应该自动提交。
 客户端可以选择关闭自动提交,并在”定义的成功条件”下提交</span></p>
 
-<h5 id="withAssumeDatePartitioning">withAssumeDatePartitioning(assumeDatePartitioning = false)</h5>
+<h4 id="withAssumeDatePartitioning">withAssumeDatePartitioning(assumeDatePartitioning = false)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.assume.date.partitioning</code><br />
 <span style="color:grey">HoodieWriteClient是否应该假设数据按日期划分,即从基本路径划分为三个级别。
 这是支持&lt;0.3.1版本创建的表的一个补丁。最终将被删除</span></p>
 
-<h5 id="withConsistencyCheckEnabled">withConsistencyCheckEnabled(enabled = false)</h5>
+<h4 id="withConsistencyCheckEnabled">withConsistencyCheckEnabled(enabled = false)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.consistency.check.enabled</code><br />
 <span style="color:grey">HoodieWriteClient是否应该执行其他检查,以确保写入的文件在基础文件系统/存储上可列出。
 将其设置为true可以解决S3的最终一致性模型,并确保作为提交的一部分写入的所有数据均能准确地用于查询。</span></p>
 
-<h4 id="索引配置">索引配置</h4>
+<h3 id="索引配置">索引配置</h3>
 <p>以下配置控制索引行为,该行为将传入记录标记为对较旧记录的插入或更新。</p>
 
 <p><a href="#withIndexConfig">withIndexConfig</a> (HoodieIndexConfig) <br />
 <span style="color:grey">可插入以具有外部索引(HBase)或使用存储在Parquet文件中的默认布隆过滤器(bloom filter)</span></p>
 
-<h5 id="withIndexType">withIndexType(indexType = BLOOM)</h5>
+<h4 id="withIndexType">withIndexType(indexType = BLOOM)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.type</code> <br />
 <span style="color:grey">要使用的索引类型。默认为布隆过滤器。可能的选项是[BLOOM | HBASE | INMEMORY]。
 布隆过滤器消除了对外部系统的依赖,并存储在Parquet数据文件的页脚中</span></p>
 
-<h5 id="bloomFilterNumEntries">bloomFilterNumEntries(numEntries = 60000)</h5>
+<h4 id="bloomFilterNumEntries">bloomFilterNumEntries(numEntries = 60000)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.bloom.num_entries</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />这是要存储在布隆过滤器中的条目数。
 我们假设maxParquetFileSize为128MB,averageRecordSize为1024B,因此,一个文件中的记录总数约为130K。
@@ -579,302 +597,269 @@ Hudi将有关提交、保存点、清理审核日志等的所有主要元数据
 描述了如何动态地对此进行计算。
 警告:将此值设置得太低,将产生很多误报,并且索引查找将必须扫描比其所需的更多的文件;如果将其设置得非常高,将线性增加每个数据文件的大小(每50000个条目大约4KB)。</span></p>
 
-<h5 id="bloomFilterFPP">bloomFilterFPP(fpp = 0.000000001)</h5>
+<h4 id="bloomFilterFPP">bloomFilterFPP(fpp = 0.000000001)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.bloom.fpp</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />根据条目数允许的错误率。
 这用于计算应为布隆过滤器分配多少位以及哈希函数的数量。通常将此值设置得很低(默认值:0.000000001),我们希望在磁盘空间上进行权衡以降低误报率</span></p>
 
-<h5 id="bloomIndexPruneByRanges">bloomIndexPruneByRanges(pruneRanges = true)</h5>
+<h4 id="bloomIndexPruneByRanges">bloomIndexPruneByRanges(pruneRanges = true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bloom.index.prune.by.ranges</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />为true时,从文件框定信息,可以加快索引查找的速度。 如果键具有单调递增的前缀,例如时间戳,则特别有用。</span></p>
 
-<h5 id="bloomIndexUseCaching">bloomIndexUseCaching(useCaching = true)</h5>
+<h4 id="bloomIndexUseCaching">bloomIndexUseCaching(useCaching = true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bloom.index.use.caching</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />为true时,将通过减少用于计算并行度或受影响分区的IO来缓存输入的RDD以加快索引查找</span></p>
 
-<h5 id="bloomIndexTreebasedFilter">bloomIndexTreebasedFilter(useTreeFilter = true)</h5>
+<h4 id="bloomIndexTreebasedFilter">bloomIndexTreebasedFilter(useTreeFilter = true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bloom.index.use.treebased.filter</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />为true时,启用基于间隔树的文件过滤优化。与暴力模式相比,此模式可根据键范围加快文件过滤速度</span></p>
 
-<h5 id="bloomIndexBucketizedChecking">bloomIndexBucketizedChecking(bucketizedChecking = true)</h5>
+<h4 id="bloomIndexBucketizedChecking">bloomIndexBucketizedChecking(bucketizedChecking = true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bloom.index.bucketized.checking</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />为true时,启用了桶式布隆过滤。这减少了在基于排序的布隆索引查找中看到的偏差</span></p>
 
-<h5 id="bloomIndexKeysPerBucket">bloomIndexKeysPerBucket(keysPerBucket = 10000000)</h5>
+<h4 id="bloomIndexKeysPerBucket">bloomIndexKeysPerBucket(keysPerBucket = 10000000)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bloom.index.keys.per.bucket</code> <br />
 <span style="color:grey">仅在启用bloomIndexBucketizedChecking并且索引类型为bloom的情况下适用。<br />
 此配置控制“存储桶”的大小,该大小可跟踪对单个文件进行的记录键检查的次数,并且是分配给执行布隆过滤器查找的每个分区的工作单位。
 较高的值将分摊将布隆过滤器读取到内存的固定成本。</span></p>
 
-<h5 id="bloomIndexParallelism">bloomIndexParallelism(0)</h5>
+<h4 id="bloomIndexParallelism">bloomIndexParallelism(0)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.bloom.index.parallelism</code> <br />
 <span style="color:grey">仅在索引类型为BLOOM时适用。<br />这是索引查找的并行度,其中涉及Spark Shuffle。 默认情况下,这是根据输入的工作负载特征自动计算的</span></p>
 
-<h5 id="hbaseZkQuorum">hbaseZkQuorum(zkString) [必须]</h5>
+<h4 id="hbaseZkQuorum">hbaseZkQuorum(zkString) [必须]</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.hbase.zkquorum</code> <br />
 <span style="color:grey">仅在索引类型为HBASE时适用。要连接的HBase ZK Quorum URL。</span></p>
 
-<h5 id="hbaseZkPort">hbaseZkPort(port) [必须]</h5>
+<h4 id="hbaseZkPort">hbaseZkPort(port) [必须]</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.hbase.zkport</code> <br />
 <span style="color:grey">仅在索引类型为HBASE时适用。要连接的HBase ZK Quorum端口。</span></p>
 
-<h5 id="hbaseTableName">hbaseZkZnodeParent(zkZnodeParent)  [必须]</h5>
+<h4 id="hbaseTableName">hbaseZkZnodeParent(zkZnodeParent)  [必须]</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.hbase.zknode.path</code> <br />
 <span style="color:grey">仅在索引类型为HBASE时适用。这是根znode,它将包含HBase创建及使用的所有znode。</span></p>
 
-<h5 id="hbaseTableName">hbaseTableName(tableName)  [必须]</h5>
+<h4 id="hbaseTableName">hbaseTableName(tableName)  [必须]</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.index.hbase.table</code> <br />
 <span style="color:grey">仅在索引类型为HBASE时适用。HBase表名称,用作索引。Hudi将row_key和[partition_path, fileID, commitTime]映射存储在表中。</span></p>
 
-<h4 id="存储选项">存储选项</h4>
+<h3 id="存储选项">存储选项</h3>
 <p>控制有关调整parquet和日志文件大小的方面。</p>
 
 <p><a href="#withStorageConfig">withStorageConfig</a> (HoodieStorageConfig) <br /></p>
 
-<h5 id="limitFileSize">limitFileSize (size = 120MB)</h5>
+<h4 id="limitFileSize">limitFileSize (size = 120MB)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.max.file.size</code> <br />
 <span style="color:grey">Hudi写阶段生成的parquet文件的目标大小。对于DFS,这需要与基础文件系统块大小保持一致,以实现最佳性能。</span></p>
 
-<h5 id="parquetBlockSize">parquetBlockSize(rowgroupsize = 120MB)</h5>
+<h4 id="parquetBlockSize">parquetBlockSize(rowgroupsize = 120MB)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.block.size</code> <br />
 <span style="color:grey">Parquet行组大小。最好与文件大小相同,以便将文件中的单个列连续存储在磁盘上</span></p>
 
-<h5 id="parquetPageSize">parquetPageSize(pagesize = 1MB)</h5>
+<h4 id="parquetPageSize">parquetPageSize(pagesize = 1MB)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.page.size</code> <br />
 <span style="color:grey">Parquet页面大小。页面是parquet文件中的读取单位。 在一个块内,页面被分别压缩。</span></p>
 
-<h5 id="parquetCompressionRatio">parquetCompressionRatio(parquetCompressionRatio = 0.1)</h5>
+<h4 id="parquetCompressionRatio">parquetCompressionRatio(parquetCompressionRatio = 0.1)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.compression.ratio</code> <br />
 <span style="color:grey">当Hudi尝试调整新parquet文件的大小时,预期对parquet数据进行压缩的比例。
 如果bulk_insert生成的文件小于预期大小,请增加此值</span></p>
 
-<h5 id="parquetCompressionCodec">parquetCompressionCodec(parquetCompressionCodec = gzip)</h5>
+<h4 id="parquetCompressionCodec">parquetCompressionCodec(parquetCompressionCodec = gzip)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.compression.codec</code> <br />
 <span style="color:grey">Parquet压缩编解码方式名称。默认值为gzip。可能的选项是[gzip | snappy | uncompressed | lzo]</span></p>
 
-<h5 id="logFileMaxSize">logFileMaxSize(logFileSize = 1GB)</h5>
+<h4 id="logFileMaxSize">logFileMaxSize(logFileSize = 1GB)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.logfile.max.size</code> <br />
 <span style="color:grey">LogFile的最大大小。这是在将日志文件移到下一个版本之前允许的最大大小。</span></p>
 
-<h5 id="logFileDataBlockMaxSize">logFileDataBlockMaxSize(dataBlockSize = 256MB)</h5>
+<h4 id="logFileDataBlockMaxSize">logFileDataBlockMaxSize(dataBlockSize = 256MB)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.logfile.data.block.max.size</code> <br />
 <span style="color:grey">LogFile数据块的最大大小。这是允许将单个数据块附加到日志文件的最大大小。
 这有助于确保附加到日志文件的数据被分解为可调整大小的块,以防止发生OOM错误。此大小应大于JVM内存。</span></p>
 
-<h5 id="logFileToParquetCompressionRatio">logFileToParquetCompressionRatio(logFileToParquetCompressionRatio = 0.35)</h5>
+<h4 id="logFileToParquetCompressionRatio">logFileToParquetCompressionRatio(logFileToParquetCompressionRatio = 0.35)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.logfile.to.parquet.compression.ratio</code> <br />
 <span style="color:grey">随着记录从日志文件移动到parquet,预期会进行额外压缩的比例。
 用于merge_on_read存储,以将插入内容发送到日志文件中并控制压缩parquet文件的大小。</span></p>
 
-<h5 id="parquetCompressionCodec">parquetCompressionCodec(parquetCompressionCodec = gzip)</h5>
+<h4 id="parquetCompressionCodec">parquetCompressionCodec(parquetCompressionCodec = gzip)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.compression.codec</code> <br />
 <span style="color:grey">Parquet文件的压缩编解码方式</span></p>
 
-<h4 id="压缩compaction配置">压缩(Compaction)配置</h4>
+<h3 id="压缩配置">压缩配置</h3>
 <p>压缩配置用于控制压缩(将日志文件合并到新的parquet基本文件中)、清理(回收较旧及未使用的文件组)。
 <a href="#withCompactionConfig">withCompactionConfig</a> (HoodieCompactionConfig) <br /></p>
 
-<h5 id="withCleanerPolicy">withCleanerPolicy(policy = KEEP_LATEST_COMMITS)</h5>
+<h4 id="withCleanerPolicy">withCleanerPolicy(policy = KEEP_LATEST_COMMITS)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.cleaner.policy</code> <br />
 <span style="color:grey">要使用的清理政策。Hudi将删除旧版本的parquet文件以回收空间。
 任何引用此版本文件的查询和计算都将失败。最好确保数据保留的时间超过最大查询执行时间。</span></p>
 
-<h5 id="retainCommits">retainCommits(no_of_commits_to_retain = 24)</h5>
+<h4 id="retainCommits">retainCommits(no_of_commits_to_retain = 24)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.cleaner.commits.retained</code> <br />
 <span style="color:grey">保留的提交数。因此,数据将保留为num_of_commits * time_between_commits(计划的)。
 这也直接转化为您可以逐步提取此数据集的数量</span></p>
 
-<h5 id="archiveCommitsWith">archiveCommitsWith(minCommits = 96, maxCommits = 128)</h5>
+<h4 id="archiveCommitsWith">archiveCommitsWith(minCommits = 96, maxCommits = 128)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.keep.min.commits</code>, <code class="highlighter-rouge">hoodie.keep.max.commits</code> <br />
 <span style="color:grey">每个提交都是<code class="highlighter-rouge">.hoodie</code>目录中的一个小文件。由于DFS通常不支持大量小文件,因此Hudi将较早的提交归档到顺序日志中。
 提交通过重命名提交文件以原子方式发布。</span></p>
 
-<h5 id="withCommitsArchivalBatchSize">withCommitsArchivalBatchSize(batch = 10)</h5>
+<h4 id="withCommitsArchivalBatchSize">withCommitsArchivalBatchSize(batch = 10)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.commits.archival.batch</code> <br />
 <span style="color:grey">这控制着批量读取并一起归档的提交即时的数量。</span></p>
 
-<h5 id="compactionSmallFileSize">compactionSmallFileSize(size = 0)</h5>
+<h4 id="compactionSmallFileSize">compactionSmallFileSize(size = 0)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.parquet.small.file.limit</code> <br />
 <span style="color:grey">该值应小于maxFileSize,如果将其设置为0,会关闭此功能。
 由于批处理中分区中插入记录的数量众多,总会出现小文件。
 Hudi提供了一个选项,可以通过将对该分区中的插入作为对现有小文件的更新来解决小文件的问题。
 此处的大小是被视为“小文件大小”的最小文件大小。</span></p>
 
-<h5 id="insertSplitSize">insertSplitSize(size = 500000)</h5>
+<h4 id="insertSplitSize">insertSplitSize(size = 500000)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.copyonwrite.insert.split.size</code> <br />
 <span style="color:grey">插入写入并行度。为单个分区的总共插入次数。
 写出100MB的文件,至少1kb大小的记录,意味着每个文件有100K记录。默认值是超额配置为500K。
 为了改善插入延迟,请对其进行调整以匹配单个文件中的记录数。
 将此值设置为较小的值将导致文件变小(尤其是当compactionSmallFileSize为0时)</span></p>
 
-<h5 id="autoTuneInsertSplits">autoTuneInsertSplits(true)</h5>
+<h4 id="autoTuneInsertSplits">autoTuneInsertSplits(true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.copyonwrite.insert.auto.split</code> <br />
 <span style="color:grey">Hudi是否应该基于最后24个提交的元数据动态计算insertSplitSize。默认关闭。</span></p>
 
-<h5 id="approxRecordSize">approxRecordSize(size = 1024)</h5>
+<h4 id="approxRecordSize">approxRecordSize(size = 1024)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.copyonwrite.record.size.estimate</code> <br />
 <span style="color:grey">平均记录大小。如果指定,hudi将使用它,并且不会基于最后24个提交的元数据动态地计算。
 没有默认值设置。这对于计算插入并行度以及将插入打包到小文件中至关重要。如上所述。</span></p>
 
-<h5 id="withInlineCompaction">withInlineCompaction(inlineCompaction = false)</h5>
+<h4 id="withInlineCompaction">withInlineCompaction(inlineCompaction = false)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compact.inline</code> <br />
 <span style="color:grey">当设置为true时,紧接在插入或插入更新或批量插入的提交或增量提交操作之后由摄取本身触发压缩</span></p>
 
-<h5 id="withMaxNumDeltaCommitsBeforeCompaction">withMaxNumDeltaCommitsBeforeCompaction(maxNumDeltaCommitsBeforeCompaction = 10)</h5>
+<h4 id="withMaxNumDeltaCommitsBeforeCompaction">withMaxNumDeltaCommitsBeforeCompaction(maxNumDeltaCommitsBeforeCompaction = 10)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compact.inline.max.delta.commits</code> <br />
 <span style="color:grey">触发内联压缩之前要保留的最大增量提交数</span></p>
 
-<h5 id="withCompactionLazyBlockReadEnabled">withCompactionLazyBlockReadEnabled(true)</h5>
+<h4 id="withCompactionLazyBlockReadEnabled">withCompactionLazyBlockReadEnabled(true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compaction.lazy.block.read</code> <br />
 <span style="color:grey">当CompactedLogScanner合并所有日志文件时,此配置有助于选择是否应延迟读取日志块。
 选择true以使用I/O密集型延迟块读取(低内存使用),或者为false来使用内存密集型立即块读取(高内存使用)</span></p>
 
-<h5 id="withCompactionReverseLogReadEnabled">withCompactionReverseLogReadEnabled(false)</h5>
+<h4 id="withCompactionReverseLogReadEnabled">withCompactionReverseLogReadEnabled(false)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compaction.reverse.log.read</code> <br />
 <span style="color:grey">HoodieLogFormatReader会从pos=0到pos=file_length向前读取日志文件。
 如果此配置设置为true,则Reader会从pos=file_length到pos=0反向读取日志文件</span></p>
 
-<h5 id="withCleanerParallelism">withCleanerParallelism(cleanerParallelism = 200)</h5>
+<h4 id="withCleanerParallelism">withCleanerParallelism(cleanerParallelism = 200)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.cleaner.parallelism</code> <br />
 <span style="color:grey">如果清理变慢,请增加此值。</span></p>
 
-<h5 id="withCompactionStrategy">withCompactionStrategy(compactionStrategy = org.apache.hudi.io.compact.strategy.LogFileSizeBasedCompactionStrategy)</h5>
+<h4 id="withCompactionStrategy">withCompactionStrategy(compactionStrategy = org.apache.hudi.io.compact.strategy.LogFileSizeBasedCompactionStrategy)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compaction.strategy</code> <br />
 <span style="color:grey">用来决定在每次压缩运行期间选择要压缩的文件组的压缩策略。
 默认情况下,Hudi选择具有累积最多未合并数据的日志文件</span></p>
 
-<h5 id="withTargetIOPerCompactionInMB">withTargetIOPerCompactionInMB(targetIOPerCompactionInMB = 500000)</h5>
+<h4 id="withTargetIOPerCompactionInMB">withTargetIOPerCompactionInMB(targetIOPerCompactionInMB = 500000)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compaction.target.io</code> <br />
 <span style="color:grey">LogFileSizeBasedCompactionStrategy的压缩运行期间要花费的MB量。当压缩以内联模式运行时,此值有助于限制摄取延迟。</span></p>
 
-<h5 id="withTargetPartitionsPerDayBasedCompaction">withTargetPartitionsPerDayBasedCompaction(targetPartitionsPerCompaction = 10)</h5>
+<h4 id="withTargetPartitionsPerDayBasedCompaction">withTargetPartitionsPerDayBasedCompaction(targetPartitionsPerCompaction = 10)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compaction.daybased.target</code> <br />
 <span style="color:grey">由org.apache.hudi.io.compact.strategy.DayBasedCompactionStrategy使用,表示在压缩运行期间要压缩的最新分区数。</span></p>
 
-<h5 id="payloadClassName">withPayloadClass(payloadClassName = org.apache.hudi.common.model.HoodieAvroPayload)</h5>
+<h4 id="payloadClassName">withPayloadClass(payloadClassName = org.apache.hudi.common.model.HoodieAvroPayload)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.compaction.payload.class</code> <br />
 <span style="color:grey">这需要与插入/插入更新过程中使用的类相同。
 就像写入一样,压缩也使用记录有效负载类将日志中的记录彼此合并,再次与基本文件合并,并生成压缩后要写入的最终记录。</span></p>
 
-<h4 id="指标配置">指标配置</h4>
+<h3 id="指标配置">指标配置</h3>
 <p>能够将Hudi指标报告给graphite。
 <a href="#withMetricsConfig">withMetricsConfig</a> (HoodieMetricsConfig) <br />
 <span style="color:grey">Hudi会发布有关每次提交、清理、回滚等的指标。</span></p>
 
-<h5 id="on">on(metricsOn = true)</h5>
+<h4 id="on">on(metricsOn = true)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.metrics.on</code> <br />
 <span style="color:grey">打开或关闭发送指标。默认情况下处于启用状态。</span></p>
 
-<h5 id="withReporterType">withReporterType(reporterType = GRAPHITE)</h5>
+<h4 id="withReporterType">withReporterType(reporterType = GRAPHITE)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.metrics.reporter.type</code> <br />
 <span style="color:grey">指标报告者的类型。默认使用graphite,也是唯一支持的类型。</span></p>
 
-<h5 id="toGraphiteHost">toGraphiteHost(host = localhost)</h5>
+<h4 id="toGraphiteHost">toGraphiteHost(host = localhost)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.metrics.graphite.host</code> <br />
 <span style="color:grey">要连接的graphite主机</span></p>
 
-<h5 id="onGraphitePort">onGraphitePort(port = 4756)</h5>
+<h4 id="onGraphitePort">onGraphitePort(port = 4756)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.metrics.graphite.port</code> <br />
 <span style="color:grey">要连接的graphite端口</span></p>
 
-<h5 id="usePrefix">usePrefix(prefix = “”)</h5>
+<h4 id="usePrefix">usePrefix(prefix = “”)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.metrics.graphite.metric.prefix</code> <br />
 <span style="color:grey">适用于所有指标的标准前缀。这有助于添加如数据中心、环境等信息</span></p>
 
-<h4 id="内存配置">内存配置</h4>
+<h3 id="内存配置">内存配置</h3>
 <p>控制由Hudi内部执行的压缩和合并的内存使用情况
 <a href="#withMemoryConfig">withMemoryConfig</a> (HoodieMemoryConfig) <br />
 <span style="color:grey">内存相关配置</span></p>
 
-<h5 id="withMaxMemoryFractionPerPartitionMerge">withMaxMemoryFractionPerPartitionMerge(maxMemoryFractionPerPartitionMerge = 0.6)</h5>
+<h4 id="withMaxMemoryFractionPerPartitionMerge">withMaxMemoryFractionPerPartitionMerge(maxMemoryFractionPerPartitionMerge = 0.6)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.memory.merge.fraction</code> <br />
 <span style="color:grey">该比例乘以用户内存比例(1-spark.memory.fraction)以获得合并期间要使用的堆空间的最终比例</span></p>
 
-<h5 id="withMaxMemorySizePerCompactionInBytes">withMaxMemorySizePerCompactionInBytes(maxMemorySizePerCompactionInBytes = 1GB)</h5>
+<h4 id="withMaxMemorySizePerCompactionInBytes">withMaxMemorySizePerCompactionInBytes(maxMemorySizePerCompactionInBytes = 1GB)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.memory.compaction.fraction</code> <br />
 <span style="color:grey">HoodieCompactedLogScanner读取日志块,将记录转换为HoodieRecords,然后合并这些日志块和记录。
 在任何时候,日志块中的条目数可以小于或等于相应的parquet文件中的条目数。这可能导致Scanner出现OOM。
 因此,可溢出的映射有助于减轻内存压力。使用此配置来设置可溢出映射的最大允许inMemory占用空间。</span></p>
 
-<h5 id="withWriteStatusFailureFraction">withWriteStatusFailureFraction(failureFraction = 0.1)</h5>
+<h4 id="withWriteStatusFailureFraction">withWriteStatusFailureFraction(failureFraction = 0.1)</h4>
 <p>属性:<code class="highlighter-rouge">hoodie.memory.writestatus.failure.fraction</code> <br />
 <span style="color:grey">此属性控制报告给驱动程序的失败记录和异常的比例</span></p>
 
+      </section>
 
-    <div class="tags">
-        
-    </div>
+      <a href="#masthead__inner-wrap" class="back-to-top">Back to top &uarr;</a>
 
-    
 
-</div>
+      
 
-<hr class="shaded"/>
-
-<footer>
-            <div class="row">
-                <div class="col-lg-12 footer">
-                  <p>
-                  Copyright &copy; <span id="copyright-year">2019</span> <a href="https://apache.org">The Apache Software Foundation</a>,
-                  Licensed under the Apache License, Version 2.0<br>
-                  Hudi, Apache and the Apache feather logo are trademarks of The Apache Software Foundation.| <a href="/privacy">Privacy Policy</a><br>
-                  <a class="footer-link-img" href="https://apache.org">
-                    <img src="/images/asf_logo.svg" alt="The Apache Software Foundation" height="100px" widh="50px"></a>
-                  </p>
-                  <p>
-                  Apache Hudi is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the <a href="http://incubator.apache.org/">Apache Incubator</a>.
-                  Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have
-                  stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a
-                  reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
-                  </p>
-                </div>
-                <div class="col-lg-12 footer">
-                  <div class="ui link list">
-                    <a class="item" rel="external" href="https://incubator.apache.org/"> Apache Incubator </a>
-                    <a class="item" rel="external" href="https://www.apache.org/"> About the ASF </a>
-                    <a class="item" rel="external" href="https://www.apache.org/events/current-event"> Events </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/thanks.html"> Thanks </a>
-                    <a class="item" rel="external" href="https://www.apache.org/foundation/sponsorship.html"> Become a Sponsor </a>
-                    <a class="item" rel="external" href="https://www.apache.org/security/"> Security </a>
-                    <a class="item" rel="external" href="https://www.apache.org/licenses/"> License </a>
-                  </div>
-                </div>
-            </div>
-</footer>
-
-
-        </div>
-        <div class="col-md-2">
-            
-            
-<!-- this handles the automatic toc. use ## for subheads to auto-generate the on-page minitoc. if you use html tags, you must supply an ID for the heading element in order for it to appear in the minitoc. -->
-<script>
-$( document ).ready(function() {
-  // Handler for .ready() called.
-
-$('#toc').toc({ minimumHeaders: 0, listType: 'ul', showSpeed: 0, headers: 'h2,h3,h4' });
-
-/* this offset helps account for the space taken up by the floating toolbar. */
-$('#toc').on('click', 'a', function() {
-  var target = $(this.getAttribute('href'))
-    , scroll_target = target.offset().top
+    </div>
 
... 51624 lines suppressed ...