You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@ozone.apache.org by gi...@apache.org on 2025/04/15 01:16:27 UTC
(ozone-site) branch asf-site updated: [auto] Generated docs from Apache Ozone master 3d8644e172208b0851cf811105a4cc07765d8c37
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/ozone-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 681394dd [auto] Generated docs from Apache Ozone master 3d8644e172208b0851cf811105a4cc07765d8c37
681394dd is described below
commit 681394dd4d3691fe7bc8da337b273f7a72bd64db
Author: Github Actions <no...@github.com>
AuthorDate: Tue Apr 15 01:16:23 2025 +0000
[auto] Generated docs from Apache Ozone master 3d8644e172208b0851cf811105a4cc07765d8c37
---
docs/edge/en/sitemap.xml | 2 +-
docs/edge/index.xml | 2 +-
docs/edge/sitemap.xml | 2 +-
docs/edge/start/fromsource.html | 82 +++++++++++++++++++++++++++++++++++------
docs/edge/start/index.xml | 2 +-
5 files changed, 75 insertions(+), 15 deletions(-)
diff --git a/docs/edge/en/sitemap.xml b/docs/edge/en/sitemap.xml
index d783a41d..ef0f4627 100644
--- a/docs/edge/en/sitemap.xml
+++ b/docs/edge/en/sitemap.xml
@@ -595,7 +595,7 @@
/>
</url><url>
<loc>/start/fromsource.html</loc>
- <lastmod>2021-11-04T09:06:13+01:00</lastmod>
+ <lastmod>2025-04-14T11:15:15-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
diff --git a/docs/edge/index.xml b/docs/edge/index.xml
index 89d6460a..3509700f 100644
--- a/docs/edge/index.xml
+++ b/docs/edge/index.xml
@@ -348,7 +348,7 @@
<link>/start/fromsource.html</link>
<pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
<guid>/start/fromsource.html</guid>
- <description><!---
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements. See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the "License"); you may not use this file except in compliance with
 the License. You may obtain a copy of the License at

 http: [...]
+ <description><!---
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements. See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the "License"); you may not use this file except in compliance with
 the License. You may obtain a copy of the License at

 http: [...]
</item>
<item>
<title>Ozone Debug</title>
diff --git a/docs/edge/sitemap.xml b/docs/edge/sitemap.xml
index bd4a8360..936685d7 100644
--- a/docs/edge/sitemap.xml
+++ b/docs/edge/sitemap.xml
@@ -4,7 +4,7 @@
<sitemap>
<loc>/en/sitemap.xml</loc>
- <lastmod>2025-04-03T11:39:45-07:00</lastmod>
+ <lastmod>2025-04-14T11:15:15-07:00</lastmod>
</sitemap>
diff --git a/docs/edge/start/fromsource.html b/docs/edge/start/fromsource.html
index 4299b6f6..073923e4 100644
--- a/docs/edge/start/fromsource.html
+++ b/docs/edge/start/fromsource.html
@@ -513,10 +513,17 @@ s=d.getElementsByTagName('script')[0];
<div class="panel-heading">Requirements</div>
<div class="panel-body">
<ul>
-<li>Java 1.8</li>
-<li>Maven</li>
+<li>x86 or ARM64</li>
+<li>Linux or MacOS</li>
+<li>JDK 1.8 or higher</li>
+<li><a href="https://maven.apache.org/download.cgi">Maven 3.6 or later</a></li>
+<li>Internet connection for first build (to fetch all Maven and Ozone dependencies)</li>
+</ul>
+<p>You will also need to install the following dependencies to build native code (optional):</p>
+<ul>
+<li>gcc</li>
+<li>cmake</li>
</ul>
-
</div>
</div>
@@ -525,19 +532,72 @@ s=d.getElementsByTagName('script')[0];
color="red">not</font>
planning to build sources yourself, you can safely skip this page.</p>
</div>
-<p>If you are a Hadoop ninja, and wise in the ways of Apache, you already know
-that a real Apache release is a source release.</p>
<p>If you want to build from sources, Please untar the source tarball (or clone the latest code
-from the <a href="https://github.com/apache/ozone">git repository</a>) and run the ozone build command. This instruction assumes that you have all the
-dependencies to build Hadoop on your build machine. If you need instructions
-on how to build Hadoop, please look at the Apache Hadoop Website.</p>
+from the <a href="https://github.com/apache/ozone">git repository</a>).</p>
+<h2 id="arm-based-linux">ARM-based Linux</h2>
+<p>If you are using an ARM-based Linux, patch protobuf 2.5.0 and build it from source.</p>
+<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>sudo yum install -y make cmake gcc g++ patch
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># or for Ubuntu and Debian:</span>
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># sudo apt-get install -y make cmake gcc g++ patch</span>
+</span></span><span style="display:flex;"><span>
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># Download protobuf 2.5.0 tarball</span>
+</span></span><span style="display:flex;"><span>curl -sSL https://github.com/protocolbuffers/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz | tar zx
+</span></span><span style="display:flex;"><span>cd protobuf-2.5.0
+</span></span><span style="display:flex;"><span>
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># patch protobuf 2.5.0</span>
+</span></span><span style="display:flex;"><span>curl -L -O https://gist.githubusercontent.com/liusheng/64aee1b27de037f8b9ccf1873b82c413/raw/118c2fce733a9a62a03281753572a45b6efb8639/protobuf-2.5.0-arm64.patch
+</span></span><span style="display:flex;"><span>patch -p1 < protobuf-2.5.0-arm64.patch
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># build protobuf</span>
+</span></span><span style="display:flex;"><span>./configure --disable-shared
+</span></span><span style="display:flex;"><span>make
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># install protoc to the local Maven repository</span>
+</span></span><span style="display:flex;"><span>mvn install:install-file -DgroupId<span style="color:#f92672">=</span>com.google.protobuf -DartifactId<span style="color:#f92672">=</span>protoc -Dversion<span style="color:#f92672">=</span>2.5.0 -Dclassifier<span style="color:#f92672">=</span>linux-aarch_64 -Dpackaging<span style="color:#f92672">=</span>exe -Dfile<span style="color:#f92672">=</span>src/protoc
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># workaround for Maven 3.9.x</span>
+</span></span><span style="display:flex;"><span>cp $HOME/.m2/repository/com/google/protobuf/protoc/2.5.0/protoc-2.5.0-linux-aarch_64 $HOME/.m2/repository/com/google/protobuf/protoc/2.5.0/protoc-2.5.0-linux-aarch_64.exe
+</span></span></code></pre></div><h2 id="arm-based-apple-silicon-apple-m1--etc">ARM-based Apple Silicon (Apple M1 … etc)</h2>
+<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>PROTOBUF_VERSION<span style="color:#f92672">=</span><span style="color:#e6db74">"3.7.1"</span>
+</span></span><span style="display:flex;"><span>curl -sSL https://github.com/protocolbuffers/protobuf/releases/download/v<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>/protobuf-all-<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>.tar.gz | tar zx
+</span></span><span style="display:flex;"><span>cd protobuf-<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>
+</span></span><span style="display:flex;"><span>./configure --disable-shared
+</span></span><span style="display:flex;"><span>make -j
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># install protoc to the local Maven repository</span>
+</span></span><span style="display:flex;"><span>mvn install:install-file -DgroupId<span style="color:#f92672">=</span>com.google.protobuf -DartifactId<span style="color:#f92672">=</span>protoc -Dversion<span style="color:#f92672">=</span><span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span> -Dclassifier<span style="color:#f92672">=</span>osx-aarch_64 -Dpackaging<span style="color:#f92672">=</span>exe -Dfile<span style="color:#f92672">=</span>src/protoc
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># workaround for Maven 3.9.x. Not needed for 3.8.x or earlier</span>
+</span></span><span style="display:flex;"><span>cp $HOME/.m2/repository/com/google/protobuf/protoc/<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>/protoc-<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>-osx-aarch_64 $HOME/.m2/repository/com/google/protobuf/protoc/<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>/protoc-<span style="color:#e6db74">${</span>PROTOBUF_VE [...]
+</span></span><span style="display:flex;"><span>
+</span></span><span style="display:flex;"><span>cd ..
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># Download protobuf 2.5.0 tarball</span>
+</span></span><span style="display:flex;"><span>PROTOBUF_VERSION<span style="color:#f92672">=</span><span style="color:#e6db74">"2.5.0"</span>
+</span></span><span style="display:flex;"><span>curl -sSL https://github.com/protocolbuffers/protobuf/releases/download/v<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>/protobuf-<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>.tar.gz | tar zx
+</span></span><span style="display:flex;"><span>cd protobuf-<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>
+</span></span><span style="display:flex;"><span>
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># patch protobuf 2.5.0</span>
+</span></span><span style="display:flex;"><span>curl -L -O https://gist.githubusercontent.com/liusheng/64aee1b27de037f8b9ccf1873b82c413/raw/118c2fce733a9a62a03281753572a45b6efb8639/protobuf-2.5.0-arm64.patch
+</span></span><span style="display:flex;"><span>patch -p1 < protobuf-2.5.0-arm64.patch
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># build protobuf</span>
+</span></span><span style="display:flex;"><span>./configure --disable-shared
+</span></span><span style="display:flex;"><span>make
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># install protoc to the local Maven repository</span>
+</span></span><span style="display:flex;"><span>mvn install:install-file -DgroupId<span style="color:#f92672">=</span>com.google.protobuf -DartifactId<span style="color:#f92672">=</span>protoc -Dversion<span style="color:#f92672">=</span><span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span> -Dclassifier<span style="color:#f92672">=</span>osx-aarch_64 -Dpackaging<span style="color:#f92672">=</span>exe -Dfile<span style="color:#f92672">=</span>src/protoc
+</span></span><span style="display:flex;"><span><span style="color:#75715e"># workaround for Maven 3.9.x. Not needed for 3.8.x or earlier</span>
+</span></span><span style="display:flex;"><span>cp $HOME/.m2/repository/com/google/protobuf/protoc/<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>/protoc-<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>-osx-aarch_64 $HOME/.m2/repository/com/google/protobuf/protoc/<span style="color:#e6db74">${</span>PROTOBUF_VERSION<span style="color:#e6db74">}</span>/protoc-<span style="color:#e6db74">${</span>PROTOBUF_VE [...]
+</span></span></code></pre></div><h2 id="build-ozone">Build Ozone</h2>
+<p>Run the ozone build command.</p>
<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>mvn clean package -DskipTests<span style="color:#f92672">=</span>true
</span></span></code></pre></div><p>This will build an <code>ozone-\<version\></code> directory in your <code>hadoop-ozone/dist/target</code> directory.</p>
<p>You can copy this tarball and use this instead of binary artifacts that are
provided along with the official release.</p>
-<p>To create tar file distribution, use the <code>-Pdist</code> profile:</p>
+<p>Depending on the network speed, the build can take anywhere from 10 minutes to 20 minutes.</p>
+<p>To create tarball file distribution, use the <code>-Pdist</code> profile:</p>
<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>mvn clean package -DskipTests<span style="color:#f92672">=</span>true -Pdist
-</span></span></code></pre></div><h2 id="how-to-run-ozone-from-build">How to run Ozone from build</h2>
+</span></span></code></pre></div><h2 id="other-useful-maven-build-options">Other useful Maven build options</h2>
+<ul>
+<li>Use <code>-DskipShade</code> to skip shaded Ozone FS jar file creation. Saves time, but you can’t test integration with other software that uses Ozone as a Hadoop-compatible file system.</li>
+<li>Use <code>-DskipRecon</code> to skip building Recon Web UI. It saves about 2 minutes.</li>
+<li>Use <code>-Dmaven.javadoc.skip=true</code> to skip building javadocs.</li>
+<li>Use <code>-Drocks_tools_native</code> to build the RocksDB native code for the Ozone Snapshot feature. This is optional and not required for building Ozone. It is only needed if you want to build the RocksDB native code for Ozone.</li>
+</ul>
+<h2 id="how-to-run-ozone-from-build">How to run Ozone from build</h2>
<p>When you have the new distribution, you can start a local cluster <a href="../start/runningviadocker.html">with docker-compose</a>.</p>
<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>cd hadoop-ozone/dist/target/ozone-X.X.X...
</span></span><span style="display:flex;"><span>cd compose/ozone
@@ -561,7 +621,7 @@ provided along with the official release.</p>
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: November 4, 2021 <a class="hide-child link primary-color" href="https://github.com/apache/ozone/commit/1cf43ace9603119b4895f1072ef828a5ae04514d">1cf43ace96</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: April 14, 2025 <a class="hide-child link primary-color" href="https://github.com/apache/ozone/commit/9e4da5bac25a356ff3704cc7d5f471757fbf08b2">9e4da5bac2</a>
</span>
</div>
</footer>
diff --git a/docs/edge/start/index.xml b/docs/edge/start/index.xml
index 75705640..d8f072dc 100644
--- a/docs/edge/start/index.xml
+++ b/docs/edge/start/index.xml
@@ -47,7 +47,7 @@
<link>/start/fromsource.html</link>
<pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
<guid>/start/fromsource.html</guid>
- <description><!---
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements. See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the "License"); you may not use this file except in compliance with
 the License. You may obtain a copy of the License at

 http: [...]
+ <description><!---
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements. See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the "License"); you may not use this file except in compliance with
 the License. You may obtain a copy of the License at

 http: [...]
</item>
</channel>
</rss>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org