You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2023/03/07 02:15:51 UTC

[GitHub] [doris] morningman opened a new pull request, #17482: [refactor](libhdfs) introduce hadoop libhdfs

morningman opened a new pull request, #17482:
URL: https://github.com/apache/doris/pull/17482

   # Proposed changes
   
   Issue Number: close #xxx
   
   ## Problem summary
   
   1. Introduce hadoop libhdfs 
   2. For Linux-X86 platform, use the hadoop libhdfs
   3. For other platform, use libhdfs3, because currently we don't have  hadoop libhdfs binary for other platform
   
   Still WIP, this PR is just for review.
   
   ## Checklist(Required)
   
   * [ ] Does it affect the original behavior
   * [ ] Has unit tests been added
   * [ ] Has document been added or modified
   * [ ] Does it need to update dependencies
   * [ ] Is this PR support rollback (If NO, please explain WHY)
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] github-actions[bot] commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1487041724

   #### `sh-checker report`
   
   To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/4544490332") output.
   
   <details>
   <summary>shellcheck errors</summary>
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   ----------
   
   In bin/start_be.sh line 100:
   export CLASSPATH="${DORIS_HOME}/conf/:$DORIS_CLASSPATH"
                                         ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
   export CLASSPATH="${DORIS_HOME}/conf/:${DORIS_CLASSPATH}"
   
   
   In bin/start_be.sh line 262:
           export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/$jvm_arch/server:$JAVA_HOME/jre/lib/$jvm_arch:$LD_LIBRARY_PATH
                                  ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                     ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                      ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                         ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                                   ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${JAVA_HOME}/jre/lib/${jvm_arch}/server:${JAVA_HOME}/jre/lib/${jvm_arch}:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 263:
           export LD_LIBRARY_PATH=$DORIS_HOME/lib/hadoop_hdfs/native:$LD_LIBRARY_PATH
                                  ^---------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                     ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${DORIS_HOME}/lib/hadoop_hdfs/native:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 264:
           export LIBHDFS_OPTS="${JAVA_OPTS}"
                                ^----------^ SC2154 (warning): JAVA_OPTS is referenced but not assigned.
   
   
   In bin/start_be.sh line 269:
   echo "CLASSPATH: ${CLASSPATH}\n"
        ^-------------------------^ SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 270:
   echo "LD_LIBRARY_PATH: ${LD_LIBRARY_PATH}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 271:
   echo "LIBHDFS_OPTS: ${LIBHDFS_OPTS}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   For more information:
     https://www.shellcheck.net/wiki/SC2154 -- JAVA_OPTS is referenced but not a...
     https://www.shellcheck.net/wiki/SC2028 -- echo may not expand escape sequen...
     https://www.shellcheck.net/wiki/SC2250 -- Prefer putting braces around vari...
   ----------
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
     # shellcheck disable=NNNN
   above the line that contains the issue, where NNNN is the error code;
   3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   </details>
   
   <details>
   <summary>shfmt errors</summary>
   
   ```
   'shfmt ' found no issues.
   
   ```
   </details>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] morningman commented on a diff in pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on code in PR #17482:
URL: https://github.com/apache/doris/pull/17482#discussion_r1127273307


##########
be/src/io/fs/hdfs.h:
##########
@@ -0,0 +1,24 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+#pragma once
+
+#if defined(__x86_64__)

Review Comment:
   Should also check system os?



##########
be/src/util/hdfs_storage_backend.cpp:
##########
@@ -124,6 +128,7 @@ Status HDFSStorageBackend::direct_upload(const std::string& remote, const std::s
 Status HDFSStorageBackend::list(const std::string& remote_path, bool contain_md5, bool recursion,
                                 std::map<std::string, FileStat>* files) {
     CHECK_HDFS_CLIENT(_hdfs_fs);
+#if 0

Review Comment:
   Comment out temporarily, this class will be refactored



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] github-actions[bot] commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1484716067

   #### `sh-checker report`
   
   To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/4530282778") output.
   
   <details>
   <summary>shellcheck errors</summary>
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   ----------
   
   In bin/start_be.sh line 100:
   export CLASSPATH="${DORIS_HOME}/conf/:$DORIS_CLASSPATH"
                                         ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
   export CLASSPATH="${DORIS_HOME}/conf/:${DORIS_CLASSPATH}"
   
   
   In bin/start_be.sh line 262:
           export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/$jvm_arch/server:$JAVA_HOME/jre/lib/$jvm_arch:$LD_LIBRARY_PATH
                                  ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                     ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                      ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                         ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                                   ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${JAVA_HOME}/jre/lib/${jvm_arch}/server:${JAVA_HOME}/jre/lib/${jvm_arch}:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 263:
           export LD_LIBRARY_PATH=$DORIS_HOME/lib/hadoop_hdfs/native:$LD_LIBRARY_PATH
                                  ^---------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                     ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${DORIS_HOME}/lib/hadoop_hdfs/native:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 264:
           export LIBHDFS_OPTS="${JAVA_OPTS}"
                                ^----------^ SC2154 (warning): JAVA_OPTS is referenced but not assigned.
   
   
   In bin/start_be.sh line 269:
   echo "CLASSPATH: ${CLASSPATH}\n"
        ^-------------------------^ SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 270:
   echo "LD_LIBRARY_PATH: ${LD_LIBRARY_PATH}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 271:
   echo "LIBHDFS_OPTS: ${LIBHDFS_OPTS}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   For more information:
     https://www.shellcheck.net/wiki/SC2154 -- JAVA_OPTS is referenced but not a...
     https://www.shellcheck.net/wiki/SC2028 -- echo may not expand escape sequen...
     https://www.shellcheck.net/wiki/SC2250 -- Prefer putting braces around vari...
   ----------
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
     # shellcheck disable=NNNN
   above the line that contains the issue, where NNNN is the error code;
   3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   </details>
   
   <details>
   <summary>shfmt errors</summary>
   
   ```
   'shfmt ' found no issues.
   
   ```
   </details>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] github-actions[bot] commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1485133918

   #### `sh-checker report`
   
   To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/4532631900") output.
   
   <details>
   <summary>shellcheck errors</summary>
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   ----------
   
   In bin/start_be.sh line 100:
   export CLASSPATH="${DORIS_HOME}/conf/:$DORIS_CLASSPATH"
                                         ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
   export CLASSPATH="${DORIS_HOME}/conf/:${DORIS_CLASSPATH}"
   
   
   In bin/start_be.sh line 262:
           export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/$jvm_arch/server:$JAVA_HOME/jre/lib/$jvm_arch:$LD_LIBRARY_PATH
                                  ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                     ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                      ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                         ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                                   ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${JAVA_HOME}/jre/lib/${jvm_arch}/server:${JAVA_HOME}/jre/lib/${jvm_arch}:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 263:
           export LD_LIBRARY_PATH=$DORIS_HOME/lib/hadoop_hdfs/native:$LD_LIBRARY_PATH
                                  ^---------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                     ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${DORIS_HOME}/lib/hadoop_hdfs/native:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 264:
           export LIBHDFS_OPTS="${JAVA_OPTS}"
                                ^----------^ SC2154 (warning): JAVA_OPTS is referenced but not assigned.
   
   
   In bin/start_be.sh line 269:
   echo "CLASSPATH: ${CLASSPATH}\n"
        ^-------------------------^ SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 270:
   echo "LD_LIBRARY_PATH: ${LD_LIBRARY_PATH}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 271:
   echo "LIBHDFS_OPTS: ${LIBHDFS_OPTS}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   For more information:
     https://www.shellcheck.net/wiki/SC2154 -- JAVA_OPTS is referenced but not a...
     https://www.shellcheck.net/wiki/SC2028 -- echo may not expand escape sequen...
     https://www.shellcheck.net/wiki/SC2250 -- Prefer putting braces around vari...
   ----------
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
     # shellcheck disable=NNNN
   above the line that contains the issue, where NNNN is the error code;
   3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   </details>
   
   <details>
   <summary>shfmt errors</summary>
   
   ```
   'shfmt ' found no issues.
   
   ```
   </details>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] github-actions[bot] commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1485112375

   #### `sh-checker report`
   
   To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/4532520600") output.
   
   <details>
   <summary>shellcheck errors</summary>
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   ----------
   
   In bin/start_be.sh line 100:
   export CLASSPATH="${DORIS_HOME}/conf/:$DORIS_CLASSPATH"
                                         ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
   export CLASSPATH="${DORIS_HOME}/conf/:${DORIS_CLASSPATH}"
   
   
   In bin/start_be.sh line 262:
           export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/$jvm_arch/server:$JAVA_HOME/jre/lib/$jvm_arch:$LD_LIBRARY_PATH
                                  ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                     ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                      ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                         ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                                   ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${JAVA_HOME}/jre/lib/${jvm_arch}/server:${JAVA_HOME}/jre/lib/${jvm_arch}:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 263:
           export LD_LIBRARY_PATH=$DORIS_HOME/lib/hadoop_hdfs/native:$LD_LIBRARY_PATH
                                  ^---------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                     ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${DORIS_HOME}/lib/hadoop_hdfs/native:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 264:
           export LIBHDFS_OPTS="${JAVA_OPTS}"
                                ^----------^ SC2154 (warning): JAVA_OPTS is referenced but not assigned.
   
   
   In bin/start_be.sh line 269:
   echo "CLASSPATH: ${CLASSPATH}\n"
        ^-------------------------^ SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 270:
   echo "LD_LIBRARY_PATH: ${LD_LIBRARY_PATH}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 271:
   echo "LIBHDFS_OPTS: ${LIBHDFS_OPTS}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   For more information:
     https://www.shellcheck.net/wiki/SC2154 -- JAVA_OPTS is referenced but not a...
     https://www.shellcheck.net/wiki/SC2028 -- echo may not expand escape sequen...
     https://www.shellcheck.net/wiki/SC2250 -- Prefer putting braces around vari...
   ----------
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
     # shellcheck disable=NNNN
   above the line that contains the issue, where NNNN is the error code;
   3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   </details>
   
   <details>
   <summary>shfmt errors</summary>
   
   ```
   'shfmt ' found no issues.
   
   ```
   </details>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] github-actions[bot] commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1486319946

   #### `sh-checker report`
   
   To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/4540182748") output.
   
   <details>
   <summary>shellcheck errors</summary>
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   ----------
   
   In bin/start_be.sh line 100:
   export CLASSPATH="${DORIS_HOME}/conf/:$DORIS_CLASSPATH"
                                         ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
   export CLASSPATH="${DORIS_HOME}/conf/:${DORIS_CLASSPATH}"
   
   
   In bin/start_be.sh line 262:
           export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/$jvm_arch/server:$JAVA_HOME/jre/lib/$jvm_arch:$LD_LIBRARY_PATH
                                  ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                     ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                      ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                         ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                                   ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${JAVA_HOME}/jre/lib/${jvm_arch}/server:${JAVA_HOME}/jre/lib/${jvm_arch}:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 263:
           export LD_LIBRARY_PATH=$DORIS_HOME/lib/hadoop_hdfs/native:$LD_LIBRARY_PATH
                                  ^---------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                     ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${DORIS_HOME}/lib/hadoop_hdfs/native:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 264:
           export LIBHDFS_OPTS="${JAVA_OPTS}"
                                ^----------^ SC2154 (warning): JAVA_OPTS is referenced but not assigned.
   
   
   In bin/start_be.sh line 269:
   echo "CLASSPATH: ${CLASSPATH}\n"
        ^-------------------------^ SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 270:
   echo "LD_LIBRARY_PATH: ${LD_LIBRARY_PATH}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 271:
   echo "LIBHDFS_OPTS: ${LIBHDFS_OPTS}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   For more information:
     https://www.shellcheck.net/wiki/SC2154 -- JAVA_OPTS is referenced but not a...
     https://www.shellcheck.net/wiki/SC2028 -- echo may not expand escape sequen...
     https://www.shellcheck.net/wiki/SC2250 -- Prefer putting braces around vari...
   ----------
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
     # shellcheck disable=NNNN
   above the line that contains the issue, where NNNN is the error code;
   3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   </details>
   
   <details>
   <summary>shfmt errors</summary>
   
   ```
   'shfmt ' found no issues.
   
   ```
   </details>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] github-actions[bot] commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1457395830

   #### `sh-checker report`
   
   To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/4349933410") output.
   
   <details>
   <summary>shellcheck errors</summary>
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   ----------
   
   In bin/start_be.sh line 100:
   export CLASSPATH="${DORIS_HOME}/conf/:$DORIS_CLASSPATH"
                                         ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
   export CLASSPATH="${DORIS_HOME}/conf/:${DORIS_CLASSPATH}"
   
   
   In bin/start_be.sh line 262:
           export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/$jvm_arch/server:$JAVA_HOME/jre/lib/$jvm_arch:$LD_LIBRARY_PATH
                                  ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                     ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                      ^--------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                         ^-------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                                                   ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${JAVA_HOME}/jre/lib/${jvm_arch}/server:${JAVA_HOME}/jre/lib/${jvm_arch}:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 263:
           export LD_LIBRARY_PATH=$DORIS_HOME/lib/hadoop_hdfs/native:$LD_LIBRARY_PATH
                                  ^---------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
                                                                     ^--------------^ SC2250 (style): Prefer putting braces around variable references even when not strictly required.
   
   Did you mean: 
           export LD_LIBRARY_PATH=${DORIS_HOME}/lib/hadoop_hdfs/native:${LD_LIBRARY_PATH}
   
   
   In bin/start_be.sh line 264:
           export LIBHDFS_OPTS="${JAVA_OPTS}"
                                ^----------^ SC2154 (warning): JAVA_OPTS is referenced but not assigned.
   
   
   In bin/start_be.sh line 269:
   echo "CLASSPATH: ${CLASSPATH}\n"
        ^-------------------------^ SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 270:
   echo "LD_LIBRARY_PATH: ${LD_LIBRARY_PATH}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   
   In bin/start_be.sh line 271:
   echo "LIBHDFS_OPTS: ${LIBHDFS_OPTS}\n"
        ^-- SC2028 (info): echo may not expand escape sequences. Use printf.
   
   For more information:
     https://www.shellcheck.net/wiki/SC2154 -- JAVA_OPTS is referenced but not a...
     https://www.shellcheck.net/wiki/SC2028 -- echo may not expand escape sequen...
     https://www.shellcheck.net/wiki/SC2250 -- Prefer putting braces around vari...
   ----------
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
     # shellcheck disable=NNNN
   above the line that contains the issue, where NNNN is the error code;
   3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   </details>
   
   <details>
   <summary>shfmt errors</summary>
   
   ```
   'shfmt ' found no issues.
   
   ```
   </details>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] morningman commented on pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #17482:
URL: https://github.com/apache/doris/pull/17482#issuecomment-1487985804

   see #18204


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] morningman closed pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman closed pull request #17482: [refactor](libhdfs) introduce hadoop libhdfs
URL: https://github.com/apache/doris/pull/17482


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org