You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zhangbutao (via GitHub)" <gi...@apache.org> on 2024/04/01 07:19:58 UTC

[I] [Bug] Can not start BE in docker environment [doris]

zhangbutao opened a new issue, #33099:
URL: https://github.com/apache/doris/issues/33099

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   Latest main branch:
   Commit ID: 7338683fdbdf77711f2ce61e580c19f4ea100723
   
   ### What's Wrong?
   
   I followed this doc https://doris.apache.org/zh-CN/docs/install/source-install/compilation-general to build Doris source code  using Docker container. After building, I tried to start the BE daemon in this docker container, but occuring exception.
   
   I am sure i have built the source code by Docker container successfully, and if i start the BE daemon in local physical host, it can work fine. But if i try to start the BE in the Docker container(also used by source code build) `apache/doris:build-env-ldb-toolchain-latest`,  i can not make it work.
   
   
   So, how can i start the BE daemon in this Docker contaner?
   
   ### What You Expected?
   
   Run be in docker env
   
   ### How to Reproduce?
   
   1. build the Apache Doris latest code:
       Follow this build doc: https://doris.apache.org/zh-CN/docs/install/source-install/compilation-general
   ```
       docker pull apache/doris:build-env-ldb-toolchain-latest
   ```
   ```
       docker run -itd --network=host --name latestdorisdocker -v /root/.m2:/root/.m2 -v /souce_code/dorislatest/doris/:/root/doris- 
       source/ apache/doris:build-env-ldb-toolchain-latest
   ```
   
   ```
   export JAVA_HOME=/usr/lib/jvm/jdk-17.0.2
   /root/doris-source/build.sh
   ```
   
   2. Try to run BE daemon in this docker container
        `/root/doris-source/output/be/bin/start_be.sh --daemon`
    
     ###    Found that BE daemon started failed:
   **/root/doris-source/output/be/log/be.out**:
   ```
   start time: Mon Apr  1 06:52:59 UTC 2024
   INFO: java_cmd /usr/lib/jvm/jdk-17.0.2/bin/java
   INFO: jdk_version 17
   OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
   SLF4J: Class path contains multiple SLF4J bindings.
   SLF4J: Found binding in [jar:file:/root/doris-source/output/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/root/doris-source/output/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/root/doris-source/output/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
   SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
   OpenJDK 64-Bit Server VM warning: You have loaded library /root/doris-source/output/be/lib/hadoop_hdfs/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
   It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
   start BE in local mode
   *** Query id: 0-0 ***
   *** is nereids: 0 ***
   *** tablet id: 0 ***
   *** Aborted at 1711954381 (unix time) try "date -d @1711954381" if you are using GNU date ***
   *** Current BE git commitID: 7338683 ***
   *** SIGSEGV address not mapped to object (@0x0) received by PID 3553 (TID 4932 OR 0x7fa08f6a3700) from PID 0; stack trace: ***
    0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris-source/be/src/common/signal_handler.h:421
    1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /usr/lib/jvm/jdk-17.0.2/lib/server/libjvm.so
    2# JVM_handle_linux_signal in /usr/lib/jvm/jdk-17.0.2/lib/server/libjvm.so
    3# 0x00007FA451541400 in /lib64/libc.so.6
    4# je_arena_dalloc_promoted at /var/local/doris/thirdparty/src/jemalloc-5.3.0/doris_build/../src/arena.c:1277
    5# je_free_default at /var/local/doris/thirdparty/src/jemalloc-5.3.0/doris_build/../src/jemalloc.c:3014
    6# __GI__dl_deallocate_tls in /lib64/ld-linux-x86-64.so.2
    7# __free_stacks in /lib64/libpthread.so.0
    8# __deallocate_stack in /lib64/libpthread.so.0
    9# pthread_join in /lib64/libpthread.so.0
   10# std::thread::join() at ../../../../../libstdc++-v3/src/c++11/thread.cc:114
   11# rocksdb::VersionBuilder::Rep::LoadTableHandlers(rocksdb::InternalStats*, int, bool) in /root/doris-source/output/be/lib/doris_be
   12# rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool) in /root/doris-source/output/be/lib/doris_be
   13# rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool) in /root/doris-source/output/be/lib/doris_be
   14# rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**, bool) in /root/doris-source/output/be/lib/doris_be
   15# rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**) in /root/doris-source/output/be/lib/doris_be
   16# doris::OlapMeta::init() at /root/doris-source/be/src/olap/olap_meta.cpp:101
   17# doris::DataDir::_init_meta() at /root/doris-source/be/src/olap/data_dir.cpp:210
   18# doris::DataDir::init(bool) at /root/doris-source/be/src/olap/data_dir.cpp:157
   19# std::thread::_State_impl<std::thread::_Invoker<std::tuple<doris::StorageEngine::_init_store_map()::$_0> > >::_M_run() at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_thread.h:211
   20# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:84
   21# start_thread in /lib64/libpthread.so.0
   22# clone in /lib64/libc.so.6
   ```
   
   
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org