You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2025/05/16 16:36:00 UTC
[jira] [Assigned] (IMPALA-14079) Catalog hits TSAN error during dataload
[ https://issues.apache.org/jira/browse/IMPALA-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Riza Suminto reassigned IMPALA-14079:
-------------------------------------
Assignee: Riza Suminto
> Catalog hits TSAN error during dataload
> ---------------------------------------
>
> Key: IMPALA-14079
> URL: https://issues.apache.org/jira/browse/IMPALA-14079
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 5.0.0
> Reporter: Joe McDonnell
> Assignee: Riza Suminto
> Priority: Blocker
>
> The TSAN job is failing during dataload with this error in the catalogd ERROR log:
> {noformat}
> WARNING: ThreadSanitizer: data race (pid=25180)
> Read of size 1 at 0x7b10000bd0f0 by thread T84:
> #0 impala::CatalogServiceThriftIf::AcceptRequest(impala::CatalogServiceVersion::type) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:566:28 (impalad+0x2107287)
> #1 impala::CatalogServiceThriftIf::ExecDdl(impala::TDdlExecResponse&, impala::TDdlExecRequest const&) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:348:21 (impalad+0x2104302)
> #2 impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::process_ExecDdl(int, apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, void*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3172:13 (impalad+0x2017d63)
> #3 impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, void*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3124:3 (impalad+0x2021822)
> #4 apache::thrift::TDispatchProcessor::process(std::shared_ptr<apache::thrift::protocol::TProtocol>, std::shared_ptr<apache::thrift::protocol::TProtocol>, void*) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/thrift-0.16.0-p7/include/thrift/TDispatchProcessor.h:121:12 (impalad+0x202159e)
> #5 apache::thrift::server::TAcceptQueueServer::Task::run() /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/rpc/TAcceptQueueServer.cpp:84:26 .(impalad+0x265a5b4)
> ...
> p1/libs/thread/src/pthread/thread.cpp:179:37 (impalad+0x3c80856) Previous write of size 1 at 0x7b10000bd0f0 by thread T82:
> #0 impala::CatalogServiceThriftIf::AcceptRequest(impala::CatalogServiceVersion::type) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:571:36 (impalad+0x2107309)
> #1 impala::CatalogServiceThriftIf::ExecDdl(impala::TDdlExecResponse&, impala::TDdlExecRequest const&) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:348:21 (impalad+0x2104302)
> #2 impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::process_ExecDdl(int, apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, void*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3172:13 (impalad+0x2017d63)
> #3 impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, void*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3124:3 (impalad+0x2021822)
> #4 apache::thrift::TDispatchProcessor::process(std::shared_ptr<apache::thrift::protocol::TProtocol>, std::shared_ptr<apache::thrift::protocol::TProtocol>, void*) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/thrift-0.16.0-p7/include/thrift/TDispatchProcessor.h:121:12 (impalad+0x202159e)
> #5 apache::thrift::server::TAcceptQueueServer::Task::run() /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/rpc/TAcceptQueueServer.cpp:84:26 (impalad+0x265a5b4){noformat}
> It looks like a race on has_initiated_first_reset_ and came in with "IMPALA-13850 (part 2): Fix bug found by test_restart_services.py". has_initiated_first_reset_ could be made into a std::atomic<bool>.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org