You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Michael Brown (JIRA)" <ji...@apache.org> on 2018/03/26 16:39:00 UTC
[jira] [Updated] (KUDU-2375) Can't parse message of type
"kudu.master.SysTablesEntryPB" because it is missing required fields:
schema.columns[5].type
[ https://issues.apache.org/jira/browse/KUDU-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Brown updated KUDU-2375:
--------------------------------
Description:
A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the problem go away.
Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the backward incompatibility was not intended.
{noformat}
F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet metadata into memory failed: Corruption: Failed while visiting tables in sys catalog: unable to parse metadata field for row 467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of type "kudu.master.SysTablesEntryPB" because it is missing required fields: schema.columns[5].type
{noformat}
{noformat}
#0 0x0000003355e32625 in raise () from /lib64/libc.so.6
#1 0x0000003355e33e05 in abort () from /lib64/libc.so.6
#2 0x0000000001cea129 in ?? ()
#3 0x00000000009268cd in google::LogMessage::Fail() ()
#4 0x000000000092878d in google::LogMessage::SendToLog() ()
#5 0x0000000000926409 in google::LogMessage::Flush() ()
#6 0x000000000092922f in google::LogMessageFatal::~LogMessageFatal() ()
#7 0x00000000008f05de in ?? ()
#8 0x00000000008f6039 in kudu::master::CatalogManager::PrepareForLeadershipTask() ()
#9 0x0000000001d297d7 in kudu::ThreadPool::DispatchThread() ()
#10 0x0000000001d20151 in kudu::Thread::SuperviseThread(void*) ()
#11 0x0000003356207aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003355ee893d in clone () from /lib64/libc.so.6
{noformat}
was:
A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the problem go away.
Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the backward incompatibility was not intended.
{noformat}
I0324 17:45:10.681015 105716 catalog_manager.cc:306] Loaded metadata for table impala::tpcds_1000_kudu.web_returns [id=40c35b333fa84bb8ad331fab02e03fdf]
F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet metadata into memory failed: Corruption: Failed while visiting tables in sys catalog: unable to parse metadata field for row 467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of type "kudu.master.SysTablesEntryPB" because it is missing required fields: schema.columns[5].type
{noformat}
{noformat}
#0 0x0000003355e32625 in raise () from /lib64/libc.so.6
#1 0x0000003355e33e05 in abort () from /lib64/libc.so.6
#2 0x0000000001cea129 in ?? ()
#3 0x00000000009268cd in google::LogMessage::Fail() ()
#4 0x000000000092878d in google::LogMessage::SendToLog() ()
#5 0x0000000000926409 in google::LogMessage::Flush() ()
#6 0x000000000092922f in google::LogMessageFatal::~LogMessageFatal() ()
#7 0x00000000008f05de in ?? ()
#8 0x00000000008f6039 in kudu::master::CatalogManager::PrepareForLeadershipTask() ()
#9 0x0000000001d297d7 in kudu::ThreadPool::DispatchThread() ()
#10 0x0000000001d20151 in kudu::Thread::SuperviseThread(void*) ()
#11 0x0000003356207aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003355ee893d in clone () from /lib64/libc.so.6
{noformat}
This is on a long-lived cluster that has had Impala and Kudu slowly upgrading with mostly dev releases over time for a few months. Here's the Impala {{SHOW CREATE TABLE}}:
{noformat}
| CREATE TABLE tpcds_1000_kudu.web_returns ( |
| wr_returned_date_sk INT NOT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_order_number BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_item_sk BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_returned_time_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_refunded_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_refunded_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_refunded_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_refunded_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_returning_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_returning_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_returning_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_returning_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_web_page_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_reason_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_return_quantity INT NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_return_amt DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_return_tax DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_return_amt_inc_tax DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_fee DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_return_ship_cost DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_refunded_cash DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_reversed_charge DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_account_credit DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| wr_net_loss DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION DEFAULT_COMPRESSION, |
| PRIMARY KEY (wr_returned_date_sk, wr_order_number, wr_item_sk) |
| ) |
| PARTITION BY HASH (wr_order_number, wr_item_sk) PARTITIONS 140 |
| STORED AS KUDU |
| TBLPROPERTIES ('STATS_GENERATED_VIA_STATS_TASK'='true', 'kudu.master_addresses'='redacted', 'numRows'='68758263') |
{noformat}
> Can't parse message of type "kudu.master.SysTablesEntryPB" because it is missing required fields: schema.columns[5].type
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: KUDU-2375
> URL: https://issues.apache.org/jira/browse/KUDU-2375
> Project: Kudu
> Issue Type: Bug
> Components: master
> Affects Versions: 1.7.0
> Reporter: Michael Brown
> Priority: Blocker
>
> A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the problem go away.
> Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the backward incompatibility was not intended.
> {noformat}
> F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet metadata into memory failed: Corruption: Failed while visiting tables in sys catalog: unable to parse metadata field for row 467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of type "kudu.master.SysTablesEntryPB" because it is missing required fields: schema.columns[5].type
> {noformat}
> {noformat}
> #0 0x0000003355e32625 in raise () from /lib64/libc.so.6
> #1 0x0000003355e33e05 in abort () from /lib64/libc.so.6
> #2 0x0000000001cea129 in ?? ()
> #3 0x00000000009268cd in google::LogMessage::Fail() ()
> #4 0x000000000092878d in google::LogMessage::SendToLog() ()
> #5 0x0000000000926409 in google::LogMessage::Flush() ()
> #6 0x000000000092922f in google::LogMessageFatal::~LogMessageFatal() ()
> #7 0x00000000008f05de in ?? ()
> #8 0x00000000008f6039 in kudu::master::CatalogManager::PrepareForLeadershipTask() ()
> #9 0x0000000001d297d7 in kudu::ThreadPool::DispatchThread() ()
> #10 0x0000000001d20151 in kudu::Thread::SuperviseThread(void*) ()
> #11 0x0000003356207aa1 in start_thread () from /lib64/libpthread.so.0
> #12 0x0000003355ee893d in clone () from /lib64/libc.so.6
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)