You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Michael Brown (JIRA)" <ji...@apache.org> on 2018/11/06 21:38:00 UTC

[jira] [Resolved] (IMPALA-7809) test_concurrent_schema_change incompatible with Kudu 1.9

     [ https://issues.apache.org/jira/browse/IMPALA-7809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Brown resolved IMPALA-7809.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.2.0

> test_concurrent_schema_change incompatible with Kudu 1.9
> --------------------------------------------------------
>
>                 Key: IMPALA-7809
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7809
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>    Affects Versions: Impala 3.2.0
>            Reporter: Michael Brown
>            Assignee: Michael Brown
>            Priority: Blocker
>              Labels: broken-build
>             Fix For: Impala 3.2.0
>
>
> With Kudu 1.9, test_concurrent_schema_change incompatible fails because the message format is slightly different.
> {noformat}
> query_test/test_kudu.py:442: in test_concurrent_schema_change     assert "has fewer columns (1) than the SELECT / VALUES clause returns (2)" in msg \ E   assert ('has fewer columns (1) than the SELECT / VALUES clause returns (2)' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or "(type: TINYINT) is not compatible with column 'col1' (type: STRING)" in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or 'has fewer columns than expected.' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or 'Column col1 has unexpected type.' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or 'Client provided column col1[int64 NULLABLE] not present in tablet' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n')
> Stacktrace
> query_test/test_kudu.py:442: in test_concurrent_schema_change
>     assert "has fewer columns (1) than the SELECT / VALUES clause returns (2)" in msg \
> E   assert ('has fewer columns (1) than the SELECT / VALUES clause returns (2)' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or "(type: TINYINT) is not compatible with column 'col1' (type: STRING)" in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or 'has fewer columns than expected.' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or 'Column col1 has unexpected type.' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n' or 'Client provided column col1[int64 NULLABLE] not present in tablet' in 'ImpalaBeeswaxException:\n Query aborted:Kudu error(s) reported, first error: Invalid argument: Failed to write batch ...redacted.com:31201): Client provided column col1 INT64 NULLABLE not present in tablet (1 of 2 similar)\n\n')
> {noformat}
> We see that the message returned includes {{Client provided column col1 INT64 NULLABLE not present in tablet}} and the code is looking for:
> {noformat}
>  437     for error in insert_thread.errors:
>  438       msg = str(error)
>  439       # The first two are AnalysisExceptions, the next two come from KuduTableSink::Open()
>  440       # if the schema has changed since analysis, the last comes from the Kudu server if
>  441       # the schema changes between KuduTableSink::Open() and when the write ops are sent.
>  442       assert "has fewer columns (1) than the SELECT / VALUES clause returns (2)" in msg \
>  443         or "(type: TINYINT) is not compatible with column 'col1' (type: STRING)" in msg \
>  444         or "has fewer columns than expected." in msg \
>  445         or "Column col1 has unexpected type." in msg \
>  446         or "Client provided column col1[int64 NULLABLE] not present in tablet" in msg
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)