You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Michael Smith (Jira)" <ji...@apache.org> on 2022/07/26 17:32:00 UTC

[jira] [Created] (IMPALA-11457) Ozone parallelism reduced when backends are co-located

Michael Smith created IMPALA-11457:
--------------------------------------

             Summary: Ozone parallelism reduced when backends are co-located
                 Key: IMPALA-11457
                 URL: https://issues.apache.org/jira/browse/IMPALA-11457
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 4.1.0
            Reporter: Michael Smith


When Impala and Ozone backends are co-located (at the same IP address), access to Ozone will use a local filesystem access path. It's supposed to assign each backend a separate disk ID so access happens in parallel, but a bug in assigning queues when storage ID is unknown results in all Ozone backends sharing the same queue. This results in reduced parallelism as the queue uses a single I/O thread.

To make Impala see Ozone as co-located in a dev environment, start Impala with {{--hostname=localhost}} (which is already the default for Ozone).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org