[jira] [Created] (IMPALA-12115) Must rebuild minicluster to switch filesystems

["Michael Smith (Jira)" <ji...@apache.org>]

Michael Smith created IMPALA-12115:
--------------------------------------

             Summary: Must rebuild minicluster to switch filesystems
                 Key: IMPALA-12115
                 URL: https://issues.apache.org/jira/browse/IMPALA-12115
             Project: IMPALA
          Issue Type: Task
          Components: Infrastructure
            Reporter: Michael Smith


When switching between HDFS, Ozone, S3, and erasure-coded variants, Impala's minicluster uses the same directory for config and data. That means any time you want to test a different one, you need to replace the current minicluster config/data (particularly data load) which can take awhile. When switching from erasure-coding, you usually need to wipe out the directory because it has too many nodes configured and build scripts don't know to clean them up.

It would be useful to be able to switch between these configurations more quickly in a dev environment by preserving each. You can manually do that by setting {{IMPALA_CLUSTER_NODES_DIR}}, but that's an extra step to remember to do every time. We should set the directory based on {{TARGET_FILESYSTEM}} and {{ERASURE_CODING}} so they're automatically preserved.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org