You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by "hemanthumashankar0511 (via GitHub)" <gi...@apache.org> on 2026/09/01 09:06:06 UTC
Re: [PR] HIVE-29483: Implement an integration testing mechanism with real Tez on Yarn including resource localization [hive]
hemanthumashankar0511 commented on PR #6640:
URL: https://github.com/apache/hive/pull/6640#issuecomment-5491617508
Switched to docker-compose.yml + ComposeContainer. custom_hosts_file stays because the host JVM still needs namenode / resourcemanager → 127.0.0.1; Compose DNS only works inside the Docker network, not on the host OS.
Added ComposeImageSubstitutor + testcontainers.properties for withLocalCompose(false). Testcontainers’ default docker:24.0.2 helper is too old for Docker Desktop 25+ (API 1.43 vs 1.44+). The substitutor rewrites it to docker:27.5.1 so compose startup works on current dev machines without requiring a local docker compose binary
Limitation that needs to be addressed: For manual Beeline runs: avoid INSERT INTO ... VALUES (...) it stages data on the host filesystem and the Tez AM in Docker cannot read it. Use INSERT ... SELECT from tables backed by HDFS instead.
https://github.com/apache/hive/pull/6640/changes#diff-914621668d347d62a377c385f0b932e545b57d7eddcf31562cf86590109d72a6R117
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org