You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by "Dineshkumar Yadav (Jira)" <ji...@apache.org> on 2026/05/20 12:28:00 UTC

[jira] [Commented] (RANGER-5605) Fix Ranger build failure when triggered through Docker

    [ https://issues.apache.org/jira/browse/RANGER-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18082304#comment-18082304 ] 

Dineshkumar Yadav commented on RANGER-5605:
-------------------------------------------

Root Cause Analysis: Docker Build Failure — OutOfMemoryError: Java heap space

The build fails during packaging of the schema-registry-plugin module with java.lang.OutOfMemoryError: Java heap space.

Root Cause:

Insufficient JVM heap in ranger-build.sh: MAVEN_OPTS was hardcoded to -Xms2g -Xmx2g, which is insufficient for this module. The schema-registry-plugin transitively pulls in software.amazon.awssdk:bundle:2.29.52 — a monolithic JAR (~500 MB on disk) that requires significant heap to process during the maven-shade-plugin packaging phase (Building jar: ranger-3.0.0-SNAPSHOT-schema-registry-plugin.jar).

 

 

> Fix Ranger build failure when triggered through Docker
> ------------------------------------------------------
>
>                 Key: RANGER-5605
>                 URL: https://issues.apache.org/jira/browse/RANGER-5605
>             Project: Ranger
>          Issue Type: Task
>          Components: Ranger
>            Reporter: Dineshkumar Yadav
>            Assignee: Dineshkumar Yadav
>            Priority: Major
>
> While building Ranger using the commands below:
> {{docker compose -f docker-compose.ranger-build.yml build}}
> {{docker compose -f docker-compose.ranger-build.yml up}}
> the build fails with the following error:
> {code:java}
> ranger-build  | [WARNING] The assembly descriptor contains a filesystem-root relative reference, which is not cross platform compatible /
> ranger-build  | [INFO] Building tar: /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-elasticsearch-plugin.tar.gz
> ranger-build  | [INFO] Building tar: /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-audit-ingestor.tar.gz
> ranger-build  | [INFO] Building tar: /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-audit-dispatcher.tar.gz
> ranger-build  | [INFO] Building jar: /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-schema-registry-plugin.jar
> ranger-build  | [1216.203s][warning][gc,alloc] pool-110-thread-1: Retried waiting for GCLocker too often allocating 333 words
> ranger-build  | Exception in thread "pool-110-thread-7" java.lang.OutOfMemoryError: Java heap space
> ranger-build  | 	at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1617)
> ranger-build  | 	at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
> ranger-build  | 	at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062)
> ranger-build  | 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122)
> ranger-build  | 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> ranger-build  | 	at java.base/java.lang.Thread.run(Thread.java:840)
> ranger-build  | Cleaning up unclosed ZipFile for archive /home/ranger/.m2/repository/software/amazon/awssdk/bundle/2.29.52/bundle-2.29.52.jar
> ranger-build  | Exception in thread "pool-110-thread-12" java.lang.OutOfMemoryError: Java heap space
> ranger-build  | 	at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1617)
> ranger-build  | 	at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
> ranger-build  | 	at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062)
> ranger-build  | 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122)
> ranger-build  | 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> ranger-build  | 	at java.base/java.lang.Thread.run(Thread.java:840)
> ranger-build  | [INFO] ------------------------------------------------------------------------
> ranger-build  | [INFO] Reactor Summary for ranger 3.0.0-SNAPSHOT:
> ranger-build  | [INFO] 
> ranger-build  | [INFO] ranger ............................................. SUCCESS [  5.032 s]
> ranger-build  | [INFO] Credential Support ................................. SUCCESS [  7.376 s]
> ranger-build  | [INFO] Audit Component .................................... SUCCESS [  7.638 s]
> ranger-build  | [INFO] Ranger Authorization API ........................... SUCCESS [  3.719 s]
> ranger-build  | [INFO] ranger-common-utils ................................ SUCCESS [  3.350 s]
> ranger-build  | [INFO] ranger-plugin-classloader .......................... SUCCESS [  2.154 s]
> ranger-build  | [INFO] User Group Synchronizer Util ....................... SUCCESS [  3.529 s]
> ranger-build  | [INFO] Common library for Plugins ......................... SUCCESS [ 20.941 s]
> ranger-build  | [INFO] Ranger Audit Destination - auditserver ............. SUCCESS [  2.990 s]
> ranger-build  | [INFO] Ranger Audit Destination - CloudWatch .............. SUCCESS [  2.383 s]
> ranger-build  | [INFO] Ranger Audit Destination - Elasticsearch ........... SUCCESS [  4.250 s]
> ranger-build  | [INFO] Ranger Audit Destination - Hadoop FileSystem ....... SUCCESS [  2.700 s]
> ranger-build  | [INFO] Ranger Audit Destination - Kafka ................... SUCCESS [  1.895 s]
> ranger-build  | [INFO] Ranger Audit Destination - Log4j ................... SUCCESS [  1.776 s]
> ranger-build  | [INFO] Ranger Audit Destination - Solr .................... SUCCESS [  2.526 s]
> ranger-build  | [INFO] Ranger Audit Destination - ORC Util ................ SUCCESS [  2.139 s]
> ranger-build  | [INFO] Ranger Plugins Audit ............................... SUCCESS [  0.086 s]
> ranger-build  | [INFO] Installer Support Component ........................ SUCCESS [  1.372 s]
> ranger-build  | [INFO] Ranger Audit Server Common ......................... SUCCESS [  2.486 s]
> ranger-build  | [INFO] Ranger Audit Dispatcher Common ..................... SUCCESS [  5.577 s]
> ranger-build  | [INFO] Ranger Audit Dispatcher HDFS ....................... SUCCESS [ 11.178 s]
> ranger-build  | [INFO] Ranger Audit Dispatcher Solr ....................... SUCCESS [  5.387 s]
> ranger-build  | [INFO] Ranger Audit Dispatcher App ........................ SUCCESS [ 11.960 s]
> ranger-build  | [INFO] Ranger Audit Dispatcher Parent ..................... SUCCESS [  0.113 s]
> ranger-build  | [INFO] ranger-authn ....................................... SUCCESS [  3.299 s]
> ranger-build  | [INFO] Ranger Audit Ingestor .............................. SUCCESS [ 13.156 s]
> ranger-build  | [INFO] Ranger Audit Server Parent ......................... SUCCESS [  0.088 s]
> ranger-build  | [INFO] authz-embedded ..................................... SUCCESS [  6.304 s]
> ranger-build  | [INFO] Ranger Authorization Remote Client ................. SUCCESS [  3.131 s]
> ranger-build  | [INFO] Credential Builder ................................. SUCCESS [  3.308 s]
> ranger-build  | [INFO] Embedded Web Server Invoker ........................ SUCCESS [  3.863 s]
> ranger-build  | [INFO] Jdbc SQL Connector ................................. SUCCESS [  1.314 s]
> ranger-build  | [INFO] Ranger Util ........................................ SUCCESS [ 11.597 s]
> ranger-build  | [INFO] Ldap Config Check Tool ............................. SUCCESS [  1.804 s]
> ranger-build  | [INFO] Atlas Security Plugin .............................. SUCCESS [  8.853 s]
> ranger-build  | [INFO] Atlas Security Plugin Shim ......................... SUCCESS [  4.853 s]
> ranger-build  | [INFO] Ranger HA Common Library ........................... SUCCESS [  3.854 s]
> ranger-build  | [INFO] Elasticsearch Security Plugin Shim ................. SUCCESS [  2.109 s]
> ranger-build  | [INFO] Elasticsearch Security Plugin ...................... SUCCESS [  5.267 s]
> ranger-build  | [INFO] ranger-examples .................................... SUCCESS [  0.068 s]
> ranger-build  | [INFO] Ranger Examples - Conditions and ContextEnrichers .. SUCCESS [  3.500 s]
> ranger-build  | [INFO] Ranger Examples - Ranger Plugin for SampleApp ...... SUCCESS [  2.173 s]
> ranger-build  | [INFO] ranger-intg ........................................ SUCCESS [  4.615 s]
> ranger-build  | [INFO] sample-client ...................................... SUCCESS [  2.662 s]
> ranger-build  | [INFO] Ranger Examples - SampleApp ........................ SUCCESS [  0.991 s]
> ranger-build  | [INFO] Apache Ranger Examples Distribution ................ SUCCESS [  3.276 s]
> ranger-build  | [INFO] HBase Security Plugin Shim ......................... SUCCESS [ 12.781 s]
> ranger-build  | [INFO] HBase Security Plugin .............................. SUCCESS [ 12.550 s]
> ranger-build  | [INFO] Hdfs Security Plugin ............................... SUCCESS [ 10.778 s]
> ranger-build  | [INFO] Hdfs Security Plugin Shim .......................... SUCCESS [  1.469 s]
> ranger-build  | [INFO] Hive Security Plugin ............................... SUCCESS [ 27.536 s]
> ranger-build  | [INFO] Hive Security Plugin Shim .......................... SUCCESS [  5.709 s]
> ranger-build  | [INFO] KAFKA Security Plugin .............................. SUCCESS [  6.598 s]
> ranger-build  | [INFO] KAFKA Security Plugin Shim ......................... SUCCESS [  1.601 s]
> ranger-build  | [INFO] ranger-metrics ..................................... SUCCESS [  5.546 s]
> ranger-build  | [INFO] Key Management Service ............................. SUCCESS [ 21.521 s]
> ranger-build  | [INFO] KMS Security Plugin ................................ SUCCESS [ 11.591 s]
> ranger-build  | [INFO] KMS Security Plugin Shim ........................... SUCCESS [  5.336 s]
> ranger-build  | [INFO] Knox Security Plugin Shim .......................... SUCCESS [  4.296 s]
> ranger-build  | [INFO] Knox Security Plugin ............................... SUCCESS [ 14.860 s]
> ranger-build  | [INFO] Kudu Security Plugin ............................... SUCCESS [  2.190 s]
> ranger-build  | [INFO] Kylin Security Plugin .............................. SUCCESS [  7.741 s]
> ranger-build  | [INFO] Kylin Security Plugin Shim ......................... SUCCESS [  3.375 s]
> ranger-build  | [INFO] NestedStructure Security Plugin .................... SUCCESS [  6.303 s]
> ranger-build  | [INFO] NiFi Security Plugin ............................... SUCCESS [  7.749 s]
> ranger-build  | [INFO] NiFi Registry Security Plugin ...................... SUCCESS [  5.477 s]
> ranger-build  | [INFO] Ozone Security Plugin .............................. SUCCESS [ 10.712 s]
> ranger-build  | [INFO] OZONE Security Plugin Shim ......................... SUCCESS [  3.647 s]
> ranger-build  | [INFO] ranger-pdp ......................................... SUCCESS [  5.842 s]
> ranger-build  | [INFO] Presto Security Plugin ............................. SUCCESS [  5.485 s]
> ranger-build  | [INFO] Presto Security Plugin Shim ........................ SUCCESS [  2.153 s]
> ranger-build  | [INFO] SchemaRegistry Security Plugin ..................... SUCCESS [ 11.045 s]
> ranger-build  | [INFO] SOLR Security Plugin ............................... SUCCESS [  7.133 s]
> ranger-build  | [INFO] SOLR Security Plugin Shim .......................... SUCCESS [  3.349 s]
> ranger-build  | [INFO] Sqoop Security Plugin .............................. SUCCESS [  4.992 s]
> ranger-build  | [INFO] Sqoop Security Plugin Shim ......................... SUCCESS [  1.607 s]
> ranger-build  | [INFO] Storm Security Plugin .............................. SUCCESS [  5.664 s]
> ranger-build  | [INFO] Storm Security Plugin shim ......................... SUCCESS [  1.736 s]
> ranger-build  | [INFO] Tag Synchronizer ................................... SUCCESS [  9.514 s]
> ranger-build  | [INFO] Ranger Tools ....................................... SUCCESS [  5.472 s]
> ranger-build  | [INFO] Ranger Security Plugin for Trino ................... SUCCESS [  6.908 s]
> ranger-build  | [INFO] YARN Security Plugin ............................... SUCCESS [  3.397 s]
> ranger-build  | [INFO] YARN Security Plugin Shim .......................... SUCCESS [  2.361 s]
> ranger-build  | [INFO] Unix Authentication Client ......................... SUCCESS [  3.832 s]
> ranger-build  | [INFO] Security Admin Web Application ..................... SUCCESS [04:49 min]
> ranger-build  | [INFO] Unix User Group Synchronizer ....................... SUCCESS [ 11.071 s]
> ranger-build  | [INFO] Unix Authentication Service ........................ SUCCESS [  7.721 s]
> ranger-build  | [INFO] Apache Ranger Distribution ......................... FAILURE [07:38 min]
> ranger-build  | [INFO] ------------------------------------------------------------------------
> ranger-build  | [INFO] BUILD FAILURE
> ranger-build  | [INFO] ------------------------------------------------------------------------
> ranger-build  | [INFO] Total time:  20:40 min
> ranger-build  | [INFO] Finished at: 2026-05-20T07:49:51Z
> ranger-build  | [INFO] ------------------------------------------------------------------------
> ranger-build  | [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.6:single (default) on project ranger-distro: Failed to create assembly: Error creating assembly archive schema-registry-plugin: Problem creating jar: Execution exception: Java heap space -> [Help 1]
> ranger-build  | [ERROR] 
> ranger-build  | [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> ranger-build  | [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> ranger-build  | [ERROR] 
> ranger-build  | [ERROR] For more information about the errors and possible solutions, please read the following articles:
> ranger-build  | [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> ranger-build  | [ERROR] 
> ranger-build  | [ERROR] After correcting the problems, you can resume the build with the command
> ranger-build  | [ERROR]   mvn <args> -rf :ranger-distro {code}
> {{}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)