You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Vitalii Diravka (Jira)" <ji...@apache.org> on 2021/08/06 08:21:00 UTC
[jira] [Comment Edited] (DRILL-7973) Increase direct memory for
Drill build in CI to prevent OutOfMemoryException
[ https://issues.apache.org/jira/browse/DRILL-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394318#comment-17394318 ]
Vitalii Diravka edited comment on DRILL-7973 at 8/6/21, 8:20 AM:
-----------------------------------------------------------------
[~cgivre] You can monitor the current status of the [branch|https://github.com/vdiravka/drill/commits/DRILL-7973]. I performed separate CI build run for every change to make sure it enhances the successful builds probability.
I am going to open PR soon.
It will include the following improvements:
* added _fail-fast: false_ fot the CI to avoid build failures once other build is failed:
[https://github.community/t/error-the-operation-was-canceled-in-ci/166506/3]
[https://stackoverflow.com/questions/61070925/github-actions-disable-auto-cancel-when-job-fails]
[https://docs.github.com/en/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstrategyfail-fast]
* Clean memory for the container running:
[https://github.com/actions/virtual-environments/issues/1918]
* Fix for Cassandra connection timeout in scope of Test Container
* Update Maven Version _3.6.3_ -> _3.8.1_
* Update _actions/cache@v1 -> actions/cache@v2_
* Decrease Heap size for CI builds _-DmemoryMb=1600_
* Add info how to enable github Debug logging:
[https://docs.github.com/en/actions/managing-workflow-runs/enabling-debug-logging]
[https://github.community/t/ci-access-to-shell-session/17250]
https://issues.apache.org/jira/browse/INFRA-20945
was (Author: vitalii):
[~cgivre] You can monitor the current status of the [branch|https://github.com/vdiravka/drill/commits/DRILL-7973]. I performed separate CI build run for every change to make sure it enhances the successful builds probability.
I am going to open PR soon.
It will include the following improvements:
* added _fail-fast: false_ fot the CI to avoid build failures once other build is failed:
[https://github.community/t/error-the-operation-was-canceled-in-ci/166506/3]
[https://stackoverflow.com/questions/61070925/github-actions-disable-auto-cancel-when-job-fails]
[https://docs.github.com/en/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstrategyfail-fast]
* Clean memory for the container running:
[https://github.com/actions/virtual-environments/issues/1918]
* Fix for Cassandra connection timeout in scope of Test Container
* Update Maven Version _3.6.3_ -> _3.8.1_
_*_ Update _actions/cache@v1 -> actions/cache@v2_
_*_ Decrease Heap size for CI builds _-DmemoryMb=1600_
_*_ Add info how to enable github Debug logging:
[https://docs.github.com/en/actions/managing-workflow-runs/enabling-debug-logging]
[https://github.community/t/ci-access-to-shell-session/17250]
https://issues.apache.org/jira/browse/INFRA-20945
> Increase direct memory for Drill build in CI to prevent OutOfMemoryException
> ----------------------------------------------------------------------------
>
> Key: DRILL-7973
> URL: https://issues.apache.org/jira/browse/DRILL-7973
> Project: Apache Drill
> Issue Type: Sub-task
> Components: Tools, Build & Test
> Affects Versions: 1.19.0
> Reporter: Vitalii Diravka
> Assignee: Vitalii Diravka
> Priority: Major
> Fix For: 1.20.0
>
>
> I got locally:
> {code:java}
> [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.264 s - in org.apache.drill.exec.work.metadata.TestServerMetaProvider
> [ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.713 s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
> [ERROR] org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation Time elapsed: 0.084 s <<< ERROR!
> java.lang.Exception: Unexpected exception, expected<org.apache.drill.exec.exception.OversizedAllocationException> but was<org.apache.drill.exec.exception.OutOfMemoryException>
> at org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 2147483644 byte(s) of direct memory (used: 872415232, max: 2621440000)
> at org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR] org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation Time elapsed: 0.013 s <<< ERROR!
> java.lang.Exception: Unexpected exception, expected<org.apache.drill.exec.exception.OversizedAllocationException> but was<org.apache.drill.exec.exception.OutOfMemoryException>
> at org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 2147483647 byte(s) of direct memory (used: 872415232, max: 2621440000)
> at org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> {code}
> for the command:
> {code:java}
> drill$ mvn install -V -ntp -DdirectMemoryMb=2500 -DmemoryMb=2000{code}
> and
> {code:java}
> [INFO] Running org.apache.drill.exec.work.metadata.TestServerMetaProvider
> [ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6.358 s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
> [ERROR] org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation Time elapsed: 0.048 s <<< ERROR!
> java.lang.Exception: Unexpected exception, expected<org.apache.drill.exec.exception.OversizedAllocationException> but was<org.apache.drill.exec.exception.OutOfMemoryException>
> at org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 2147483644 byte(s) of direct memory (used: 989855744, max: 2936012800)
> at org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR] org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation Time elapsed: 0.008 s <<< ERROR!
> java.lang.Exception: Unexpected exception, expected<org.apache.drill.exec.exception.OversizedAllocationException> but was<org.apache.drill.exec.exception.OutOfMemoryException>
> at org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 2147483647 byte(s) of direct memory (used: 989855744, max: 2936012800)
> at org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> {code}
> for the command:
> {code:java}
> mvn install -V -ntp -DdirectMemoryMb=2800 -DmemoryMb=2000
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)