You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by GitBox <gi...@apache.org> on 2022/03/20 08:56:38 UTC
[GitHub] [drill] luocooong opened a new pull request #2500: DRILL-8172: Use the specified memory usage for Travis CI
luocooong opened a new pull request #2500:
URL: https://github.com/apache/drill/pull/2500
# [DRILL-8172](https://issues.apache.org/jira/browse/DRILL-8172): Use the specified memory usage for Travis CI
## Description
To-do.
## Documentation
N/A
## Testing
To-do.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] luocooong commented on pull request #2500: DRILL-8172: Use the specified memory usage for Travis CI
Posted by GitBox <gi...@apache.org>.
luocooong commented on pull request #2500:
URL: https://github.com/apache/drill/pull/2500#issuecomment-1073204983
<pre>
total used free shared buff/cache available
Mem: 7768 249 128 0 7391 7321
Swap: 0 0 0
</pre>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton commented on pull request #2500: DRILL-8172: Use the specified memory usage for Travis CI
Posted by GitBox <gi...@apache.org>.
jnturton commented on pull request #2500:
URL: https://github.com/apache/drill/pull/2500#issuecomment-1073221723
> ```
> [INFO] Running org.apache.drill.exec.server.TestDrillbitResilience
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.622 s <<< FAILURE! - in org.apache.drill.exec.server.TestDrillbitResilience
> [ERROR] org.apache.drill.exec.server.TestDrillbitResilience Time elapsed: 1.622 s <<< ERROR!
> java.util.ServiceConfigurationError: org.apache.hadoop.io.compress.CompressionCodec: Provider org.apache.hadoop.io.compress.BrotliCodec could not be instantiated
> at org.apache.drill.exec.server.TestDrillbitResilience.startSomeDrillbits(TestDrillbitResilience.java:154)
> Caused by: java.lang.UnsatisfiedLinkError: Couldn't load native library 'brotli'. [LoaderResult: os.name="Linux", os.arch="aarch64", os.version="5.4.0-1021-aws", java.vm.name="OpenJDK 64-Bit Server VM", java.vm.version="25.312-b07", java.vm.vendor="Private Build", alreadyLoaded="null", loadedFromSystemLibraryPath="false", nativeLibName="libbrotli.so", temporaryLibFile="/home/travis/build/apache/drill/exec/java-exec/target/brotli7597512439703457056/libbrotli.so", libNameWithinClasspath="/lib/linux-aarch64/libbrotli.so", usedThisClassloader="false", usedSystemClassloader="false", java.library.path="/usr/java/packages/lib/aarch64:/usr/lib/aarch64-linux-gnu/jni:/lib/aarch64-linux-gnu:/usr/lib/aarch64-linux-gnu:/usr/lib/jni:/lib:/usr/lib"]
> at org.apache.drill.exec.server.TestDrillbitResilience.startSomeDrillbits(TestDrillbitResilience.java:154)
> ```
@luocooong apologies, I clearly did not solve this issue when I believed I had. I will look again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton commented on a change in pull request #2500: DRILL-8172: Use the specified memory usage for Travis CI
Posted by GitBox <gi...@apache.org>.
jnturton commented on a change in pull request #2500:
URL: https://github.com/apache/drill/pull/2500#discussion_r830597920
##########
File path: exec/java-exec/pom.xml
##########
@@ -782,8 +782,7 @@
<id>linux-amd64</id>
<activation>
<os>
- <arch>amd64</arch>
- <name>Linux</name>
+ <arch>x86_64</arch>
Review comment:
It is only macOS that returns x86_64, IIRC. Windows and Linux return amd64 for this arch. I think the following will be enough to fix the Travis problem...
```
diff --git a/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java b/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
index 35335c2db..0ff029424 100644
--- a/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
+++ b/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
@@ -1001,8 +1001,7 @@ public class TestParquetWriter extends ClusterTest {
// Only attempt this test on Linux / amd64 because com.rdblue.brotli-codec
// only bundles natives for Mac and Linux on AMD64. See PARQUET-1975.
@Test
- @EnabledIfSystemProperty(named = "os.name", matches = "Linux")
- @EnabledIfSystemProperty(named = "os.arch", matches = "amd64")
+ @Ignore("Depends on platform specific library code.")
public void testTPCHReadWriteBrotli() throws Exception {
try {
client.alterSession(ExecConstants.PARQUET_WRITER_COMPRESSION_TYPE, "brotli");
```
##########
File path: exec/java-exec/pom.xml
##########
@@ -782,8 +782,7 @@
<id>linux-amd64</id>
<activation>
<os>
- <arch>amd64</arch>
- <name>Linux</name>
+ <arch>x86_64</arch>
Review comment:
@luocooong it is only macOS that returns x86_64, IIRC. Windows and Linux return amd64 for this arch. I think the following will be enough to fix the Travis problem...
```
diff --git a/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java b/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
index 35335c2db..0ff029424 100644
--- a/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
+++ b/exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
@@ -1001,8 +1001,7 @@ public class TestParquetWriter extends ClusterTest {
// Only attempt this test on Linux / amd64 because com.rdblue.brotli-codec
// only bundles natives for Mac and Linux on AMD64. See PARQUET-1975.
@Test
- @EnabledIfSystemProperty(named = "os.name", matches = "Linux")
- @EnabledIfSystemProperty(named = "os.arch", matches = "amd64")
+ @Ignore("Depends on platform specific library code.")
public void testTPCHReadWriteBrotli() throws Exception {
try {
client.alterSession(ExecConstants.PARQUET_WRITER_COMPRESSION_TYPE, "brotli");
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] luocooong commented on pull request #2500: DRILL-8172: Use the specified memory usage for Travis CI
Posted by GitBox <gi...@apache.org>.
luocooong commented on pull request #2500:
URL: https://github.com/apache/drill/pull/2500#issuecomment-1073205939
```
[INFO] Running org.apache.drill.exec.server.TestDrillbitResilience
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.622 s <<< FAILURE! - in org.apache.drill.exec.server.TestDrillbitResilience
[ERROR] org.apache.drill.exec.server.TestDrillbitResilience Time elapsed: 1.622 s <<< ERROR!
java.util.ServiceConfigurationError: org.apache.hadoop.io.compress.CompressionCodec: Provider org.apache.hadoop.io.compress.BrotliCodec could not be instantiated
at org.apache.drill.exec.server.TestDrillbitResilience.startSomeDrillbits(TestDrillbitResilience.java:154)
Caused by: java.lang.UnsatisfiedLinkError: Couldn't load native library 'brotli'. [LoaderResult: os.name="Linux", os.arch="aarch64", os.version="5.4.0-1021-aws", java.vm.name="OpenJDK 64-Bit Server VM", java.vm.version="25.312-b07", java.vm.vendor="Private Build", alreadyLoaded="null", loadedFromSystemLibraryPath="false", nativeLibName="libbrotli.so", temporaryLibFile="/home/travis/build/apache/drill/exec/java-exec/target/brotli7597512439703457056/libbrotli.so", libNameWithinClasspath="/lib/linux-aarch64/libbrotli.so", usedThisClassloader="false", usedSystemClassloader="false", java.library.path="/usr/java/packages/lib/aarch64:/usr/lib/aarch64-linux-gnu/jni:/lib/aarch64-linux-gnu:/usr/lib/aarch64-linux-gnu:/usr/lib/jni:/lib:/usr/lib"]
at org.apache.drill.exec.server.TestDrillbitResilience.startSomeDrillbits(TestDrillbitResilience.java:154)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton merged pull request #2500: DRILL-8172: Use the specified memory usage for Travis CI
Posted by GitBox <gi...@apache.org>.
jnturton merged pull request #2500:
URL: https://github.com/apache/drill/pull/2500
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org