You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/07/26 22:04:46 UTC
[GitHub] [iceberg] RussellSpitzer opened a new pull request #2872: Build: Remove Dependency on Test31 for Spark Tests
RussellSpitzer opened a new pull request #2872:
URL: https://github.com/apache/iceberg/pull/2872
Due to an issue with the build.gradle both the spark test and test31 modules were both running with Spark 3.1. Removing the inter dependency fixes the issue and both grade tasks now run with the correct respective spark versions.
@cwsteinbach
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer merged pull request #2872: Build: Run tests against Spark 3.0 and Spark 3.1
Posted by GitBox <gi...@apache.org>.
RussellSpitzer merged pull request #2872:
URL: https://github.com/apache/iceberg/pull/2872
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on pull request #2872: Build: Run tests against Spark 3.0 and Spark 3.1
Posted by GitBox <gi...@apache.org>.
RussellSpitzer commented on pull request #2872:
URL: https://github.com/apache/iceberg/pull/2872#issuecomment-887058647
@rdblue - @karuppayya noticed this when we were debugging the issue for #2783
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on pull request #2872: Build: Run tests against Spark 3.0 and Spark 3.1
Posted by GitBox <gi...@apache.org>.
RussellSpitzer commented on pull request #2872:
URL: https://github.com/apache/iceberg/pull/2872#issuecomment-887100753
Had to make an additional change to trigger both sets of tests to run during gradle check command, rerunning suite
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on pull request #2872: Build: Run tests against Spark 3.0 and Spark 3.1
Posted by GitBox <gi...@apache.org>.
RussellSpitzer commented on pull request #2872:
URL: https://github.com/apache/iceberg/pull/2872#issuecomment-887100371
```bash
➜ iceberg-master git:(FixBuildAgainstSparkVersions) ✗ g check --dry-run | grep testSpark31
:iceberg-spark3:testSpark31 SKIPPED
:iceberg-spark3-extensions:testSpark31 SKIPPED
```
```
➜ iceberg-master git:(FixBuildAgainstSparkVersions) ✗ g :iceberg-spark3:dependencies --configuration compileOnly | grep spark-hive
\--- org.apache.spark:spark-hive_2.12:3.0.3
➜ iceberg-master git:(FixBuildAgainstSparkVersions) ✗ g :iceberg-spark3:dependencies --configuration testRuntimeClasspath | grep spark-hive
+--- org.apache.spark:spark-hive_2.12:3.0.3
// Only compiles tests
➜ iceberg-master git:(FixBuildAgainstSparkVersions) ✗ g :iceberg-spark3:dependencies --configuration spark31CompileClasspath | grep spark-hive
+--- org.apache.spark:spark-hive_2.12:3.0.3 -> 3.1.1
+--- org.apache.spark:spark-hive_2.12:3.1.1 (*)
➜ iceberg-master git:(FixBuildAgainstSparkVersions) ✗ g :iceberg-spark3:dependencies --configuration spark31RuntimeClasspath | grep spark-hive
+--- org.apache.spark:spark-hive_2.12:3.0.3 -> 3.1.1
+--- org.apache.spark:spark-hive_2.12:3.1.1 (*)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org