You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/09/19 05:42:13 UTC
[GitHub] [hudi] YannByron opened a new pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
YannByron opened a new pull request #3691:
URL: https://github.com/apache/hudi/pull/3691
Recently, fail to build hudi in master branch using `mvn clean package -DskipTest`.
The rroor message is as follows:
```
[ERROR] /hudi/hudi-integ-test/src/main/scala/org/apache/hudi/integ/testsuite/utils/SparkSqlUtils.scala:32: error: object avro is not a member of package org.apache.spark.sql
[ERROR] import org.apache.spark.sql.avro.SchemaConverters
[ERROR] ^
[ERROR] /hudi/hudi-integ-test/src/main/scala/org/apache/hudi/integ/testsuite/utils/SparkSqlUtils.scala:142: error: not found: value SchemaConverters
[ERROR] val structType = SchemaConverters.toSqlType(schema).dataType.asInstanceOf[StructType]
[ERROR] ^
[ERROR] two errors found```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
YannByron commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922423975
@nsivabalan can you help to run workflows?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922419073
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "575b8598e500d51cbc6c8b10312498af84e4967a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2292",
"triggerID" : "575b8598e500d51cbc6c8b10312498af84e4967a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 575b8598e500d51cbc6c8b10312498af84e4967a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2292)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-926084152
@YannByron : guess you missed the "s" in the end. just to package,
```
mvn package -DskipTests
```
not sure if you made a typo. But in original desc, I see you missed "s" in "-DskipTests"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-924486402
yeah, I could build successfully w/ master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
YannByron commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922679473
@xushiyan I have doubted this may be my local issue. Clean up my environment and local repo, but it still fails.
If you verify that is not a common problem, ignore it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922419073
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "575b8598e500d51cbc6c8b10312498af84e4967a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "575b8598e500d51cbc6c8b10312498af84e4967a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 575b8598e500d51cbc6c8b10312498af84e4967a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
YannByron commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-939213789
@nsivabalan I upgrade maven version to 3.8.x, and make it works. Thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-926083451
I tested in latest master and no issues. closing it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan closed pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan closed pull request #3691:
URL: https://github.com/apache/hudi/pull/3691
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-934384095
@YannByron : so apart from building/packing, were you looking for any assistance in running the test suite jobs a such ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-924486497
```
mvn package -DskipTests
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-939306069
cool.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922617121
@YannByron Don't see this is a problem. The package command ran ok on master. Can you confirm if this is a local issue in your environment?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron edited a comment on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
YannByron edited a comment on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922679473
@xushiyan I have doubted this may be my local issue. Clean up my environment and local repo, but it still fails.
If you verify that is not a common problem, ignore and close it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3691: [HUDI-2455] Adding spark_avro dependency to hudi-integ-test
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922419073
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "575b8598e500d51cbc6c8b10312498af84e4967a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2292",
"triggerID" : "575b8598e500d51cbc6c8b10312498af84e4967a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 575b8598e500d51cbc6c8b10312498af84e4967a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2292)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org