You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "Abacn (via GitHub)" <gi...@apache.org> on 2023/06/02 14:07:11 UTC
[GitHub] [beam] Abacn opened a new issue, #26985: [Failing Test]: Spark runner broken logging overflow
Abacn opened a new issue, #26985:
URL: https://github.com/apache/beam/issues/26985
### What happened?
Since Jun 1, 2023 all spark tests failing due to logger Overflow:
```
java.lang.StackOverflowError
at org.slf4j.impl.JDK14LoggerFactory.getLogger(JDK14LoggerFactory.java:58)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
at org.slf4j.bridge.SLF4JBridgeHandler.getSLF4JLogger(SLF4JBridgeHandler.java:202)
at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:293)
at java.util.logging.Logger.log(Logger.java:738)
at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:582)
at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:632)
at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:221)
at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:303)
at java.util.logging.Logger.log(Logger.java:738)
at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:582)
at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:632)
at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:221)
at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:303)
at java.util.logging.Logger.log(Logger.java:738)
at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:582)
at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:632)
at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:221)
at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:303)
at java.util.logging.Logger.log(Logger.java:738)
```
check the history of https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_Examples_Spark/
all 4 commits between the last green and first red run seems unrelated:
f5e17e3e3b9bf164381e84902108732a4f687552
3dd239e204593dd8fc67ceb4aaa558768fc3edbb
538c7bdd852bb86b01479f827935ea651ee3b3b8
e1b4ed355da518c49aa2971ba5ea4d079055b24e
Is it due to transitive dependency change?
### Issue Failure
Failure: Test is continually failing
### Issue Priority
Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)
### Issue Components
- [ ] Component: Python SDK
- [X] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [X] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn closed issue #26985: [Failing Test]: Spark runner broken logging overflow
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #26985: [Failing Test]: Spark runner broken logging overflow
URL: https://github.com/apache/beam/issues/26985
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] chamikaramj commented on issue #26985: [Failing Test]: Spark runner broken logging overflow
Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1574054012
Revert: https://github.com/apache/beam/pull/26990
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #26985: [Failing Test]: Spark runner broken logging overflow
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1573947501
CC: @chamikaramj
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] chamikaramj commented on issue #26985: [Failing Test]: Spark runner broken logging overflow
Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1574037852
Looking
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #26985: [Failing Test]: Spark runner broken logging overflow
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1573831270
A bisect shows the cause is #26834
```
git checkout e1b4ed355da518c49aa2971ba5ea4d079055b24e
./gradlew :runners:spark:3:examplesIntegrationTest --tests org.apache.beam.examples.WordCountIT.testE2EWordCount
org.apache.beam.examples.WordCountIT > testE2EWordCount FAILED
java.lang.StackOverflowError at JDK14LoggerFactory.java:58
git checkout 69c58a9e5ee972c0c49c86dfe974657e9eec70a5
./gradlew :runners:spark:3:examplesIntegrationTest --tests org.apache.beam.examples.WordCountIT.testE2EWordCount
BUILD SUCCESSFUL in 23s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] chamikaramj commented on issue #26985: [Failing Test]: Spark runner broken logging overflow
Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1574290683
Actually, have a proper fix now: https://github.com/apache/beam/pull/27001
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org