You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "Abacn (via GitHub)" <gi...@apache.org> on 2023/06/02 14:07:11 UTC

[GitHub] [beam] Abacn opened a new issue, #26985: [Failing Test]: Spark runner broken logging overflow

Abacn opened a new issue, #26985:
URL: https://github.com/apache/beam/issues/26985

   ### What happened?
   
   Since Jun 1, 2023 all spark tests failing due to logger Overflow:
   
   ```
   java.lang.StackOverflowError
   	at org.slf4j.impl.JDK14LoggerFactory.getLogger(JDK14LoggerFactory.java:58)
   	at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
   	at org.slf4j.bridge.SLF4JBridgeHandler.getSLF4JLogger(SLF4JBridgeHandler.java:202)
   	at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:293)
   	at java.util.logging.Logger.log(Logger.java:738)
   	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:582)
   	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:632)
   	at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:221)
   	at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:303)
   	at java.util.logging.Logger.log(Logger.java:738)
   	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:582)
   	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:632)
   	at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:221)
   	at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:303)
   	at java.util.logging.Logger.log(Logger.java:738)
   	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:582)
   	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:632)
   	at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:221)
   	at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:303)
   	at java.util.logging.Logger.log(Logger.java:738)
   ```
   
   check the history of https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_Examples_Spark/
   
   all 4 commits between the last green and first red run seems unrelated:
   
   f5e17e3e3b9bf164381e84902108732a4f687552
   3dd239e204593dd8fc67ceb4aaa558768fc3edbb
   538c7bdd852bb86b01479f827935ea651ee3b3b8
   e1b4ed355da518c49aa2971ba5ea4d079055b24e
   
   Is it due to transitive dependency change?
   
   
   ### Issue Failure
   
   Failure: Test is continually failing
   
   ### Issue Priority
   
   Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [X] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [X] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn closed issue #26985: [Failing Test]: Spark runner broken logging overflow

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #26985: [Failing Test]: Spark runner broken logging overflow
URL: https://github.com/apache/beam/issues/26985


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] chamikaramj commented on issue #26985: [Failing Test]: Spark runner broken logging overflow

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1574054012

   Revert: https://github.com/apache/beam/pull/26990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #26985: [Failing Test]: Spark runner broken logging overflow

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1573947501

   CC: @chamikaramj 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] chamikaramj commented on issue #26985: [Failing Test]: Spark runner broken logging overflow

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1574037852

   Looking


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #26985: [Failing Test]: Spark runner broken logging overflow

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1573831270

   A bisect shows the cause is #26834
   
   ```
   git checkout e1b4ed355da518c49aa2971ba5ea4d079055b24e
   ./gradlew :runners:spark:3:examplesIntegrationTest --tests org.apache.beam.examples.WordCountIT.testE2EWordCount
   
   org.apache.beam.examples.WordCountIT > testE2EWordCount FAILED
       java.lang.StackOverflowError at JDK14LoggerFactory.java:58
   
   git checkout 69c58a9e5ee972c0c49c86dfe974657e9eec70a5
   ./gradlew :runners:spark:3:examplesIntegrationTest --tests org.apache.beam.examples.WordCountIT.testE2EWordCount
   
   BUILD SUCCESSFUL in 23s
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] chamikaramj commented on issue #26985: [Failing Test]: Spark runner broken logging overflow

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #26985:
URL: https://github.com/apache/beam/issues/26985#issuecomment-1574290683

   Actually, have a proper fix now: https://github.com/apache/beam/pull/27001


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org