You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/09/15 23:45:16 UTC
[GitHub] [beam] shanemhansen opened a new issue, #23268: [Bug]: Java expansion server fails to start when there are too many classpath entries
shanemhansen opened a new issue, #23268:
URL: https://github.com/apache/beam/issues/23268
### What happened?
While attempting to use the builtin java expansion server to utilize a java Bigtable Source from python I ran into errors due to the generated temporary jar file being invalid. In particular `Class-Path: ` was too long and caused the jvm to fail to start with a "could not find main class" error.
I was able to track down the offending code and monkey-patch it so that it went from generating entries like this:
```
Class-Path: file1.jar file.jar .....
```
to
```
Class-Path: file1.jar
file2.jar
file3.jar
```
Which fixed the problem. See monkey-patched code here along with sample java project (apologies the gist isn't entirely complete. The '--classpath' entry was generated from the following command:
```sh
mvn dependency:build-classpath -Dmdep.outputFile=cp.txt
```
I believe this affects versions of beam since at least 6b9e37484038f0733db64af1c905adf7706f1d88 (and probably before since that was a revert).
I have an inbound PR which fixes this issue.
### Issue Priority
Priority: 2
### Issue Component
Component: sdk-py-core
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] shanemhansen commented on issue #23268: [Bug]: Java expansion server fails to start when there are too many classpath entries
Posted by GitBox <gi...@apache.org>.
shanemhansen commented on issue #23268:
URL: https://github.com/apache/beam/issues/23268#issuecomment-1248761073
Example monkey-patched code. https://gist.github.com/shanemhansen/c7b7fa4a0b5cea7a000f090c4728b68b
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] shanemhansen commented on issue #23268: [Bug]: Java expansion server fails to start when there are too many classpath entries
Posted by GitBox <gi...@apache.org>.
shanemhansen commented on issue #23268:
URL: https://github.com/apache/beam/issues/23268#issuecomment-1248761110
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] y1chi closed issue #23268: [Bug]: Java expansion server fails to start when there are too many classpath entries
Posted by GitBox <gi...@apache.org>.
y1chi closed issue #23268: [Bug]: Java expansion server fails to start when there are too many classpath entries
URL: https://github.com/apache/beam/issues/23268
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org