You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/02/15 23:16:00 UTC
[jira] [Work logged] (GOBBLIN-1610) Exclude Jackson from elasticsearch-deps for avoiding version conflict
[ https://issues.apache.org/jira/browse/GOBBLIN-1610?focusedWorklogId=727911&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-727911 ]
ASF GitHub Bot logged work on GOBBLIN-1610:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 15/Feb/22 23:15
Start Date: 15/Feb/22 23:15
Worklog Time Spent: 10m
Work Description: sekikn opened a new pull request #3468:
URL: https://github.com/apache/gobblin/pull/3468
Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
### JIRA
- [x] My PR addresses the following [Gobblin JIRA](https://issues.apache.org/jira/browse/GOBBLIN/) issues and references them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"
- https://issues.apache.org/jira/browse/GOBBLIN-1610
### Description
- [x] Here are some details about my PR, including screenshots (if applicable):
Currently, following the "Getting Started" guide fails due to Jackson's version conflict.
It comes from the gobblin-elasticsearch-deps module, so this PR excludes Jackson from its dependencies.
### Tests
- [x] My PR adds the following unit tests __OR__ does not need testing for this extremely good reason:
No additional test, since it's just a fix for a configuration file.
I ran `./gradlew :gobblin-modules:gobblin-elasticsearch:test` locally and confirmed it succeeded.
### Commits
- [ ] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "[How to write a good git commit message](http://chris.beams.io/posts/git-commit/)":
1. Subject is separated from body by a blank line
2. Subject is limited to 50 characters
3. Subject does not end with a period
4. Subject uses the imperative mood ("add", not "adding")
5. Body wraps at 72 characters
6. Body explains "what" and "why", not "how"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@gobblin.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 727911)
Remaining Estimate: 0h
Time Spent: 10m
> Exclude Jackson from elasticsearch-deps for avoiding version conflict
> ---------------------------------------------------------------------
>
> Key: GOBBLIN-1610
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1610
> Project: Apache Gobblin
> Issue Type: Bug
> Reporter: Kengo Seki
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> After merging GOBBLIN-1542, following the "Getting Started" guide fails as follows:
> {code}
> $ git checkout 678a3afa1
> $ ./gradlew clean
> $ ./gradlew :gobblin-distribution:buildDistributionTar
> ...
> BUILD SUCCESSFUL in 36s
> 147 actionable tasks: 142 executed, 5 up-to-date
> $ tar xf build/gobblin-distribution/distributions/apache-gobblin-incubating-bin-0.17.0.tar.gz -C /tmp
> $ cd /tmp/gobblin-dist
> $ bin/gobblin cli run wikipedia -lookback P10D LinkedIn Wikipedia:Sandbox
> ...
> 2022-02-16 07:51:22 JST ERROR [org.apache.gobblin.runtime.embedded.EmbeddedGobblin-thread-0] org.apache.gobblin.runtime.instance.DefaultGobblinInstanceDriverImpl$JobSpecRunnable - Job launch failed: java.lang.VerifyError: Stack map does not match the one at exception handler 77
> Exception Details:
> Location:
> com/fasterxml/jackson/databind/deser/std/StdDeserializer._parseDate(Lcom/fasterxml/jackson/core/JsonParser;Lcom/fasterxml/jackson/databind/DeserializationContext;)Ljava/util/Date; @77: astore
> Reason:
> Type 'com/fasterxml/jackson/core/JsonParseException' (current frame, stack[0]) is not assignable to 'com/fasterxml/jackson/core/exc/StreamReadException' (stack map, stack[0])
> Current Frame:
> bci: @69
> flags: { }
> locals: { 'com/fasterxml/jackson/databind/deser/std/StdDeserializer', 'com/fasterxml/jackson/core/JsonParser', 'com/fasterxml/jackson/databind/DeserializationContext' }
> stack: { 'com/fasterxml/jackson/core/JsonParseException' }
> Stackmap Frame:
> bci: @77
> flags: { }
> locals: { 'com/fasterxml/jackson/databind/deser/std/StdDeserializer', 'com/fasterxml/jackson/core/JsonParser', 'com/fasterxml/jackson/databind/DeserializationContext' }
> stack: { 'com/fasterxml/jackson/core/exc/StreamReadException' }
> Bytecode:
> 0x0000000: 2bb6 0035 aa00 0000 0000 0081 0000 0003
> 0x0000010: 0000 000b 0000 007a 0000 0081 0000 0081
> 0x0000020: 0000 0034 0000 0041 0000 0081 0000 0081
> 0x0000030: 0000 0081 0000 0071 2a2b b600 11b6 0012
> 0x0000040: 2cb6 006b b02b b600 4742 a700 223a 052c
> 0x0000050: 2ab4 0002 2bb6 006e 126f 03bd 0004 b600
> 0x0000060: 70c0 002d 3a06 1906 b600 4c42 bb00 7159
> 0x0000070: 21b7 0072 b02a 2cb6 0073 c000 71b0 2a2b
> 0x0000080: 2cb6 0074 b02c 2ab4 0002 2bb6 0025 c000
> 0x0000090: 71b0
> Exception Handler Table:
> bci [69, 74] => handler: 77
> bci [69, 74] => handler: 77
> Stackmap Table:
> same_frame(@56)
> same_frame(@69)
> same_locals_1_stack_item_frame(@77,Object[#367])
> append_frame(@108,Long)
> chop_frame(@117,1)
> same_frame(@126)
> same_frame(@133)
> {code}
> This is caused by Jackson's version conflict. In my environment, it comes from gobblin-elasticsearch-deps and removing Jackson from its dependencies works.
> {code}
> $ git diff
> diff --git a/gobblin-modules/gobblin-elasticsearch-deps/build.gradle b/gobblin-modules/gobblin-elasticsearch-deps/build.gradle
> index 2372c478f..79a6bb98f 100644
> --- a/gobblin-modules/gobblin-elasticsearch-deps/build.gradle
> +++ b/gobblin-modules/gobblin-elasticsearch-deps/build.gradle
> @@ -40,6 +40,7 @@ dependencies {
> configurations {
> compile {
> exclude group: "org.apache.hadoop"
> + exclude group: "com.fasterxml.jackson.core"
> exclude group: "com.sun.jersey.contribs"
> }
> }
> $ ./gradlew :gobblin-modules:gobblin-elasticsearch:test
> ...
> BUILD SUCCESSFUL in 2m 7s
> 85 actionable tasks: 81 executed, 4 up-to-date
> $ ./gradlew :gobblin-distribution:buildDistributionTar
> ...
> BUILD SUCCESSFUL in 21s
> 147 actionable tasks: 65 executed, 82 up-to-date
> $ rm -rf /tmp/gobblin-dist
> $ tar xf build/gobblin-distribution/distributions/apache-gobblin-incubating-bin-0.17.0.tar.gz -C /tmp
> $ cd /tmp/gobblin-dist
> $ bin/gobblin cli run wikipedia -lookback P10D LinkedIn Wikipedia:Sandbox
> ...
> 2022-02-16 08:03:53 JST INFO [ForkExecutor-1] org.apache.gobblin.writer.ConsoleWriter - {"revid":1070248862,"parentid":1070243271,"user":"Cyberbot I","userid":16266655,"timestamp":"2022-02-06T14:00:03Z","size":440,"pageid":16283969,"title":"Wikipedia:Sandbox"}
> ...
> $ echo $?
> 0
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)