You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by GitBox <gi...@apache.org> on 2021/12/18 04:31:02 UTC
[GitHub] [nutch] lewismc opened a new pull request #717: NUTCH-2919 Upgrade to Tika 2.2.0
lewismc opened a new pull request #717:
URL: https://github.com/apache/nutch/pull/717
This PR addresses [NUTCH-2919](https://issues.apache.org/jira/browse/NUTCH-2919)
I'm performing some tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.1 and Any23 2.6
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1011617429
Anyone able to try this patch out?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: WIP NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1007867630
I just released Any23 2.6. I will update this PR once the release has hit the CDN.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1009313690
This PR also upgrades to Any23 2.6 to resolve potential classpath issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: WIP NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1005345130
May the force be with you @kennethmcfarland . Take care my friend.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc merged pull request #717: NUTCH-2919 Upgrade to Tika 2.2.1 and Any23 2.6
Posted by GitBox <gi...@apache.org>.
lewismc merged pull request #717:
URL: https://github.com/apache/nutch/pull/717
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.1 and Any23 2.6
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1013770346
Thanks @sebastian-nagel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1002883095
I was getting a local failure on [parse-tika's TestRTFParser](https://github.com/apache/nutch/blob/master/src/plugin/parse-tika/src/test/org/apache/nutch/parse/tika/TestRTFParser.java#L63) where it was attempting to use the deprecated [org.apache.tika.metadata.OfficeOpenXMLCore#SUBJECT](https://github.com/apache/tika/blob/main/tika-core/src/main/java/org/apache/tika/metadata/OfficeOpenXMLCore.java#L71-L77). This has been replaced by [DublinCore#SUBJECT](https://github.com/apache/tika/blob/main/tika-core/src/main/java/org/apache/tika/metadata/DublinCore.java#L162-L170)
Tests passed locally. Let's see how CI does.
Additionally, when inspecting the extracted metadata from the sample `.rtf` file, I see the following... should we augment the unit test to assert the results?
```
Content-Length: 2235
Content-Type: application/rtf
X-TIKA:Parsed-By: org.apache.tika.parser.DefaultParser
X-TIKA:Parsed-By: org.apache.tika.parser.microsoft.rtf.RTFParser
X-TIKA:digest:MD5: 61d9f6cd7ebacf61737936f9341c2289
X-TIKA:digest:SHA256: 1aae10f9ae8fdfdfddae338dec7f4a40cf9fc7d0c254af32e742dbd227f9399b
dc:subject: tests
dc:title: test rft document
dcterms:created: 2004-09-21T02:36:00Z
resourceName: test.rtf
w:Comments: StarWriter
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: WIP NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1007867630
I just released Any23 2.6. I will update this PR once the release has hit the CDN.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1002887610
To achieve a successful CI build I also had to disable the `ant javadoc` target. The problem here is definitely Any23.
This can be fixed in the next Any23 release by setting the Tika depdency scopes to **provided**, meaning that the expectation is that they will be provided at runtime... which will be true if we upgrade to Tika 2.2.0.
I'll get to work on another release candidate for Any23...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] kennethmcfarland commented on pull request #717: WIP NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
kennethmcfarland commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1005187214
Hi Lewis, this is off topic but thanks for being such a great inspiration
when I needed it a few years ago. Sorry I didnt get to do GSOC with you, Im
36 now and have no interest in school, I dont want recognition or pay. Just
wanted to let you know you really changed my life by being so
compassionate. This world needs more like you man. Should I spring for one
of those Lord / Lady (if married) packs so you can go by Lord Lewis John
McGibbney? LOL. TTYL gotta focus on repairing the trauma I'm working thru.
<3 -Kenny
On Tue, Jan 4, 2022 at 8:12 AM Lewis John McGibbney <
***@***.***> wrote:
> I just created a 2nd release candidate for Any23 2.6
> <https://lists.apache.org/thread/0x6jfkd9vkdkwq63chd7jl8j09lgkjtf> which
> ships with Tika 2.2.1.
> I will augment this pull request in due course... hopefully once Any23 2.6
> has been released.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/nutch/pull/717#issuecomment-1004941265>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AHED4LCYZO56LBUAIUA5BN3UUML3ZANCNFSM5KKGQEPA>
> .
> Triage notifications on the go with GitHub Mobile for iOS
> <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
> or Android
> <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
>
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] sebastian-nagel commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.1 and Any23 2.6
Posted by GitBox <gi...@apache.org>.
sebastian-nagel commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1013689493
Ok, the dependency conflict with commons-io is tracked in NUTCH-2937.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: WIP NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1004941265
I just created a [2nd release candidate for Any23 2.6](https://lists.apache.org/thread/0x6jfkd9vkdkwq63chd7jl8j09lgkjtf) which ships with Tika 2.2.1.
I will augment this pull request in due course... hopefully once Any23 2.6 has been released.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch] lewismc commented on pull request #717: NUTCH-2919 Upgrade to Tika 2.2.0
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #717:
URL: https://github.com/apache/nutch/pull/717#issuecomment-1002883562
CI was failing with the tests to the `any23` plugin. This makes some kind of sense as the Tika version included in Any23 may be in conflict with Tika 2.2.0.
I've temporarily disabled the `any23` plugin in this PR to see the results.
Over in Any23 we already use Tika 2.2.0 and each and every dependency is kept up-to-date with Dependabot. We just need to release Any23 2.6.0 but we don't have enough votes quite yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org