You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@solr.apache.org by Mike Phillips <m....@prosperodigital.com> on 2025/02/04 20:52:51 UTC
basic steps for data-import-handler do not work without exceptions
I have a non cloud 8.4.1 solr version with built in DIH working and I am
looking to migrate.
This are the steps I did to try and have a solr test system with the
data-import-hander plugin.
# as root
1) install_solr_service.sh solr-9.7.0.tgz -f -i /opt -d /var/solr-data
-u solruser -s solr -p 8983
# as solruser
2) solr stop -p 8983
3) solr start --cloud -Denable.packages=true
4) solr package add-repo data-import-handler
"https://raw.githubusercontent.com/searchscale/dataimporthandler/master/repo/"
Neither --zk-host or --solr-url parameters provided so assuming solr url
is http://localhost:8983.
Added repository: data-import-handler
5) solr package list-available
Neither --zk-host or --solr-url parameters provided so assuming solr url
is http://localhost:8983.
Available packages:
-----
data-import-handler A utility to import documents from a
database system into Apache Solr
Version: 9.2.1
Version: 9.0.0
Version: 8.10.0
Version: 8.6.0
Version: 9.3.0
Version: 9.4.0
Version: 9.6.1
Version: 9.7.0
6) solr package install data-import-handler
Neither --zk-host or --solr-url parameters provided so assuming solr url
is http://localhost:8983.
Posting manifest...
Posting artifacts...
Executing Package API to register this package...
Response: {
"responseHeader":{
"status":0,
"QTime":144}}
data-import-handler installed.
7) curl
"http://localhost:8983/solr/admin/collections?action=CREATE&name=oel1_6&numShards=1"
{
"responseHeader":{
"status":0,
"QTime":5294
},
"success":{
"localhost:8983_solr":{
"responseHeader":{
"status":0,
"QTime":2450
},
"core":"oel1_6_shard1_replica_n1"
}
},
"warning":"Using _default configset. Data driven schema functionality
is enabled by default, which is NOT RECOMMENDED for production use. To
turn it off: curl http://{host:port}/solr/oel1_6/config -d
'{\"set-user-property\": {\"update.autoCreateFields\":\"false\"}}'"
8) solr package deploy data-import-handler:9.7.0 -y -collections oel1_6
Neither --zk-host or --solr-url parameters provided so assuming solr url
is http://localhost:8983.
Executing
{"add-requesthandler":{"name":"/dataimport","class":"data-import-handler:org.apache.solr.handler.dataimport.DataImportHandler","defaults":{"config":"data-config.xml"}}}
for path:/api/collections/oel1_6/config
Executing
http://localhost:8983/api/collections/oel1_6/config/requestHandler?componentName=/dataimport&meta=true
for collection:oel1_6
{
"responseHeader":{
"status":0,
"QTime":2},
"config":{"requestHandler":{"/dataimport":{
"name":"/dataimport",
"class":"data-import-handler:org.apache.solr.handler.dataimport.DataImportHandler",
"defaults":{"config":"data-config.xml"},
"_packageinfo_":{
"package":"data-import-handler",
"version":"9.7.0",
"files":[
"/package/data-import-handler/9.7.0/data-import-handler-9.7.0.jar",
"/package/data-import-handler/9.7.0/mariadb-java-client-2.6.0.jar"],
"manifest":"/package/data-import-handler/9.7.0/manifest.json",
"manifestSHA512":"2bba2115d6105cf39b935980553b9c85d06121e0a406888595b2e5cf922b4e09df882076b572a32957a60c9b67d3e7a39b0e79f512c5d12b3003e3be0857629b"}}}}}
com.jayway.jsonpath.InvalidPathException: Error in JSON
Path:$[config].[requestHandler].[HANDLER-PATH].[_packageinfo_].[version]
at
org.apache.solr.packagemanager.PackageManager.jsonPathRead(PackageManager.java:870)
at
org.apache.solr.packagemanager.PackageManager.verify(PackageManager.java:834)
at
org.apache.solr.packagemanager.PackageManager.deployPackage(PackageManager.java:366)
at
org.apache.solr.packagemanager.PackageManager.deploy(PackageManager.java:947)
at org.apache.solr.cli.PackageTool.runImpl(PackageTool.java:184)
at org.apache.solr.cli.ToolBase.runTool(ToolBase.java:52)
at org.apache.solr.cli.SolrCLI.main(SolrCLI.java:227)
Caused by: com.jayway.jsonpath.InvalidPathException: Could not parse
token starting at position 1. Expected ?, ', 0-9, *
at
com.jayway.jsonpath.internal.path.PathCompiler.fail(PathCompiler.java:642)
at
com.jayway.jsonpath.internal.path.PathCompiler.readNextToken(PathCompiler.java:139)
at
com.jayway.jsonpath.internal.path.PathCompiler.readContextToken(PathCompiler.java:123)
at
com.jayway.jsonpath.internal.path.PathCompiler.compile(PathCompiler.java:58)
at
com.jayway.jsonpath.internal.path.PathCompiler.compile(PathCompiler.java:75)
at com.jayway.jsonpath.JsonPath.<init>(JsonPath.java:97)
at com.jayway.jsonpath.JsonPath.compile(JsonPath.java:515)
at
com.jayway.jsonpath.internal.JsonContext.pathFromCache(JsonContext.java:222)
at com.jayway.jsonpath.internal.JsonContext.read(JsonContext.java:77)
at
org.apache.solr.packagemanager.PackageManager.jsonPathRead(PackageManager.java:866)
... 6 more
ERROR: Error in JSON
Path:$[config].[requestHandler].[HANDLER-PATH].[_packageinfo_].[version]
Re: basic steps for data-import-handler do not work without exceptions
Posted by Mikhail Khludnev <mk...@apache.org>.
This error with this path was already fixed in repository.json for previous
versions of DIH, but it reoccur in new releases:
https://github.com/SearchScale/dataimporthandler/issues/85
Have no idea why and what to do.
On Tue, Feb 4, 2025 at 11:53 PM Mike Phillips <
m.phillips@prosperodigital.com> wrote:
> I have a non cloud 8.4.1 solr version with built in DIH working and I am
> looking to migrate.
>
> This are the steps I did to try and have a solr test system with the
> data-import-hander plugin.
>
> # as root
> 1) install_solr_service.sh solr-9.7.0.tgz -f -i /opt -d /var/solr-data
> -u solruser -s solr -p 8983
>
> # as solruser
> 2) solr stop -p 8983
>
> 3) solr start --cloud -Denable.packages=true
>
> 4) solr package add-repo data-import-handler
> "
> https://raw.githubusercontent.com/searchscale/dataimporthandler/master/repo/
> "
> Neither --zk-host or --solr-url parameters provided so assuming solr url
> is http://localhost:8983.
> Added repository: data-import-handler
>
> 5) solr package list-available
> Neither --zk-host or --solr-url parameters provided so assuming solr url
> is http://localhost:8983.
> Available packages:
> -----
> data-import-handler A utility to import documents from a
> database system into Apache Solr
> Version: 9.2.1
> Version: 9.0.0
> Version: 8.10.0
> Version: 8.6.0
> Version: 9.3.0
> Version: 9.4.0
> Version: 9.6.1
> Version: 9.7.0
>
> 6) solr package install data-import-handler
> Neither --zk-host or --solr-url parameters provided so assuming solr url
> is http://localhost:8983.
> Posting manifest...
> Posting artifacts...
> Executing Package API to register this package...
> Response: {
> "responseHeader":{
> "status":0,
> "QTime":144}}
> data-import-handler installed.
>
>
> 7) curl
> "
> http://localhost:8983/solr/admin/collections?action=CREATE&name=oel1_6&numShards=1
> "
> {
> "responseHeader":{
> "status":0,
> "QTime":5294
> },
> "success":{
> "localhost:8983_solr":{
> "responseHeader":{
> "status":0,
> "QTime":2450
> },
> "core":"oel1_6_shard1_replica_n1"
> }
> },
> "warning":"Using _default configset. Data driven schema functionality
> is enabled by default, which is NOT RECOMMENDED for production use. To
> turn it off: curl http://{host:port}/solr/oel1_6/config -d
> '{\"set-user-property\": {\"update.autoCreateFields\":\"false\"}}'"
>
>
> 8) solr package deploy data-import-handler:9.7.0 -y -collections oel1_6
> Neither --zk-host or --solr-url parameters provided so assuming solr url
> is http://localhost:8983.
> Executing
> {"add-requesthandler":{"name":"/dataimport","class":"data-import-handler:org.apache.solr.handler.dataimport.DataImportHandler","defaults":{"config":"data-config.xml"}}}
>
> for path:/api/collections/oel1_6/config
> Executing
>
> http://localhost:8983/api/collections/oel1_6/config/requestHandler?componentName=/dataimport&meta=true
> for collection:oel1_6
> {
> "responseHeader":{
> "status":0,
> "QTime":2},
> "config":{"requestHandler":{"/dataimport":{
> "name":"/dataimport",
>
> "class":"data-import-handler:org.apache.solr.handler.dataimport.DataImportHandler",
> "defaults":{"config":"data-config.xml"},
> "_packageinfo_":{
> "package":"data-import-handler",
> "version":"9.7.0",
> "files":[
> "/package/data-import-handler/9.7.0/data-import-handler-9.7.0.jar",
> "/package/data-import-handler/9.7.0/mariadb-java-client-2.6.0.jar"],
> "manifest":"/package/data-import-handler/9.7.0/manifest.json",
>
> "manifestSHA512":"2bba2115d6105cf39b935980553b9c85d06121e0a406888595b2e5cf922b4e09df882076b572a32957a60c9b67d3e7a39b0e79f512c5d12b3003e3be0857629b"}}}}}
> com.jayway.jsonpath.InvalidPathException: Error in JSON
> Path:$[config].[requestHandler].[HANDLER-PATH].[_packageinfo_].[version]
> at
>
> org.apache.solr.packagemanager.PackageManager.jsonPathRead(PackageManager.java:870)
> at
>
> org.apache.solr.packagemanager.PackageManager.verify(PackageManager.java:834)
> at
>
> org.apache.solr.packagemanager.PackageManager.deployPackage(PackageManager.java:366)
> at
>
> org.apache.solr.packagemanager.PackageManager.deploy(PackageManager.java:947)
> at org.apache.solr.cli.PackageTool.runImpl(PackageTool.java:184)
> at org.apache.solr.cli.ToolBase.runTool(ToolBase.java:52)
> at org.apache.solr.cli.SolrCLI.main(SolrCLI.java:227)
> Caused by: com.jayway.jsonpath.InvalidPathException: Could not parse
> token starting at position 1. Expected ?, ', 0-9, *
> at
> com.jayway.jsonpath.internal.path.PathCompiler.fail(PathCompiler.java:642)
> at
>
> com.jayway.jsonpath.internal.path.PathCompiler.readNextToken(PathCompiler.java:139)
> at
>
> com.jayway.jsonpath.internal.path.PathCompiler.readContextToken(PathCompiler.java:123)
> at
>
> com.jayway.jsonpath.internal.path.PathCompiler.compile(PathCompiler.java:58)
> at
>
> com.jayway.jsonpath.internal.path.PathCompiler.compile(PathCompiler.java:75)
> at com.jayway.jsonpath.JsonPath.<init>(JsonPath.java:97)
> at com.jayway.jsonpath.JsonPath.compile(JsonPath.java:515)
> at
>
> com.jayway.jsonpath.internal.JsonContext.pathFromCache(JsonContext.java:222)
> at com.jayway.jsonpath.internal.JsonContext.read(JsonContext.java:77)
> at
>
> org.apache.solr.packagemanager.PackageManager.jsonPathRead(PackageManager.java:866)
> ... 6 more
>
> ERROR: Error in JSON
> Path:$[config].[requestHandler].[HANDLER-PATH].[_packageinfo_].[version]
>
>
--
Sincerely yours
Mikhail Khludnev
Re: basic steps for data-import-handler do not work without exceptions
Posted by Mikhail Khludnev <mk...@apache.org>.
On Tue, Feb 4, 2025 at 11:53 PM Mike Phillips <
m.phillips@prosperodigital.com> wrote:
>
>
> 8) solr package deploy data-import-handler:9.7.0 -y -collections oel1_6
> Neither --zk-host or --solr-url parameters provided so assuming solr url
> is http://localhost:8983.
> Executing
> {"add-requesthandler":{"name":"/dataimport","class":"data-import-handler:org.apache.solr.handler.dataimport.DataImportHandler","defaults":{"config":"data-config.xml"}}}
>
> for path:/api/collections/oel1_6/config
> Executing
>
> http://localhost:8983/api/collections/oel1_6/config/requestHandler?componentName=/dataimport&meta=true
> for collection:oel1_6
> {
> "responseHeader":{
> "status":0,
> "QTime":2},
> "config":{"requestHandler":{"/dataimport":{
> "name":"/dataimport",
>
> "class":"data-import-handler:org.apache.solr.handler.dataimport.DataImportHandler",
> "defaults":{"config":"data-config.xml"},
> "_packageinfo_":{
> "package":"data-import-handler",
> "version":"9.7.0",
> "files":[
> "/package/data-import-handler/9.7.0/data-import-handler-9.7.0.jar",
> "/package/data-import-handler/9.7.0/mariadb-java-client-2.6.0.jar"],
> "manifest":"/package/data-import-handler/9.7.0/manifest.json",
>
> "manifestSHA512":"2bba2115d6105cf39b935980553b9c85d06121e0a406888595b2e5cf922b4e09df882076b572a32957a60c9b67d3e7a39b0e79f512c5d12b3003e3be0857629b"}}}}}
> com.jayway.jsonpath.InvalidPathException: Error in JSON
> Path:$[config].[requestHandler].[HANDLER-PATH].[_packageinfo_].[version]
> at
>
> org.apache.solr.packagemanager.PackageManager.jsonPathRead(PackageManager.java:870)
> at
>
> org.apache.solr.packagemanager.PackageManager.verify(PackageManager.java:834)
>
> ERROR: Error in JSON
> Path:$[config].[requestHandler].[HANDLER-PATH].[_packageinfo_].[version]
>
>
Try now. The issue should be fixed now
https://github.com/SearchScale/dataimporthandler/pull/90/files
--
Sincerely yours
Mikhail Khludnev