You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Shawn Heisey (JIRA)" <ji...@apache.org> on 2015/05/12 19:27:00 UTC

[jira] [Comment Edited] (SOLR-7533) DIH doesn't return "Indexing completed" when 0 documents processed

    [ https://issues.apache.org/jira/browse/SOLR-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14540276#comment-14540276 ] 

Shawn Heisey edited comment on SOLR-7533 at 5/12/15 5:26 PM:
-------------------------------------------------------------

Determining DIH status in a program is a far harder problem than it needs to be.  I've filed a number of issues.  I have found the DIH code to be very layered, using abstractions effectively, but hard to understand for someone who's not familiar with it.  I'm sure that once you become familiar with it, the use of abstraction actually helps, but it's a barrier when you don't know the code already.

This looks like a nearly identical issue to SOLR-2729, but in newer versions the extraneous space has been removed from the "Time taken" field name.  I can't tell if the original command was a delta-import, but I assume that it probably was, which would make this a duplicate of SOLR-2729.


was (Author: elyograg):
Determining DIH status in a program is a far harder problem than it needs to be.  I've filed a number of issues.  I have found the DIH code to be very layered, using abstractions effectively, but hard to understand for someone who's not familiar with it.  I'm sure that once you become familiar with it, the use of abstraction actually helps, but it's a barrier when you don't know the code already.

This looks like a nearly identical issue to SOLR-2729, but in newer versions the extraneous space has been removed from the "Time taken" field name, and the "Indexing complete" message is entirely gone.


> DIH doesn't return "Indexing completed" when 0 documents processed
> ------------------------------------------------------------------
>
>                 Key: SOLR-7533
>                 URL: https://issues.apache.org/jira/browse/SOLR-7533
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 5.0, 5.1
>            Reporter: Jellyfrog
>
> Normally, the status for a DIH when done will be something like:
> {code}
> {
>     "responseHeader": {
>         "status": 0,
>         "QTime": 0
>     },
>     "initArgs": [
>         "defaults",
>         [
>             "config",
>             "data_import.xml"
>         ]
>     ],
>     "command": "status",
>     "status": "idle",
>     "importResponse": "",
>     "statusMessages": {
>         "Total Requests made to DataSource": "1",
>         "Total Rows Fetched": "480463",
>         "Total Documents Skipped": "0",
>         "Full Dump Started": "2015-04-21 14:16:17",
>         "": "Indexing completed. Added/Updated: 480463 documents. Deleted 0 documents.",
>         "Total Documents Processed": "480463",
>         "Time taken": "0:12:31.863"
>     }
> }
> {code}
> But when it processes 0 rows, it's missing the "Indexing completed" part:
> {code}
> {
>     "responseHeader": {
>         "status": 0,
>         "QTime": 0
>     },
>     "initArgs": [
>         "defaults",
>         [
>             "config",
>             "data_import.xml"
>         ]
>     ],
>     "command": "status",
>     "status": "idle",
>     "importResponse": "",
>     "statusMessages": {
>         "Total Requests made to DataSource": "1",
>         "Total Rows Fetched": "0",
>         "Total Documents Processed": "0",
>         "Total Documents Skipped": "0",
>         "Full Dump Started": "2015-05-12 17:39:44",
>         "Time taken": "0:0:2.805"
>     }
> }
> {code}
> This makes the output very inconsistent and harder to handle programatically 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org