You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Shawn Heisey (JIRA)" <ji...@apache.org> on 2017/04/13 23:20:41 UTC

[jira] [Updated] (SOLR-10487) Add connection/read timeout for SolrEntityProcessor in DataImportHandler

     [ https://issues.apache.org/jira/browse/SOLR-10487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shawn Heisey updated SOLR-10487:
--------------------------------
    Attachment: SOLR-10487.patch

New patch.  I have changed the HttpClient handling a little bit as well as applying the timeouts using methods that aren't slated for deprecation.

I marked the TIMEOUT constant as deprecated because that seemed to be the intent, but it appears that the replacement (QUERY_TIMEOUT) is not actually being used.  I wasn't entirely sure what the intent was, so I did not attempt to fix that.  This still needs to be done.

Side discussion: In HttpSolrClient#close, I was able to remove the "throws" part of the signature without causing any errors in HttpSolrClient, but there were some other places in the code that DID have errors as a result, so that is going to require some more thought.

> Add connection/read timeout for SolrEntityProcessor in DataImportHandler
> ------------------------------------------------------------------------
>
>                 Key: SOLR-10487
>                 URL: https://issues.apache.org/jira/browse/SOLR-10487
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: contrib - DataImportHandler
>    Affects Versions: trunk
>            Reporter: Goutam Mandal
>            Priority: Minor
>              Labels: easyfix
>         Attachments: SOLR-10487.patch
>
>
> This issue pertains to SolrEntityProcessor for importing documents from one Solr to another over HTTP. There have been instances when the DataImportHandler (DIH) hangs due to network/LB level issues. The abort command fails to stop the in-progress frozen import process. The DIH remains in this state for days and does not accept new request for import until Solr restart. The current implementation of SolrEntityProcessor has timeout at query level only.
> There should be option to specify connection as well as socket read timeouts. The import process must fail in case of any anomaly and not remain in hung state.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org