[jira] [Created] (SOLR-8494) bin/post (SimplePostTool) cannot index files larger than 2.1GB

["Shalin Shekhar Mangar (JIRA)" <ji...@apache.org>]

Shalin Shekhar Mangar created SOLR-8494:
-------------------------------------------

             Summary: bin/post (SimplePostTool) cannot index files larger than 2.1GB
                 Key: SOLR-8494
                 URL: https://issues.apache.org/jira/browse/SOLR-8494
             Project: Solr
          Issue Type: Bug
          Components: SimplePostTool
    Affects Versions: 5.4, 5.3.1, 4.10.4
            Reporter: Shalin Shekhar Mangar
             Fix For: 5.5, Trunk


The SimplePostTool used by the bin/post script always uses the fixed length streaming mode which limits the size of the file being uploaded to 2.1GB (Integer.MAX_VALUE).

{code}
SimplePostTool version 5.0.0
Posting files to [base] url http://localhost:8983/solr/xyz/update...
Entering auto mode. File endings considered are xml,json,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log
POSTing file xyz.json (application/json) to [base]
Exception in thread "main" java.lang.IllegalArgumentException: invalid content length
    at java.net.HttpURLConnection.setFixedLengthStreamingMode(HttpURLConnection.java:161)
    at org.apache.solr.util.SimplePostTool.postData(SimplePostTool.java:887)
    at org.apache.solr.util.SimplePostTool.postFile(SimplePostTool.java:794)
    at org.apache.solr.util.SimplePostTool.postFiles(SimplePostTool.java:515)
    at org.apache.solr.util.SimplePostTool.postFiles(SimplePostTool.java:435)
    at org.apache.solr.util.SimplePostTool.doFilesMode(SimplePostTool.java:311)
    at org.apache.solr.util.SimplePostTool.execute(SimplePostTool.java:178)
    at org.apache.solr.util.SimplePostTool.main(SimplePostTool.java:167)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org