You are viewing a plain text version of this content. The canonical link for it is here.
Posted to derby-dev@db.apache.org by "Sunitha Kambhampati (JIRA)" <de...@db.apache.org> on 2006/08/10 20:00:18 UTC

[jira] Updated: (DERBY-1661) Create index on large tables fails with too many open files , FileNotFoundException.

     [ http://issues.apache.org/jira/browse/DERBY-1661?page=all ]

Sunitha Kambhampati updated DERBY-1661:
---------------------------------------

    Attachment: derby1661.diff.txt
                1661_Notes.txt
                1661_PerfResults.xls

I am attaching a patch derby1661.diff.txt to fix this issue.   

This patch changes the max size for merge runs to 512 from 1024.

For more notes on this issue, please see 1661_notes.txt.  Also attached is an excel sheet  with some numbers.  

svn stat
M      java\engine\org\apache\derby\impl\store\access\sort\ExternalSortFactory.java

I ran derbyall on windows/jdk142 ok with this patch.

Can someone please review.  Thanks. 

> Create index on large tables fails with too many open files , FileNotFoundException.
> ------------------------------------------------------------------------------------
>
>                 Key: DERBY-1661
>                 URL: http://issues.apache.org/jira/browse/DERBY-1661
>             Project: Derby
>          Issue Type: Bug
>          Components: Store
>    Affects Versions: 10.0.2.0, 10.0.2.1, 10.1.1.0, 10.2.0.0, 10.1.2.1, 10.1.3.0, 10.1.3.1
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>             Fix For: 10.2.0.0
>
>         Attachments: 1661_Notes.txt, 1661_PerfResults.xls, derby1661.diff.txt
>
>
> Create index fails on a table with 18million rows during sort with too many open files error
> This error was first seen when running against a tpcc-like test.  The test creates the tables, inserts data and then creates the indexes & adds constraints.
> Customer table has 18 million rows in this case. The below error is thrown on create index. 
>  
> ij> create index customer_last on customer(c_w_id, c_d_id, c_last);
> ERROR XSDF1: Exception during creation of file /home/cloudtst/SinglePerf/testruns/scripts/dbtpcc/tmp/T1128794811044.tmp for container
> ERROR XJ001: Java exception: '/home/cloudtst/SinglePerf/testruns/scripts/dbtpcc/tmp/T1128794811044.tmp (Too many open files): java.io.FileNotFoundException'.
> ij

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira