You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@clerezza.apache.org by "Tsuyoshi Ito (JIRA)" <ji...@apache.org> on 2011/03/03 09:12:37 UTC

[jira] Created: (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
---------------------------------------------------------------------------------------------------------------------------------------------------------------

                 Key: CLEREZZA-454
                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
             Project: Clerezza
          Issue Type: Bug
            Reporter: Tsuyoshi Ito
            Priority: Blocker


 (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
java.lang.NullPointerException
        at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
        at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
a:99)
        at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
        at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
        at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002466#comment-13002466 ] 

Tsuyoshi Ito commented on CLEREZZA-454:
---------------------------------------

on ext2 not more than 31998 subdirectories are allowed. this is not considered in the current implemetation of the storage.externalizer 

> rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLEREZZA-454
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
>             Project: Clerezza
>          Issue Type: Bug
>            Reporter: Tsuyoshi Ito
>            Priority: Blocker
>
>  (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
> java.lang.NullPointerException
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
> a:99)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002496#comment-13002496 ] 

Tsuyoshi Ito commented on CLEREZZA-454:
---------------------------------------

I suggest to use 2 resp. 3 characters from the base16Hash for the directory name instead of 4 (256 resp. 4096 subdirectories instead of 65536)

to make a minimal change I would implement the method getStoringFile as follows:

private File getStoringFile(String base16Hash) {
		
		File dir1 = new File(dataDir, base16Hash.substring(0, 2));
		File dir2 = new File(dir1, base16Hash.substring(2, 5));
		File dir3 = new File(dir2, base16Hash.substring(5, 8));
		dir3.mkdirs();
		return new File(dir3, base16Hash.substring(8));
	}

I am not sure if these changes have any side effects somewhere else.

> rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLEREZZA-454
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
>             Project: Clerezza
>          Issue Type: Bug
>            Reporter: Tsuyoshi Ito
>            Priority: Blocker
>
>  (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
> java.lang.NullPointerException
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
> a:99)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Assigned: (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsuyoshi Ito reassigned CLEREZZA-454:
-------------------------------------

    Assignee: Tsuyoshi Ito

> rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLEREZZA-454
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
>             Project: Clerezza
>          Issue Type: Bug
>            Reporter: Tsuyoshi Ito
>            Assignee: Tsuyoshi Ito
>            Priority: Blocker
>
>  (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
> java.lang.NullPointerException
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
> a:99)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Resolved: (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsuyoshi Ito resolved CLEREZZA-454.
-----------------------------------

    Resolution: Fixed

> rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLEREZZA-454
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
>             Project: Clerezza
>          Issue Type: Bug
>            Reporter: Tsuyoshi Ito
>            Assignee: Tsuyoshi Ito
>            Priority: Blocker
>
>  (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
> java.lang.NullPointerException
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
> a:99)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002517#comment-13002517 ] 

Reto Bachmann-Gmür commented on CLEREZZA-454:
---------------------------------------------

That sounds like the way to go, the patch would be very welcome.

Apart from breaking compaitibility with existing stores I can't think of any side-effect.

> rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLEREZZA-454
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
>             Project: Clerezza
>          Issue Type: Bug
>            Reporter: Tsuyoshi Ito
>            Priority: Blocker
>
>  (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
> java.lang.NullPointerException
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
> a:99)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Closed] (CLEREZZA-454) rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system)

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reto Bachmann-Gmür closed CLEREZZA-454.
---------------------------------------


> rdf.storage.externalizer: could not upload a blob anymore because directory contains more than allowed subdirectories ( "too many links" error on file system) 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLEREZZA-454
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-454
>             Project: Clerezza
>          Issue Type: Bug
>            Reporter: Tsuyoshi Ito
>            Assignee: Tsuyoshi Ito
>            Priority: Blocker
>
>  (JaxRsHandler.java\:585) - RuntimeException (with no exception mapper)
> java.lang.NullPointerException
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replace(ExternalizingMGraph.java:151)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.replaceWithReference(ExternalizingMGraph.jav
> a:99)
>         at org.apache.clerezza.rdf.storage.externalizer.ExternalizingMGraph.performAdd(ExternalizingMGraph.java:88)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:111)
>         at org.apache.clerezza.rdf.core.impl.AbstractTripleCollection.add(AbstractTripleCollection.java:45)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira