You are viewing a plain text version of this content. The canonical link for it is here.
Posted to olio-dev@incubator.apache.org by "Shanti Subramanyam (JIRA)" <ji...@apache.org> on 2009/08/11 15:50:15 UTC
[jira] Updated: (OLIO-40) File loader is slow. Filestore
architecture is problematic
[ https://issues.apache.org/jira/browse/OLIO-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shanti Subramanyam updated OLIO-40:
-----------------------------------
Due Date: 28/Aug/09
Description:
As we scale up the number of users, the fileloader takes longer and longer to load the filestore. Further, the loader clutters the faban log with lots of messages marking it's progress. The frequency of these msgs need to be reduced.
In addition, the current filestore design of a single directory to hold all the files is proving to be difficult to manage. It is impossible to even do an 'ls' in the directory as the number of files is large at scales beyond a few thousand users. A well-defined directory hierarchy should be used to make access more reasonable.
was:As we scale up the number of users, the fileloader takes longer and longer to load the filestore. Further, the loader clutters the faban log with lots of messages marking it's progress. The frequency of these msgs need to be reduced.
Priority: Major (was: Minor)
Affects Version/s: 0.1
Fix Version/s: 0.2
Summary: File loader is slow. Filestore architecture is problematic (was: File loader is slow)
Expanded JIRA to include re-design of filestore to use multiple level directories.
> File loader is slow. Filestore architecture is problematic
> ----------------------------------------------------------
>
> Key: OLIO-40
> URL: https://issues.apache.org/jira/browse/OLIO-40
> Project: Olio
> Issue Type: Improvement
> Components: generic
> Affects Versions: 0.1
> Reporter: Shanti Subramanyam
> Assignee: Akara Sucharitakul
> Fix For: 0.2
>
>
> As we scale up the number of users, the fileloader takes longer and longer to load the filestore. Further, the loader clutters the faban log with lots of messages marking it's progress. The frequency of these msgs need to be reduced.
> In addition, the current filestore design of a single directory to hold all the files is proving to be difficult to manage. It is impossible to even do an 'ls' in the directory as the number of files is large at scales beyond a few thousand users. A well-defined directory hierarchy should be used to make access more reasonable.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.