You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@directory.apache.org by Ezsra McDonald <ez...@gmail.com> on 2015/06/16 03:31:41 UTC
Large replica files in /tmp
Greetings
I assume this has to do with the import of 300+k entries to my LDAP. What
do these mean? Do they have to be in /tmp? Can I put them somewhere else?
-rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
replica2007608221525362157.sorted-data
-rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
replica2007608221525362157.sorted-data.db
-rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
replica2007608221525362157.sorted-data.lg
ADS M20
--Ez
Re: Large replica files in /tmp
Posted by Kiran Ayyagari <ka...@apache.org>.
On Wed, Jun 17, 2015 at 5:52 AM, Ezsra McDonald <ez...@gmail.com>
wrote:
> On Tue, Jun 16, 2015 at 11:01 AM, Ezsra McDonald <ezsra.mcdonald@gmail.com
> >
> wrote:
>
> >
> >
> > On Tue, Jun 16, 2015 at 10:31 AM, Kiran Ayyagari <ka...@apache.org>
> > wrote:
> >
> >> On Tue, Jun 16, 2015 at 11:16 PM, Ezsra McDonald <
> >> ezsra.mcdonald@gmail.com>
> >> wrote:
> >>
> >> > I don't think it is a bug.
> >> >
> >>
> >> > These files were generated during the very large import via ldapadd.
> The
> >> > replica files filled the /tmp file system which I believe snowballed
> >> into
> >> > other issues so the replication may not have completed. I was hoping I
> >> > could configure ADS to use a different location for the replica files.
> >> I am
> >> > also working with our system guys to have the tmp file system
> increased.
> >> >
> >> the files with extension ".sorted-data" are created while searching
> with a
> >> sort control
> >> and these files will be deleted when the associated cursor gets closed.
> >>
> >>
> >
> > To make sure I understand, these were not created by the replication
> > process but by a query? I may have opened a browser on my People OU with
> > 300k entries it it. Would this cause he sorted-data files?
> >
> >
> >> And something is not right and these files are still hanging around, was
> >> the server
> >> stopped using ctrl+c ? or are you running server on windows?
> >>
> >>
> > When I saw the file system was full I stopped ADS.
> >
> >
> >>
> >> > On the note of replication completing. What is the best way to tell
> the
> >> > status of replication on ADS? Even getting a count of entries in the
> >> > database would be helpful.
> >> >
> >> the best way is to compare the contentEntryCsn on the base entry of each
> >> partition
> >> I planned to write a CLI to do this, but it still remained in the TODO
> >> list.
> >>
> >>
> > I'll take a look at contentEntryCsn, thanks.
> >
>
> I could not find the contentEntryCsn attribute but I did find entryCSN.
>
sorry, it is contextCsn (no 'Entry')
> This seems to be an index or something. What am I looking for? I made a
> change to a user's e-mail address. The change was replicated but this value
> stayed the same.
>
just look at the root entry of the partition, for example dc=example,dc=com
>
>
>
> >
> >
> >> >
> >> > On Mon, Jun 15, 2015 at 9:52 PM, Kiran Ayyagari <kayyagari@apache.org
> >
> >> > wrote:
> >> >
> >> > > On Tue, Jun 16, 2015 at 9:31 AM, Ezsra McDonald <
> >> > ezsra.mcdonald@gmail.com>
> >> > > wrote:
> >> > >
> >> > > > Greetings
> >> > > >
> >> > > > I assume this has to do with the import of 300+k entries to my
> LDAP.
> >> > What
> >> > > > do these mean? Do they have to be in /tmp? Can I put them
> somewhere
> >> > else?
> >> > > >
> >> > > they are created by the replication subsystem, they are supposed to
> be
> >> > > deleted after
> >> > > use, can you file a bug?
> >> > >
> >> > > >
> >> > > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> >> > > > replica2007608221525362157.sorted-data
> >> > > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> >> > > > replica2007608221525362157.sorted-data.db
> >> > > > -rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
> >> > > > replica2007608221525362157.sorted-data.lg
> >> > > >
> >> > > >
> >> > > > ADS M20
> >> > > >
> >> > > > --Ez
> >> > > >
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Kiran Ayyagari
> >> > > http://keydap.com
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Kiran Ayyagari
> >> http://keydap.com
> >>
> >
> >
>
--
Kiran Ayyagari
http://keydap.com
Re: Large replica files in /tmp
Posted by Ezsra McDonald <ez...@gmail.com>.
On Tue, Jun 16, 2015 at 11:01 AM, Ezsra McDonald <ez...@gmail.com>
wrote:
>
>
> On Tue, Jun 16, 2015 at 10:31 AM, Kiran Ayyagari <ka...@apache.org>
> wrote:
>
>> On Tue, Jun 16, 2015 at 11:16 PM, Ezsra McDonald <
>> ezsra.mcdonald@gmail.com>
>> wrote:
>>
>> > I don't think it is a bug.
>> >
>>
>> > These files were generated during the very large import via ldapadd. The
>> > replica files filled the /tmp file system which I believe snowballed
>> into
>> > other issues so the replication may not have completed. I was hoping I
>> > could configure ADS to use a different location for the replica files.
>> I am
>> > also working with our system guys to have the tmp file system increased.
>> >
>> the files with extension ".sorted-data" are created while searching with a
>> sort control
>> and these files will be deleted when the associated cursor gets closed.
>>
>>
>
> To make sure I understand, these were not created by the replication
> process but by a query? I may have opened a browser on my People OU with
> 300k entries it it. Would this cause he sorted-data files?
>
>
>> And something is not right and these files are still hanging around, was
>> the server
>> stopped using ctrl+c ? or are you running server on windows?
>>
>>
> When I saw the file system was full I stopped ADS.
>
>
>>
>> > On the note of replication completing. What is the best way to tell the
>> > status of replication on ADS? Even getting a count of entries in the
>> > database would be helpful.
>> >
>> the best way is to compare the contentEntryCsn on the base entry of each
>> partition
>> I planned to write a CLI to do this, but it still remained in the TODO
>> list.
>>
>>
> I'll take a look at contentEntryCsn, thanks.
>
I could not find the contentEntryCsn attribute but I did find entryCSN.
This seems to be an index or something. What am I looking for? I made a
change to a user's e-mail address. The change was replicated but this value
stayed the same.
>
>
>> >
>> > On Mon, Jun 15, 2015 at 9:52 PM, Kiran Ayyagari <ka...@apache.org>
>> > wrote:
>> >
>> > > On Tue, Jun 16, 2015 at 9:31 AM, Ezsra McDonald <
>> > ezsra.mcdonald@gmail.com>
>> > > wrote:
>> > >
>> > > > Greetings
>> > > >
>> > > > I assume this has to do with the import of 300+k entries to my LDAP.
>> > What
>> > > > do these mean? Do they have to be in /tmp? Can I put them somewhere
>> > else?
>> > > >
>> > > they are created by the replication subsystem, they are supposed to be
>> > > deleted after
>> > > use, can you file a bug?
>> > >
>> > > >
>> > > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
>> > > > replica2007608221525362157.sorted-data
>> > > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
>> > > > replica2007608221525362157.sorted-data.db
>> > > > -rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
>> > > > replica2007608221525362157.sorted-data.lg
>> > > >
>> > > >
>> > > > ADS M20
>> > > >
>> > > > --Ez
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Kiran Ayyagari
>> > > http://keydap.com
>> > >
>> >
>>
>>
>>
>> --
>> Kiran Ayyagari
>> http://keydap.com
>>
>
>
Re: Large replica files in /tmp
Posted by Ezsra McDonald <ez...@gmail.com>.
On Tue, Jun 16, 2015 at 10:31 AM, Kiran Ayyagari <ka...@apache.org>
wrote:
> On Tue, Jun 16, 2015 at 11:16 PM, Ezsra McDonald <ezsra.mcdonald@gmail.com
> >
> wrote:
>
> > I don't think it is a bug.
> >
>
> > These files were generated during the very large import via ldapadd. The
> > replica files filled the /tmp file system which I believe snowballed into
> > other issues so the replication may not have completed. I was hoping I
> > could configure ADS to use a different location for the replica files. I
> am
> > also working with our system guys to have the tmp file system increased.
> >
> the files with extension ".sorted-data" are created while searching with a
> sort control
> and these files will be deleted when the associated cursor gets closed.
>
>
To make sure I understand, these were not created by the replication
process but by a query? I may have opened a browser on my People OU with
300k entries it it. Would this cause he sorted-data files?
> And something is not right and these files are still hanging around, was
> the server
> stopped using ctrl+c ? or are you running server on windows?
>
>
When I saw the file system was full I stopped ADS.
>
> > On the note of replication completing. What is the best way to tell the
> > status of replication on ADS? Even getting a count of entries in the
> > database would be helpful.
> >
> the best way is to compare the contentEntryCsn on the base entry of each
> partition
> I planned to write a CLI to do this, but it still remained in the TODO
> list.
>
>
I'll take a look at contentEntryCsn, thanks.
> >
> > On Mon, Jun 15, 2015 at 9:52 PM, Kiran Ayyagari <ka...@apache.org>
> > wrote:
> >
> > > On Tue, Jun 16, 2015 at 9:31 AM, Ezsra McDonald <
> > ezsra.mcdonald@gmail.com>
> > > wrote:
> > >
> > > > Greetings
> > > >
> > > > I assume this has to do with the import of 300+k entries to my LDAP.
> > What
> > > > do these mean? Do they have to be in /tmp? Can I put them somewhere
> > else?
> > > >
> > > they are created by the replication subsystem, they are supposed to be
> > > deleted after
> > > use, can you file a bug?
> > >
> > > >
> > > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> > > > replica2007608221525362157.sorted-data
> > > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> > > > replica2007608221525362157.sorted-data.db
> > > > -rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
> > > > replica2007608221525362157.sorted-data.lg
> > > >
> > > >
> > > > ADS M20
> > > >
> > > > --Ez
> > > >
> > >
> > >
> > >
> > > --
> > > Kiran Ayyagari
> > > http://keydap.com
> > >
> >
>
>
>
> --
> Kiran Ayyagari
> http://keydap.com
>
Re: Large replica files in /tmp
Posted by Kiran Ayyagari <ka...@apache.org>.
On Tue, Jun 16, 2015 at 11:16 PM, Ezsra McDonald <ez...@gmail.com>
wrote:
> I don't think it is a bug.
>
> These files were generated during the very large import via ldapadd. The
> replica files filled the /tmp file system which I believe snowballed into
> other issues so the replication may not have completed. I was hoping I
> could configure ADS to use a different location for the replica files. I am
> also working with our system guys to have the tmp file system increased.
>
the files with extension ".sorted-data" are created while searching with a
sort control
and these files will be deleted when the associated cursor gets closed.
And something is not right and these files are still hanging around, was
the server
stopped using ctrl+c ? or are you running server on windows?
> On the note of replication completing. What is the best way to tell the
> status of replication on ADS? Even getting a count of entries in the
> database would be helpful.
>
the best way is to compare the contentEntryCsn on the base entry of each
partition
I planned to write a CLI to do this, but it still remained in the TODO list.
>
> On Mon, Jun 15, 2015 at 9:52 PM, Kiran Ayyagari <ka...@apache.org>
> wrote:
>
> > On Tue, Jun 16, 2015 at 9:31 AM, Ezsra McDonald <
> ezsra.mcdonald@gmail.com>
> > wrote:
> >
> > > Greetings
> > >
> > > I assume this has to do with the import of 300+k entries to my LDAP.
> What
> > > do these mean? Do they have to be in /tmp? Can I put them somewhere
> else?
> > >
> > they are created by the replication subsystem, they are supposed to be
> > deleted after
> > use, can you file a bug?
> >
> > >
> > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> > > replica2007608221525362157.sorted-data
> > > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> > > replica2007608221525362157.sorted-data.db
> > > -rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
> > > replica2007608221525362157.sorted-data.lg
> > >
> > >
> > > ADS M20
> > >
> > > --Ez
> > >
> >
> >
> >
> > --
> > Kiran Ayyagari
> > http://keydap.com
> >
>
--
Kiran Ayyagari
http://keydap.com
Re: Large replica files in /tmp
Posted by Ezsra McDonald <ez...@gmail.com>.
I don't think it is a bug.
These files were generated during the very large import via ldapadd. The
replica files filled the /tmp file system which I believe snowballed into
other issues so the replication may not have completed. I was hoping I
could configure ADS to use a different location for the replica files. I am
also working with our system guys to have the tmp file system increased.
On the note of replication completing. What is the best way to tell the
status of replication on ADS? Even getting a count of entries in the
database would be helpful.
On Mon, Jun 15, 2015 at 9:52 PM, Kiran Ayyagari <ka...@apache.org>
wrote:
> On Tue, Jun 16, 2015 at 9:31 AM, Ezsra McDonald <ez...@gmail.com>
> wrote:
>
> > Greetings
> >
> > I assume this has to do with the import of 300+k entries to my LDAP. What
> > do these mean? Do they have to be in /tmp? Can I put them somewhere else?
> >
> they are created by the replication subsystem, they are supposed to be
> deleted after
> use, can you file a bug?
>
> >
> > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> > replica2007608221525362157.sorted-data
> > -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> > replica2007608221525362157.sorted-data.db
> > -rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
> > replica2007608221525362157.sorted-data.lg
> >
> >
> > ADS M20
> >
> > --Ez
> >
>
>
>
> --
> Kiran Ayyagari
> http://keydap.com
>
Re: Large replica files in /tmp
Posted by Kiran Ayyagari <ka...@apache.org>.
On Tue, Jun 16, 2015 at 9:31 AM, Ezsra McDonald <ez...@gmail.com>
wrote:
> Greetings
>
> I assume this has to do with the import of 300+k entries to my LDAP. What
> do these mean? Do they have to be in /tmp? Can I put them somewhere else?
>
they are created by the replication subsystem, they are supposed to be
deleted after
use, can you file a bug?
>
> -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> replica2007608221525362157.sorted-data
> -rw-r--r-- 1 apacheds apacheds 0 Jun 15 20:32
> replica2007608221525362157.sorted-data.db
> -rw-r--r-- 1 apacheds apacheds 685559808 Jun 15 20:45
> replica2007608221525362157.sorted-data.lg
>
>
> ADS M20
>
> --Ez
>
--
Kiran Ayyagari
http://keydap.com