You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@vxquery.apache.org by Menaka Jayawardena <me...@gmail.com> on 2016/07/25 17:38:32 UTC
Indexing metadata file location.
Hello,
Currently the index metadata file is stored in the same directory where
index is created.
In metadata file, as we store all index information, it will be much better
if we could define a common directory to store the file and make the
indexing process much centralized.
I'd like to know any ideas about this.
Best regards
Menaka
--
*Menaka Madushanka Jayawardena*
Faculty of Engineering, <http://www.pdn.ac.lk/eng>
University of Peradeniyaya.
LinkedIn <http://lk.linkedin.com/in/menakajayawardena>
TP:- 071 885 1183/ 071 350 5470
Re: Indexing metadata file location.
Posted by Menaka Jayawardena <me...@gmail.com>.
It currently does create file per partition, but those contain all index
information.
I'll work on removing other metadata and make it specific to partition.
On 25 July 2016 at 23:46, Preston Carman <pr...@apache.org> wrote:
> Each partition should have its own index file. The separate index
> files for each partition allow for the query to ignore synchronization
> and keep index information close to the data. The partition index file
> should not include global information. The result will be index files
> that are sized relative to the partition data size.
>
> I think we could talk about adding a metadata file that holds a list
> of index files. Although, the current index metadata file should be
> stored per partition per index. (I know the structure allows for many
> indexing in one file, but for now keep them plan on them being
> separate.)
>
> On Mon, Jul 25, 2016 at 10:38 AM, Menaka Jayawardena
> <me...@gmail.com> wrote:
> > Hello,
> >
> > Currently the index metadata file is stored in the same directory where
> > index is created.
> >
> > In metadata file, as we store all index information, it will be much
> better
> > if we could define a common directory to store the file and make the
> > indexing process much centralized.
> >
> > I'd like to know any ideas about this.
> >
> > Best regards
> > Menaka
> >
> > --
> > *Menaka Madushanka Jayawardena*
> > Faculty of Engineering, <http://www.pdn.ac.lk/eng>
> > University of Peradeniyaya.
> > LinkedIn <http://lk.linkedin.com/in/menakajayawardena>
> > TP:- 071 885 1183/ 071 350 5470
>
--
*Menaka Madushanka Jayawardena*
Faculty of Engineering, <http://www.pdn.ac.lk/eng>
University of Peradeniyaya.
LinkedIn <http://lk.linkedin.com/in/menakajayawardena>
TP:- 071 885 1183/ 071 350 5470
Re: Indexing metadata file location.
Posted by Preston Carman <pr...@apache.org>.
Each partition should have its own index file. The separate index
files for each partition allow for the query to ignore synchronization
and keep index information close to the data. The partition index file
should not include global information. The result will be index files
that are sized relative to the partition data size.
I think we could talk about adding a metadata file that holds a list
of index files. Although, the current index metadata file should be
stored per partition per index. (I know the structure allows for many
indexing in one file, but for now keep them plan on them being
separate.)
On Mon, Jul 25, 2016 at 10:38 AM, Menaka Jayawardena
<me...@gmail.com> wrote:
> Hello,
>
> Currently the index metadata file is stored in the same directory where
> index is created.
>
> In metadata file, as we store all index information, it will be much better
> if we could define a common directory to store the file and make the
> indexing process much centralized.
>
> I'd like to know any ideas about this.
>
> Best regards
> Menaka
>
> --
> *Menaka Madushanka Jayawardena*
> Faculty of Engineering, <http://www.pdn.ac.lk/eng>
> University of Peradeniyaya.
> LinkedIn <http://lk.linkedin.com/in/menakajayawardena>
> TP:- 071 885 1183/ 071 350 5470