You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jay Potharaju <js...@gmail.com> on 2016/03/21 02:11:32 UTC

Indexing using CSV

Hi,
I am trying to index some data using csv files. The data contains
description column, which can include quotes, comma, LF/CR & other special
characters.

I have it working but run into an issue with the following error

line=5,can't read line: 5 values={NO LINES AVAILABLE}.

What is the best way to debug this issue and secondly how do other people
handle indexing data using csv data.

-- 
Thanks
Jay

Re: Indexing using CSV

Posted by Zheng Lin Edwin Yeo <ed...@gmail.com>.
Are you using post.jar or other methods of indexing the CSV file?

You have to ensure that the number of fields in your CSV file are the same
as the fields in Solr.
Also, each records in the CSV file must be on separate lines, and each
record must have the same number of fields, with each field separate by a
"," (even for fields that are empty)

Regards,
Edwin


On 21 March 2016 at 23:46, Paul Hoffman <pa...@flo.org> wrote:

> On Sun, Mar 20, 2016 at 06:11:32PM -0700, Jay Potharaju wrote:
> > Hi,
> > I am trying to index some data using csv files. The data contains
> > description column, which can include quotes, comma, LF/CR & other
> special
> > characters.
> >
> > I have it working but run into an issue with the following error
> >
> > line=5,can't read line: 5 values={NO LINES AVAILABLE}.
> >
> > What is the best way to debug this issue and secondly how do other people
> > handle indexing data using csv data.
>
> I would concentrate first on getting the CSV reader working verifiably,
> which might be the hardest part -- CSV is not a file format, it's a
> hodgepodge.
>
> Paul.
>
> --
> Paul Hoffman <pa...@flo.org>
> Systems Librarian
> Fenway Libraries Online
> c/o Wentworth Institute of Technology
> 550 Huntington Ave.
> Boston, MA 02115
> (617) 442-2384 (FLO main number)
>

Re: Indexing using CSV

Posted by Paul Hoffman <pa...@flo.org>.
On Sun, Mar 20, 2016 at 06:11:32PM -0700, Jay Potharaju wrote:
> Hi,
> I am trying to index some data using csv files. The data contains
> description column, which can include quotes, comma, LF/CR & other special
> characters.
> 
> I have it working but run into an issue with the following error
> 
> line=5,can't read line: 5 values={NO LINES AVAILABLE}.
> 
> What is the best way to debug this issue and secondly how do other people
> handle indexing data using csv data.

I would concentrate first on getting the CSV reader working verifiably, 
which might be the hardest part -- CSV is not a file format, it's a 
hodgepodge.

Paul.

-- 
Paul Hoffman <pa...@flo.org>
Systems Librarian
Fenway Libraries Online
c/o Wentworth Institute of Technology
550 Huntington Ave.
Boston, MA 02115
(617) 442-2384 (FLO main number)