You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Tim Archambault <ta...@bangordailynews.net> on 2006/09/14 07:07:31 UTC

duplicating all records added to index

My index seems to be duplicating all records on insert even though I have my
add statements set to not allow duplicates.

I've provided a samle xml file of add docs. Anyone experienced this?


<add  allowDups="false" overwriteCommitted="true" overwritePending="true">

 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16140
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">BURGESS, Fidalis &apos;Dale&apos; J., 82</field>
   <field name="summary">HERMON - Fidalis &quot;Dale&quot; J. Burgess, 82,
husband of the late Lottie (Glidden) Burgess, passed away unexpectedly Dec.
1, 2000, at his residence. He was born Jan. 21, 1918, in Bangor, the son of
Elias and Margaret (Cheverie) Burgess.  Dale lived in Hermon   </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16141
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">CLARKE, Paul H., 79</field>
   <field name="summary">BANGOR- Paul H. Clarke, 79, died Dec. 1, 2000, at
his residence. He was born Jan. 14, 1921, in Saco the son of Charles and
Jennie (Larson) Clarke.  Paul was a life long member of Elks Lodge 244,
Bangor.  He worked most of his life as a meat cutter for    </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16142
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">COMEAU, Janice Mary, 63</field>
   <field name="summary">WALTHAM - Janice Mary Comeau, 63, died Dec. 1,
2000, at her home in Waltham. She was born Oct. 22, 1937, in Hartford,
Conn., the daughter of Joseph Edmund and Helen (LeBel) Comeau.  Janice
served her country in the U.S. Army as a nurse. She graduated     </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16143
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">CONNERS, Lois Marie</field>
   <field name="summary">HERMON AND BANGOR - Funeral services for Lois Marie
Conners will be held 9:30 a.m. Monday at Brookings-Smith, 133 Center St.,
Bangor with the Rev. Robert T. Carlson, pastor of the East Orrington
Congregational Church, officiating.  Interment will be in   </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16144
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">CORBETT, Linda L., 53</field>
   <field name="summary">CARIBOU - Linda L. Corbett, 53, wife of Nathan
Corbett, died Dec. 1, 2000, at Bangor. She was born at Caribou, March 7,
1947, the daughter of Jerry and Luella (Clark) Hewitt.  She was a graduate
of the Caribou High School and was a loving and devoted     </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16145
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">EDWARDS, James E.</field>
   <field name="summary">BANGOR - Mr. James E. Edwards died Dec. 2, 2000, at
his residence after a long illness. He was born in Hartford, Conn., May 27,
1929, the son of James V. and Cecelia (Fury) Edwards.  James served in the
U.S. Navy in Guam attaining the rank of fireman. He </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16146
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">FOLSOM, Robert E., 64</field>
   <field name="summary">MILLINOCKET - Robert E. Folsom, 64, died at a local
hospital, Dec. 1, 2000, after a brief illness. He was born in Millinocket,
the son of Lee and Ada (Hall) Folsom.  Bob retired from Great Northern Paper
Co. after many years. He was a member of BPO Elks  </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16147
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">FORTIN, Ludger Joseph, 62</field>
   <field name="summary">CARIBOU - Ludger J. Fortin, 62, died Dec. 2, 2000,
at Van Buren, after a long illness. He was born at St. Anne, N.B., Canada,
Sept. 28, 1938, the son of Edmond and Azilda (Burby) Fortin.  In 1960, he
married Shirley (Stubbs) Fortin. Ludger was employed   </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16148
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">FOX, Gertrude G.</field>
   <field name="summary">ORRINGTON - A Mass of Christian Burial for Gertrude
G. Fox will be celebrated 10 a.m. Monday at St. Teresa Catholic Church,
Brewer with the Rev. Joel R. Cyr, pastor, celebrant.  Burial will be 12 noon
Tuesday at the Maine Veterans Memorial Cemetery,      </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16149
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">GRENDELL, Edith, 83</field>
   <field name="summary">MAPLETON - Edith Grendell, 83, wife of the late
Ashley A. Grendell, died Dec. 1, 2000, at a Presque Isle health-care
facility. She was born in Somerville, Mass., Jan. 9, 1917, the daughter of
Albert B. and Ella (Morrow) MacLaughlin.  She was a member of  </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16150
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">HOWARD, Theron G., 53</field>
   <field name="summary">BUCKSPORT - On Sunday, Dec. 3, 2000, Theron G.
Howard, 53, rode the spirit horse home to once again be with his mother and
father, Phyllis (Robertson) and Urban Coombs, his brother, Steven Howard;
and father-in-law, Francios Desaulniers.  Theron was born </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16151
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">HUMPHREY, Gene R., 55</field>
   <field name="summary">DETROIT - Gene R. Humphrey, 55, died unexpectedly
at his residence on Friday, Dec. 1, 2000. He was born in Hartland, Nov. 18,
1945, a son of Clifton L. and Alice B. (Chipman) Humphrey.   Gene was
employed by Maine Central Institute until his retirement   </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16152
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">JAMISON, Mildred B., 72</field>
   <field name="summary">MANCHESTER - Mildred B. Jamison, 72, died Saturday,
Dec. 2, 2000, at MaineGeneral Nursing and Rehabilitation Center, at Gray
Birch, after a 31-year courageous battle with rheumatoid arthritis and its
various complications.  Mildred was born April 3,      </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16153
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">KEEFE, Cynthia H., 87</field>
   <field name="summary">SEDGWICK - Cynthia Hooper Keefe, 87, died Dec. 3,
2000, at a Deer Isle healthcare facility.  She was born May 17, 1913, in
Brooklin, the daughter of Otis A. and A. Maud (Willey) Hooper.    She was a
graduate of Sedgwick High School and the Eastern Maine  </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16154
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">KUHNS, Faith Hallock Colgan</field>
   <field name="summary">BLUE HILL - Faith Hallock Colgan Kuhns died of
complications from congestive heart failure on Thursday, Nov. 30, 2000, in
Blue Hill. She was with her two daughters, Kristin and Katherine and her
husband of 59 years, James Edward Kuhns.  Mrs. Kuhns had    </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16155
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">LANE, Helen Hughes, 82</field>
   <field name="summary">PALM BEACH, FLA. - Helen Hughes Lane, 82, of North
Palm Beach, Fla., died Dec. 2, 2000.   She was a former public relations
executive in New York City and the widow of furniture manufacturer, Edward
H. Lane of Altavista, Va. In her youth, she wrote The   </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16156
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">LYMBURNER, Grace P., 80</field>
   <field name="summary">BROOKSVILLE - Grace Patricia (Gross) Lymburner, 80,
died December 1, 2000, at a Deer Isle healthcare facility.  She was born
June 4, 1920, in Rockland the daughter of Sterling L. and Harriet (Finley)
Gross.    Grace taught elementary education for many   </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16157
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">OUELLETTE, Diana Judy, 46</field>
   <field name="summary">VAN BUREN - D. Judy Ouellette, 46, died
unexpectedly Dec. 2, 2000, at her Fulton Street residence.  She was born in
Grand Isle, March 16, 1954, the daughter of Mack and Cecile Thibodeau Sr.
She was employed as a nurse&apos;s aide at Borderview Manor in Van
</field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16158
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">RONCO, Adelaide (Clukey), 86</field>
   <field name="summary">DEXTER - Adelaide M. Ronco, 86, died unexpectedly
Dec. 3, 2000, at her Fairway Knolls residence. She was born Nov. 6, 1914, at
Dexter, the daughter of Harry and Rose (LaFountain) Clukey.  She graduated
from N.H. Fay High School, Class of 1932. She was    </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16159
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">SHORTMAN, Mae L.</field>
   <field name="summary">BANGOR AND COOPERS MILLS - Graveside services for
Mae L. Shortman will be held 1:30 p.m. Monday at Mt. Hope Cemetery, Bangor
with Capt. Doug Burr of the Salvation Army, officiating.  Relatives and
friends are invited to meet at the Superintendents Lodge, </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16160
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">SLIPP, Garth L., 79</field>
   <field name="summary">BOWDOIN - Garth L. Slipp, 79, of the West Road,
Bowdoin died Friday afternoon at his home following a period of failing
health.    Mr. Slipp was born in Bridgewater,  Oct. 21,1921, the son of Bert
and Margaret Smith Slipp.   He graduated from Bridgewater </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16161
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">TOOTHAKER, Michael K. Sr., &apos;Mike&apos;,
49</field>
   <field name="summary">HAMPDEN - Michael K. Toothaker Sr., 49, died
unexpectedly Dec. 2, 2000, at a Bangor hospital. He was born in Bangor, May
5, 1951, the son of Phillip D. and Germaine (Knowles) Toothaker.  Mike was a
lifelong resident of Hampden, attended Hampden schools,  </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16162
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">WALKER, Charlotte G., 88</field>
   <field name="summary">BANGOR - Charlotte G. Walker, 88, died Dec. 1,
2000, at a local hospital. The complete obituary will be published in a
later edition of the Bangor Daily News. A service of Brookings-Smith,
Bangor.                                                           </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16163
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">WHITNEY, Philip E., &apos;Chief&apos;</field>
   <field name="summary">BANGOR - Philip E. Whitney died Dec. 1, 2000, at
the Togus VA Hospital. He was born in Bangor, June 2, 1925, the son of
Earnest and Gwendolyn (Hamel) Whitney.  Philip attended Bangor schools and
in 1942 joined the Navy. The &quot;Chief&quot; served in World War II
</field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16164
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">WHITTEN, Ellen M., 82</field>
   <field name="summary">BROWNVILLE - Ellen M. Whitten, 82, loving wife of
the late Richard L. Whitten, died Nov. 30, 2000, at a Bangor hospital after
a long illness. She was born May 21, 1918, in North Brownville, the daughter
of William and Lena Gertrude (Rolfe) McGrath.  She  </field>
   <field name="article"></field>
 </doc>


 <doc>
   <field name="id">obituaries_</field>
   <field name="link">
http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16165
</field>
   <field name="posted">20001204</field>
   <field name="adnumber"></field>
   <field name="vertical">Obituaries</field>
   <field name="author">BDN Classifieds</field>
   <field name="headline">YOUNG, Ashley K., 80</field>
   <field name="summary">HAMPDEN and ORONO - Ashley K. Young Sr., 80, died
Saturday, Dec. 2, 2000, at a Bangor hospital. He was born in LaGrange, Dec.
29, 1919, a son of Ralph A. and Ena E. (Priest) Young Sr.  During his early
years, he entered the U.S. Army during World War II, </field>
   <field name="article"></field>
 </doc>


</add>

Re: duplicating all records added to index

Posted by Tim Archambault <ta...@bangordailynews.net>.
absolutely.

On 9/14/06, Chris Hostetter <ho...@fucit.org> wrote:
>
>
> : >  My index seems to be duplicating all records on insert even though I
> have
> : > my add statements set to not allow duplicates.
> : >
> : > I've provided a samle xml file of add docs. Anyone experienced this?
>
> Is your "id" field listed as the <uniqueKey> in your schema.xml?
>
>
> -Hoss
>

Re: duplicating all records added to index

Posted by Chris Hostetter <ho...@fucit.org>.
: >  My index seems to be duplicating all records on insert even though I have
: > my add statements set to not allow duplicates.
: >
: > I've provided a samle xml file of add docs. Anyone experienced this?

Is your "id" field listed as the <uniqueKey> in your schema.xml?


-Hoss

Re: duplicating all records added to index

Posted by Tim Archambault <ta...@bangordailynews.net>.
In the example I sent the "id" field is not unique, but I've long since
corrected that and still getting duplication. FYI

On 9/14/06, Tim Archambault <ta...@bangordailynews.net> wrote:
>
>  My index seems to be duplicating all records on insert even though I have
> my add statements set to not allow duplicates.
>
> I've provided a samle xml file of add docs. Anyone experienced this?
>
>
> <add  allowDups="false" overwriteCommitted="true" overwritePending="true">
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">
> http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16140
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">BURGESS, Fidalis &apos;Dale&apos; J., 82</field>
>
>    <field name="summary">HERMON - Fidalis &quot;Dale&quot; J. Burgess, 82,
> husband of the late Lottie (Glidden) Burgess, passed away unexpectedly Dec.
> 1, 2000, at his residence. He was born Jan. 21, 1918, in Bangor, the son of
> Elias and Margaret (Cheverie) Burgess.  Dale lived in Hermon   </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16141
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">CLARKE, Paul H., 79</field>
>    <field name="summary">BANGOR- Paul H. Clarke, 79, died Dec. 1, 2000, at
> his residence. He was born Jan. 14, 1921, in Saco the son of Charles and
> Jennie (Larson) Clarke.  Paul was a life long member of Elks Lodge 244,
> Bangor.  He worked most of his life as a meat cutter for    </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16142
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">COMEAU, Janice Mary, 63</field>
>    <field name="summary">WALTHAM - Janice Mary Comeau, 63, died Dec. 1,
> 2000, at her home in Waltham. She was born Oct. 22, 1937, in Hartford,
> Conn., the daughter of Joseph Edmund and Helen (LeBel) Comeau.  Janice
> served her country in the U.S. Army as a nurse. She graduated     </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16143
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">CONNERS, Lois Marie</field>
>    <field name="summary">HERMON AND BANGOR - Funeral services for Lois
> Marie Conners will be held 9:30 a.m. Monday at Brookings-Smith, 133 Center
> St., Bangor with the Rev. Robert T. Carlson, pastor of the East Orrington
> Congregational Church, officiating.  Interment will be in   </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16144
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">CORBETT, Linda L., 53</field>
>    <field name="summary">CARIBOU - Linda L. Corbett, 53, wife of Nathan
> Corbett, died Dec. 1, 2000, at Bangor. She was born at Caribou, March 7,
> 1947, the daughter of Jerry and Luella (Clark) Hewitt.  She was a graduate
> of the Caribou High School and was a loving and devoted     </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16145
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">EDWARDS, James E.</field>
>    <field name="summary">BANGOR - Mr. James E. Edwards died Dec. 2, 2000,
> at his residence after a long illness. He was born in Hartford, Conn., May
> 27, 1929, the son of James V. and Cecelia (Fury) Edwards.  James served in
> the U.S. Navy in Guam attaining the rank of fireman. He </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16146
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">FOLSOM, Robert E., 64</field>
>    <field name="summary">MILLINOCKET - Robert E. Folsom, 64, died at a
> local hospital, Dec. 1, 2000, after a brief illness. He was born in
> Millinocket, the son of Lee and Ada (Hall) Folsom.  Bob retired from Great
> Northern Paper Co. after many years. He was a member of BPO Elks  </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16147
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">FORTIN, Ludger Joseph, 62</field>
>    <field name="summary">CARIBOU - Ludger J. Fortin, 62, died Dec. 2,
> 2000, at Van Buren, after a long illness. He was born at St. Anne, N.B.,
> Canada, Sept. 28, 1938, the son of Edmond and Azilda (Burby) Fortin.  In
> 1960, he married Shirley (Stubbs) Fortin. Ludger was employed   </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16148
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">FOX, Gertrude G.</field>
>    <field name="summary">ORRINGTON - A Mass of Christian Burial for
> Gertrude G. Fox will be celebrated 10 a.m. Monday at St. Teresa Catholic
> Church, Brewer with the Rev. Joel R. Cyr, pastor, celebrant.  Burial will be
> 12 noon Tuesday at the Maine Veterans Memorial Cemetery,      </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16149
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">GRENDELL, Edith, 83</field>
>    <field name="summary">MAPLETON - Edith Grendell, 83, wife of the late
> Ashley A. Grendell, died Dec. 1, 2000, at a Presque Isle health-care
> facility. She was born in Somerville, Mass., Jan. 9, 1917, the daughter of
> Albert B. and Ella (Morrow) MacLaughlin.  She was a member of  </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16150
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">HOWARD, Theron G., 53</field>
>    <field name="summary">BUCKSPORT - On Sunday, Dec. 3, 2000, Theron G.
> Howard, 53, rode the spirit horse home to once again be with his mother and
> father, Phyllis (Robertson) and Urban Coombs, his brother, Steven Howard;
> and father-in-law, Francios Desaulniers.  Theron was born </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16151
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">HUMPHREY, Gene R., 55</field>
>    <field name="summary">DETROIT - Gene R. Humphrey, 55, died unexpectedly
> at his residence on Friday, Dec. 1, 2000. He was born in Hartland, Nov. 18,
> 1945, a son of Clifton L. and Alice B. (Chipman) Humphrey.   Gene was
> employed by Maine Central Institute until his retirement   </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16152
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">JAMISON, Mildred B., 72</field>
>    <field name="summary">MANCHESTER - Mildred B. Jamison, 72, died
> Saturday, Dec. 2, 2000, at MaineGeneral Nursing and Rehabilitation Center,
> at Gray Birch, after a 31-year courageous battle with rheumatoid arthritis
> and its various complications.  Mildred was born April 3,      </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16153
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">KEEFE, Cynthia H., 87</field>
>    <field name="summary">SEDGWICK - Cynthia Hooper Keefe, 87, died Dec. 3,
> 2000, at a Deer Isle healthcare facility.  She was born May 17, 1913, in
> Brooklin, the daughter of Otis A. and A. Maud (Willey) Hooper.    She was a
> graduate of Sedgwick High School and the Eastern Maine  </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16154
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">KUHNS, Faith Hallock Colgan</field>
>    <field name="summary">BLUE HILL - Faith Hallock Colgan Kuhns died of
> complications from congestive heart failure on Thursday, Nov. 30, 2000, in
> Blue Hill. She was with her two daughters, Kristin and Katherine and her
> husband of 59 years, James Edward Kuhns.  Mrs. Kuhns had    </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16155
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">LANE, Helen Hughes, 82</field>
>    <field name="summary">PALM BEACH, FLA. - Helen Hughes Lane, 82, of
> North Palm Beach, Fla., died Dec. 2, 2000.   She was a former public
> relations executive in New York City and the widow of furniture
> manufacturer, Edward H. Lane of Altavista, Va. In her youth, she wrote The
> </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16156
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">LYMBURNER, Grace P., 80</field>
>    <field name="summary">BROOKSVILLE - Grace Patricia (Gross) Lymburner,
> 80, died December 1, 2000, at a Deer Isle healthcare facility.  She was born
> June 4, 1920, in Rockland the daughter of Sterling L. and Harriet (Finley)
> Gross.    Grace taught elementary education for many   </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16157
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">OUELLETTE, Diana Judy, 46</field>
>    <field name="summary">VAN BUREN - D. Judy Ouellette, 46, died
> unexpectedly Dec. 2, 2000, at her Fulton Street residence.  She was born in
> Grand Isle, March 16, 1954, the daughter of Mack and Cecile Thibodeau Sr.
> She was employed as a nurse&apos;s aide at Borderview Manor in Van
> </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16158
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">RONCO, Adelaide (Clukey), 86</field>
>    <field name="summary">DEXTER - Adelaide M. Ronco, 86, died unexpectedly
> Dec. 3, 2000, at her Fairway Knolls residence. She was born Nov. 6, 1914, at
> Dexter, the daughter of Harry and Rose (LaFountain) Clukey.  She graduated
> from N.H. Fay High School, Class of 1932. She was    </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16159
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">SHORTMAN, Mae L.</field>
>    <field name="summary">BANGOR AND COOPERS MILLS - Graveside services for
> Mae L. Shortman will be held 1:30 p.m. Monday at Mt. Hope Cemetery, Bangor
> with Capt. Doug Burr of the Salvation Army, officiating.  Relatives and
> friends are invited to meet at the Superintendents Lodge, </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16160
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">SLIPP, Garth L., 79</field>
>    <field name="summary">BOWDOIN - Garth L. Slipp, 79, of the West Road,
> Bowdoin died Friday afternoon at his home following a period of failing
> health.    Mr. Slipp was born in Bridgewater,  Oct. 21,1921, the son of Bert
> and Margaret Smith Slipp.   He graduated from Bridgewater </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16161
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">TOOTHAKER, Michael K. Sr., &apos;Mike&apos;,
> 49</field>
>    <field name="summary">HAMPDEN - Michael K. Toothaker Sr., 49, died
> unexpectedly Dec. 2, 2000, at a Bangor hospital. He was born in Bangor, May
> 5, 1951, the son of Phillip D. and Germaine (Knowles) Toothaker.  Mike was a
> lifelong resident of Hampden, attended Hampden schools,  </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16162
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">WALKER, Charlotte G., 88</field>
>    <field name="summary">BANGOR - Charlotte G. Walker, 88, died Dec. 1,
> 2000, at a local hospital. The complete obituary will be published in a
> later edition of the Bangor Daily News. A service of Brookings-Smith,
> Bangor.                                                           </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16163
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">WHITNEY, Philip E., &apos;Chief&apos;</field>
>    <field name="summary">BANGOR - Philip E. Whitney died Dec. 1, 2000, at
> the Togus VA Hospital. He was born in Bangor, June 2, 1925, the son of
> Earnest and Gwendolyn (Hamel) Whitney.  Philip attended Bangor schools and
> in 1942 joined the Navy. The &quot;Chief&quot; served in World War II
> </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16164
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">WHITTEN, Ellen M., 82</field>
>    <field name="summary">BROWNVILLE - Ellen M. Whitten, 82, loving wife of
> the late Richard L. Whitten, died Nov. 30, 2000, at a Bangor hospital after
> a long illness. She was born May 21, 1918, in North Brownville, the daughter
> of William and Lena Gertrude (Rolfe) McGrath.  She  </field>
>    <field name="article"></field>
>  </doc>
>
>
>  <doc>
>    <field name="id">obituaries_</field>
>    <field name="link">http://www.bangordailynews.com/a/class/obituaries/obituary.cfm?id=16165
> </field>
>    <field name="posted">20001204</field>
>    <field name="adnumber"></field>
>    <field name="vertical">Obituaries</field>
>    <field name="author">BDN Classifieds</field>
>    <field name="headline">YOUNG, Ashley K., 80</field>
>    <field name="summary">HAMPDEN and ORONO - Ashley K. Young Sr., 80, died
> Saturday, Dec. 2, 2000, at a Bangor hospital. He was born in LaGrange, Dec.
> 29, 1919, a son of Ralph A. and Ena E. (Priest) Young Sr.  During his early
> years, he entered the U.S. Army during World War II, </field>
>    <field name="article"></field>
>  </doc>
>
>
> </add>
>
>
>

Re: duplicating all records added to index

Posted by Chris Hostetter <ho...@fucit.org>.
If you can send out:
  * your schema.xml
  * your solrconfig.xml
  * an XML file containing a couple of example <add><doc>... directives
    for your schema

...that folks can use to try and recreate your situation, that would be
the best way to help figure out what problem you may be having.


: Date: Thu, 14 Sep 2006 13:40:56 -0400
: From: Tim Archambault <ta...@bangordailynews.net>
: Reply-To: solr-user@lucene.apache.org
: To: solr-user@lucene.apache.org
: Subject: Re: duplicating all records added to index
:
: Thanks Yonick. I should not have sent the example code as I later changed
: the "obituaries_" issue. I deleted the whole index folder and started over
: and made sure the pk from the obits table was included in all obituary_#pk#
: from the database and still got dupes.
:
: I also searched to see if I had multiple declarations for "ID" in my schema
: and did not.
:
: I'm going to bomb it and start over tonight.
:
: Learning as I go I guess.
:
:
: On 9/14/06, Yonik Seeley <yo...@apache.org> wrote:
: >
: > On 9/14/06, Tim Archambault <ta...@bangordailynews.net> wrote:
: > > My index seems to be duplicating all records on insert even though I
: > have my
: > > add statements set to not allow duplicates.
: >
: > How did you verify this?
: > When you do a search on id:obituaries_ do you get more than a single
: > result?
: >
: > > <add  allowDups="false" overwriteCommitted="true"
: > overwritePending="true">
: >
: > These options are the default... you shouldn't need to provide them.
: > Try removing the options on the outside chance an option-parsing bug
: > was introduced at some point.
: >
: > -Yonik
: >
:



-Hoss


Re: duplicating all records added to index

Posted by Tim Archambault <ta...@bangordailynews.net>.
Thanks Yonick. I should not have sent the example code as I later changed
the "obituaries_" issue. I deleted the whole index folder and started over
and made sure the pk from the obits table was included in all obituary_#pk#
from the database and still got dupes.

I also searched to see if I had multiple declarations for "ID" in my schema
and did not.

I'm going to bomb it and start over tonight.

Learning as I go I guess.


On 9/14/06, Yonik Seeley <yo...@apache.org> wrote:
>
> On 9/14/06, Tim Archambault <ta...@bangordailynews.net> wrote:
> > My index seems to be duplicating all records on insert even though I
> have my
> > add statements set to not allow duplicates.
>
> How did you verify this?
> When you do a search on id:obituaries_ do you get more than a single
> result?
>
> > <add  allowDups="false" overwriteCommitted="true"
> overwritePending="true">
>
> These options are the default... you shouldn't need to provide them.
> Try removing the options on the outside chance an option-parsing bug
> was introduced at some point.
>
> -Yonik
>

Re: duplicating all records added to index

Posted by Yonik Seeley <yo...@apache.org>.
On 9/14/06, Tim Archambault <ta...@bangordailynews.net> wrote:
> My index seems to be duplicating all records on insert even though I have my
> add statements set to not allow duplicates.

How did you verify this?
When you do a search on id:obituaries_ do you get more than a single result?

> <add  allowDups="false" overwriteCommitted="true" overwritePending="true">

These options are the default... you shouldn't need to provide them.
Try removing the options on the outside chance an option-parsing bug
was introduced at some point.

-Yonik