You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by ma...@apache.org on 2014/02/19 16:50:22 UTC
svn commit: r1569796 - in /lucene/dev/branches/branch_4x: ./ lucene/ solr/
solr/contrib/
solr/contrib/morphlines-cell/src/java/org/apache/solr/morphlines/cell/
solr/contrib/morphlines-cell/src/test/org/apache/solr/morphlines/cell/
solr/contrib/morphlin...
Author: markrmiller
Date: Wed Feb 19 15:50:21 2014
New Revision: 1569796
URL: http://svn.apache.org/r1569796
Log:
SOLR-5729: Merge in bug fixes and minor improvements for mapreduce and morphlines contribs.
Added:
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java
- copied, changed from r1569794, lucene/dev/trunk/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1
- copied, changed from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1
Removed:
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-avro-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.10.0-tests.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-hadoop-sequencefile-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-json-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-saxon-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-core-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-decompress-0.10.0.jar.sha1
lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-twitter-0.10.0.jar.sha1
Modified:
lucene/dev/branches/branch_4x/ (props changed)
lucene/dev/branches/branch_4x/lucene/ (props changed)
lucene/dev/branches/branch_4x/lucene/ivy-versions.properties (contents, props changed)
lucene/dev/branches/branch_4x/solr/ (props changed)
lucene/dev/branches/branch_4x/solr/CHANGES.txt (contents, props changed)
lucene/dev/branches/branch_4x/solr/contrib/ (props changed)
lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/java/org/apache/solr/morphlines/cell/SolrCellBuilder.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/test/org/apache/solr/morphlines/cell/SolrCellMorphlineTest.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/SolrLocator.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/ZooKeeperDownloader.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineTestBase.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineZkTestBase.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineTest.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAliasTest.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAvroTest.java
lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkTest.java
lucene/dev/branches/branch_4x/solr/licenses/ (props changed)
Modified: lucene/dev/branches/branch_4x/lucene/ivy-versions.properties
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/lucene/ivy-versions.properties?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/lucene/ivy-versions.properties (original)
+++ lucene/dev/branches/branch_4x/lucene/ivy-versions.properties Wed Feb 19 15:50:21 2014
@@ -191,7 +191,7 @@ org.gagravarr.vorbis.java.version = 0.1
/org.gagravarr/vorbis-java-core = ${org.gagravarr.vorbis.java.version}
/org.gagravarr/vorbis-java-tika = ${org.gagravarr.vorbis.java.version}
-org.kitesdk.kite-morphlines.version = 0.10.0
+org.kitesdk.kite-morphlines.version = 0.11.0
/org.kitesdk/kite-morphlines-avro = ${org.kitesdk.kite-morphlines.version}
/org.kitesdk/kite-morphlines-core = ${org.kitesdk.kite-morphlines.version}
/org.kitesdk/kite-morphlines-hadoop-sequencefile = ${org.kitesdk.kite-morphlines.version}
Modified: lucene/dev/branches/branch_4x/solr/CHANGES.txt
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/CHANGES.txt?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/CHANGES.txt (original)
+++ lucene/dev/branches/branch_4x/solr/CHANGES.txt Wed Feb 19 15:50:21 2014
@@ -31,6 +31,30 @@ Upgrading from Solr 4.7.0
Detailed Change List
----------------------
+================== 4.8.0 ==================
+
+Versions of Major Components
+---------------------
+Apache Tika 1.4
+Carrot2 3.8.0
+Velocity 1.7 and Velocity Tools 2.0
+Apache UIMA 2.3.1
+Apache ZooKeeper 3.4.5
+
+
+Detailed Change List
+----------------------
+
+New Features
+----------------------
+
+Bug Fixes
+----------------------
+
+* SOLR-5729: Merge in bug fixes and minor improvements for mapreduce and
+ morphlines contribs. (Patrick Hunt via Mark Miller)
+
+
================== 4.7.0 ==================
Versions of Major Components
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/java/org/apache/solr/morphlines/cell/SolrCellBuilder.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/java/org/apache/solr/morphlines/cell/SolrCellBuilder.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/java/org/apache/solr/morphlines/cell/SolrCellBuilder.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/java/org/apache/solr/morphlines/cell/SolrCellBuilder.java Wed Feb 19 15:50:21 2014
@@ -18,7 +18,6 @@ package org.apache.solr.morphlines.cell;
import java.io.IOException;
import java.io.InputStream;
-import java.io.StringWriter;
import java.util.ArrayList;
import java.util.Collection;
import java.util.Collections;
@@ -45,15 +44,12 @@ import org.apache.tika.metadata.Metadata
import org.apache.tika.mime.MediaType;
import org.apache.tika.parser.ParseContext;
import org.apache.tika.parser.Parser;
-import org.apache.tika.sax.TeeContentHandler;
import org.apache.tika.sax.XHTMLContentHandler;
import org.apache.tika.sax.xpath.Matcher;
import org.apache.tika.sax.xpath.MatchingContentHandler;
import org.apache.tika.sax.xpath.XPathParser;
import org.apache.xml.serialize.OutputFormat;
import org.apache.xml.serialize.XMLSerializer;
-import org.xml.sax.ContentHandler;
-import org.xml.sax.SAXException;
import org.kitesdk.morphline.api.Command;
import org.kitesdk.morphline.api.CommandBuilder;
@@ -64,6 +60,9 @@ import org.kitesdk.morphline.api.Record;
import org.kitesdk.morphline.base.Configs;
import org.kitesdk.morphline.base.Fields;
import org.kitesdk.morphline.stdio.AbstractParser;
+import org.xml.sax.ContentHandler;
+import org.xml.sax.SAXException;
+
import com.google.common.base.Joiner;
import com.google.common.base.Preconditions;
import com.google.common.collect.ArrayListMultimap;
@@ -102,6 +101,7 @@ public final class SolrCellBuilder imple
private final String xpathExpr;
private final List<Parser> parsers = new ArrayList();
private final SolrContentHandlerFactory solrContentHandlerFactory;
+ private final Locale locale;
private final SolrParams solrParams;
private final Map<MediaType, Parser> mediaTypeToParserMap;
@@ -163,6 +163,8 @@ public final class SolrCellBuilder imple
}
this.solrContentHandlerFactory = getSolrContentHandlerFactory(factoryClass, dateFormats, config);
+ this.locale = getLocale(getConfigs().getString(config, "locale", ""));
+
this.mediaTypeToParserMap = new HashMap<MediaType, Parser>();
//MimeTypes mimeTypes = MimeTypes.getDefaultMimeTypes(); // FIXME getMediaTypeRegistry.normalize()
@@ -222,6 +224,7 @@ public final class SolrCellBuilder imple
}
ParseContext parseContext = new ParseContext();
+ parseContext.set(Locale.class, locale);
Metadata metadata = new Metadata();
for (Entry<String, Object> entry : record.getFields().entries()) {
@@ -233,12 +236,6 @@ public final class SolrCellBuilder imple
inputStream = TikaInputStream.get(inputStream);
ContentHandler parsingHandler = handler;
- StringWriter debugWriter = null;
- if (LOG.isTraceEnabled()) {
- debugWriter = new StringWriter();
- ContentHandler serializer = new XMLSerializer(debugWriter, new OutputFormat("XML", "UTF-8", true));
- parsingHandler = new TeeContentHandler(parsingHandler, serializer);
- }
// String xpathExpr = "/xhtml:html/xhtml:body/xhtml:div/descendant:node()";
if (xpathExpr != null) {
@@ -255,8 +252,6 @@ public final class SolrCellBuilder imple
} catch (TikaException e) {
throw new MorphlineRuntimeException("Cannot parse", e);
}
-
- LOG.trace("debug XML doc: {}", debugWriter);
} finally {
if (inputStream != null) {
Closeables.closeQuietly(inputStream);
@@ -336,6 +331,18 @@ public final class SolrCellBuilder imple
return record;
}
+ private Locale getLocale(String name) {
+ for (Locale locale : Locale.getAvailableLocales()) {
+ if (locale.toString().equals(name)) {
+ return locale;
+ }
+ }
+ assert Locale.ROOT.toString().equals("");
+ if (name.equals(Locale.ROOT.toString())) {
+ return Locale.ROOT;
+ }
+ throw new MorphlineCompilationException("Unknown locale: " + name, getConfig());
+ }
}
}
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/test/org/apache/solr/morphlines/cell/SolrCellMorphlineTest.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/test/org/apache/solr/morphlines/cell/SolrCellMorphlineTest.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/test/org/apache/solr/morphlines/cell/SolrCellMorphlineTest.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-cell/src/test/org/apache/solr/morphlines/cell/SolrCellMorphlineTest.java Wed Feb 19 15:50:21 2014
@@ -1,4 +1,4 @@
-/**
+/*
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
@@ -50,23 +50,23 @@ public class SolrCellMorphlineTest exten
public void setUp() throws Exception {
super.setUp();
- String path = RESOURCES_DIR + "/test-documents";
- expectedRecords.put(path + "/sample-statuses-20120906-141433.avro", 2);
- expectedRecords.put(path + "/sample-statuses-20120906-141433", 2);
- expectedRecords.put(path + "/sample-statuses-20120906-141433.gz", 2);
- expectedRecords.put(path + "/sample-statuses-20120906-141433.bz2", 2);
- expectedRecords.put(path + "/cars.csv", 6);
- expectedRecords.put(path + "/cars.csv.gz", 6);
- expectedRecords.put(path + "/cars.tar.gz", 4);
- expectedRecords.put(path + "/cars.tsv", 6);
- expectedRecords.put(path + "/cars.ssv", 6);
- expectedRecords.put(path + "/test-documents.7z", 9);
- expectedRecords.put(path + "/test-documents.cpio", 9);
- expectedRecords.put(path + "/test-documents.tar", 9);
- expectedRecords.put(path + "/test-documents.tbz2", 9);
- expectedRecords.put(path + "/test-documents.tgz", 9);
- expectedRecords.put(path + "/test-documents.zip", 9);
- expectedRecords.put(path + "/multiline-stacktrace.log", 4);
+ String path = RESOURCES_DIR + File.separator + "test-documents" + File.separator;
+ expectedRecords.put(path + "sample-statuses-20120906-141433.avro", 2);
+ expectedRecords.put(path + "sample-statuses-20120906-141433", 2);
+ expectedRecords.put(path + "sample-statuses-20120906-141433.gz", 2);
+ expectedRecords.put(path + "sample-statuses-20120906-141433.bz2", 2);
+ expectedRecords.put(path + "cars.csv", 6);
+ expectedRecords.put(path + "cars.csv.gz", 6);
+ expectedRecords.put(path + "cars.tar.gz", 4);
+ expectedRecords.put(path + "cars.tsv", 6);
+ expectedRecords.put(path + "cars.ssv", 6);
+ expectedRecords.put(path + "test-documents.7z", 9);
+ expectedRecords.put(path + "test-documents.cpio", 9);
+ expectedRecords.put(path + "test-documents.tar", 9);
+ expectedRecords.put(path + "test-documents.tbz2", 9);
+ expectedRecords.put(path + "test-documents.tgz", 9);
+ expectedRecords.put(path + "test-documents.zip", 9);
+ expectedRecords.put(path + "multiline-stacktrace.log", 4);
{
Map<String, Object> record = new LinkedHashMap();
@@ -81,7 +81,7 @@ public class SolrCellMorphlineTest exten
}
{
- String file = path + "/testWORD_various.doc";
+ String file = path + "testWORD_various.doc";
Map<String, Object> record = new LinkedHashMap();
record.put("ignored__attachment_mimetype", "application/msword");
record.put("ignored_author", "Michael McCandless");
@@ -94,7 +94,7 @@ public class SolrCellMorphlineTest exten
}
{
- String file = path + "/testPDF.pdf";
+ String file = path + "testPDF.pdf";
Map<String, Object> record = new LinkedHashMap();
record.put("ignored__attachment_mimetype", "application/pdf");
record.put("ignored_author", "Bertrand Delacrétaz");
@@ -106,7 +106,7 @@ public class SolrCellMorphlineTest exten
}
{
- String file = path + "/email.eml";
+ String file = path + "email.eml";
Map<String, Object> record = new LinkedHashMap();
String name = "Patrick Foo <fo...@cloudera.com>";
record.put("ignored__attachment_mimetype", "message/rfc822");
@@ -127,7 +127,7 @@ public class SolrCellMorphlineTest exten
}
{
- String file = path + "/testEXCEL.xlsx";
+ String file = path + "testEXCEL.xlsx";
Map<String, Object> record = new LinkedHashMap();
record.put("ignored__attachment_mimetype", "application/vnd.openxmlformats-officedocument.spreadsheetml.sheet");
record.put("ignored_author", "Keith Bennett");
@@ -142,23 +142,23 @@ public class SolrCellMorphlineTest exten
@Test
public void testSolrCellJPGCompressed() throws Exception {
- morphline = createMorphline("test-morphlines/solrCellJPGCompressed");
- String path = RESOURCES_DIR + "/test-documents";
+ morphline = createMorphline("test-morphlines" + File.separator + "solrCellJPGCompressed");
+ String path = RESOURCES_DIR + File.separator + "test-documents" + File.separator;
String[] files = new String[] {
- path + "/testJPEG_EXIF.jpg",
- path + "/testJPEG_EXIF.jpg.gz",
- path + "/testJPEG_EXIF.jpg.tar.gz",
- //path + "/jpeg2000.jp2",
+ path + "testJPEG_EXIF.jpg",
+ path + "testJPEG_EXIF.jpg.gz",
+ path + "testJPEG_EXIF.jpg.tar.gz",
+ //path + "jpeg2000.jp2",
};
testDocumentTypesInternal(files, expectedRecords, expectedRecordContents);
}
@Test
public void testSolrCellXML() throws Exception {
- morphline = createMorphline("test-morphlines/solrCellXML");
- String path = RESOURCES_DIR + "/test-documents";
+ morphline = createMorphline("test-morphlines" + File.separator + "solrCellXML");
+ String path = RESOURCES_DIR + File.separator + "test-documents" + File.separator;
String[] files = new String[] {
- path + "/testXML2.xml",
+ path + "testXML2.xml",
};
testDocumentTypesInternal(files, expectedRecords, expectedRecordContents);
}
@@ -168,27 +168,27 @@ public class SolrCellMorphlineTest exten
AbstractSolrMorphlineTestBase.setupMorphline(tempDir, "test-morphlines/solrCellDocumentTypes", false);
morphline = createMorphline(new File(tempDir).getAbsolutePath() + "/test-morphlines/solrCellDocumentTypes");
- String path = RESOURCES_DIR + "/test-documents";
+ String path = RESOURCES_DIR + File.separator + "test-documents" + File.separator;
String[] files = new String[] {
- path + "/testBMPfp.txt",
- path + "/boilerplate.html",
- path + "/NullHeader.docx",
- path + "/testWORD_various.doc",
- path + "/testPDF.pdf",
- path + "/testJPEG_EXIF.jpg",
- path + "/testJPEG_EXIF.jpg.gz",
- path + "/testJPEG_EXIF.jpg.tar.gz",
- path + "/testXML.xml",
- path + "/cars.csv",
-// path + "/cars.tsv",
-// path + "/cars.ssv",
- path + "/cars.csv.gz",
- path + "/cars.tar.gz",
- path + "/sample-statuses-20120906-141433.avro",
- path + "/sample-statuses-20120906-141433",
- path + "/sample-statuses-20120906-141433.gz",
- path + "/sample-statuses-20120906-141433.bz2",
- path + "/email.eml",
+ path + "testBMPfp.txt",
+ path + "boilerplate.html",
+ path + "NullHeader.docx",
+ path + "testWORD_various.doc",
+ path + "testPDF.pdf",
+ path + "testJPEG_EXIF.jpg",
+ path + "testJPEG_EXIF.jpg.gz",
+ path + "testJPEG_EXIF.jpg.tar.gz",
+ path + "testXML.xml",
+ path + "cars.csv",
+// path + "cars.tsv",
+// path + "cars.ssv",
+ path + "cars.csv.gz",
+ path + "cars.tar.gz",
+ path + "sample-statuses-20120906-141433.avro",
+ path + "sample-statuses-20120906-141433",
+ path + "sample-statuses-20120906-141433.gz",
+ path + "sample-statuses-20120906-141433.bz2",
+ path + "email.eml",
};
testDocumentTypesInternal(files, expectedRecords, expectedRecordContents);
}
@@ -199,58 +199,58 @@ public class SolrCellMorphlineTest exten
AbstractSolrMorphlineTestBase.setupMorphline(tempDir, "test-morphlines/solrCellDocumentTypes", false);
morphline = createMorphline(new File(tempDir).getAbsolutePath() + "/test-morphlines/solrCellDocumentTypes");
- String path = RESOURCES_DIR + "/test-documents";
+ String path = RESOURCES_DIR + File.separator + "test-documents" + File.separator;
String[] files = new String[] {
- path + "/testPPT_various.ppt",
- path + "/testPPT_various.pptx",
- path + "/testEXCEL.xlsx",
- path + "/testEXCEL.xls",
- path + "/testPages.pages",
- //path + "/testNumbers.numbers",
- //path + "/testKeynote.key",
+ path + "testPPT_various.ppt",
+ path + "testPPT_various.pptx",
+ path + "testEXCEL.xlsx",
+ path + "testEXCEL.xls",
+ path + "testPages.pages",
+ //path + "testNumbers.numbers",
+ //path + "testKeynote.key",
- path + "/testRTFVarious.rtf",
- path + "/complex.mbox",
- path + "/test-outlook.msg",
- path + "/testEMLX.emlx",
- path + "/testRFC822",
- path + "/rsstest.rss",
-// path + "/testDITA.dita",
+ path + "testRTFVarious.rtf",
+ path + "complex.mbox",
+ path + "test-outlook.msg",
+ path + "testEMLX.emlx",
+ path + "testRFC822",
+ path + "rsstest.rss",
+// path + "testDITA.dita",
- path + "/testMP3i18n.mp3",
- path + "/testAIFF.aif",
- path + "/testFLAC.flac",
-// path + "/testFLAC.oga",
-// path + "/testVORBIS.ogg",
- path + "/testMP4.m4a",
- path + "/testWAV.wav",
-// path + "/testWMA.wma",
+ path + "testMP3i18n.mp3",
+ path + "testAIFF.aif",
+ path + "testFLAC.flac",
+// path + "testFLAC.oga",
+// path + "testVORBIS.ogg",
+ path + "testMP4.m4a",
+ path + "testWAV.wav",
+// path + "testWMA.wma",
- path + "/testFLV.flv",
-// path + "/testWMV.wmv",
+ path + "testFLV.flv",
+// path + "testWMV.wmv",
- path + "/testBMP.bmp",
- path + "/testPNG.png",
- path + "/testPSD.psd",
- path + "/testSVG.svg",
- path + "/testTIFF.tif",
-
-// path + "/test-documents.7z",
-// path + "/test-documents.cpio",
-// path + "/test-documents.tar",
-// path + "/test-documents.tbz2",
-// path + "/test-documents.tgz",
-// path + "/test-documents.zip",
-// path + "/test-zip-of-zip.zip",
-// path + "/testJAR.jar",
+ path + "testBMP.bmp",
+ path + "testPNG.png",
+ path + "testPSD.psd",
+ path + "testSVG.svg",
+ path + "testTIFF.tif",
+
+// path + "test-documents.7z",
+// path + "test-documents.cpio",
+// path + "test-documents.tar",
+// path + "test-documents.tbz2",
+// path + "test-documents.tgz",
+// path + "test-documents.zip",
+// path + "test-zip-of-zip.zip",
+// path + "testJAR.jar",
-// path + "/testKML.kml",
-// path + "/testRDF.rdf",
- path + "/testVISIO.vsd",
-// path + "/testWAR.war",
-// path + "/testWindows-x86-32.exe",
-// path + "/testWINMAIL.dat",
-// path + "/testWMF.wmf",
+// path + "testKML.kml",
+// path + "testRDF.rdf",
+ path + "testVISIO.vsd",
+// path + "testWAR.war",
+// path + "testWindows-x86-32.exe",
+// path + "testWINMAIL.dat",
+// path + "testWMF.wmf",
};
testDocumentTypesInternal(files, expectedRecords, expectedRecordContents);
}
Copied: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java (from r1569794, lucene/dev/trunk/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java?p2=lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java&p1=lucene/dev/trunk/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/FileUtils.java&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/SolrLocator.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/SolrLocator.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/SolrLocator.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/SolrLocator.java Wed Feb 19 15:50:21 2014
@@ -16,16 +16,10 @@
*/
package org.apache.solr.morphlines.solr;
-import org.kitesdk.morphline.api.MorphlineCompilationException;
-import org.kitesdk.morphline.api.MorphlineContext;
-import org.kitesdk.morphline.api.MorphlineRuntimeException;
-import org.kitesdk.morphline.base.Configs;
+import java.io.File;
+import java.io.IOException;
-import com.google.common.base.Preconditions;
-import com.typesafe.config.Config;
-import com.typesafe.config.ConfigFactory;
-import com.typesafe.config.ConfigRenderOptions;
-import com.typesafe.config.ConfigUtil;
+import javax.xml.parsers.ParserConfigurationException;
import org.apache.solr.client.solrj.SolrServer;
import org.apache.solr.client.solrj.impl.CloudSolrServer;
@@ -35,16 +29,21 @@ import org.apache.solr.core.SolrResource
import org.apache.solr.schema.IndexSchema;
import org.apache.solr.util.SystemIdResolver;
import org.apache.zookeeper.KeeperException;
+import org.kitesdk.morphline.api.MorphlineCompilationException;
+import org.kitesdk.morphline.api.MorphlineContext;
+import org.kitesdk.morphline.api.MorphlineRuntimeException;
+import org.kitesdk.morphline.base.Configs;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.xml.sax.InputSource;
import org.xml.sax.SAXException;
-import javax.xml.parsers.ParserConfigurationException;
-
-import java.io.File;
-import java.io.IOException;
-import java.net.MalformedURLException;
+import com.google.common.base.Preconditions;
+import com.google.common.io.Files;
+import com.typesafe.config.Config;
+import com.typesafe.config.ConfigFactory;
+import com.typesafe.config.ConfigRenderOptions;
+import com.typesafe.config.ConfigUtil;
/**
* Set of configuration parameters that identify the location and schema of a Solr server or
@@ -119,55 +118,67 @@ public class SolrLocator {
return schema;
}
}
-
- // If solrHomeDir isn't defined and zkHost and collectionName are defined
- // then download schema.xml and solrconfig.xml, etc from zk and use that as solrHomeDir
- String mySolrHomeDir = solrHomeDir;
- if (solrHomeDir == null || solrHomeDir.length() == 0) {
- if (zkHost == null || zkHost.length() == 0) {
- // TODO: implement download from solrUrl if specified
- throw new MorphlineCompilationException(
- "Downloading a Solr schema requires either parameter 'solrHomeDir' or parameters 'zkHost' and 'collection'",
- config);
- }
- if (collectionName == null || collectionName.length() == 0) {
- throw new MorphlineCompilationException(
- "Parameter 'zkHost' requires that you also pass parameter 'collection'", config);
+
+ File downloadedSolrHomeDir = null;
+ try {
+ // If solrHomeDir isn't defined and zkHost and collectionName are defined
+ // then download schema.xml and solrconfig.xml, etc from zk and use that as solrHomeDir
+ String mySolrHomeDir = solrHomeDir;
+ if (solrHomeDir == null || solrHomeDir.length() == 0) {
+ if (zkHost == null || zkHost.length() == 0) {
+ // TODO: implement download from solrUrl if specified
+ throw new MorphlineCompilationException(
+ "Downloading a Solr schema requires either parameter 'solrHomeDir' or parameters 'zkHost' and 'collection'",
+ config);
+ }
+ if (collectionName == null || collectionName.length() == 0) {
+ throw new MorphlineCompilationException(
+ "Parameter 'zkHost' requires that you also pass parameter 'collection'", config);
+ }
+ ZooKeeperDownloader zki = new ZooKeeperDownloader();
+ SolrZkClient zkClient = zki.getZkClient(zkHost);
+ try {
+ String configName = zki.readConfigName(zkClient, collectionName);
+ downloadedSolrHomeDir = Files.createTempDir();
+ downloadedSolrHomeDir = zki.downloadConfigDir(zkClient, configName, downloadedSolrHomeDir);
+ mySolrHomeDir = downloadedSolrHomeDir.getAbsolutePath();
+ } catch (KeeperException e) {
+ throw new MorphlineCompilationException("Cannot download schema.xml from ZooKeeper", config, e);
+ } catch (InterruptedException e) {
+ throw new MorphlineCompilationException("Cannot download schema.xml from ZooKeeper", config, e);
+ } catch (IOException e) {
+ throw new MorphlineCompilationException("Cannot download schema.xml from ZooKeeper", config, e);
+ } finally {
+ zkClient.close();
+ }
}
- ZooKeeperDownloader zki = new ZooKeeperDownloader();
- SolrZkClient zkClient = zki.getZkClient(zkHost);
+
+ LOG.debug("SolrLocator loading IndexSchema from dir {}", mySolrHomeDir);
try {
- String configName = zki.readConfigName(zkClient, collectionName);
- File downloadedSolrHomeDir = zki.downloadConfigDir(zkClient, configName);
- mySolrHomeDir = downloadedSolrHomeDir.getAbsolutePath();
- } catch (KeeperException e) {
- throw new MorphlineCompilationException("Cannot download schema.xml from ZooKeeper", config, e);
- } catch (InterruptedException e) {
- throw new MorphlineCompilationException("Cannot download schema.xml from ZooKeeper", config, e);
+ SolrResourceLoader loader = new SolrResourceLoader(mySolrHomeDir);
+ SolrConfig solrConfig = new SolrConfig(loader, "solrconfig.xml", null);
+ InputSource is = new InputSource(loader.openSchema("schema.xml"));
+ is.setSystemId(SystemIdResolver.createSystemIdFromResourceName("schema.xml"));
+
+ IndexSchema schema = new IndexSchema(solrConfig, "schema.xml", is);
+ validateSchema(schema);
+ return schema;
+ } catch (ParserConfigurationException e) {
+ throw new MorphlineRuntimeException(e);
} catch (IOException e) {
- throw new MorphlineCompilationException("Cannot download schema.xml from ZooKeeper", config, e);
- } finally {
- zkClient.close();
+ throw new MorphlineRuntimeException(e);
+ } catch (SAXException e) {
+ throw new MorphlineRuntimeException(e);
+ }
+ } finally {
+ if (downloadedSolrHomeDir != null) {
+ try {
+ FileUtils.deleteDirectory(downloadedSolrHomeDir);
+ } catch (IOException e) {
+ LOG.warn("Cannot delete tmp directory", e);
+ }
}
}
-
- LOG.debug("SolrLocator loading IndexSchema from dir {}", mySolrHomeDir);
- try {
- SolrResourceLoader loader = new SolrResourceLoader(mySolrHomeDir);
- SolrConfig solrConfig = new SolrConfig(loader, "solrconfig.xml", null);
- InputSource is = new InputSource(loader.openSchema("schema.xml"));
- is.setSystemId(SystemIdResolver.createSystemIdFromResourceName("schema.xml"));
-
- IndexSchema schema = new IndexSchema(solrConfig, "schema.xml", is);
- validateSchema(schema);
- return schema;
- } catch (ParserConfigurationException e) {
- throw new MorphlineRuntimeException(e);
- } catch (IOException e) {
- throw new MorphlineRuntimeException(e);
- } catch (SAXException e) {
- throw new MorphlineRuntimeException(e);
- }
}
private void validateSchema(IndexSchema schema) {
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/ZooKeeperDownloader.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/ZooKeeperDownloader.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/ZooKeeperDownloader.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/java/org/apache/solr/morphlines/solr/ZooKeeperDownloader.java Wed Feb 19 15:50:21 2014
@@ -31,6 +31,7 @@ import org.apache.zookeeper.KeeperExcept
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
+import com.google.common.base.Preconditions;
import com.google.common.io.Files;
/**
@@ -100,10 +101,10 @@ final class ZooKeeperDownloader {
/**
* Download and return the config directory from ZK
*/
- public File downloadConfigDir(SolrZkClient zkClient, String configName)
+ public File downloadConfigDir(SolrZkClient zkClient, String configName, File dir)
throws IOException, InterruptedException, KeeperException {
- File dir = Files.createTempDir();
- dir.deleteOnExit();
+ Preconditions.checkArgument(dir.exists());
+ Preconditions.checkArgument(dir.isDirectory());
ZkController.downloadConfigDir(zkClient, configName, dir);
File confDir = new File(dir, "conf");
if (!confDir.isDirectory()) {
@@ -116,7 +117,23 @@ final class ZooKeeperDownloader {
Files.move(dir, confDir);
dir = confDir.getParentFile();
}
+ verifyConfigDir(confDir);
return dir;
}
+
+ private void verifyConfigDir(File confDir) throws IOException {
+ File solrConfigFile = new File(confDir, "solrconfig.xml");
+ if (!solrConfigFile.exists()) {
+ throw new IOException("Detected invalid Solr config dir in ZooKeeper - Reason: File not found: "
+ + solrConfigFile.getName());
+ }
+ if (!solrConfigFile.isFile()) {
+ throw new IOException("Detected invalid Solr config dir in ZooKeeper - Reason: Not a file: "
+ + solrConfigFile.getName());
+ }
+ if (!solrConfigFile.canRead()) {
+ throw new IOException("Insufficient permissions to read file: " + solrConfigFile);
+ }
+ }
}
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineTestBase.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineTestBase.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineTestBase.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineTestBase.java Wed Feb 19 15:50:21 2014
@@ -54,6 +54,7 @@ import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import com.codahale.metrics.MetricRegistry;
+import com.google.common.base.Joiner;
import com.google.common.io.Files;
import com.typesafe.config.Config;
@@ -85,10 +86,11 @@ public class AbstractSolrMorphlineTestBa
}
protected static void myInitCore(String baseDirName) throws Exception {
+ Joiner joiner = Joiner.on(File.separator);
initCore(
- RESOURCES_DIR + "/" + baseDirName + "/collection1/conf/solrconfig.xml",
- RESOURCES_DIR + "/" + baseDirName + "/collection1/conf/schema.xml",
- RESOURCES_DIR + "/" + baseDirName
+ joiner.join(RESOURCES_DIR, baseDirName, "collection1", "conf", "solrconfig.xml"),
+ joiner.join(RESOURCES_DIR, baseDirName, "collection1", "conf", "schema.xml"),
+ joiner.join(RESOURCES_DIR, baseDirName)
);
}
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineZkTestBase.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineZkTestBase.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineZkTestBase.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/AbstractSolrMorphlineZkTestBase.java Wed Feb 19 15:50:21 2014
@@ -42,6 +42,7 @@ import org.kitesdk.morphline.base.Compil
import org.kitesdk.morphline.base.FaultTolerance;
import org.kitesdk.morphline.base.Notifications;
import org.kitesdk.morphline.stdlib.PipeBuilder;
+
import com.codahale.metrics.MetricRegistry;
import com.google.common.collect.ListMultimap;
import com.typesafe.config.Config;
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineTest.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineTest.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineTest.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineTest.java Wed Feb 19 15:50:21 2014
@@ -16,6 +16,7 @@
*/
package org.apache.solr.morphlines.solr;
+import java.io.File;
import java.util.Arrays;
import org.apache.lucene.util.Constants;
@@ -57,7 +58,7 @@ public class SolrMorphlineTest extends A
@Test
public void testTokenizeText() throws Exception {
- morphline = createMorphline("test-morphlines/tokenizeText");
+ morphline = createMorphline("test-morphlines" + File.separator + "tokenizeText");
for (int i = 0; i < 3; i++) {
Record record = new Record();
record.put(Fields.MESSAGE, "Hello World!");
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAliasTest.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAliasTest.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAliasTest.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAliasTest.java Wed Feb 19 15:50:21 2014
@@ -16,6 +16,7 @@
*/
package org.apache.solr.morphlines.solr;
+import java.io.File;
import java.io.IOException;
import java.util.Iterator;
@@ -31,6 +32,9 @@ import org.apache.solr.common.params.Col
import org.apache.solr.common.params.ModifiableSolrParams;
import org.apache.solr.common.util.NamedList;
import org.junit.BeforeClass;
+import org.kitesdk.morphline.api.Record;
+import org.kitesdk.morphline.base.Fields;
+import org.kitesdk.morphline.base.Notifications;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakAction;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakAction.Action;
@@ -39,9 +43,6 @@ import com.carrotsearch.randomizedtestin
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakScope.Scope;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakZombies;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakZombies.Consequence;
-import org.kitesdk.morphline.api.Record;
-import org.kitesdk.morphline.base.Fields;
-import org.kitesdk.morphline.base.Notifications;
@ThreadLeakAction({Action.WARN})
@ThreadLeakLingering(linger = 0)
@@ -64,7 +65,7 @@ public class SolrMorphlineZkAliasTest ex
createAlias("aliascollection", "collection1");
- morphline = parse("test-morphlines/loadSolrBasic", "aliascollection");
+ morphline = parse("test-morphlines" + File.separator + "loadSolrBasic", "aliascollection");
Record record = new Record();
record.put(Fields.ID, "id0-innsbruck");
record.put("text", "mytext");
@@ -113,7 +114,7 @@ public class SolrMorphlineZkAliasTest ex
createAlias("aliascollection", "collection1,collection2");
try {
- parse("test-morphlines/loadSolrBasic", "aliascollection");
+ parse("test-morphlines" + File.separator + "loadSolrBasic", "aliascollection");
fail("Expected IAE because update alias maps to multiple collections");
} catch (IllegalArgumentException e) {
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAvroTest.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAvroTest.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAvroTest.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkAvroTest.java Wed Feb 19 15:50:21 2014
@@ -35,6 +35,9 @@ import org.apache.solr.client.solrj.Solr
import org.apache.solr.client.solrj.response.QueryResponse;
import org.apache.solr.common.SolrDocument;
import org.junit.BeforeClass;
+import org.kitesdk.morphline.api.Record;
+import org.kitesdk.morphline.base.Fields;
+import org.kitesdk.morphline.base.Notifications;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakAction;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakAction.Action;
@@ -43,9 +46,7 @@ import com.carrotsearch.randomizedtestin
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakScope.Scope;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakZombies;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakZombies.Consequence;
-import org.kitesdk.morphline.api.Record;
-import org.kitesdk.morphline.base.Fields;
-import org.kitesdk.morphline.base.Notifications;
+import com.google.common.base.Joiner;
import com.google.common.base.Preconditions;
import com.google.common.io.Files;
@@ -65,12 +66,13 @@ public class SolrMorphlineZkAvroTest ext
@Override
public void doTest() throws Exception {
- File file = new File(RESOURCES_DIR + "/test-documents/sample-statuses-20120906-141433-medium.avro");
+ Joiner joiner = Joiner.on(File.separator);
+ File file = new File(joiner.join(RESOURCES_DIR, "test-documents", "sample-statuses-20120906-141433-medium.avro"));
waitForRecoveriesToFinish(false);
// load avro records via morphline and zk into solr
- morphline = parse("test-morphlines/tutorialReadAvroContainer");
+ morphline = parse("test-morphlines" + File.separator + "tutorialReadAvroContainer");
Record record = new Record();
byte[] body = Files.toByteArray(file);
record.put(Fields.ATTACHMENT_BODY, body);
Modified: lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkTest.java
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkTest.java?rev=1569796&r1=1569795&r2=1569796&view=diff
==============================================================================
--- lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkTest.java (original)
+++ lucene/dev/branches/branch_4x/solr/contrib/morphlines-core/src/test/org/apache/solr/morphlines/solr/SolrMorphlineZkTest.java Wed Feb 19 15:50:21 2014
@@ -16,6 +16,7 @@
*/
package org.apache.solr.morphlines.solr;
+import java.io.File;
import java.util.Iterator;
import org.apache.lucene.util.Constants;
@@ -25,6 +26,9 @@ import org.apache.solr.client.solrj.Solr
import org.apache.solr.client.solrj.response.QueryResponse;
import org.apache.solr.common.SolrDocument;
import org.junit.BeforeClass;
+import org.kitesdk.morphline.api.Record;
+import org.kitesdk.morphline.base.Fields;
+import org.kitesdk.morphline.base.Notifications;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakAction;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakAction.Action;
@@ -33,9 +37,6 @@ import com.carrotsearch.randomizedtestin
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakScope.Scope;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakZombies;
import com.carrotsearch.randomizedtesting.annotations.ThreadLeakZombies.Consequence;
-import org.kitesdk.morphline.api.Record;
-import org.kitesdk.morphline.base.Fields;
-import org.kitesdk.morphline.base.Notifications;
@ThreadLeakAction({Action.WARN})
@ThreadLeakLingering(linger = 0)
@@ -56,7 +57,7 @@ public class SolrMorphlineZkTest extends
waitForRecoveriesToFinish(false);
- morphline = parse("test-morphlines/loadSolrBasic");
+ morphline = parse("test-morphlines" + File.separator + "loadSolrBasic");
Record record = new Record();
record.put(Fields.ID, "id0-innsbruck");
record.put("text", "mytext");
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-avro-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-core-0.11.0-tests.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-core-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-hadoop-sequencefile-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-json-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-saxon-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-tika-core-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-tika-decompress-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)
Copied: lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1 (from r1569794, lucene/dev/trunk/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1)
URL: http://svn.apache.org/viewvc/lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1?p2=lucene/dev/branches/branch_4x/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1&p1=lucene/dev/trunk/solr/licenses/kite-morphlines-twitter-0.11.0.jar.sha1&r1=1569794&r2=1569796&rev=1569796&view=diff
==============================================================================
(empty)