You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Jose Raul Perez Rodriguez <jo...@gmail.com> on 2018/12/29 12:29:25 UTC

about testing distributed features

Hi all,

I am interested in contribute to solr and I have a couple o details I 
would like to know but I can't find the answer in the doc. If its 
possible, what kinds of aspects of distributed features of solr 
(replication, lucene index sharding, etc) are tested in the tests 
included in the repo https://github.com/apache/lucene-solr?. And if 
there is any like an external tool for test solr distributed features as 
a whole system?

Many Thanks in advance,

Jr

On 12/29/18 1:23 PM, dev-help@lucene.apache.org wrote:
> Hi! This is the ezmlm program. I'm managing the
> dev@lucene.apache.org mailing list.
>
> Acknowledgment: I have added the address
>
>     joseraul.subscription@gmail.com
>
> to the dev mailing list.
>
> Welcome to dev@lucene.apache.org!
>
> Please save this message so that you know the address you are
> subscribed under, in case you later want to unsubscribe or change your
> subscription address.
>
>
> --- Administrative commands for the dev list ---
>
> I can handle administrative requests automatically. Please
> do not send them to the list address! Instead, send
> your message to the correct command address:
>
> To subscribe to the list, send a message to:
>     <de...@lucene.apache.org>
>
> To remove your address from the list, send a message to:
>     <de...@lucene.apache.org>
>
> Send mail to the following for info and FAQ for this list:
>     <de...@lucene.apache.org>
>     <de...@lucene.apache.org>
>
> Similar addresses exist for the digest list:
>     <de...@lucene.apache.org>
>     <de...@lucene.apache.org>
>
> To get messages 123 through 145 (a maximum of 100 per request), mail:
>     <de...@lucene.apache.org>
>
> To get an index with subject and author for messages 123-456 , mail:
>     <de...@lucene.apache.org>
>
> They are always returned as sets of 100, max 2000 per request,
> so you'll actually get 100-499.
>
> To receive all messages with the same subject as message 12345,
> send a short message to:
>     <de...@lucene.apache.org>
>
> The messages should contain one line or word of text to avoid being
> treated as sp@m, but I will ignore their content.
> Only the ADDRESS you send to is important.
>
> You can start a subscription for an alternate address,
> for example "john@host.domain", just add a hyphen and your
> address (with '=' instead of '@') after the command word:
> <de...@lucene.apache.org>
>
> To stop subscription for this address, mail:
> <de...@lucene.apache.org>
>
> In both cases, I'll send a confirmation message to that address. When
> you receive it, simply reply to it to complete your subscription.
>
> If despite following these instructions, you do not get the
> desired results, please contact my owner at
> dev-owner@lucene.apache.org. Please be patient, my owner is a
> lot slower than I am ;-)
>
> --- Enclosed is a copy of the request I received.
>
> Return-Path: <jo...@gmail.com>
> Received: (qmail 73053 invoked by uid 99); 29 Dec 2018 12:23:23 -0000
> Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142)
>      by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Dec 2018 12:23:23 +0000
> Received: from localhost (localhost [127.0.0.1])
> 	by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2F7E0180F8C
> 	for <de...@lucene.apache.org>; Sat, 29 Dec 2018 12:23:23 +0000 (UTC)
> X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org
> X-Spam-Flag: NO
> X-Spam-Score: -0.203
> X-Spam-Level:
> X-Spam-Status: No, score=-0.203 tagged_above=-999 required=6.31
> 	tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1,
> 	DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001,
> 	RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled
> Authentication-Results: spamd3-us-west.apache.org (amavisd-new);
> 	dkim=pass (2048-bit key) header.d=gmail.com
> Received: from mx1-lw-us.apache.org ([10.40.0.8])
> 	by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024)
> 	with ESMTP id ho2hFxHqhG_S
> 	for <de...@lucene.apache.org>;
> 	Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
> Received: from mail-wr1-f48.google.com (mail-wr1-f48.google.com [209.85.221.48])
> 	by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 0A4D060FBD
> 	for <de...@lucene.apache.org>; Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
> Received: by mail-wr1-f48.google.com with SMTP id v13so23006289wrw.5
>          for <de...@lucene.apache.org>; Sat, 29 Dec 2018 04:23:21 -0800 (PST)
> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
>          d=gmail.com; s=20161025;
>          h=to:from:subject:message-id:date:user-agent:mime-version
>           :content-transfer-encoding:content-language;
>          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
>          b=AoyqSfbhk/02hiFtHtNKoUoBnGDd/g7XhoCY3jiu+h10j/hPx3+QOG/t7w5DgqJvu3
>           y4w/Vd0w0eROD8B0zL/fDtdJABDvf/6s7eS8vg7DqFmOPb52Z4L7kSe4aHLXc+FJzj3Z
>           74P1iETJR+0nyYjWE+AZC6bRUg5EATYsgUYD3OFv4WQ3X4a5AyWvcaODLyDCm4lvOdp6
>           LOl+wck6Kp0jflF5ycMAA7a+yqDPG8LP4IBiY1MDlWOmzhYJMYVpFB9FzYlwU0E57DLE
>           4nzYETlOGqSC0SuLoNxuED3QZqVwbbGrWj5hB31STHwMCcd6Iug90tHhwXziWFppc4za
>           MkBQ==
> X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
>          d=1e100.net; s=20161025;
>          h=x-gm-message-state:to:from:subject:message-id:date:user-agent
>           :mime-version:content-transfer-encoding:content-language;
>          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
>          b=AF7zULS6VHLL22l+zGX2N9kwYZ3GQKRGfsw3K1AG+f9muWY60dnGmCH/E9bEe1oaQs
>           9K10qgr2CDy1rkg/L+d+qWgsPiL+h7sswgqmbCsY1yofcqXlImmTSofuITDPisXNE17P
>           Py6WdTZYVSZwGncGzMqTgYydXhxlQovpUMgqcIHM/1JBFDGoQ572D+i9Hej0C2Xn1okH
>           uWmmw6wNyipvDwwgh/Fihqpjct4o8FycUydhSk0kWRuIbRo8o+4kRBBCZWvVtuGcC/yM
>           wSc9R0fA9XEEfcpUUI2lJqTaaMRp9SrTxQnXUO2KY1pJYEBKqeCQ+wYAzoAFMKLuY+10
>           OfRw==
> X-Gm-Message-State: AJcUukfE9qgui2xrZFGdj80EUrdUgS6EFuzQRykMr5Pn/dZHHos0a+TI
> 	Yzgi1CdPxcRBDTmun3Ksm2n9QNjQ
> X-Google-Smtp-Source: ALg8bN5NppwygVHN4UQxlnkVuJ/nkV+JuGbXmr0X7bupnBIHBQ/vI8v453Dlq1bMICjZyqGvtG6Z0w==
> X-Received: by 2002:adf:c042:: with SMTP id c2mr29279246wrf.158.1546086195331;
>          Sat, 29 Dec 2018 04:23:15 -0800 (PST)
> Received: from [192.168.1.107] (60.27.134.37.dynamic.jazztel.es. [37.134.27.60])
>          by smtp.gmail.com with ESMTPSA id p4sm27829580wrs.74.2018.12.29.04.23.14
>          for <de...@lucene.apache.org>
>          (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
>          Sat, 29 Dec 2018 04:23:14 -0800 (PST)
> To: dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
> From: Jose Raul Perez Rodriguez <jo...@gmail.com>
> Subject: subs
> Message-ID: <b5...@gmail.com>
> Date: Sat, 29 Dec 2018 13:23:14 +0100
> User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
>   Thunderbird/60.2.1
> MIME-Version: 1.0
> Content-Type: text/plain; charset=utf-8; format=flowed
> Content-Transfer-Encoding: 7bit
> Content-Language: en-US
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: about testing distributed features

Posted by David Smiley <da...@gmail.com>.
No, it's not done on a real/physical set of servers.  Instead the test
harness creates multiple Solr/Jetty servers in one JVM; the same used for
tests.

On Thu, Jan 3, 2019 at 5:49 AM Jose Raul Perez Rodriguez <
joseraul.subscription@gmail.com> wrote:

> Hi David, thanks for the answer.
>
> Let me reformulate the doubt in a different way; what I was trying to ask
> is, if the testing of Solr distributed features are performed in a
> distributed environment; like deploying a test Solr Cloud Cluster on some
> machines, to perform test on sharding, partitioning, etc.
>
> If this is done on some way here in solr, could you explain a bit, how can
> I introduce in it, what technologies are used, etc.
>
> Thanks a lot in advance
>
>
>
> On 12/31/18 5:37 PM, David Smiley wrote:
>
> Hi Jose,
>
> Just about everything is tested.  If you are looking to improve some
> aspect of SolrCloud's internals, then I suggest looking for existing tests
> of that particular aspect.  If you are working on a feature that wants
> SolrCloud (whole system integration test) then I suggest
> subclassing SolrCloudTestCase.  You will see many such subclasses already,
> and you can learn from them.  You can have an external project that depends
> on solr-test-framework.  Note that it may be essential to depend on that
> before any explicit dependencies on solr core or solrj that you may have.
>
> ~ David
>
> On Sat, Dec 29, 2018 at 7:29 AM Jose Raul Perez Rodriguez <
> joseraul.subscription@gmail.com> wrote:
>
>> Hi all,
>>
>> I am interested in contribute to solr and I have a couple o details I
>> would like to know but I can't find the answer in the doc. If its
>> possible, what kinds of aspects of distributed features of solr
>> (replication, lucene index sharding, etc) are tested in the tests
>> included in the repo https://github.com/apache/lucene-solr?. And if
>> there is any like an external tool for test solr distributed features as
>> a whole system?
>>
>> Many Thanks in advance,
>>
>> Jr
>>
>> On 12/29/18 1:23 PM, dev-help@lucene.apache.org wrote:
>> > Hi! This is the ezmlm program. I'm managing the
>> > dev@lucene.apache.org mailing list.
>> >
>> > Acknowledgment: I have added the address
>> >
>> >     joseraul.subscription@gmail.com
>> >
>> > to the dev mailing list.
>> >
>> > Welcome to dev@lucene.apache.org!
>> >
>> > Please save this message so that you know the address you are
>> > subscribed under, in case you later want to unsubscribe or change your
>> > subscription address.
>> >
>> >
>> > --- Administrative commands for the dev list ---
>> >
>> > I can handle administrative requests automatically. Please
>> > do not send them to the list address! Instead, send
>> > your message to the correct command address:
>> >
>> > To subscribe to the list, send a message to:
>> >     <de...@lucene.apache.org>
>> >
>> > To remove your address from the list, send a message to:
>> >     <de...@lucene.apache.org>
>> >
>> > Send mail to the following for info and FAQ for this list:
>> >     <de...@lucene.apache.org>
>> >     <de...@lucene.apache.org>
>> >
>> > Similar addresses exist for the digest list:
>> >     <de...@lucene.apache.org>
>> >     <de...@lucene.apache.org>
>> >
>> > To get messages 123 through 145 (a maximum of 100 per request), mail:
>> >     <de...@lucene.apache.org>
>> >
>> > To get an index with subject and author for messages 123-456 , mail:
>> >     <de...@lucene.apache.org>
>> >
>> > They are always returned as sets of 100, max 2000 per request,
>> > so you'll actually get 100-499.
>> >
>> > To receive all messages with the same subject as message 12345,
>> > send a short message to:
>> >     <de...@lucene.apache.org>
>> >
>> > The messages should contain one line or word of text to avoid being
>> > treated as sp@m, but I will ignore their content.
>> > Only the ADDRESS you send to is important.
>> >
>> > You can start a subscription for an alternate address,
>> > for example "john@host.domain" <jo...@host.domain>, just add a hyphen
>> and your
>> > address (with '=' instead of '@') after the command word:
>> > <de...@lucene.apache.org>
>> >
>> > To stop subscription for this address, mail:
>> > <de...@lucene.apache.org>
>> >
>> > In both cases, I'll send a confirmation message to that address. When
>> > you receive it, simply reply to it to complete your subscription.
>> >
>> > If despite following these instructions, you do not get the
>> > desired results, please contact my owner at
>> > dev-owner@lucene.apache.org. Please be patient, my owner is a
>> > lot slower than I am ;-)
>> >
>> > --- Enclosed is a copy of the request I received.
>> >
>> > Return-Path: <jo...@gmail.com>
>> > Received: (qmail 73053 invoked by uid 99); 29 Dec 2018 12:23:23 -0000
>> > Received: from pnap-us-west-generic-nat.apache.org (HELO
>> spamd3-us-west.apache.org) (209.188.14.142)
>> >      by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Dec 2018
>> 12:23:23 +0000
>> > Received: from localhost (localhost [127.0.0.1])
>> >       by spamd3-us-west.apache.org (ASF Mail Server at
>> spamd3-us-west.apache.org) with ESMTP id 2F7E0180F8C
>> >       for <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
>> gmail.com@lucene.apache.org>; Sat, 29 Dec 2018 12:23:23 +0000 (UTC)
>> > X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org
>> > X-Spam-Flag: NO
>> > X-Spam-Score: -0.203
>> > X-Spam-Level:
>> > X-Spam-Status: No, score=-0.203 tagged_above=-999 required=6.31
>> >       tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1,
>> >       DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
>> RCVD_IN_DNSWL_NONE=-0.0001,
>> >       RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled
>> > Authentication-Results: spamd3-us-west.apache.org (amavisd-new);
>> >       dkim=pass (2048-bit key) header.d=gmail.com
>> > Received: from mx1-lw-us.apache.org ([10.40.0.8])
>> >       by localhost (spamd3-us-west.apache.org [10.40.0.10])
>> (amavisd-new, port 10024)
>> >       with ESMTP id ho2hFxHqhG_S
>> >       for <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
>> gmail.com@lucene.apache.org>;
>> >       Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
>> > Received: from mail-wr1-f48.google.com (mail-wr1-f48.google.com
>> [209.85.221.48])
>> >       by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org)
>> with ESMTPS id 0A4D060FBD
>> >       for <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
>> gmail.com@lucene.apache.org>; Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
>> > Received: by mail-wr1-f48.google.com with SMTP id v13so23006289wrw.5
>> >          for
>> <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
>> gmail.com@lucene.apache.org>; Sat, 29 Dec 2018 04:23:21 -0800 (PST)
>> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
>> >          d=gmail.com; s=20161025;
>> >          h=to:from:subject:message-id:date:user-agent:mime-version
>> >           :content-transfer-encoding:content-language;
>> >          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
>> >
>> b=AoyqSfbhk/02hiFtHtNKoUoBnGDd/g7XhoCY3jiu+h10j/hPx3+QOG/t7w5DgqJvu3
>> >
>>  y4w/Vd0w0eROD8B0zL/fDtdJABDvf/6s7eS8vg7DqFmOPb52Z4L7kSe4aHLXc+FJzj3Z
>> >
>>  74P1iETJR+0nyYjWE+AZC6bRUg5EATYsgUYD3OFv4WQ3X4a5AyWvcaODLyDCm4lvOdp6
>> >
>>  LOl+wck6Kp0jflF5ycMAA7a+yqDPG8LP4IBiY1MDlWOmzhYJMYVpFB9FzYlwU0E57DLE
>> >
>>  4nzYETlOGqSC0SuLoNxuED3QZqVwbbGrWj5hB31STHwMCcd6Iug90tHhwXziWFppc4za
>> >           MkBQ==
>> > X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
>> >          d=1e100.net; s=20161025;
>> >          h=x-gm-message-state:to:from:subject:message-id:date:user-agent
>> >           :mime-version:content-transfer-encoding:content-language;
>> >          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
>> >
>> b=AF7zULS6VHLL22l+zGX2N9kwYZ3GQKRGfsw3K1AG+f9muWY60dnGmCH/E9bEe1oaQs
>> >
>>  9K10qgr2CDy1rkg/L+d+qWgsPiL+h7sswgqmbCsY1yofcqXlImmTSofuITDPisXNE17P
>> >
>>  Py6WdTZYVSZwGncGzMqTgYydXhxlQovpUMgqcIHM/1JBFDGoQ572D+i9Hej0C2Xn1okH
>> >
>>  uWmmw6wNyipvDwwgh/Fihqpjct4o8FycUydhSk0kWRuIbRo8o+4kRBBCZWvVtuGcC/yM
>> >
>>  wSc9R0fA9XEEfcpUUI2lJqTaaMRp9SrTxQnXUO2KY1pJYEBKqeCQ+wYAzoAFMKLuY+10
>> >           OfRw==
>> > X-Gm-Message-State:
>> AJcUukfE9qgui2xrZFGdj80EUrdUgS6EFuzQRykMr5Pn/dZHHos0a+TI
>> >       Yzgi1CdPxcRBDTmun3Ksm2n9QNjQ
>> > X-Google-Smtp-Source:
>> ALg8bN5NppwygVHN4UQxlnkVuJ/nkV+JuGbXmr0X7bupnBIHBQ/vI8v453Dlq1bMICjZyqGvtG6Z0w==
>> > X-Received: by 2002:adf:c042:: with SMTP id
>> c2mr29279246wrf.158.1546086195331;
>> >          Sat, 29 Dec 2018 04:23:15 -0800 (PST)
>> > Received: from [192.168.1.107] (60.27.134.37.dynamic.jazztel.es.
>> [37.134.27.60])
>> >          by smtp.gmail.com with ESMTPSA id
>> p4sm27829580wrs.74.2018.12.29.04.23.14
>> >          for
>> <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
>> gmail.com@lucene.apache.org>
>> >          (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256
>> bits=128/128);
>> >          Sat, 29 Dec 2018 04:23:14 -0800 (PST)
>> > To: dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
>> gmail.com@lucene.apache.org
>> > From: Jose Raul Perez Rodriguez <jo...@gmail.com>
>> > Subject: subs
>> > Message-ID: <b5...@gmail.com>
>> > Date: Sat, 29 Dec 2018 13:23:14 +0100
>> > User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
>> >   Thunderbird/60.2.1
>> > MIME-Version: 1.0
>> > Content-Type: text/plain; charset=utf-8; format=flowed
>> > Content-Transfer-Encoding: 7bit
>> > Content-Language: en-US
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>> --
> Lucene/Solr Search Committer (PMC), Developer, Author, Speaker
> LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
> http://www.solrenterprisesearchserver.com
>
> --
Lucene/Solr Search Committer (PMC), Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com

Re: about testing distributed features

Posted by Jose Raul Perez Rodriguez <jo...@gmail.com>.
Hi David, thanks for the answer.

Let me reformulate the doubt in a different way; what I was trying to 
ask is, if the testing of Solr distributed features are performed in a 
distributed environment; like deploying a test Solr Cloud Cluster on 
some machines, to perform test on sharding, partitioning, etc.

If this is done on some way here in solr, could you explain a bit, how 
can I introduce in it, what technologies are used, etc.

Thanks a lot in advance



On 12/31/18 5:37 PM, David Smiley wrote:
> Hi Jose,
>
> Just about everything is tested.  If you are looking to improve some 
> aspect of SolrCloud's internals, then I suggest looking for existing 
> tests of that particular aspect.  If you are working on a feature that 
> wants SolrCloud (whole system integration test) then I suggest 
> subclassing SolrCloudTestCase.  You will see many such subclasses 
> already, and you can learn from them.  You can have an external 
> project that depends on solr-test-framework.  Note that it may be 
> essential to depend on that before any explicit dependencies on solr 
> core or solrj that you may have.
>
> ~ David
>
> On Sat, Dec 29, 2018 at 7:29 AM Jose Raul Perez Rodriguez 
> <joseraul.subscription@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     Hi all,
>
>     I am interested in contribute to solr and I have a couple o details I
>     would like to know but I can't find the answer in the doc. If its
>     possible, what kinds of aspects of distributed features of solr
>     (replication, lucene index sharding, etc) are tested in the tests
>     included in the repo https://github.com/apache/lucene-solr?. And if
>     there is any like an external tool for test solr distributed
>     features as
>     a whole system?
>
>     Many Thanks in advance,
>
>     Jr
>
>     On 12/29/18 1:23 PM, dev-help@lucene.apache.org
>     <ma...@lucene.apache.org> wrote:
>     > Hi! This is the ezmlm program. I'm managing the
>     > dev@lucene.apache.org <ma...@lucene.apache.org> mailing list.
>     >
>     > Acknowledgment: I have added the address
>     >
>     > joseraul.subscription@gmail.com
>     <ma...@gmail.com>
>     >
>     > to the dev mailing list.
>     >
>     > Welcome to dev@lucene.apache.org <ma...@lucene.apache.org>!
>     >
>     > Please save this message so that you know the address you are
>     > subscribed under, in case you later want to unsubscribe or
>     change your
>     > subscription address.
>     >
>     >
>     > --- Administrative commands for the dev list ---
>     >
>     > I can handle administrative requests automatically. Please
>     > do not send them to the list address! Instead, send
>     > your message to the correct command address:
>     >
>     > To subscribe to the list, send a message to:
>     >     <dev-subscribe@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > To remove your address from the list, send a message to:
>     >     <dev-unsubscribe@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > Send mail to the following for info and FAQ for this list:
>     >     <dev-info@lucene.apache.org <ma...@lucene.apache.org>>
>     >     <dev-faq@lucene.apache.org <ma...@lucene.apache.org>>
>     >
>     > Similar addresses exist for the digest list:
>     >     <dev-digest-subscribe@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >     <dev-digest-unsubscribe@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > To get messages 123 through 145 (a maximum of 100 per request),
>     mail:
>     >     <dev-get.123_145@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > To get an index with subject and author for messages 123-456 , mail:
>     >     <dev-index.123_456@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > They are always returned as sets of 100, max 2000 per request,
>     > so you'll actually get 100-499.
>     >
>     > To receive all messages with the same subject as message 12345,
>     > send a short message to:
>     >     <dev-thread.12345@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > The messages should contain one line or word of text to avoid being
>     > treated as sp@m, but I will ignore their content.
>     > Only the ADDRESS you send to is important.
>     >
>     > You can start a subscription for an alternate address,
>     > for example "john@host.domain", just add a hyphen and your
>     > address (with '=' instead of '@') after the command word:
>     > <dev-subscribe-john=host.domain@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > To stop subscription for this address, mail:
>     > <dev-unsubscribe-john=host.domain@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >
>     > In both cases, I'll send a confirmation message to that address.
>     When
>     > you receive it, simply reply to it to complete your subscription.
>     >
>     > If despite following these instructions, you do not get the
>     > desired results, please contact my owner at
>     > dev-owner@lucene.apache.org
>     <ma...@lucene.apache.org>. Please be patient, my owner is a
>     > lot slower than I am ;-)
>     >
>     > --- Enclosed is a copy of the request I received.
>     >
>     > Return-Path: <joseraul.subscription@gmail.com
>     <ma...@gmail.com>>
>     > Received: (qmail 73053 invoked by uid 99); 29 Dec 2018 12:23:23
>     -0000
>     > Received: from pnap-us-west-generic-nat.apache.org
>     <http://pnap-us-west-generic-nat.apache.org> (HELO
>     spamd3-us-west.apache.org <http://spamd3-us-west.apache.org>)
>     (209.188.14.142)
>     >      by apache.org <http://apache.org> (qpsmtpd/0.29) with
>     ESMTP; Sat, 29 Dec 2018 12:23:23 +0000
>     > Received: from localhost (localhost [127.0.0.1])
>     >       by spamd3-us-west.apache.org
>     <http://spamd3-us-west.apache.org> (ASF Mail Server at
>     spamd3-us-west.apache.org <http://spamd3-us-west.apache.org>) with
>     ESMTP id 2F7E0180F8C
>     >       for
>     <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
>     <ma...@lucene.apache.org>>; Sat, 29 Dec 2018 12:23:23
>     +0000 (UTC)
>     > X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org
>     <http://spamd3-us-west.apache.org>
>     > X-Spam-Flag: NO
>     > X-Spam-Score: -0.203
>     > X-Spam-Level:
>     > X-Spam-Status: No, score=-0.203 tagged_above=-999 required=6.31
>     >       tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1,
>     >       DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
>     RCVD_IN_DNSWL_NONE=-0.0001,
>     >       RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled
>     > Authentication-Results: spamd3-us-west.apache.org
>     <http://spamd3-us-west.apache.org> (amavisd-new);
>     >       dkim=pass (2048-bit key) header.d=gmail.com <http://gmail.com>
>     > Received: from mx1-lw-us.apache.org
>     <http://mx1-lw-us.apache.org> ([10.40.0.8])
>     >       by localhost (spamd3-us-west.apache.org
>     <http://spamd3-us-west.apache.org> [10.40.0.10]) (amavisd-new,
>     port 10024)
>     >       with ESMTP id ho2hFxHqhG_S
>     >       for
>     <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
>     <ma...@lucene.apache.org>>;
>     >       Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
>     > Received: from mail-wr1-f48.google.com
>     <http://mail-wr1-f48.google.com> (mail-wr1-f48.google.com
>     <http://mail-wr1-f48.google.com> [209.85.221.48])
>     >       by mx1-lw-us.apache.org <http://mx1-lw-us.apache.org> (ASF
>     Mail Server at mx1-lw-us.apache.org <http://mx1-lw-us.apache.org>)
>     with ESMTPS id 0A4D060FBD
>     >       for
>     <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
>     <ma...@lucene.apache.org>>; Sat, 29 Dec 2018 12:23:22
>     +0000 (UTC)
>     > Received: by mail-wr1-f48.google.com
>     <http://mail-wr1-f48.google.com> with SMTP id v13so23006289wrw.5
>     >          for
>     <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
>     <ma...@lucene.apache.org>>; Sat, 29 Dec 2018 04:23:21
>     -0800 (PST)
>     > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
>     >          d=gmail.com <http://gmail.com>; s=20161025;
>     > h=to:from:subject:message-id:date:user-agent:mime-version
>     >           :content-transfer-encoding:content-language;
>     >          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
>     > b=AoyqSfbhk/02hiFtHtNKoUoBnGDd/g7XhoCY3jiu+h10j/hPx3+QOG/t7w5DgqJvu3
>     >
>      y4w/Vd0w0eROD8B0zL/fDtdJABDvf/6s7eS8vg7DqFmOPb52Z4L7kSe4aHLXc+FJzj3Z
>     >
>      74P1iETJR+0nyYjWE+AZC6bRUg5EATYsgUYD3OFv4WQ3X4a5AyWvcaODLyDCm4lvOdp6
>     >
>      LOl+wck6Kp0jflF5ycMAA7a+yqDPG8LP4IBiY1MDlWOmzhYJMYVpFB9FzYlwU0E57DLE
>     >
>      4nzYETlOGqSC0SuLoNxuED3QZqVwbbGrWj5hB31STHwMCcd6Iug90tHhwXziWFppc4za
>     >           MkBQ==
>     > X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
>     >          d=1e100.net <http://1e100.net>; s=20161025;
>     > h=x-gm-message-state:to:from:subject:message-id:date:user-agent
>     >  :mime-version:content-transfer-encoding:content-language;
>     >          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
>     > b=AF7zULS6VHLL22l+zGX2N9kwYZ3GQKRGfsw3K1AG+f9muWY60dnGmCH/E9bEe1oaQs
>     >
>      9K10qgr2CDy1rkg/L+d+qWgsPiL+h7sswgqmbCsY1yofcqXlImmTSofuITDPisXNE17P
>     >
>      Py6WdTZYVSZwGncGzMqTgYydXhxlQovpUMgqcIHM/1JBFDGoQ572D+i9Hej0C2Xn1okH
>     >
>      uWmmw6wNyipvDwwgh/Fihqpjct4o8FycUydhSk0kWRuIbRo8o+4kRBBCZWvVtuGcC/yM
>     >
>      wSc9R0fA9XEEfcpUUI2lJqTaaMRp9SrTxQnXUO2KY1pJYEBKqeCQ+wYAzoAFMKLuY+10
>     >           OfRw==
>     > X-Gm-Message-State:
>     AJcUukfE9qgui2xrZFGdj80EUrdUgS6EFuzQRykMr5Pn/dZHHos0a+TI
>     >       Yzgi1CdPxcRBDTmun3Ksm2n9QNjQ
>     > X-Google-Smtp-Source:
>     ALg8bN5NppwygVHN4UQxlnkVuJ/nkV+JuGbXmr0X7bupnBIHBQ/vI8v453Dlq1bMICjZyqGvtG6Z0w==
>     > X-Received: by 2002:adf:c042:: with SMTP id
>     c2mr29279246wrf.158.1546086195331;
>     >          Sat, 29 Dec 2018 04:23:15 -0800 (PST)
>     > Received: from [192.168.1.107] (60.27.134.37.dynamic.jazztel.es
>     <http://60.27.134.37.dynamic.jazztel.es>. [37.134.27.60])
>     >          by smtp.gmail.com <http://smtp.gmail.com> with ESMTPSA
>     id p4sm27829580wrs.74.2018.12.29.04.23.14
>     >          for
>     <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
>     <ma...@lucene.apache.org>>
>     >          (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256
>     bits=128/128);
>     >          Sat, 29 Dec 2018 04:23:14 -0800 (PST)
>     > To:
>     dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=gmail.com@lucene.apache.org
>     <ma...@lucene.apache.org>
>     > From: Jose Raul Perez Rodriguez <joseraul.subscription@gmail.com
>     <ma...@gmail.com>>
>     > Subject: subs
>     > Message-ID: <b5372718-c178-0547-933f-d6c9f28d2320@gmail.com
>     <ma...@gmail.com>>
>     > Date: Sat, 29 Dec 2018 13:23:14 +0100
>     > User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
>     >   Thunderbird/60.2.1
>     > MIME-Version: 1.0
>     > Content-Type: text/plain; charset=utf-8; format=flowed
>     > Content-Transfer-Encoding: 7bit
>     > Content-Language: en-US
>     >
>
>     ---------------------------------------------------------------------
>     To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>     <ma...@lucene.apache.org>
>     For additional commands, e-mail: dev-help@lucene.apache.org
>     <ma...@lucene.apache.org>
>
> -- 
> Lucene/Solr Search Committer (PMC), Developer, Author, Speaker
> LinkedIn: http://linkedin.com/in/davidwsmiley | Book: 
> http://www.solrenterprisesearchserver.com

Re: about testing distributed features

Posted by David Smiley <da...@gmail.com>.
Hi Jose,

Just about everything is tested.  If you are looking to improve some aspect
of SolrCloud's internals, then I suggest looking for existing tests of that
particular aspect.  If you are working on a feature that wants SolrCloud
(whole system integration test) then I suggest
subclassing SolrCloudTestCase.  You will see many such subclasses already,
and you can learn from them.  You can have an external project that depends
on solr-test-framework.  Note that it may be essential to depend on that
before any explicit dependencies on solr core or solrj that you may have.

~ David

On Sat, Dec 29, 2018 at 7:29 AM Jose Raul Perez Rodriguez <
joseraul.subscription@gmail.com> wrote:

> Hi all,
>
> I am interested in contribute to solr and I have a couple o details I
> would like to know but I can't find the answer in the doc. If its
> possible, what kinds of aspects of distributed features of solr
> (replication, lucene index sharding, etc) are tested in the tests
> included in the repo https://github.com/apache/lucene-solr?. And if
> there is any like an external tool for test solr distributed features as
> a whole system?
>
> Many Thanks in advance,
>
> Jr
>
> On 12/29/18 1:23 PM, dev-help@lucene.apache.org wrote:
> > Hi! This is the ezmlm program. I'm managing the
> > dev@lucene.apache.org mailing list.
> >
> > Acknowledgment: I have added the address
> >
> >     joseraul.subscription@gmail.com
> >
> > to the dev mailing list.
> >
> > Welcome to dev@lucene.apache.org!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change your
> > subscription address.
> >
> >
> > --- Administrative commands for the dev list ---
> >
> > I can handle administrative requests automatically. Please
> > do not send them to the list address! Instead, send
> > your message to the correct command address:
> >
> > To subscribe to the list, send a message to:
> >     <de...@lucene.apache.org>
> >
> > To remove your address from the list, send a message to:
> >     <de...@lucene.apache.org>
> >
> > Send mail to the following for info and FAQ for this list:
> >     <de...@lucene.apache.org>
> >     <de...@lucene.apache.org>
> >
> > Similar addresses exist for the digest list:
> >     <de...@lucene.apache.org>
> >     <de...@lucene.apache.org>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> >     <de...@lucene.apache.org>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> >     <de...@lucene.apache.org>
> >
> > They are always returned as sets of 100, max 2000 per request,
> > so you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345,
> > send a short message to:
> >     <de...@lucene.apache.org>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address,
> > for example "john@host.domain", just add a hyphen and your
> > address (with '=' instead of '@') after the command word:
> > <de...@lucene.apache.org>
> >
> > To stop subscription for this address, mail:
> > <de...@lucene.apache.org>
> >
> > In both cases, I'll send a confirmation message to that address. When
> > you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the
> > desired results, please contact my owner at
> > dev-owner@lucene.apache.org. Please be patient, my owner is a
> > lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <jo...@gmail.com>
> > Received: (qmail 73053 invoked by uid 99); 29 Dec 2018 12:23:23 -0000
> > Received: from pnap-us-west-generic-nat.apache.org (HELO
> spamd3-us-west.apache.org) (209.188.14.142)
> >      by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Dec 2018 12:23:23
> +0000
> > Received: from localhost (localhost [127.0.0.1])
> >       by spamd3-us-west.apache.org (ASF Mail Server at
> spamd3-us-west.apache.org) with ESMTP id 2F7E0180F8C
> >       for <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
> gmail.com@lucene.apache.org>; Sat, 29 Dec 2018 12:23:23 +0000 (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org
> > X-Spam-Flag: NO
> > X-Spam-Score: -0.203
> > X-Spam-Level:
> > X-Spam-Status: No, score=-0.203 tagged_above=-999 required=6.31
> >       tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1,
> >       DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001,
> >       RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled
> > Authentication-Results: spamd3-us-west.apache.org (amavisd-new);
> >       dkim=pass (2048-bit key) header.d=gmail.com
> > Received: from mx1-lw-us.apache.org ([10.40.0.8])
> >       by localhost (spamd3-us-west.apache.org [10.40.0.10])
> (amavisd-new, port 10024)
> >       with ESMTP id ho2hFxHqhG_S
> >       for <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
> gmail.com@lucene.apache.org>;
> >       Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
> > Received: from mail-wr1-f48.google.com (mail-wr1-f48.google.com
> [209.85.221.48])
> >       by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org)
> with ESMTPS id 0A4D060FBD
> >       for <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
> gmail.com@lucene.apache.org>; Sat, 29 Dec 2018 12:23:22 +0000 (UTC)
> > Received: by mail-wr1-f48.google.com with SMTP id v13so23006289wrw.5
> >          for
> <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
> gmail.com@lucene.apache.org>; Sat, 29 Dec 2018 04:23:21 -0800 (PST)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> >          d=gmail.com; s=20161025;
> >          h=to:from:subject:message-id:date:user-agent:mime-version
> >           :content-transfer-encoding:content-language;
> >          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
> >
> b=AoyqSfbhk/02hiFtHtNKoUoBnGDd/g7XhoCY3jiu+h10j/hPx3+QOG/t7w5DgqJvu3
> >
>  y4w/Vd0w0eROD8B0zL/fDtdJABDvf/6s7eS8vg7DqFmOPb52Z4L7kSe4aHLXc+FJzj3Z
> >
>  74P1iETJR+0nyYjWE+AZC6bRUg5EATYsgUYD3OFv4WQ3X4a5AyWvcaODLyDCm4lvOdp6
> >
>  LOl+wck6Kp0jflF5ycMAA7a+yqDPG8LP4IBiY1MDlWOmzhYJMYVpFB9FzYlwU0E57DLE
> >
>  4nzYETlOGqSC0SuLoNxuED3QZqVwbbGrWj5hB31STHwMCcd6Iug90tHhwXziWFppc4za
> >           MkBQ==
> > X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> >          d=1e100.net; s=20161025;
> >          h=x-gm-message-state:to:from:subject:message-id:date:user-agent
> >           :mime-version:content-transfer-encoding:content-language;
> >          bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=;
> >
> b=AF7zULS6VHLL22l+zGX2N9kwYZ3GQKRGfsw3K1AG+f9muWY60dnGmCH/E9bEe1oaQs
> >
>  9K10qgr2CDy1rkg/L+d+qWgsPiL+h7sswgqmbCsY1yofcqXlImmTSofuITDPisXNE17P
> >
>  Py6WdTZYVSZwGncGzMqTgYydXhxlQovpUMgqcIHM/1JBFDGoQ572D+i9Hej0C2Xn1okH
> >
>  uWmmw6wNyipvDwwgh/Fihqpjct4o8FycUydhSk0kWRuIbRo8o+4kRBBCZWvVtuGcC/yM
> >
>  wSc9R0fA9XEEfcpUUI2lJqTaaMRp9SrTxQnXUO2KY1pJYEBKqeCQ+wYAzoAFMKLuY+10
> >           OfRw==
> > X-Gm-Message-State:
> AJcUukfE9qgui2xrZFGdj80EUrdUgS6EFuzQRykMr5Pn/dZHHos0a+TI
> >       Yzgi1CdPxcRBDTmun3Ksm2n9QNjQ
> > X-Google-Smtp-Source:
> ALg8bN5NppwygVHN4UQxlnkVuJ/nkV+JuGbXmr0X7bupnBIHBQ/vI8v453Dlq1bMICjZyqGvtG6Z0w==
> > X-Received: by 2002:adf:c042:: with SMTP id
> c2mr29279246wrf.158.1546086195331;
> >          Sat, 29 Dec 2018 04:23:15 -0800 (PST)
> > Received: from [192.168.1.107] (60.27.134.37.dynamic.jazztel.es.
> [37.134.27.60])
> >          by smtp.gmail.com with ESMTPSA id
> p4sm27829580wrs.74.2018.12.29.04.23.14
> >          for
> <dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
> gmail.com@lucene.apache.org>
> >          (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256
> bits=128/128);
> >          Sat, 29 Dec 2018 04:23:14 -0800 (PST)
> > To: dev-sc.1546086179.eabpkmhgdkkmnnhndmlo-joseraul.subscription=
> gmail.com@lucene.apache.org
> > From: Jose Raul Perez Rodriguez <jo...@gmail.com>
> > Subject: subs
> > Message-ID: <b5...@gmail.com>
> > Date: Sat, 29 Dec 2018 13:23:14 +0100
> > User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
> >   Thunderbird/60.2.1
> > MIME-Version: 1.0
> > Content-Type: text/plain; charset=utf-8; format=flowed
> > Content-Transfer-Encoding: 7bit
> > Content-Language: en-US
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
> --
Lucene/Solr Search Committer (PMC), Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com