You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/06/16 17:07:01 UTC
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1160 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1160/
[...truncated 29 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2225/consoleText
[...truncated 48 lines...]
raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2225/consoleText : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1166 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1166/
[...truncated 29 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2232/consoleText
[repro] Revision: a1be1de67e641229236dfd4648a71030b8a86fc7
[repro] Ant options: -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
[repro] Repro line: ant test -Dtestcase=TestBinaryDocValuesUpdates -Dtests.method=testTonsOfUpdates -Dtests.seed=1FF990BFFC55CE87 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sd -Dtests.timezone=America/Porto_Velho -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] git rev-parse --abbrev-ref HEAD
[repro] git rev-parse HEAD
[repro] Initial local git branch/revision: 710fe3a107e91eb7f15fd23df455341168929747
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] git fetch
[...truncated 7 lines...]
[repro] git checkout a1be1de67e641229236dfd4648a71030b8a86fc7
[...truncated 2 lines...]
[repro] git merge --ff-only
[...truncated 1 lines...]
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] lucene/core
[repro] TestBinaryDocValuesUpdates
[repro] ant compile-test
[...truncated 139 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestBinaryDocValuesUpdates" -Dtests.showOutput=onerror -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.seed=1FF990BFFC55CE87 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sd -Dtests.timezone=America/Porto_Velho -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 716 lines...]
[repro] Setting last failure code to 256
[repro] Failures w/original seeds at a1be1de67e641229236dfd4648a71030b8a86fc7:
[repro] 5/5 failed: org.apache.lucene.index.TestBinaryDocValuesUpdates
[repro] Re-testing 100% failures at the tip of master
[repro] git fetch
[...truncated 7 lines...]
[repro] git checkout master
[...truncated 4 lines...]
[repro] git merge --ff-only
[...truncated 1633 lines...]
[repro] ant clean
[...truncated 7 lines...]
[repro] Test suites by module:
[repro] lucene/core
[repro] TestBinaryDocValuesUpdates
[repro] ant compile-test
[...truncated 139 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestBinaryDocValuesUpdates" -Dtests.showOutput=onerror -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.seed=1FF990BFFC55CE87 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sd -Dtests.timezone=America/Porto_Velho -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 865 lines...]
[repro] Setting last failure code to 256
[repro] Failures original seeds at the tip of master:
[repro] 5/5 failed: org.apache.lucene.index.TestBinaryDocValuesUpdates
[repro] Re-testing 100% failures at the tip of master without a seed
[repro] ant clean
[...truncated 7 lines...]
[repro] Test suites by module:
[repro] lucene/core
[repro] TestBinaryDocValuesUpdates
[repro] ant compile-test
[...truncated 139 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestBinaryDocValuesUpdates" -Dtests.showOutput=onerror -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sd -Dtests.timezone=America/Porto_Velho -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 228 lines...]
[repro] Failures at the tip of master without a seed:
[repro] 0/5 failed: org.apache.lucene.index.TestBinaryDocValuesUpdates
[repro] git checkout 710fe3a107e91eb7f15fd23df455341168929747
[...truncated 8 lines...]
[repro] Exiting with code 256
[...truncated 54 lines...]
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1165 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1165/
[...truncated 37 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-Tests-master/4822/consoleText
[repro] Revision: 541fc984e90cdd86a70c467e8046cfcf76c12ffc
[repro] Repro line: ant test -Dtestcase=TestCloudJSONFacetSKGEquiv -Dtests.method=testRandom -Dtests.seed=356C5A0B17DE491 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=en-KN -Dtests.timezone=Asia/Ho_Chi_Minh -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] git rev-parse --abbrev-ref HEAD
[repro] git rev-parse HEAD
[repro] Initial local git branch/revision: 541fc984e90cdd86a70c467e8046cfcf76c12ffc
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] git fetch
[repro] git checkout 541fc984e90cdd86a70c467e8046cfcf76c12ffc
[...truncated 1 lines...]
[repro] git merge --ff-only
[...truncated 1 lines...]
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCloudJSONFacetSKGEquiv
[repro] ant compile-test
[...truncated 2449 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudJSONFacetSKGEquiv" -Dtests.showOutput=onerror -Dtests.seed=356C5A0B17DE491 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=en-KN -Dtests.timezone=Asia/Ho_Chi_Minh -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 31742 lines...]
[repro] Setting last failure code to 256
[repro] Failures w/original seeds at 541fc984e90cdd86a70c467e8046cfcf76c12ffc:
[repro] 5/5 failed: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv
[repro] Re-testing 100% failures at the tip of master
[repro] git fetch
[repro] git checkout master
[...truncated 4 lines...]
[repro] git merge --ff-only
[...truncated 983 lines...]
[repro] ant clean
[...truncated 8 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCloudJSONFacetSKGEquiv
[repro] ant compile-test
[...truncated 2449 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudJSONFacetSKGEquiv" -Dtests.showOutput=onerror -Dtests.seed=356C5A0B17DE491 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=en-KN -Dtests.timezone=Asia/Ho_Chi_Minh -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 31724 lines...]
[repro] Setting last failure code to 256
[repro] Failures original seeds at the tip of master:
[repro] 5/5 failed: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv
[repro] Re-testing 100% failures at the tip of master without a seed
[repro] ant clean
[...truncated 8 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCloudJSONFacetSKGEquiv
[repro] ant compile-test
[...truncated 2449 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudJSONFacetSKGEquiv" -Dtests.showOutput=onerror -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=en-KN -Dtests.timezone=Asia/Ho_Chi_Minh -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 95 lines...]
[repro] Failures at the tip of master without a seed:
[repro] 0/5 failed: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv
[repro] git checkout 541fc984e90cdd86a70c467e8046cfcf76c12ffc
[...truncated 8 lines...]
[repro] Exiting with code 256
[...truncated 54 lines...]
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1164 - Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1164/
[...truncated 29 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-BadApples-NightlyTests-master/118/consoleText
[repro] Revision: 972c84022ec9c2b867848cb11f6d4c6bc466e8f2
[repro] Ant options: -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt
[repro] Repro line: ant test -Dtestcase=TestStressNRT -Dtests.method=test -Dtests.seed=35EA598B0C825D80 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=lkt-US -Dtests.timezone=Africa/Monrovia -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] Repro line: ant test -Dtestcase=TestStressNRT -Dtests.seed=35EA598B0C825D80 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=lkt-US -Dtests.timezone=Africa/Monrovia -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] Repro line: ant test -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=41BC41761B6E9C42 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=fr-MG -Dtests.timezone=US/Michigan -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] git rev-parse --abbrev-ref HEAD
[repro] git rev-parse HEAD
[repro] Initial local git branch/revision: 972c84022ec9c2b867848cb11f6d4c6bc466e8f2
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] git fetch
[repro] git checkout 972c84022ec9c2b867848cb11f6d4c6bc466e8f2
[...truncated 1 lines...]
[repro] git merge --ff-only
[...truncated 1 lines...]
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] lucene/core
[repro] TestStressNRT
[repro] solr/core
[repro] RollingRestartTest
[repro] ant compile-test
[...truncated 139 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestStressNRT" -Dtests.showOutput=onerror -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.seed=35EA598B0C825D80 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=lkt-US -Dtests.timezone=Africa/Monrovia -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 72 lines...]
[repro] ant compile-test
[...truncated 2396 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.RollingRestartTest" -Dtests.showOutput=onerror -Dtests.multiplier=2 -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.seed=41BC41761B6E9C42 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=fr-MG -Dtests.timezone=US/Michigan -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 1974093 lines...]
[repro] Setting last failure code to 256
[repro] Failures w/original seeds at 972c84022ec9c2b867848cb11f6d4c6bc466e8f2:
[repro] 0/5 failed: org.apache.lucene.index.TestStressNRT
[repro] 1/5 failed: org.apache.solr.cloud.RollingRestartTest
[repro] git checkout 972c84022ec9c2b867848cb11f6d4c6bc466e8f2
[...truncated 1 lines...]
[repro] Exiting with code 256
[...truncated 6 lines...]
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1163 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1163/
[...truncated 29 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2228/consoleText
[...truncated 48 lines...]
raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2228/consoleText : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Re: [JENKINS] Lucene-Solr-repro-Java11 - Build # 1162 - Still Failing
Posted by Mike Drob <md...@apache.org>.
I had previously opened https://issues.apache.org/jira/browse/INFRA-20452
and https://issues.apache.org/jira/browse/LUCENE-9412 for this. Any more
details posted there would be appreciated!
On Tue, Jun 30, 2020 at 8:23 AM Jan Høydahl <ja...@cominvent.com> wrote:
> @Bruno
>
> Note that the smoke tester is not happy, so someone needs to fix it before
> the release can be made.
> I sent this email to dev list June 19th but no progress.
>
> Looking into it again, I see that some Jenkins smoketest runs succeeds and
> some fail.
> I think I have found a pattern that all the failures are on build slave
> «lucene2» and all builds on «lucene» succeed.
> See this example
> https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-SmokeRelease-master/1731/
> which fails for master on "lucene2"
> and this that succeeds on «lucene».
>
> So my theory is still that the CA certificates Python3 uses by default on
> «lucene2» are messed up, either by a Linux of Python upgrade on that box.
> Can someone verify?
>
> Jan
>
> 19. jun. 2020 kl. 20:39 skrev Jan Høydahl <ja...@cominvent.com>:
>
> The same happens with other python scripts like the smoke tester:
>
> [smoker] Retrying download of url
> https://archive.apache.org/dist/lucene/KEYS after exception: <urlopen
> error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed
> (_ssl.c:645)>
>
>
> I also have a customer where this suddenly started happening, so I suspect
> a Linux upgrade or perhaps a Python upgrade messed with the default CA cert
> location or something.
> Uwe, have you ever seen similar on Policeman Jenkins?
>
> Jan
>
>
> 19. jun. 2020 kl. 00:24 skrev Jan Høydahl <ja...@cominvent.com>:
>
> The repro python script is failing on Jenkins due to SSL cert trust issues
> when fetching the console output
>
> File "dev-tools/scripts/reproduceJenkinsFailures.py", line 110, in fetchAndParseJenkinsLog
>
>
> The SSL cert of Jenkins seems legit, so it could be that Python somehow
> does not have access to the CA certs of the host (anymore)?
> We could ‘pip install certifi’ or add code to not verify certs at all?
>
> Jan
>
> 19. jun. 2020 kl. 00:08 skrev Apache Jenkins Server <
> jenkins@builds.apache.org>:
>
> Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/
>
> [...truncated 32 lines...]
> [repro] Jenkins log URL:
> https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText
>
> [...truncated 48 lines...]
> raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
> RuntimeError: ERROR: fetching
> https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText :
> <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed
> (_ssl.c:645)>
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
> <bu...@lucene.apache.org>
> For additional commands, e-mail: builds-help@lucene.apache.org
> <bu...@lucene.apache.org>
>
>
>
>
>
Re: [JENKINS] Lucene-Solr-repro-Java11 - Build # 1162 - Still Failing
Posted by Jan Høydahl <ja...@cominvent.com>.
@Bruno
Note that the smoke tester is not happy, so someone needs to fix it before the release can be made.
I sent this email to dev list June 19th but no progress.
Looking into it again, I see that some Jenkins smoketest runs succeeds and some fail.
I think I have found a pattern that all the failures are on build slave «lucene2» and all builds on «lucene» succeed.
See this example https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-SmokeRelease-master/1731/ which fails for master on "lucene2"
and this that succeeds on «lucene».
So my theory is still that the CA certificates Python3 uses by default on «lucene2» are messed up, either by a Linux of Python upgrade on that box. Can someone verify?
Jan
> 19. jun. 2020 kl. 20:39 skrev Jan Høydahl <ja...@cominvent.com>:
>
> The same happens with other python scripts like the smoke tester:
>
>> [smoker] Retrying download of url https://archive.apache.org/dist/lucene/KEYS <https://archive.apache.org/dist/lucene/KEYS> after exception: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
>
> I also have a customer where this suddenly started happening, so I suspect a Linux upgrade or perhaps a Python upgrade messed with the default CA cert location or something.
> Uwe, have you ever seen similar on Policeman Jenkins?
>
> Jan
>
>
>> 19. jun. 2020 kl. 00:24 skrev Jan Høydahl <jan.asf@cominvent.com <ma...@cominvent.com>>:
>>
>> The repro python script is failing on Jenkins due to SSL cert trust issues when fetching the console output
>>
>> File "dev-tools/scripts/reproduceJenkinsFailures.py", line 110, in fetchAndParseJenkinsLog
>>
>> The SSL cert of Jenkins seems legit, so it could be that Python somehow does not have access to the CA certs of the host (anymore)?
>> We could ‘pip install certifi’ or add code to not verify certs at all?
>>
>> Jan
>>
>>> 19. jun. 2020 kl. 00:08 skrev Apache Jenkins Server <jenkins@builds.apache.org <ma...@builds.apache.org>>:
>>>
>>> Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/ <https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/>
>>>
>>> [...truncated 32 lines...]
>>> [repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText <https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText>
>>>
>>> [...truncated 48 lines...]
>>> raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
>>> RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText <https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText> : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
>>> Build step 'Execute shell' marked build as failure
>>> Archiving artifacts
>>> Recording test results
>>> Email was triggered for: Failure - Any
>>> Sending email for trigger: Failure - Any
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org <ma...@lucene.apache.org>
>>> For additional commands, e-mail: builds-help@lucene.apache.org <ma...@lucene.apache.org>
>
Re: [JENKINS] Lucene-Solr-repro-Java11 - Build # 1162 - Still Failing
Posted by Jan Høydahl <ja...@cominvent.com>.
The same happens with other python scripts like the smoke tester:
> [smoker] Retrying download of url https://archive.apache.org/dist/lucene/KEYS <https://archive.apache.org/dist/lucene/KEYS> after exception: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
I also have a customer where this suddenly started happening, so I suspect a Linux upgrade or perhaps a Python upgrade messed with the default CA cert location or something.
Uwe, have you ever seen similar on Policeman Jenkins?
Jan
> 19. jun. 2020 kl. 00:24 skrev Jan Høydahl <ja...@cominvent.com>:
>
> The repro python script is failing on Jenkins due to SSL cert trust issues when fetching the console output
>
> File "dev-tools/scripts/reproduceJenkinsFailures.py", line 110, in fetchAndParseJenkinsLog
>
> The SSL cert of Jenkins seems legit, so it could be that Python somehow does not have access to the CA certs of the host (anymore)?
> We could ‘pip install certifi’ or add code to not verify certs at all?
>
> Jan
>
>> 19. jun. 2020 kl. 00:08 skrev Apache Jenkins Server <jenkins@builds.apache.org <ma...@builds.apache.org>>:
>>
>> Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/ <https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/>
>>
>> [...truncated 32 lines...]
>> [repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText <https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText>
>>
>> [...truncated 48 lines...]
>> raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
>> RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText <https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText> : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
>> Build step 'Execute shell' marked build as failure
>> Archiving artifacts
>> Recording test results
>> Email was triggered for: Failure - Any
>> Sending email for trigger: Failure - Any
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org <ma...@lucene.apache.org>
>> For additional commands, e-mail: builds-help@lucene.apache.org <ma...@lucene.apache.org>
Re: [JENKINS] Lucene-Solr-repro-Java11 - Build # 1162 - Still Failing
Posted by Jan Høydahl <ja...@cominvent.com>.
The repro python script is failing on Jenkins due to SSL cert trust issues when fetching the console output
File "dev-tools/scripts/reproduceJenkinsFailures.py", line 110, in fetchAndParseJenkinsLog
The SSL cert of Jenkins seems legit, so it could be that Python somehow does not have access to the CA certs of the host (anymore)?
We could ‘pip install certifi’ or add code to not verify certs at all?
Jan
> 19. jun. 2020 kl. 00:08 skrev Apache Jenkins Server <je...@builds.apache.org>:
>
> Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/
>
> [...truncated 32 lines...]
> [repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText
>
> [...truncated 48 lines...]
> raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
> RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
> For additional commands, e-mail: builds-help@lucene.apache.org
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1162 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1162/
[...truncated 32 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText
[...truncated 48 lines...]
raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-Tests-master/4813/consoleText : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-repro-Java11 - Build # 1161 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-repro-Java11/1161/
[...truncated 29 lines...]
[repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2226/consoleText
[...truncated 48 lines...]
raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
RuntimeError: ERROR: fetching https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2226/consoleText : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645)>
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any