You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Yiteng Zhang (Jira)" <ji...@apache.org> on 2022/12/09 23:02:00 UTC
[jira] [Updated] (NIFI-10623) Several Related Flaky Tests in TestHttpClient
[ https://issues.apache.org/jira/browse/NIFI-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yiteng Zhang updated NIFI-10623:
--------------------------------
Description:
These tests:
{code:java}
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTP
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPS
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPSWithProxy
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPSWithProxyAuth
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPWithProxy
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPWithProxyAuth
org.apache.nifi.remote.client.http.TestHttpClient.testSendSlowClientSuccess
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccess
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessCompressed
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessHTTPS
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessMultipleUrls
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessWithProxy
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessWithProxyAuth {code}
can pass using the normal maven-test, but show non-deterministic behaviors under [NonDex|[https://github.com/TestingResearchIllinois/NonDex]] and thus failed.
An example of the error message is below:
{code:java}
[ERROR] Errors:
[ERROR] TestHttpClient.testSendLargeFileHTTPS:1024->testSendLargeFile:954->testSendIgnoreProxyError:940 » IO Failed to confirm transaction with Peer[url=https://localhost:33385/nifi-api] due to java.io.IOException: [Url=https://localhost:33385/nifi-api, TransferDirection=SEND, State=DATA_EXCHANGED] Sent data to peer Peer[url=https://localhost:33385/nifi-api] but calculated CRC32 Checksum as 2387509971 while peer calculated CRC32 Checksum as 1527414060; canceling transaction and rolling back session {code}
It seems like two peers calculate a different checksum, therefore the transaction was rolled back, and thus the test failed.
*Steps to reproduce the failure:*
# install [NonDex|[https://github.com/TestingResearchIllinois/NonDex]]
# run the following command in nifi
{code:java}
MODULE=nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-site-to-site
TEST=org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol#testTransferTwoFiles
mvn install -pl $MODULE -am -DskipTests
mvn -pl $MODULE edu.illinois:nondex-maven-plugin:1.1.2:nondex -Dtest=$TEST{code}
3. the result will be saved under the package folder in .nondex
h4.
was:
These tests:
{code:java}
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTP
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPS
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPSWithProxy
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPSWithProxyAuth
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPWithProxy
org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPWithProxyAuth
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessWithProxyAuth
org.apache.nifi.remote.client.http.TestHttpClient.testSendSlowClientSuccess
org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessCompressed{code}
can pass using the normal maven-test, but show non-deterministic behaviors under [NonDex|[https://github.com/TestingResearchIllinois/NonDex]] and thus failed.
An example of the error message is below:
{code:java}
[ERROR] Errors:
[ERROR] TestHttpClient.testSendLargeFileHTTPS:1024->testSendLargeFile:954->testSendIgnoreProxyError:940 » IO Failed to confirm transaction with Peer[url=https://localhost:33385/nifi-api] due to java.io.IOException: [Url=https://localhost:33385/nifi-api, TransferDirection=SEND, State=DATA_EXCHANGED] Sent data to peer Peer[url=https://localhost:33385/nifi-api] but calculated CRC32 Checksum as 2387509971 while peer calculated CRC32 Checksum as 1527414060; canceling transaction and rolling back session {code}
It seems like two peers calculate a different checksum, therefore the transaction was rolled back, and thus the test failed.
*Steps to reproduce the failure:*
# install [NonDex|[https://github.com/TestingResearchIllinois/NonDex]]
# run the following command in nifi
{code:java}
MODULE=nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-site-to-site
TEST=org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol#testTransferTwoFiles
mvn install -pl $MODULE -am -DskipTests
mvn -pl $MODULE edu.illinois:nondex-maven-plugin:1.1.2:nondex -Dtest=$TEST{code}
3. the result will be saved under the package folder in .nondex
h4.
> Several Related Flaky Tests in TestHttpClient
> ---------------------------------------------
>
> Key: NIFI-10623
> URL: https://issues.apache.org/jira/browse/NIFI-10623
> Project: Apache NiFi
> Issue Type: Bug
> Components: NiFi Registry
> Environment: Apache Maven 3.6.0;
> openjdk version "1.8.0_342";
> OpenJDK Runtime Environment (build 1.8.0_342-8u342-b07-0ubuntu1~20.04-b07);
> OpenJDK 64-Bit Server VM (build 25.342-b07, mixed mode);
> Reporter: Yiteng Zhang
> Priority: Trivial
> Attachments: org.apache.nifi.remote.client.http.TestHttpClient.txt
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> These tests:
> {code:java}
> org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTP
> org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPS
> org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPSWithProxy
> org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPSWithProxyAuth
> org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPWithProxy
> org.apache.nifi.remote.client.http.TestHttpClient.testSendLargeFileHTTPWithProxyAuth
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSlowClientSuccess
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccess
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessCompressed
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessHTTPS
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessMultipleUrls
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessWithProxy
> org.apache.nifi.remote.client.http.TestHttpClient.testSendSuccessWithProxyAuth {code}
> can pass using the normal maven-test, but show non-deterministic behaviors under [NonDex|[https://github.com/TestingResearchIllinois/NonDex]] and thus failed.
> An example of the error message is below:
> {code:java}
> [ERROR] Errors:
> [ERROR] TestHttpClient.testSendLargeFileHTTPS:1024->testSendLargeFile:954->testSendIgnoreProxyError:940 » IO Failed to confirm transaction with Peer[url=https://localhost:33385/nifi-api] due to java.io.IOException: [Url=https://localhost:33385/nifi-api, TransferDirection=SEND, State=DATA_EXCHANGED] Sent data to peer Peer[url=https://localhost:33385/nifi-api] but calculated CRC32 Checksum as 2387509971 while peer calculated CRC32 Checksum as 1527414060; canceling transaction and rolling back session {code}
> It seems like two peers calculate a different checksum, therefore the transaction was rolled back, and thus the test failed.
>
> *Steps to reproduce the failure:*
> # install [NonDex|[https://github.com/TestingResearchIllinois/NonDex]]
> # run the following command in nifi
> {code:java}
> MODULE=nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-site-to-site
> TEST=org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol#testTransferTwoFiles
> mvn install -pl $MODULE -am -DskipTests
> mvn -pl $MODULE edu.illinois:nondex-maven-plugin:1.1.2:nondex -Dtest=$TEST{code}
> 3. the result will be saved under the package folder in .nondex
> h4.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)