You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by "taojintianxia (via GitHub)" <gi...@apache.org> on 2023/03/28 00:56:25 UTC

[GitHub] [shardingsphere] taojintianxia opened a new issue, #24871: refactor the github action process

taojintianxia opened a new issue, #24871:
URL: https://github.com/apache/shardingsphere/issues/24871

   as we know, there are serveral E2E IT , E2E-SQL、E2E-Agent、E2E-Pipeline etc.
   
   At present, the E2E test on github action is mainly divided into three parts, agent, sql, operation
     - e2e-agent is the related test of the probe, including the combination of tracing, metrics, etc.
     - e2e-sql is the original suite, because it is based on the SQL in xml for testing, here it is renamed e2e-sql
     - e2e-operation is the combination to be merged next, including pipeline, transaction, discovery, etc.
   
   The test of e2e-operation consists of three parts:
   - Trigger rules (triggered according to action and path)
   - Environment preparation (build proxy image for testing)
   - Execute tests (./mvnw clean install ${function}/pom.xml)
   All operation tests are the same except for the path that triggers the rule and the matrix parameter when executing the test.
   Here you can try to integrate all operations into the same workflow:
   
   ```yaml
   jobs:
     preconditions:
       name: Preconditions
       runs-on: ubuntu-20.04
       if: (github.event_name != 'schedule') || (github.repository == 'apache/pulsar')
       outputs:
         pipeline: ${{ steps.check_changes.outputs.pipeline }}
         transaction: ${{ steps.changes.outputs.transaction }}
         discovery: ${{ steps.changes.outputs.discovery }}
         ...
     
     build-image:
       needs: preconditions
       name: Build Images
       runs-on: ubuntu-20.04
       timeout-minutes: 60
       ...
       
     operation-e2e-tests:
       name: CI - Unit - ${{ matrix.name }}
       runs-on: ubuntu-20.04
       timeout-minutes: ${{ matrix.timeout || 60 }}
       needs: ['preconditions', 'build-image']
       strategy:
         fail-fast: false
         matrix:
           mode: [ Standalone, Cluster ]
           database: [ MySQL-8.0, PostgreSQL-12 ]
       if: ${{ needs.preconditions.outputs.showprocesslist == 'true' }}
       run: ./mvnw -nsu -B install -f test/e2e/operation/showprocesslist/pom.xml -Dit.env.type=docker -Dit.scenarios=cluster_jdbc_proxy -Dit.run.modes=${{ matrix.mode }}
       if: ${{ needs.preconditions.outputs.transaction == 'true' }}
       run: ./mvnw -nsu -B install -f test/e2e/operation/transaction/pom.xml -Dit.env.type=docker -Dit.scenarios=cluster_jdbc_proxy -Dit.run.modes=${{ matrix.mode }}
   ```
   
   try to make the PR trigger as short as possible, and make the full combination in nightly build :
   ```yaml
     operation-e2e-tests:
       name: CI - Unit - ${{ matrix.name }}
       runs-on: ubuntu-20.04
       timeout-minutes: ${{ matrix.timeout || 60 }}
       needs: ['preconditions', 'build-image']
       strategy:
         fail-fast: false
         matrix:
           mode: [ Standalone, Cluster ]
           database: [ MySQL-5.7, MySQL-8.0, PostgreSQL-11, PostgreSQL-12, OpenGauss-2, OpenGauss-3 ]
       if: ${{ needs.preconditions.outputs.showprocesslist == 'true' }}
       run: ./mvnw -nsu -B install -f test/e2e/operation/showprocesslist/pom.xml -Dit.env.type=docker -Dit.scenarios=cluster_jdbc_proxy -Dit.run.modes=${{ matrix.mode }}
       if: ${{ needs.preconditions.outputs.transaction == 'true' }}
       run: ./mvnw -nsu -B install -f test/e2e/operation/transaction/pom.xml -Dit.env.type=docker -Dit.scenarios=cluster_jdbc_proxy -Dit.run.modes=${{ matrix.mode }}
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [shardingsphere] taojintianxia closed issue #24871: refactor the github action process

Posted by "taojintianxia (via GitHub)" <gi...@apache.org>.
taojintianxia closed issue #24871: refactor the github action process
URL: https://github.com/apache/shardingsphere/issues/24871


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org