You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/08/16 02:02:54 UTC

[GitHub] [incubator-seatunnel] EricJoy2048 opened a new issue, #2421: [ST-Engine][maven profile] Add engine-all profile used to reduce engine test build time and test easy

EricJoy2048 opened a new issue, #2421:
URL: https://github.com/apache/incubator-seatunnel/issues/2421

   ### Search before asking
   
   - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
   
   
   ### Description
   
   pom.xml
   
   ```
   <modules>
           <!--
               We retrieve the config module from maven repository. If you want to change the config module,
               you need to open this annotation and change the dependency of config-shade to project.
               <module>seatunnel-config</module>
           -->
           <module>seatunnel-common</module>
           <module>seatunnel-apis</module>
           <module>seatunnel-core</module>
           <module>seatunnel-api</module>
           <module>seatunnel-plugin-discovery</module>
           <module>seatunnel-formats</module>
           <module>seatunnel-dist</module>
           <module>seatunnel-server</module>
           <module>seatunnel-engine</module>
       </modules>
   
       <profiles>
           <!-- Use in CI, UT and integration test -->
           <profile>
               <id>all</id>
               <activation>
                   <activeByDefault>true</activeByDefault>
               </activation>
               <modules>
                   <module>seatunnel-transforms</module>
                   <module>seatunnel-translation</module>
                   <module>seatunnel-connectors</module>
                   <module>seatunnel-connectors-v2</module>
                   <module>seatunnel-connectors-v2-dist</module>
                   <module>seatunnel-examples</module>
                   <module>seatunnel-e2e</module>
               </modules>
           </profile>
           <!--
               profile engine-all is used to build the package that not contains spark and flink things. For example
               spark and flink connectors
               spark and flink e2e and examples
               spark and flink starters
               spark and flink transforms
               spark and flink translation
           -->
           <profile>
               <id>engine-all</id>
               <modules>
                   <module>seatunnel-connectors-v2</module>
                   <module>seatunnel-connectors-v2-dist</module>
               </modules>
           </profile>
           <profile>
               <id>release</id>
               <modules>
                   <module>seatunnel-transforms</module>
                   <module>seatunnel-translation</module>
                   <module>seatunnel-connectors</module>
               </modules>
           </profile>
       </profiles>
   ```
   
   seatunnel-core/pom.xml
   
   ```
   <profiles>
           <profile>
               <id>all</id>
               <activation>
                   <activeByDefault>true</activeByDefault>
               </activation>
               <modules>
                   <module>seatunnel-core-base</module>
                   <module>seatunnel-core-flink</module>
                   <module>seatunnel-core-spark</module>
                   <module>seatunnel-core-flink-sql</module>
                   <module>seatunnel-core-starter</module>
                   <module>seatunnel-flink-starter</module>
                   <module>seatunnel-spark-starter</module>
                   <module>seatunnel-seatunnel-starter</module>
               </modules>
           </profile>
           <profile>
               <id>engine-all</id>
               <modules>
                   <module>seatunnel-core-base</module>
                   <module>seatunnel-core-starter</module>
                   <module>seatunnel-seatunnel-starter</module>
               </modules>
           </profile>
           <profile>
               <id>release</id>
               <modules>
                   <module>seatunnel-core-base</module>
                   <module>seatunnel-core-flink</module>
                   <module>seatunnel-core-spark</module>
                   <module>seatunnel-core-flink-sql</module>
                   <module>seatunnel-core-starter</module>
                   <module>seatunnel-flink-starter</module>
                   <module>seatunnel-spark-starter</module>
                   <module>seatunnel-seatunnel-starter</module>
               </modules>
           </profile>
       </profiles>
   ```
   
   seatunnel-dist/pom.xml
   
   ```
   <profiles>
           <profile>
               <id>all</id>
               <activation>
                   <activeByDefault>true</activeByDefault>
               </activation>
               <dependencies>
                   <dependency>
                       <groupId>org.apache.seatunnel</groupId>
                       <artifactId>seatunnel-connectors-v2-dist</artifactId>
                       <version>${project.version}</version>
                   </dependency>
                   <dependency>
                       <groupId>org.apache.seatunnel</groupId>
                       <artifactId>seatunnel-connectors-spark-dist</artifactId>
                       <version>${project.version}</version>
                   </dependency>
                   <dependency>
                       <groupId>org.apache.seatunnel</groupId>
                       <artifactId>seatunnel-connectors-flink-dist</artifactId>
                       <version>${project.version}</version>
                   </dependency>
               </dependencies>
               <build>
                   <plugins>
                       <plugin>
                           <artifactId>maven-assembly-plugin</artifactId>
                           <executions>
                               <execution>
                                   <id>bin</id>
                                   <phase>package</phase>
                                   <goals>
                                       <goal>single</goal>
                                   </goals>
   
                                   <configuration>
                                       <descriptors>
                                           <descriptor>src/main/assembly/assembly-bin-ci.xml</descriptor>
                                       </descriptors>
                                       <appendAssemblyId>true</appendAssemblyId>
                                   </configuration>
                               </execution>
   
                               <execution>
                                   <id>src</id>
                                   <phase>package</phase>
                                   <goals>
                                       <goal>single</goal>
                                   </goals>
                                   <configuration>
                                       <descriptors>
                                           <descriptor>src/main/assembly/assembly-src.xml</descriptor>
                                       </descriptors>
                                       <appendAssemblyId>true</appendAssemblyId>
                                   </configuration>
                               </execution>
   
                           </executions>
                       </plugin>
                   </plugins>
                   <finalName>apache-seatunnel-incubating-${project.version}</finalName>
               </build>
           </profile>
           <profile>
               <id>engine-all</id>
               <activation>
                   <activeByDefault>true</activeByDefault>
               </activation>
               <dependencies>
                   <dependency>
                       <groupId>org.apache.seatunnel</groupId>
                       <artifactId>seatunnel-connectors-v2-dist</artifactId>
                       <version>${project.version}</version>
                   </dependency>
               </dependencies>
               <build>
                   <plugins>
                       <plugin>
                           <artifactId>maven-assembly-plugin</artifactId>
                           <executions>
                               <execution>
                                   <id>bin</id>
                                   <phase>package</phase>
                                   <goals>
                                       <goal>single</goal>
                                   </goals>
   
                                   <configuration>
                                       <descriptors>
                                           <descriptor>src/main/assembly/assembly-bin-ci.xml</descriptor>
                                       </descriptors>
                                       <appendAssemblyId>true</appendAssemblyId>
                                   </configuration>
                               </execution>
   
                               <execution>
                                   <id>src</id>
                                   <phase>package</phase>
                                   <goals>
                                       <goal>single</goal>
                                   </goals>
                                   <configuration>
                                       <descriptors>
                                           <descriptor>src/main/assembly/assembly-src.xml</descriptor>
                                       </descriptors>
                                       <appendAssemblyId>true</appendAssemblyId>
                                   </configuration>
                               </execution>
   
                           </executions>
                       </plugin>
                   </plugins>
                   <finalName>apache-seatunnel-incubating-${project.version}</finalName>
               </build>
           </profile>
           <profile>
               <id>release</id>
               <dependencies>
                   <dependency>
                       <groupId>org.apache.seatunnel</groupId>
                       <artifactId>seatunnel-connectors-spark-dist</artifactId>
                       <version>${project.version}</version>
                   </dependency>
                   <dependency>
                       <groupId>org.apache.seatunnel</groupId>
                       <artifactId>seatunnel-connectors-flink-dist</artifactId>
                       <version>${project.version}</version>
                   </dependency>
               </dependencies>
               <build>
                   <plugins>
                       <plugin>
                           <artifactId>maven-assembly-plugin</artifactId>
                           <executions>
                               <execution>
                                   <id>bin</id>
                                   <phase>package</phase>
                                   <goals>
                                       <goal>single</goal>
                                   </goals>
   
                                   <configuration>
                                       <descriptors>
                                           <descriptor>src/main/assembly/assembly-bin.xml</descriptor>
                                       </descriptors>
                                       <appendAssemblyId>true</appendAssemblyId>
                                   </configuration>
                               </execution>
   
                               <execution>
                                   <id>src</id>
                                   <phase>package</phase>
                                   <goals>
                                       <goal>single</goal>
                                   </goals>
                                   <configuration>
                                       <descriptors>
                                           <descriptor>src/main/assembly/assembly-src.xml</descriptor>
                                       </descriptors>
                                       <appendAssemblyId>true</appendAssemblyId>
                                   </configuration>
                               </execution>
   
                           </executions>
                       </plugin>
                   </plugins>
                   <finalName>apache-seatunnel-incubating-${project.version}</finalName>
               </build>
           </profile>
       </profiles>
   ```
   
   
   ### Usage Scenario
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] EricJoy2048 closed issue #2421: [ST-Engine][maven profile] Add engine-all profile used to reduce engine test build time and test easy

Posted by GitBox <gi...@apache.org>.
EricJoy2048 closed issue #2421: [ST-Engine][maven profile] Add engine-all profile used to reduce engine test build time and test easy
URL: https://github.com/apache/incubator-seatunnel/issues/2421


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #2421: [ST-Engine][maven profile] Add engine-all profile used to reduce engine test build time and test easy

Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #2421:
URL: https://github.com/apache/incubator-seatunnel/issues/2421#issuecomment-1216073066

   +1, but we'd better add the corresponding CI conditions, and use this only if the engine module file is modified.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org